nvidia-smi not working on gpu1

[Predrag Punosevac]

Sibi Venkatesan <sibiv at andrew.cmu.edu> wrote:

> Hi Predrag,
> 
> nvidia-smi does not work on gpu1 -- Nick and I have both checked. It gives
> me this issue:
> 
> Failed to initialize NVML: Driver/library version mismatch
> 
> Have others reported this issue?

Sibi,

Simon did reboot the machine which have cleared the error. My initial
hunch was that the driver is too old. We were using older driver on GPU1
due to the fact that newer 8.xxx driver released after September of last
year were braking MATLAB 2016b. The MATLAB 2017a has being released
three weeks ago. I am planning to start upgrading MATLAB in the least
descriptive way, firstly GPU[2-4] which had to use newer NVIDIA driver
due to the compatibility issue with Titan X cards and on which MATLAB
currently is broken with for GPU work. I will then upgrade NVIDIA driver
to the latest following by TensorFlow and Caffe.

Best,
Predrag

> -- 
> 
> - Sibi