Fwd: ipython sqlite errors

[Chirag Nagpal]

So I digged in a little more and it seemed to me initially the problem is
in ipython itself rather than ipython[notebook]/jupyter.

and indeed, running just ipython stuck on the nodes as well. I fixed that
by adding the line

export IPYTHONDIR=/home/scratch/<user>/.ipython

to ~/.bash_profile

This forces ipython to use the scratch directory for  storing its sqlite
histories rather than the NFS and fixes ipython.

<Predrag: if you see this, request if you could add this environment
variable to the global profile>

I was reasonably sure that this would fix the notebook too, but i haven't
still been able to fix the notebooks. Something more sinister is going on
with the notebooks.

I am on it.

Chirag



---------- Forwarded message ----------
From: Chirag Nagpal <chiragn at cs.cmu.edu>
Date: Tue, Sep 26, 2017 at 7:48 PM
Subject: ipython sqlite errors
To: users at autonlab.org


So today ipython notebook randomly stopped working for me on the nodes.

After a bit of troubleshooting, I discovered that ipython/jupyter uses
sqlite for storing notebook histories and sqlite over the NFS is not very
efficient, especially if your trying concurrent access to a single notebook
from multiple nodes.

Incase you are facing such issues a quick workaround is

$rm -rf ~/.local/share/jupyter/

or removing the file nbsignatures.db from wherever it is on your home.

I thought ill post this in public interest.



-- 

*Chirag Nagpal* Graduate Student, Language Technologies Institute
School of Computer Science
Carnegie Mellon University
cs.cmu.edu/~chiragn <http://cs.cmu.edu/%7Echiragn>



-- 

*Chirag Nagpal* Graduate Student, Language Technologies Institute
School of Computer Science
Carnegie Mellon University
cs.cmu.edu/~chiragn
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/autonlab-users/attachments/20170926/69b51a94/attachment.html>