Python error on Auton server

[Predrag Punosevac]

Saswati Ray <sray at cs.cmu.edu> wrote:

Hi Saswati and the rest of Autonians,

Could you please test 

/opt/miniconda3-new

and

/opt/miniconda3-py38


on LOV3. Note only LOV3 has two new instances of conda.

miniconda3-new is the fresh installation of Python 3.7.7 which seems to
fixes linking problem for me. 

miniconda3-py38 is python 3.8.3 which we probably should start using in
the near future.

Considering the pace of Python development and its importance for our
lab I propose to have two miniconda installations per server (last two
consequtive releases)

/opt/miniconda-py37

/opt/miniconda-py38

I know that many people have their own installations of Conda which is
not really optimal. If I get positive feed back I will go ahead and
refresh miniconda installations on all nodes running RedHat 7.8.

Cheers,
Predrag



> Thanks Predrag!
> 
> On Mon, Jun 15, 2020 at 2:33 PM Predrag Punosevac <predragp at andrew.cmu.edu>
> wrote:
> 
> > Saswati Ray <sray at cs.cmu.edu> wrote:
> >
> > > I cannot create a conda env on lov3. Which are the machines on which you
> > > say are running RH 8.2 and are not affected?
> > >
> >
> > Documentation?
> >
> > https://www.autonlab.org/intranet
> >
> >
> > lov[7-9] gpu[15-21]
> >
> > That is actually ten not eight machines as I wrote in my original email.
> >
> >
> > > Thanks,
> > > Saswati
> > >
> > > On Mon, Jun 15, 2020 at 1:48 PM Predrag Punosevac <
> > predragp at andrew.cmu.edu>
> > > wrote:
> > >
> > > > Saswati Ray <sray at cs.cmu.edu> wrote:
> > > >
> > > > > Hi Predrag,
> > > > >
> > > > > >From today morning, I see this error in my pre-existing working
> > conda
> > > > > environment on lov3.
> > > > >
> > > >
> > > > Damn Conda morons. I have seen that before. It looks like they broke
> > > > Python 3.7.7 installation on RedHat 7.8. That is a linker problem you
> > > > see. I just checked and I can still load python 3.7.7. but when I run a
> > > > conda command I see the same error. We have 8 computing nodes in total
> > > > running RedHat 8.2 and they are not affected. Please try to rebuild
> > your
> > > > environment and report. I will see later today if reinstalling can
> > help.
> > > > I am a moron too. I was contaplanting upgrading Python to 3.8.3. I
> > > > should be much more careful with Conda guys.
> > > >
> > > > You also have RedHat rh-python36 in /opt/rh. That one always works.
> > > >
> > > > Predrag
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > > Traceback (most recent call last):
> > > > >   File "recap.py", line 15, in <module>
> > > > >     import numpy as np
> > > > >   File
> > > > >
> > > >
> > "/zfsauton2/home/sray/.local/lib/python3.7/site-packages/numpy/__init__.py",
> > > > > line 142, in <module>
> > > > >     from . import core
> > > > >   File
> > > > >
> > > >
> > "/zfsauton2/home/sray/.local/lib/python3.7/site-packages/numpy/core/__init__.py",
> > > > > line 102, in <module>
> > > > >     from . import _dtype_ctypes
> > > > >   File
> > > > >
> > > >
> > "/zfsauton2/home/sray/.local/lib/python3.7/site-packages/numpy/core/_dtype_ctypes.py",
> > > > > line 25, in <module>
> > > > >     import _ctypes
> > > > > ImportError: libffi.so.7: cannot open shared object file: No such
> > file or
> > > > > directory
> > > > >
> > > > > Any ideas?
> > > > >
> > > > > Thanks,
> > > > > Saswati
> > > > >
> > > > > --
> > > > > Saswati Ray
> > > > > Senior Research Analyst
> > > > > Carnegie Mellon University - Auton Lab
> > > > > Newell-Simon Hall Room 3115, Pittsburgh PA 15213
> > > > > Phone: 412-268-1238
> > > >
> > >
> > >
> > > --
> > > Saswati Ray
> > > Senior Research Analyst
> > > Carnegie Mellon University - Auton Lab
> > > Newell-Simon Hall Room 3115, Pittsburgh PA 15213
> > > Phone: 412-268-1238
> >
> 
> 
> -- 
> Saswati Ray
> Senior Research Analyst
> Carnegie Mellon University - Auton Lab
> Newell-Simon Hall Room 3115, Pittsburgh PA 15213
> Phone: 412-268-1238