file server problems

[Predrag Punosevac]

Dear Autonians,

I am happy to report that gaia is up and running so all the users with
home directories
on zfsauton2 and zfsauton3 can resume their work. However, I am not
happy that I had manually (in person)
to boot the machine. I am frantically checking the hardware
and going through log files trying to figure out what has happened.


Best,
Predrag


On Sat, Jul 6, 2019 at 3:59 PM Predrag Punosevac
<predragp at andrew.cmu.edu> wrote:
>
> Dear Autonians,
>
> I hate to interrupt your 4th of July festivities with a bad news but it
> appears that I have a major problem with one of our main file servers
> after a minor upgrade. This server is the home to about 2/3 of the Auton
> Lab home directories which means that many of you are no longer able to
> log into our computing infrastructure apart of your Auton Lab maintained
> desktops.
>
> Before anyone gets too upset at me for upgrading file server let me just
> state for the record that the upgrade was tested and went smoothly
> on 6 other machines. As you know upgrading software is a natural part of
> the machine's life cycle.
>
> At this point I am unable to cleanly boot machine which is stuck while
> trying to mount the root file system. I am planning to boot machine with
> the live media first thing on Monday morning and if that doesn't work
> just reinstall OS and import ZFS pools containing your home directories
> (they should not be affected).
>
> Most Kind Regards,
> Predrag Punosevac
>
> P.S. Dr. Jeff Schneider has purchased a new file server which would have
> been a backup machine in this case. Unfortunately we have not received
> it yet so I will have to troubleshoot this.
>