Could not chdir to home directory

[Predrag Punosevac]

Dear Autonians,

I hope everyone had a good Thanksgiving. I wish you safe travels.

I have fixed the main file server (home directories). Since the fix
required reboot, I upgraded the OS to the latest FreeBSD 13.1p4. I verified
autofs on several computing nodes (gpu24 was one of them). Everything works
as expected. If somebody notices any stale NFS file handles please report
immediately as those computing nodes will have to be rebooted.  Stale NFS
file handles will not resolve on their own.

There are at least 2 other file server servers (/zfsauton/data,
/zfsauton/projects, /zfsauton/datasets) which need to be fixed. I don't
want to jinx it by giving ETA.

Please adhere to the Auton Lab etiquette to keep the system stable.

https://docs.google.com/document/d/1ah94jN6tMFeHMttyW9Vr9vjhjMQoT7Cb/edit

Best,
Predrag




On Wed, Nov 23, 2022 at 12:12 PM Predrag Punosevac <predragp at andrew.cmu.edu>
wrote:

> The issues didn't go away over the night. I played with this a little bit
> last night and this morning. I see the same problem with three out of 4
> file servers. Restarting nsfd, rpcbind, and a few other daemons didn't fix
> anything. At this point your home directories are not usable. Unless
> somebody gives a really good reason not to reboot these file servers they
> will be rebooted today in an attempt to fix the system.
>
> Best,
> Predrag
>
> On Tue, Nov 22, 2022 at 9:20 PM Predrag Punosevac <predragp at andrew.cmu.edu>
> wrote:
>
>> Dear Autonians,
>>
>> It came to my attention that autofs daemon is not doing its job on the
>> numerous computing nodes. On one of the computing nodes I found this in
>> /var/log/messages
>>
>> Your configuration uses the autofs provider with schema set to rfc2307
>> and default attribute mappings. The default map has changed in this
>> release, please make sure the configuration matches the server attributes.
>>
>> which points to an old bug in SSSD which was fixed years ago
>>
>> https://bugzilla.redhat.com/show_bug.cgi?id=1372814
>>
>> I need to poke a bit more with this before I say anything else.
>>
>> Best,
>> Predrag
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/autonlab-users/attachments/20221125/293b8f1f/attachment.html>