Main file server disk usage report

[Predrag Punosevac]

Yichong Xu <yichongx at cs.cmu.edu> wrote:

> Hi Predrag,
> I will clean my home directory soon. 
> Besides this - In my opinion 250GB is a bit too small for one person,
> especially for storing models and data. Is there anywhere else I can
> store my data to? Thank you very much!

You don't get it. You can't delete anything from ZFS. Only I can delete
things with the great deal of effort (stop and remove snapshots) stop
backups and risk everyone's home directory. ZFS is designed for data
retention not for data loss. The principal designed error on my part
made 5 years ago was to allow home directories to share the same ZFS
dataset thereby losing the fine control over the data management. Right
now if you do rm -rf you will be able to delete the things because I had
to turn off bunch of switches.

250 GB home directory is not curved in stone and I can increase quota on
the need basis. We have enough disk space but I have to have some prior
notice to be able to do planning. Please stop by my office so that we
develop some kind migration strategy for your home directory. It will be
a separate ZFS dataset with the quota we agree to be reasonable for you
to work normally but also for me not to have these kind wildfires.

Predrag

> 
> Thanks,
> Yichong
> 
> 
> 
> On Nov 4, 2018, at 4:28 PM, Predrag Punosevac <predragp at andrew.cmu.edu<mailto:predragp at andrew.cmu.edu>> wrote:
> 
> Dear Autonians,
> 
> The following users exceed 250GB home directory quota which is
> implemented on the new file server. Keep in mind that ZFS is using lzma
> compression so depends on the data type 5.2 TB translates into 10 TB
> regular file system data. The reason for such large home directories
> might be completely legit but they should not have been created without
> prior notice. At least 3 of the people on this list are no longer
> formally affiliated to CMU. One of them ffalck have already contacted me
> and we are working on trimming and archiving his data. Anybody who has
> home directory larger than 1TB should contact me at the earliest
> convenience.
> 
> Best,
> Predrag
> 
> 
>    5.2 TiB [##########] /jaylee
>    3.8 TiB [#######   ] /yichongx
>    2.5 TiB [####      ] /joliva
>    1.5 TiB [##        ] /lujiec
>    1.4 TiB [##        ] /ffalck
>    1.3 TiB [##        ] /htung
>  759.5 GiB [#         ] /dsutherl
>  573.8 GiB [#         ] /kkandasa
>  542.1 GiB [#         ] /iapostol
>  536.2 GiB [#         ] /pengrui
>  518.4 GiB [          ] /bpatra
>  464.7 GiB [          ] /chunlial
>  422.2 GiB [          ] /siyuh
>  416.6 GiB [          ] /jrmoniz
>  374.8 GiB [          ] /chiragn
>  327.2 GiB [          ] /yifeim
>  253.6 GiB [          ] /bparia
>