Server Storage Hogs
Predrag Punosevac
predragp at cs.cmu.edu
Thu Feb 25 21:46:47 EST 2016
Dear Autonians,
About two years ago we acquired two new file server for the Auton Lab
to replace old file server which was almost full holding 9TB of data.
Today one of them GAIA the real home of /zfsauton shares is pretty well
stuffed.
Filesystem Size Used Avail Use% Mounted on
2.3T 622G 1.7T 28% /zfsauton/project
16T 11T 4.6T 71% /zfsauton/home
5.4T 3.7T 1.7T 70% /zfsauton/data
16TB of data might not seems like a lot but having in mind that our file
server is actually using lz4 compression to store files (build in
feature of ZFS) means that within 2 years we managed to grow data from
9TB to roughly over 25TB of decompress storage space. That essentially
takes into account only home directories and smaller projects as ARI,
Foxconn, and several other projects have dedicated separate file
servers. If all that space is put into good use I salute your hard work.
However if you find yourself having multiple copies of large data sets
which you don't even use please consider cleaning after yourself. Even
after the cleaning it will take 3 full months for our file server to
remove snapshots of old files. The idea behind this plea is that we
ought to be able to use a file server for 5 years which is the standard
equipment cycle in IT industry.
Thank you for your cooperation!
Predrag Punosevac
More information about the Autonlab-users
mailing list