Some Basic Doubts

Benedikt Boecking boecking at andrew.cmu.edu
Wed Sep 25 08:46:51 EDT 2019


And as Vincent rightfully pointed out to me, for datasets that are too large for the scratch directory please contact Predrag. He will download the dataset for you and mount it somewhere. 

If you want to check home much space is available, you can run
$ df -h .
In the directory you want to download the dataset into. 


> On Sep 25, 2019, at 7:29 AM, Benedikt Boecking <boecking at andrew.cmu.edu> wrote:
> 
> You want to make sure that you download large datasets onto a server's local scratch directory: /home/scratch/anirudds/ 
> 
> Downloading a large dataset onto the network filesystem (zfs) where your home directory resides is slow and slows the system down for all other users as well. 
> 
> On Wed, Sep 25, 2019, 12:11 AM Aniruddh Shetty <anirudds at andrew.cmu.edu <mailto:anirudds at andrew.cmu.edu>> wrote:
> What is the fastest way to get training data on the gpu server? 
> I wanted to install kitti dataset. I tried doing wget directly on the remote server (which was very slow). I tried downloading on local machine and then scp to the remote machine (also very slow). Took me around 10 hours to do it
> 
> Is nvcc not installed on the gpu14 server? The code I was using had some custom gpu kernel codes written which needed cuda toolkit. I have installed it in virtual env for now.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/autonlab-users/attachments/20190925/00ec5ea9/attachment-0001.html>


More information about the Autonlab-users mailing list