<div dir="ltr"><div>I'm getting the same error.</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Sep 1, 2018 at 12:58 PM, Yichong Xu <span dir="ltr"><<a href="mailto:yichongx@cs.cmu.edu" target="_blank">yichongx@cs.cmu.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">





<div link="blue" vlink="purple" lang="ZH-CN">
<div class="m_-673166391599796750WordSection1">
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">Hi,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">I’m having the same problem here - @ Vincent have you figured out how to fix this?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">>>> import torch<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">>>> a=torch.zeros(4,4)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">>>> a.cuda()<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">THCudaCheck FAIL file=/opt/conda/conda-bld/<wbr>pytorch_1524590031827/work/<wbr>aten/src/THC/THCTensorRandom.<wbr>cu line=25 error=30 : unknown error<u></u><u></u></span></p><span class="">
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">Traceback (most recent call last):<u></u><u></u></span></p>
</span><p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">  File "<stdin>", line 1, in <module><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">RuntimeError: cuda runtime error (30) : unknown error at /opt/conda/conda-bld/pytorch_<wbr>1524590031827/work/aten/src/<wbr>THC/THCTensorRandom.cu:25<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">Previously I can use pytorch without error.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph"><i><span style="font-size:10.5pt;font-family:等线" lang="EN-US">Thanks,<u></u><u></u></span></i></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph"><i><span style="font-size:10.5pt;font-family:等线" lang="EN-US">Yichong<u></u><u></u></span></i></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US"><u></u> <u></u></span></p>
<div>
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US"> Autonlab-users <<a href="mailto:autonlab-users-bounces@autonlab.org" target="_blank">autonlab-users-bounces@<wbr>autonlab.org</a>>
<b>On Behalf Of </b>Jayanth Koushik<br>
<b>Sent:</b> 2018</span><span style="font-size:11.0pt">年</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">8</span><span style="font-size:11.0pt">月</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">31</span><span style="font-size:11.0pt">日</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">
 11:34<br>
<b>To:</b> Predrag Punosevac <<a href="mailto:predragp@andrew.cmu.edu" target="_blank">predragp@andrew.cmu.edu</a>><br>
<b>Cc:</b> <a href="mailto:users@autonlab.org" target="_blank">users@autonlab.org</a><br>
<b>Subject:</b> Re: CUDA Error<u></u><u></u></span></p>
</div>
</div><div><div class="h5">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US">The last line of the error refers to a different conda. Can you make sure all paths are correct?<u></u><u></u></span></p>
<div id="m_-673166391599796750AppleMailSignature">
<div>
<p class="MsoNormal"><span lang="EN-US">~Jayanth<u></u><u></u></span></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US"><br>
On Aug 31, 2018, at 11:23 AM, Predrag Punosevac <<a href="mailto:predragp@andrew.cmu.edu" target="_blank">predragp@andrew.cmu.edu</a>> wrote:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Vincent Jeanselme <<a href="mailto:vjeansel@andrew.cmu.edu" target="_blank">vjeansel@andrew.cmu.edu</a>> wrote:<br>
<br>
<br>
<u></u><u></u></span></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Good Morning,<u></u><u></u></span></p>
</blockquote>
<p class="MsoNormal"><span lang="EN-US"><br>
Lets try <a href="mailto:users@autonlab.org" target="_blank">users@autonlab.org</a><br>
<br>
<br>
Predrag<br>
<br>
<br>
<u></u><u></u></span></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Since the change of the hard drive, I have the following error when I
<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">run it on the GPUs (I have reinstalled pytorch but does not solve my
<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">problem). I think that the problem comes from the Cuda library.<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   THCudaCheck FAIL<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   file=/opt/conda/conda-bld/<wbr>pytorch_1524577177097/work/<wbr>aten/src/THC/THCTensorRandom.<wbr>cu<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   line=25 error=30 : unknown error<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   Traceback (most recent call last):<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?? File "./train.py", line 519, in <module><u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?????? main(args)<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?? File "./train.py", line 61, in main<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?????? model = nn.DataParallel(model).cuda()<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?? File<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   "/zfsauton/home/vjeanselme/<wbr>anaconda3/envs/lstmpy27/lib/<wbr>python2.7/site-packages/torch/<wbr>nn/parallel/data_parallel.py",<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   line 102, in __init__<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?????? _check_balance(self.device_<wbr>ids)<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?? File<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   "/zfsauton/home/vjeanselme/<wbr>anaconda3/envs/lstmpy27/lib/<wbr>python2.7/site-packages/torch/<wbr>nn/parallel/data_parallel.py",<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   line 17, in _check_balance<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?????? dev_props = [torch.cuda.get_device_<wbr>properties(i) for i in<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   device_ids]<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?? File<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   "/zfsauton/home/vjeanselme/<wbr>anaconda3/envs/lstmpy27/lib/<wbr>python2.7/site-packages/torch/<wbr>cuda/__init__.py",<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   line 290, in get_device_properties<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?????? init()?? # will define _get_device_properties and<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   _CudaDeviceProperties<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?? File<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   "/zfsauton/home/vjeanselme/<wbr>anaconda3/envs/lstmpy27/lib/<wbr>python2.7/site-packages/torch/<wbr>cuda/__init__.py",<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   line 143, in init<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?????? _lazy_init()<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?? File<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   "/zfsauton/home/vjeanselme/<wbr>anaconda3/envs/lstmpy27/lib/<wbr>python2.7/site-packages/torch/<wbr>cuda/__init__.py",<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   line 161, in _lazy_init<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">    ?????? torch._C._cuda_init()<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   RuntimeError: cuda runtime error (30) : unknown error at<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">   /opt/conda/conda-bld/<wbr>pytorch_1524577177097/work/<wbr>aten/src/THC/THCTensorRandom.<wbr>cu:25<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">I don't know how to fix it, would you have any suggestions ?<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Thank you,<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">-- <u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Vincent Jeanselme<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">-----------------<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Analyst Researcher<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Auton Lab - Robotics Institute<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Carnegie Mellon University<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
</div>
</div></div></div>
</div>

</blockquote></div><br></div>