<div dir="ltr"><div class="gmail-PD gmail-IF" style="font-family:Roboto,sans-serif;vertical-align:top;padding:7px 0px 1px;border-radius:0px 5px 5px;margin-left:4px;color:rgb(38,38,38);font-size:13px"><div id="gmail-:ii.co" class="gmail-JL" style="color:rgb(38,50,56)"><div id="gmail-:ip.ma" class="gmail-Mu gmail-SP" style="line-height:16px;margin-bottom:6px;margin-left:9px;margin-right:9px;opacity:1;word-wrap:break-word;word-break:break-word"><span id="gmail-:ip.co" class="gmail-tL8wMe gmail-EMoHub" dir="ltr">Hi,<br><br>I am having this error,<br><br> net.cuda(3)<br> File "/zfsauton/home/egiusarm/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/nn/modules/module.py", line 258, in cuda<br> return self._apply(lambda t: t.cuda(device))<br> File "/zfsauton/home/egiusarm/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/nn/modules/module.py", line 185, in _apply<br> module._apply(fn)<br> File "/zfsauton/home/egiusarm/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/nn/modules/module.py", line 191, in _apply<br> param.data = fn(param.data)<br> File "/zfsauton/home/egiusarm/anaconda3/envs/pytorch/lib/python3.6/site-packages/torch/nn/modules/module.py", line 258, in <lambda><br> return self._apply(lambda t: t.cuda(device))<br>RuntimeError: CUDA error: unknown error<br><br>I never had that error before. I always used pytorch without problems. <br><br><br>thanks, </span></div><div id="gmail-:ip.ma" class="gmail-Mu gmail-SP" style="line-height:16px;margin-bottom:6px;margin-left:9px;margin-right:9px;opacity:1;word-wrap:break-word;word-break:break-word"><span class="gmail-tL8wMe gmail-EMoHub" dir="ltr">Elena</span></div></div></div><div class="gmail-ci" style="font-family:Roboto,sans-serif;background:none;width:7px;height:8px;overflow:hidden;color:rgb(38,38,38);font-size:13px"><br class="gmail-Apple-interchange-newline"></div></div><br><div class="gmail_quote"><div dir="ltr">Il giorno lun 3 set 2018 alle ore 09:43 Emre Yolcu <<a href="mailto:eyolcu@cs.cmu.edu">eyolcu@cs.cmu.edu</a>> ha scritto:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>I'm getting the same error.</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Sep 1, 2018 at 12:58 PM, Yichong Xu <span dir="ltr"><<a href="mailto:yichongx@cs.cmu.edu" target="_blank">yichongx@cs.cmu.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div link="blue" vlink="purple" lang="ZH-CN">
<div class="m_-6501567946194480332m_-673166391599796750WordSection1">
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">Hi,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">I’m having the same problem here - @ Vincent have you figured out how to fix this?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">>>> import torch<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">>>> a=torch.zeros(4,4)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">>>> a.cuda()<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">THCudaCheck FAIL file=/opt/conda/conda-bld/pytorch_1524590031827/work/aten/src/THC/THCTensorRandom.cu line=25 error=30 : unknown error<u></u><u></u></span></p><span>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">Traceback (most recent call last):<u></u><u></u></span></p>
</span><p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US"> File "<stdin>", line 1, in <module><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">RuntimeError: cuda runtime error (30) : unknown error at /opt/conda/conda-bld/pytorch_1524590031827/work/aten/src/THC/THCTensorRandom.cu:25<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US">Previously I can use pytorch without error.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph"><i><span style="font-size:10.5pt;font-family:等线" lang="EN-US">Thanks,<u></u><u></u></span></i></p>
<p class="MsoNormal" style="text-align:justify;text-justify:inter-ideograph"><i><span style="font-size:10.5pt;font-family:等线" lang="EN-US">Yichong<u></u><u></u></span></i></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:等线" lang="EN-US"><u></u> <u></u></span></p>
<div>
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US"> Autonlab-users <<a href="mailto:autonlab-users-bounces@autonlab.org" target="_blank">autonlab-users-bounces@autonlab.org</a>>
<b>On Behalf Of </b>Jayanth Koushik<br>
<b>Sent:</b> 2018</span><span style="font-size:11.0pt">年</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">8</span><span style="font-size:11.0pt">月</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">31</span><span style="font-size:11.0pt">日</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">
11:34<br>
<b>To:</b> Predrag Punosevac <<a href="mailto:predragp@andrew.cmu.edu" target="_blank">predragp@andrew.cmu.edu</a>><br>
<b>Cc:</b> <a href="mailto:users@autonlab.org" target="_blank">users@autonlab.org</a><br>
<b>Subject:</b> Re: CUDA Error<u></u><u></u></span></p>
</div>
</div><div><div class="m_-6501567946194480332h5">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US">The last line of the error refers to a different conda. Can you make sure all paths are correct?<u></u><u></u></span></p>
<div id="m_-6501567946194480332m_-673166391599796750AppleMailSignature">
<div>
<p class="MsoNormal"><span lang="EN-US">~Jayanth<u></u><u></u></span></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US"><br>
On Aug 31, 2018, at 11:23 AM, Predrag Punosevac <<a href="mailto:predragp@andrew.cmu.edu" target="_blank">predragp@andrew.cmu.edu</a>> wrote:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Vincent Jeanselme <<a href="mailto:vjeansel@andrew.cmu.edu" target="_blank">vjeansel@andrew.cmu.edu</a>> wrote:<br>
<br>
<br>
<u></u><u></u></span></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Good Morning,<u></u><u></u></span></p>
</blockquote>
<p class="MsoNormal"><span lang="EN-US"><br>
Lets try <a href="mailto:users@autonlab.org" target="_blank">users@autonlab.org</a><br>
<br>
<br>
Predrag<br>
<br>
<br>
<u></u><u></u></span></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Since the change of the hard drive, I have the following error when I
<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">run it on the GPUs (I have reinstalled pytorch but does not solve my
<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">problem). I think that the problem comes from the Cuda library.<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> THCudaCheck FAIL<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> file=/opt/conda/conda-bld/pytorch_1524577177097/work/aten/src/THC/THCTensorRandom.cu<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> line=25 error=30 : unknown error<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> Traceback (most recent call last):<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?? File "./train.py", line 519, in <module><u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?????? main(args)<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?? File "./train.py", line 61, in main<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?????? model = nn.DataParallel(model).cuda()<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?? File<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> "/zfsauton/home/vjeanselme/anaconda3/envs/lstmpy27/lib/python2.7/site-packages/torch/nn/parallel/data_parallel.py",<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> line 102, in __init__<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?????? _check_balance(self.device_ids)<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?? File<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> "/zfsauton/home/vjeanselme/anaconda3/envs/lstmpy27/lib/python2.7/site-packages/torch/nn/parallel/data_parallel.py",<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> line 17, in _check_balance<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?????? dev_props = [torch.cuda.get_device_properties(i) for i in<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> device_ids]<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?? File<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> "/zfsauton/home/vjeanselme/anaconda3/envs/lstmpy27/lib/python2.7/site-packages/torch/cuda/__init__.py",<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> line 290, in get_device_properties<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?????? init()?? # will define _get_device_properties and<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> _CudaDeviceProperties<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?? File<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> "/zfsauton/home/vjeanselme/anaconda3/envs/lstmpy27/lib/python2.7/site-packages/torch/cuda/__init__.py",<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> line 143, in init<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?????? _lazy_init()<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?? File<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> "/zfsauton/home/vjeanselme/anaconda3/envs/lstmpy27/lib/python2.7/site-packages/torch/cuda/__init__.py",<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> line 161, in _lazy_init<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> ?????? torch._C._cuda_init()<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> RuntimeError: cuda runtime error (30) : unknown error at<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"> /opt/conda/conda-bld/pytorch_1524577177097/work/aten/src/THC/THCTensorRandom.cu:25<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">I don't know how to fix it, would you have any suggestions ?<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Thank you,<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">-- <u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Vincent Jeanselme<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">-----------------<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Analyst Researcher<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Auton Lab - Robotics Institute<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Carnegie Mellon University<u></u><u></u></span></p>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</blockquote>
</div>
</div></div></div>
</div>
</blockquote></div><br></div>
</blockquote></div>