mersenneforum.org  

Go Back   mersenneforum.org > Great Internet Mersenne Prime Search > Hardware > Cloud Computing

Reply
 
Thread Tools
Old 2020-07-02, 14:19   #980
bayanne
 
bayanne's Avatar
 
"Tony Gott"
Aug 2002
Yell, Shetland, UK

313 Posts
Default

Quote:
Originally Posted by bayanne View Post
Completed exponents are not being reported from Colab ...

Can you advise?
Seems to be sorted now
bayanne is offline   Reply With Quote
Old 2020-07-02, 22:06   #981
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

937510 Posts
Default

Quote:
Originally Posted by bayanne View Post
Seems to be sorted now
Yeah; sorry. Error between keyboard and chair...

Stupidly busy at the moment. I check in on GPU72 several times a day to make sure things are sane, so if you see something strange please wait until 1200 UTC, and if things don't magically sort themselves out, please PM me.
chalsall is offline   Reply With Quote
Old 2020-07-02, 22:12   #982
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

3·55 Posts
Default

Quote:
Originally Posted by moebius View Post
Hope they stay there persistent. Maybe something has been changed in the configuration of colab.
My ***very*** early prototyping with Colab (only last year did we discovered this resource!) suggests they will (or, at least, should).

My recollection is copying files from Google Drive to the local Colab filesystem (read "/") can have quite a bit of latency. But writing to the Drive from executing code in the VM seemed to be relatively quick and reliable.

Note that I haven't actually mounted a Drive in a Colab instance for many months (it doesn't scale for what I do with them (and other instance environments)). I do know that there are many here who *do* regularly do this now without complaint.
chalsall is offline   Reply With Quote
Old 2020-07-04, 17:09   #983
moebius
 
moebius's Avatar
 
Jul 2009
Germany

461 Posts
Lightbulb

Quote:
Originally Posted by moebius View Post
I have now logged in with a different Google account and lo and behold, the save....
note: it is better to change the directory with chdir(), because in some cases, a cd leaves the current working directory unchanged....

import os.path
from google.colab import drive
if not os.path.exists('/content/drive/My Drive'):
drive.mount('/content/drive')
%cd '/content/drive/My Drive/gpuowl-master/'
os.chdir ('/content/drive/My Drive/gpuowl-master/')
!chmod 755 '/content/drive/My Drive/gpuowl-master/gpuowl.exe'
!ls -la
!cd '.' && /content/drive/My\ Drive/gpuowl-master/gpuowl.exe -prp 333XXXXXX
moebius is offline   Reply With Quote
Old 2020-07-04, 17:47   #984
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

3·55 Posts
Default

Quote:
Originally Posted by moebius View Post
note: it is better to change the directory with chdir(), because in some cases, a cd leaves the current working directory unchanged....
So long as you use "%cd" it should be persistent (within the context of the Python script). Using only "cd", on the other hand, does effectively nothing.

There's no downside in using chdir() though.
chalsall is offline   Reply With Quote
Old 2020-07-17, 12:21   #985
lycorn
 
lycorn's Avatar
 
Sep 2002
Oeiras, Portugal

24·89 Posts
Default

Is it just my impression or Colab is tighthning the assignment rules for GPUs?
It´s getting more and more difficult to get a GPU for a decent (say, more than 2-3 hours, sometimes much less, very seldom more than six) period of time, and most of the times I get K80s, even after "Factory Resettting" the runtime. In the rare situation I get a P100 or a T4, the runtimes are normally very short.
Are more people experiencing this "shortage"?
lycorn is offline   Reply With Quote
Old 2020-07-17, 13:50   #986
kriesel
 
kriesel's Avatar
 
"TF79LL86GIMPS96gpu17"
Mar 2017
US midwest

47×101 Posts
Default

Quote:
Originally Posted by lycorn View Post
Is it just my impression or Colab is tightening the assignment rules for GPUs?
It´s getting more and more difficult to get a GPU for a decent (say, more than 2-3 hours, sometimes much less, very seldom more than six) period of time, and most of the times I get K80s, even after "Factory Resetting" the runtime. In the rare situation I get a P100 or a T4, the runtimes are normally very short.
Are more people experiencing this "shortage"?
Paid or free?
As a Colab free user, I'm seeing gpus usually unavailable entirely, and when, slightly less than daily, I get one per user account, they last 90 minutes or as little as 20 minutes. Sometimes even cpu-only sessions are a few hours instead of the nominal 12. I think free users can expect to get preempted whenever there's paid use demand sufficient to do so, and we're seeing the effect of increased demand. It's really messing with the latency of GIMPS assignments in TF and P-1. I have different working directories with worktodo files for the different gpu models so that -maxAlloc is different. It can be weeks between appearances of a given gpu model on a given account.
At times I've resorted to removing assignments from Colab to run them on a local gpu, to keep assignments from expiring or wavefronts from stalling.
kriesel is online now   Reply With Quote
Old 2020-07-17, 15:07   #987
lycorn
 
lycorn's Avatar
 
Sep 2002
Oeiras, Portugal

24·89 Posts
Default

Ok, so it´s definitely not "my" problem...
I am also a free Colab user. Have 5 different google accounts, and the issues I´m having are very similar to yours. The main difference is the availabilty of CPUs, which is 100% (every time I want one I get one, and the sessions last the full 12 hours).
I think you are right in that paid users have higher priority access to resources, (which makes a whole lot of sense, absolutely! )
As I only use Colab for work that doesn´t impact in any way the GIMPS workflow, I don´t care too much. I take what I am given and feel grateful for it (isn´t this a nice sentence, by the way?...)
lycorn is offline   Reply With Quote
Old 2020-07-18, 03:12   #988
LaurV
Romulan Interpreter
 
LaurV's Avatar
 
Jun 2011
Thailand

22·2,239 Posts
Default

Same here. For a while, I ignored the "factory reset" trick because any time I can get a T4 or P100, they last from 20-40 minutes to 2-3 hours, while the k80s tend to last 6-10 hours. Especially before going to bed, if I am lucky enough to get a k80, then I won't make any effort to "reset" it and just let it run. It may produce more work till morning than a T4 in 30 minutes or one hour.

To be clear, I only run one account (my main), and that only when I remember. I fully understand that this is a resource which is supplied for free, and any time they need to sell it, i.e. there is a buyer, they can take it back and give it to that guy. I have no reason to complain.

Last fiddled with by LaurV on 2020-07-18 at 03:12
LaurV is offline   Reply With Quote
Old 2020-07-18, 14:24   #989
moebius
 
moebius's Avatar
 
Jul 2009
Germany

461 Posts
Default

Quote:
Originally Posted by kriesel View Post
..... I'm seeing gpus usually unavailable entirely, and when, slightly less than daily, I get one per user account, they last 90 minutes or as little as 20 minutes.
If you use 3 google accounts one after the other (not at the same time) you can definitely calculate a 100M digit exponent continuously with Tesla P100's without a break. I use 3 different notebooks for this purpose. The running time is approximately 12 hours each. However, I've only been using colab since 3 weeks, maybe that's the cause.

333698863

Last fiddled with by moebius on 2020-07-18 at 14:47
moebius is offline   Reply With Quote
Old 2020-07-18, 15:42   #990
lycorn
 
lycorn's Avatar
 
Sep 2002
Oeiras, Portugal

26208 Posts
Default

Quote:
Originally Posted by moebius View Post
However, I've only been using colab since 3 weeks, maybe that's the cause.
Yes, that should be the reason. Get it while you can...
lycorn is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Notebook enzocreti enzocreti 0 2019-02-15 08:20
Educational Qualifications & Work Experience Raman Lounge 6 2009-02-19 06:59
Ancient notebook won't run Prime95 kwstone Hardware 4 2004-01-15 00:11
v23.5 seems to have activated speedstepping in my notebook?! E_tron Software 9 2003-08-19 08:59
What is your primary educational background? eepiccolo Lounge 8 2002-12-28 21:25

All times are UTC. The time now is 07:24.

Wed Dec 2 07:24:17 UTC 2020 up 83 days, 4:35, 1 user, load averages: 0.94, 1.19, 1.33

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.