mersenneforum.org  

Go Back   mersenneforum.org > Great Internet Mersenne Prime Search > Hardware > Cloud Computing

Reply
 
Thread Tools
Old 2020-05-29, 20:28   #45
Cheetahgod
 
May 2020

2·13 Posts
Default

Yeah I'm using marine. Maybe I didn't set it up right. Has anyone used the latest version on aws?
Cheetahgod is offline   Reply With Quote
Old 2020-05-30, 07:46   #46
Cheetahgod
 
May 2020

2×13 Posts
Default

I got it working. I should do PRP-WR tests right?
Cheetahgod is offline   Reply With Quote
Old 2020-05-30, 14:00   #47
Uncwilly
6809 > 6502
 
Uncwilly's Avatar
 
"""""""""""""""""""
Aug 2003
101×103 Posts

52×401 Posts
Default

Sure, all first time checks are in the World Record range right now.
Uncwilly is online now   Reply With Quote
Old 2020-07-19, 16:30   #48
storm5510
Random Account
 
storm5510's Avatar
 
Aug 2009

3·661 Posts
Default

I have had an AWS account for a while. I have not done anything with it. Using Ubuntu with mprime in the past few months made it a bit clearer in some areas. I have been doing P-1 work for James Heinrich. This means manual reserve and submit. I do not know if this is possible in this instance. If files can be pasted and copied then this would be different.

What I am looking at now is in the attached image. It is the EC2 dashboard. I really do not know where to go from here.
Attached Thumbnails
Click image for larger version

Name:	aws.JPG
Views:	236
Size:	68.9 KB
ID:	22829  
storm5510 is offline   Reply With Quote
Old 2020-07-19, 18:21   #49
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

26F216 Posts
Default

Quote:
Originally Posted by storm5510 View Post
What I am looking at now is in the attached image. It is the EC2 dashboard. I really do not know where to go from here.
Create an SSH key-pair. Spin up an instance. SSH into the instance. Profit!
chalsall is online now   Reply With Quote
Old 2020-07-20, 00:15   #50
storm5510
Random Account
 
storm5510's Avatar
 
Aug 2009

111101111112 Posts
Default

Quote:
Originally Posted by chalsall View Post
Create an SSH key-pair. Spin up an instance. SSH into the instance. Profit!
I now have one running instance, one volume, one key pair, and two security groups. "SSH into the instant." I take it this would be "Connect." I gave the instance a name. Connect presents three options. I chose the third. It refused to connect so I stopped the instance.

I think I will let this go. It all looks great, but sails over this old head.
storm5510 is offline   Reply With Quote
Old 2020-07-20, 00:32   #51
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

2×5×997 Posts
Default

Quote:
Originally Posted by storm5510 View Post
I think I will let this go. It all looks great, but sails over this old head.
Never give up! You human; it deterministic computer. You're smarter than it is; prove it!

(I said this to someone else last year while they were making friends with Colab. They replied "Yeah, but I think it's more patient..." )
chalsall is online now   Reply With Quote
Old 2020-07-20, 12:34   #52
storm5510
Random Account
 
storm5510's Avatar
 
Aug 2009

3·661 Posts
Default

Quote:
Originally Posted by chalsall View Post
Never give up! You human; it deterministic computer. You're smarter than it is; prove it!

(I said this to someone else last year while they were making friends with Colab. They replied "Yeah, but I think it's more patient..." )
I've never been one go give up on something like this. I'll mess with it until I figure it out.
storm5510 is offline   Reply With Quote
Old 2020-07-30, 08:51   #53
keisentraut
 
Jul 2020

1816 Posts
Default

I think the EFS/EBS method in this guide is not optimal for Spot instance because you have fixed costs if you stop for a long time when spot prices are high.
  1. I have a S3 bucket, where mprime, the configuration and its savefiles are stored. The monthy costs for this will be at most 1ct, because it's a few hundered MBs only and S3 is cheap.
  2. I use the userdata script to run a bash script which copies the mprime folder from S3, then runs mprime in it and watches for the termination notice.
  3. If the 2min termination notice triggers (or some maximum runtime is done), the script will immediately stop mprime, wait 10 seconds, copy back everything to the S3 bucket and shutdown the machine.
  4. In the future, the userdata script will also immediately re-file a new spot instance request with a very low price, but for now it stops and will not continue.
  5. Assignments are done by PrimeNet, when one is finished, it will simply get a new one.
This way, my EC2 spot instances do not need any persistent EFS/EBS storage and I can set it to the shutdown behaviour to terminate. I tested that it works and plan to write a guide after I am finished with an actual candidate.

What I'm currently need help with is



  • what the settings in prime.txt and local.txt do I need for optimal performance? I don't understand which number of workers and affinity masks I will need for a c5.large instances, only found it for the older c4. Or is it still more efficient to run c4?
  • Also, do I need to run the time-consuming "Jacobi-check" on every restart of mprime? Can I disable this or should I leave it as is? Overhead is probably negligible anyway as long as the average runtime of a spot instance is at least half an hour.
keisentraut is offline   Reply With Quote
Old 2021-05-29, 13:27   #54
drkirkby
 
"David Kirkby"
Jan 2021
Althorne, Essex, UK

3×149 Posts
Default

I thought about this sentance


"NOTE: if your IP address ever changes in the future, you will need to repeat this step. Otherwise your ssh login attempts will time out and fail."

Generally speaking, if one has a dynamic IP, it will not change a huge amount. The first couple of numbers are highly likely to remain fixed. My current IP is 213.205.240.207 I can be fairly confident, it will remain 213.205.xxx.yyy, so I can set the range of IPs allows to SSH to the Amazon instance to be 213.205.0.0/16. That allows access from 256^2 -2= 65534 IP addresses, but not the whole world. To my mind that offers a reasonable compromise between the poor security of letting anyone in the world try to hack it, and the inconvenience of having to change the IP on the Amazon website every time your service provider gives you a new address.

Certainly with EE, who I use, I've never had any problems with this, as they always seem to give me some IP address in the range 213.205.0.1 to 213.205.255.254.

Dave


drkirkby is offline   Reply With Quote
Old 2021-05-30, 12:07   #55
kriesel
 
kriesel's Avatar
 
"TF79LL86GIMPS96gpu17"
Mar 2017
US midwest

16AF16 Posts
Default

Quote:
Originally Posted by chalsall View Post
They replied "Yeah, but I think it's more patient..."

The silicon its can be very patient 24/7/365. It is easier for them, with no emotions, no sense of evenutal unavoidable decline and mortality. They can be very forgiving too, none of that geez, user still doesn't get me, I'm so sick of being mistreated with wrong commands, etc. That inexhaustible forgivingness is one of my favorite features of computers. Once humans add enough AI to the OS though, that may turn for the worse.
It may be almost infinitely patient. But we can be sufficiently stubborn / determined to reach our suitably chosen goals with it.

Last fiddled with by kriesel on 2021-05-30 at 12:11
kriesel is online now   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
How-to guide for running LL tests on Google Compute Engine cloud GP2 Cloud Computing 4 2020-08-03 11:21
Is it possible to disable benchmarking while torture tests are running? ZFR Software 4 2018-02-02 20:18
Amazon Cloud Outrage kladner Science & Technology 7 2017-03-02 14:18
running single tests fast dragonbud20 Information & Answers 12 2015-09-26 21:40
LL tests running at different speeds GARYP166 Information & Answers 11 2009-07-13 19:39

All times are UTC. The time now is 01:52.


Wed Oct 27 01:52:43 UTC 2021 up 95 days, 20:21, 0 users, load averages: 0.69, 0.99, 1.10

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.