mersenneforum.org > News The Next Big Development for GIMPS
 Register FAQ Search Today's Posts Mark Forums Read

 2020-07-04, 04:00 #78 Fan Ming   Oct 2019 2·3·13 Posts In my view, the default power should be 10 or even bigger. 10(or dozens of) GB free space is not too much for current PCs or most servers. But for most PCs/servers, it would cost a lot on hardware to let their compute capability 1.5x (or more) faster (without overclock). Moreover, the disk space is much cheaper than compute capability, and It's really worth to cost more disk space to save compute times, even dozens of GB. When the disk is indeed not too much, I think it would not be hard for software to detect the disk space and decrease the power compared to default settings. Last fiddled with by Fan Ming on 2020-07-04 at 04:05
 2020-07-04, 04:25 #79 srow7   Jul 2014 618 Posts what happens when there is not enough disk space for any power ? does software check for enough disk space before starting calc ? if not enough, does it just move to next assignment ?
2020-07-04, 06:12   #80
preda

"Mihai Preda"
Apr 2015

2·547 Posts

Quote:
 Originally Posted by Prime95 Prime95 can now generate proofs. Can't upload them or verify them, but it is a start. Some interesting data and a decision to be made. For a 100Mbit number, the optimal proof power is 10. Requiring proof generator and verifier do 182K squarings. Temporary disk space is 12.8GB. Proof file size is 138MB. The power=9 proof is almost as good at 239K squarings, disk space 6.4GB, proof file size is 125MB. The difference of 57K squarings is only 0.06% the cost of a full PRP test. What about power=8? 413K squarings, disk space 3.2GB, proof file size is 113MB. The 231K extra squarings is 0.23% of a PRP test. So the question is what should be prime95's default setting? The optimize-to-the-max in me says default should be power=9. The minimal-impact-on-average-user in me says go with power=8 default. I think the biggest impact on the average user is the disk space consumed. Power=8 will result in less proofs lost due to disk full errors. The cost is just 0.17% of a PRP test. I think the preferences dialog box needs a "Max disk space each worker can use" setting. From that I can derive the best power setting, but most users will never change this preference so the question just morphs into what the default for the max GB of disk should be,
GpuOwl also can generate and verify proofs now!
And, most probably, the proofs are cross-compatible between the two software! And, the two programs (Prime95, GpuOwl) have distinct implementations written independently by different people, so it's highly unlikely to suffer from the same programmer error in the same way. They also run on different hardware, so it's highly unlikely to trigger the same hardware error in the same way. That is to say, such a cross-verification is quite strong. (I think, even the SHA3 library used by the two is different :)

For GpuOwl, the default proof power will be 8. This would result in temporary disk requirements of 3GB per 100M exponent. Users with plenty of disk would have an option to use power 9, doubling the temporary disk requirements.

2020-07-04, 19:28   #81
kriesel

"TF79LL86GIMPS96gpu17"
Mar 2017
US midwest

FCB16 Posts

Quote:
 Originally Posted by preda GpuOwl also can generate and verify proofs now! And, most probably, the proofs are cross-compatible between the two software! And, the two programs (Prime95, GpuOwl) have distinct implementations written independently by different people, so it's highly unlikely to suffer from the same programmer error in the same way. They also run on different hardware, so it's highly unlikely to trigger the same hardware error in the same way. That is to say, such a cross-verification is quite strong. (I think, even the SHA3 library used by the two is different :) For GpuOwl, the default proof power will be 8. This would result in temporary disk requirements of 3GB per 100M exponent. Users with plenty of disk would have an option to use power 9, doubling the temporary disk requirements.
Sounds like great progress on both the gpuowl and prime95 fronts.
The payoff to the project is so large for avoiding DCs of future PRP tests, that I'm in favor of whatever promotes rapid and widespread adoption of PRP-with-proof.
For 100M exponent, to recap in aligned tabular form:
Code:
A) power= 8,  3.2GB temporary disk space needed, proof file size 113MB, 413K squarings = 0.41% of a full DC, gpuowl default
B) power= 9,  6.4GB temporary disk space needed, proof file size 125MB, 239K squarings = 0.24% of a full DC
C) power=10, 12.8GB temporary disk space needed, proof file size 138MB, 182K squarings = 0.18% of a full DC.
And note the numbers rise about linearly with exponent, so 100MDigit is ~42.5GB each at power 10. And these files will add load to backup provisions.

Two instances / gpu x 5 gpus + prime95 1 worker means 11x, potentially 35GB to 141GB additional temporary space. How long do those temporaries hang around? On average, half present, ramping up from none to all during the course of a PRP-with-proof run? Do they linger afterward or does the program clear them out once the proof file is written? Do the proof files accumulate as multiple exponents are run?
141GB is a big ask on a system running with 270GB HD and compression already enabled, multiple applications installed per gpu, plus prime95 running on the 4 cpu cores. AFTER clearing a bunch of cudalucas save files off it this morning, it's now back up to 26GB free space, from 9GB.
Out of the 10 systems I checked just now, 2 of them would be marginal or worse.

What's a reasonable assumption for the percentage of systems where increased disk space requirements will deter or delay proof adoption; 1-5%?
Considering how many no-proof PRP tests may occur while people are getting around to either upgrading our systems with bigger storage, or doing severe housecleaning on what we've got, power 8's slight increase in verification effort seems like a bargain compared to the 100% PRP effort of a full blown PRP DC made necessary by a lack of a proof.

Last fiddled with by kriesel on 2020-07-04 at 19:30

 Similar Threads Thread Thread Starter Forum Replies Last Post airsquirrels Hardware 313 2019-10-29 22:51 mathwiz GMP-ECM 0 2019-05-15 01:06 Jean Penné Software 0 2011-06-16 20:05 Jean Penné Software 6 2011-04-28 06:21 Jean Penné Software 4 2010-11-14 17:32

All times are UTC. The time now is 19:34.

Sat Jul 4 19:34:26 UTC 2020 up 101 days, 17:07, 1 user, load averages: 1.88, 2.00, 2.06

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.