mersenneforum.org  

Go Back   mersenneforum.org > Great Internet Mersenne Prime Search > Software

Reply
 
Thread Tools
Old 2020-08-11, 03:07   #1
intelfx
 
Jul 2020

13 Posts
Default Prime95 — is it possible to control "automatic benchmarks"?

Prime95 periodically performs some kind of "automatic benchmark" the results of which are written to gwnum.txt and used to fine-tune future tests:



Code:
Aug 11 05:06:06 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread Aug 11 05:06] Benchmarking multiple workers to tune FFT selection.
Aug 11 05:06:06 stratofortress.nexus.i.intelfx.name mprime[284580]: [Work thread Aug 11 05:06] Stopping primality test of M109983959 at iteration 56490336 [51.36%]
Aug 11 05:06:06 stratofortress.nexus.i.intelfx.name mprime[284580]: [Work thread Aug 11 05:06] Worker stopped while running needed benchmarks.
Aug 11 05:06:22 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 89.60 ms.  Total throughput: 11.16 iter/sec.
Aug 11 05:06:35 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 90.25 ms.  Total throughput: 11.08 iter/sec.
Aug 11 05:06:49 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 87.62 ms.  Total throughput: 11.41 iter/sec.
Aug 11 05:07:02 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 91.67 ms.  Total throughput: 10.91 iter/sec.
Aug 11 05:07:16 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 92.32 ms.  Total throughput: 10.83 iter/sec.
Aug 11 05:07:29 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 88.24 ms.  Total throughput: 11.33 iter/sec.
Aug 11 05:07:43 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 92.33 ms.  Total throughput: 10.83 iter/sec.
Aug 11 05:07:56 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 89.58 ms.  Total throughput: 11.16 iter/sec.
Aug 11 05:08:09 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 95.28 ms.  Total throughput: 10.50 iter/sec.
Aug 11 05:08:22 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 89.56 ms.  Total throughput: 11.17 iter/sec.
Aug 11 05:08:36 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 83.36 ms.  Total throughput: 12.00 iter/sec.
Aug 11 05:08:49 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 85.77 ms.  Total throughput: 11.66 iter/sec.
Aug 11 05:09:02 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 90.91 ms.  Total throughput: 11.00 iter/sec.
Aug 11 05:09:15 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 82.21 ms.  Total throughput: 12.16 iter/sec.
Aug 11 05:09:28 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 84.53 ms.  Total throughput: 11.83 iter/sec.
Aug 11 05:09:41 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 95.25 ms.  Total throughput: 10.50 iter/sec.
Aug 11 05:09:55 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 88.29 ms.  Total throughput: 11.33 iter/sec.
Aug 11 05:10:08 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread] Average times: 85.82 ms.  Total throughput: 11.65 iter/sec.
Aug 11 05:10:08 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread Aug 11 05:10]
Aug 11 05:10:08 stratofortress.nexus.i.intelfx.name mprime[284580]: [Main thread Aug 11 05:10] Throughput benchmark complete.
Aug 11 05:10:08 stratofortress.nexus.i.intelfx.name mprime[284580]: [Work thread Aug 11 05:10] Benchmarks complete, restarting worker.
Unfortunately, I see no way to control how and when it happens. It has just occurred that mprime decided to run its benchmark when the server was fully occupied with greater priority work, thus completely invalidating the benchmark results (see above). I had to restore gwnum.txt from a backup, which is not really optimal user experience.

Is it possile to control those automatic benchmarks in any way? Or even disable the automatic benchmark behavior altogether to run them by hand in a controlled environment on an otherwise idle system?

Last fiddled with by intelfx on 2020-08-11 at 03:13
intelfx is offline   Reply With Quote
Old 2020-08-11, 03:23   #2
ixfd64
Bemusing Prompter
 
ixfd64's Avatar
 
"Danny"
Dec 2002
California

91016 Posts
Default

You can disable this feature by setting AutoBench=0 in your prime.txt file.
ixfd64 is online now   Reply With Quote
Old 2020-08-11, 04:29   #3
intelfx
 
Jul 2020

158 Posts
Default

Quote:
Originally Posted by ixfd64 View Post
You can disable this feature by setting AutoBench=0 in your prime.txt file.
Ah. I see. I should read undoc.txt more often.

How do I then run an equivalent benchmark manually?

Last fiddled with by intelfx on 2020-08-11 at 04:30
intelfx is offline   Reply With Quote
Old 2020-08-11, 05:07   #4
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

2·4,663 Posts
Default

Quote:
Originally Posted by intelfx View Post
Ah. I see. I should read undoc.txt more often.
Some useful stuff can be found there.

Quote:
Originally Posted by intelfx View Post
How do I then run an equivalent benchmark manually?
Read the source code to be sure (that didn't go down so well in a meeting yesterday morning)...
chalsall is offline   Reply With Quote
Old 2020-08-11, 10:33   #5
retina
Undefined
 
retina's Avatar
 
"The unspeakable one"
Jun 2006
My evil lair

5,879 Posts
Default

Since the question has been answered and the subject is raised ...

I've wondered whether these auto-benchmarks are a net loss.

The machines periodically spend a few minutes doing no useful work in an attempt to find a faster FFT strategy. But any gains it can find are not enough to justify shutting things down for so many minutes.

If I can liken it to a car race: Would you spend time stopped at the side of the road, in the middle of a race, to get out and tweak the timing belt (or whatever adjustment) in the hope of going 1 km/h faster on the straights?
retina is online now   Reply With Quote
Old 2020-08-11, 11:54   #6
axn
 
axn's Avatar
 
Jun 2003

7×683 Posts
Default

Quote:
Originally Posted by retina View Post
The machines periodically spend a few minutes doing no useful work in an attempt to find a faster FFT strategy. But any gains it can find are not enough to justify shutting things down for so many minutes.
The autobenchmark doesn't run everyday. Once it has gathered sufficient number (10?) of benchmarks for a given FFT size, the benchmarks will stop (until test requiring a new FFT size is received).

There can be a significant difference (10%?) between fastest FFT implementation and default FFT implementation. Of course, with high probability, the very first autobenchmark will find the best implementation.

Subsequent ones are just an insurance that the conditions during the first one wasn't representative (like what OP experienced, ironically).
axn is online now   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Is "mung" or "munged" a negative word in a moral sense? Uncwilly Lounge 15 2020-04-14 18:35
Aouessare-El Haddouchi-Essaaidi "test": "if Mp has no factor, it is prime!" wildrabbitt Miscellaneous Math 11 2015-03-06 08:17
In Prime95 linux64, "make clean" deletes factor64.o while it shouldn't. Explorer09 Software 1 2014-08-18 19:44
Automatic temperature control TObject Software 13 2012-04-27 19:33
Would Minimizing "iterations between results file" may reveal "is not prime" earlier? nitai1999 Software 7 2004-08-26 18:12

All times are UTC. The time now is 05:47.

Mon Nov 30 05:47:42 UTC 2020 up 81 days, 2:58, 3 users, load averages: 0.97, 1.35, 1.30

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.