mersenneforum.org  

Go Back   mersenneforum.org > Factoring Projects > CADO-NFS

Reply
 
Thread Tools
Old 2022-01-27, 04:20   #67
charybdis
 
charybdis's Avatar
 
Apr 2020

17·41 Posts
Default

I'm fairly confident that A=28 with adjust_strategy=2 beats both I=14 and I=15 at c172. The I=14/A=28 crossover is probably between c165 and c170 IMO. There's been a bit of discussion in the c165-c170 params thread.
charybdis is offline   Reply With Quote
Old 2022-01-27, 06:46   #68
bur
 
bur's Avatar
 
Aug 2020
79*6581e-4;3*2539e-3

503 Posts
Default

Removed, better suited for the c165-c170 discussion thread.

Last fiddled with by bur on 2022-01-27 at 06:46
bur is offline   Reply With Quote
Old 2022-01-27, 13:57   #69
EdH
 
EdH's Avatar
 
"Ed Hall"
Dec 2009
Adirondack Mtns

2·2,251 Posts
Default

Quote:
Originally Posted by charybdis View Post
I'm fairly confident that A=28 with adjust_strategy=2 beats both I=14 and I=15 at c172. The I=14/A=28 crossover is probably between c165 and c170 IMO. There's been a bit of discussion in the c165-c170 params thread.
I thought about that a little bit, but I'm too ignorant of some of the associated parameters and I'm trying for a blanket params file that will work in all my varied machines without too many individualizations. Perhaps it's time to rework the scripts to allow for all of that. I am already having the client scripts adjusting thread/process counts based on memory. I can probably do the same for strategy. . .

(. . .wandering off trying to remember why "A=" didn't work the last time I tried it. . .)
EdH is offline   Reply With Quote
Old 2022-01-27, 16:32   #70
charybdis
 
charybdis's Avatar
 
Apr 2020

12718 Posts
Default

Quote:
Originally Posted by EdH View Post
(. . .wandering off trying to remember why "A=" didn't work the last time I tried it. . .)
Possibly the strategy-2 composite factors bug. Once in every few hundred million relations, a relation will have a composite factor, and this makes CADO filtering quit, taking down the server with it. The solution is to use msieve instead, but that makes automation more difficult.

The other solution would be for CADO to throw out bad relations without quitting. Maybe I should suggest this to them someday...
charybdis is offline   Reply With Quote
Old 2022-01-27, 18:19   #71
VBCurtis
 
VBCurtis's Avatar
 
"Curtis"
Feb 2005
Riverside, CA

22×1,319 Posts
Default

I think in Ed's case it's that at some point CADO stopped compiling for core-2 era chips, so some of his farm uses a CADO version from before A= sievers were implemented.
I ran into this myself on my ancient dell C6100 32-core core2 server. In my case, I chose to run ECM on the core2 chips during the 4-6 weeks a year I fire that beast up as an electric heater, giving up on CADO on that old old hardware.
VBCurtis is offline   Reply With Quote
Old 2022-01-27, 23:01   #72
EdH
 
EdH's Avatar
 
"Ed Hall"
Dec 2009
Adirondack Mtns

450210 Posts
Default

Quote:
Originally Posted by charybdis View Post
Possibly the strategy-2 composite factors bug. Once in every few hundred million relations, a relation will have a composite factor, and this makes CADO filtering quit, taking down the server with it. The solution is to use msieve instead, but that makes automation more difficult.

The other solution would be for CADO to throw out bad relations without quitting. Maybe I should suggest this to them someday...
Quote:
Originally Posted by VBCurtis View Post
I think in Ed's case it's that at some point CADO stopped compiling for core-2 era chips, so some of his farm uses a CADO version from before A= sievers were implemented.
I ran into this myself on my ancient dell C6100 32-core core2 server. In my case, I chose to run ECM on the core2 chips during the 4-6 weeks a year I fire that beast up as an electric heater, giving up on CADO on that old old hardware.
Curtis' memory is obviously better than mine. That is correct, however the Core 2 issue was fixed in later versions and all my machines are now running whatever I had to upgrade to for the project Oliver ran.

I do have automation running Msieve for >c125. Msieve is only run if a matrix can be built. If successful, it kills CADO and proceeds. If unsuccessful it lets CADO finish. The Msieve script is triggered by a local client receiving the 410 signal. I even have a second (and third) machine setup to automatically start other processes when the main (or second) machine goes into LA.

I will take a look at "A=" soon, but I think my trials will be delayed past a pending c168 that looks like it will run in a few minutes. Do I simply swap "tasks.I = 14" to "tasks.A = 28" and what differences in other params?

Thanks.
EdH is offline   Reply With Quote
Old 2022-01-28, 00:20   #73
VBCurtis
 
VBCurtis's Avatar
 
"Curtis"
Feb 2005
Riverside, CA

22·1,319 Posts
Default

Quote:
Originally Posted by EdH View Post
I will take a look at "A=" soon, but I think my trials will be delayed past a pending c168 that looks like it will run in a few minutes. Do I simply swap "tasks.I = 14" to "tasks.A = 28" and what differences in other params?

Thanks.
Yep- you're going up "half" a siever, so yield will go up by about 40%, and you'll need about 70% of the Q you would have needed for I=14. However, since bur's tests are showing that Q-max to Q-min ratio should be smaller than previously designed, I'd leave Q-min alone.
VBCurtis is offline   Reply With Quote
Old 2022-01-28, 00:30   #74
charybdis
 
charybdis's Avatar
 
Apr 2020

2B916 Posts
Default

Quote:
Originally Posted by EdH View Post
Do I simply swap "tasks.I = 14" to "tasks.A = 28" and what differences in other params?
Apart from what Curtis said, make sure to add tasks.sieve.adjust_strategy=2 if you don't have it already.

Last fiddled with by charybdis on 2022-01-28 at 01:01
charybdis is offline   Reply With Quote
Old 2022-01-28, 03:23   #75
EdH
 
EdH's Avatar
 
"Ed Hall"
Dec 2009
Adirondack Mtns

106268 Posts
Default

Thanks Guys! I will work on this to try and implement it for the next run. I missed this one and it's already sieving. I still need to do some Msieve tuning again, also. I stepped from 24 to 40 threads and want to test the MPI workings again. For some reason, I haven't been using MPI. I think it was due to factor harvesting from the log file, but I have so many things to rework, I'm almost lost with where to start.
EdH is offline   Reply With Quote
Old 2022-01-30, 19:21   #76
EdH
 
EdH's Avatar
 
"Ed Hall"
Dec 2009
Adirondack Mtns

10001100101102 Posts
Default

I'm looking at the implementation of strategy 2 for my machines and have a couple questions. I'm hoping to add the fewest scripts possible to my mix.

- In the case of adding strategy 2, if I start by using the default, can I add strategy 2 via my clients at first?

- Is strategy 2 dependent on "A=" or will it be of use for other "I=" runs?

- I think there was discussion with HenryZ over a memory limit switch. Is that correct, or is my memory failing me yet again? If available, should I try using it with my "lesser" machines, or just go without strategy 2?

- Now the complicated one to describe: I'm running all my clients as 4-threaded right now and then filling the available machines with clients, e.g. 40-thread machine has 10 clients. If I go with strategy 2, is this still a good setup, for those machines that can handle the memory?
EdH is offline   Reply With Quote
Old 2022-01-30, 20:10   #77
charybdis
 
charybdis's Avatar
 
Apr 2020

17×41 Posts
Default

Quote:
Originally Posted by EdH View Post
I'm looking at the implementation of strategy 2 for my machines and have a couple questions. I'm hoping to add the fewest scripts possible to my mix.

- In the case of adding strategy 2, if I start by using the default, can I add strategy 2 via my clients at first?
Yes, "--override adjust-strategy 2" should work fine. Note the hyphen rather than underscore here.

Quote:
- Is strategy 2 dependent on "A=" or will it be of use for other "I=" runs?
It's useful for "I=" (i.e. odd A value) on large enough numbers. For c150+ it usually increases yield by a few percent without sacrificing much speed. But the advantage is bigger for even values of A.

Quote:
- I think there was discussion with HenryZ over a memory limit switch. Is that correct, or is my memory failing me yet again? If available, should I try using it with my "lesser" machines, or just go without strategy 2?
This is -bkthresh1. Lower values use less RAM but are slower. Above max(lim0, lim1) it has no effect. You'll need to test different values out to see if it's at all useful for your setup. For ~c170 you might want to try 5M, 10M, 20M. But I suspect if you have enough memory for strategy 0 then -bkthresh1 will sieve too slowly to be helpful.

Quote:
- Now the complicated one to describe: I'm running all my clients as 4-threaded right now and then filling the available machines with clients, e.g. 40-thread machine has 10 clients. If I go with strategy 2, is this still a good setup, for those machines that can handle the memory?
Nothing wrong with this as long as there's enough memory. And indeed above 4 threads/client you probably won't see full CPU usage.

Last fiddled with by charybdis on 2022-01-30 at 20:11
charybdis is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Posting log files or other text files Xyzzy Forum Feedback 3 2018-12-30 19:37
Improved NFS polynomial selection jasonp Operation Kibibit 5 2014-09-07 11:02
CADO-NFS skan Information & Answers 1 2013-10-22 07:00
could oddperfect's ecm progress page be improved? jasong GMP-ECM 11 2007-05-30 03:08
Factoring progress has really improved! eepiccolo Lone Mersenne Hunters 3 2003-04-12 02:04

All times are UTC. The time now is 04:58.


Tue May 17 04:58:00 UTC 2022 up 33 days, 2:59, 0 users, load averages: 2.14, 1.79, 1.67

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.

≠ ± ∓ ÷ × · − √ ‰ ⊗ ⊕ ⊖ ⊘ ⊙ ≤ ≥ ≦ ≧ ≨ ≩ ≺ ≻ ≼ ≽ ⊏ ⊐ ⊑ ⊒ ² ³ °
∠ ∟ ° ≅ ~ ‖ ⟂ ⫛
≡ ≜ ≈ ∝ ∞ ≪ ≫ ⌊⌋ ⌈⌉ ∘ ∏ ∐ ∑ ∧ ∨ ∩ ∪ ⨀ ⊕ ⊗ 𝖕 𝖖 𝖗 ⊲ ⊳
∅ ∖ ∁ ↦ ↣ ∩ ∪ ⊆ ⊂ ⊄ ⊊ ⊇ ⊃ ⊅ ⊋ ⊖ ∈ ∉ ∋ ∌ ℕ ℤ ℚ ℝ ℂ ℵ ℶ ℷ ℸ 𝓟
¬ ∨ ∧ ⊕ → ← ⇒ ⇐ ⇔ ∀ ∃ ∄ ∴ ∵ ⊤ ⊥ ⊢ ⊨ ⫤ ⊣ … ⋯ ⋮ ⋰ ⋱
∫ ∬ ∭ ∮ ∯ ∰ ∇ ∆ δ ∂ ℱ ℒ ℓ
𝛢𝛼 𝛣𝛽 𝛤𝛾 𝛥𝛿 𝛦𝜀𝜖 𝛧𝜁 𝛨𝜂 𝛩𝜃𝜗 𝛪𝜄 𝛫𝜅 𝛬𝜆 𝛭𝜇 𝛮𝜈 𝛯𝜉 𝛰𝜊 𝛱𝜋 𝛲𝜌 𝛴𝜎𝜍 𝛵𝜏 𝛶𝜐 𝛷𝜙𝜑 𝛸𝜒 𝛹𝜓 𝛺𝜔