mersenneforum.org  

Go Back   mersenneforum.org > Factoring Projects > Cunningham Tables

Reply
 
Thread Tools
Old 2021-11-11, 13:48   #243
EdH
 
EdH's Avatar
 
"Ed Hall"
Dec 2009
Adirondack Mtns

101278 Posts
Default Not quite a dozen

Eleven "stuck" clients greeted me this morning! Was this another IP refresh? I might drop a note to the CADO Team.

On a bright note, our Team CPU has turned 21 and is now fully considered an adult in the U.S.
EdH is offline   Reply With Quote
Old 2021-11-11, 14:07   #244
kruoli
 
kruoli's Avatar
 
"Oliver"
Sep 2017
Porta Westfalica, DE

14768 Posts
Default

Yes, I had to restart the server this morning once again.

The problem is not strictly with renewing the IP. My IP gets renewed every day and I had no problems for at least a few days. It is much more likely that the problem occurs when the server and/or client is doing something specific while the IP gets renewed. The HTTP server on the server side gets stuck. Thus, I have to Strg+C twice to kill the server. I am not sure at which point the client gets stuck. I would advise to add a timeout 1h ./cado-nfs-client.py … --single to your command line (that already uses --single, as you said, but not timeout). I thought about this only just now and will add that to my client script.

I was irritated to see that a few WUs came through after the server got stuck, our status page showed the last incoming WU at least three hours after the IP renewal.

Last fiddled with by kruoli on 2021-11-11 at 14:50 Reason: Grammar.
kruoli is offline   Reply With Quote
Old 2021-11-11, 14:50   #245
EdH
 
EdH's Avatar
 
"Ed Hall"
Dec 2009
Adirondack Mtns

105716 Posts
Default

Quote:
Originally Posted by kruoli View Post
Yes, I had to restart the server this morning once again.

The problem is not strictly with renewing the IP. My IP gets renewed every day and I had no problems for at least a few days. It is much more likely that the problem occurs when the server and/or client is doing something specific while the IP gets renewed. The HTTP server on the server side gets stuck. Thus, I have to Strg+C twice to kill the server. I am not sure at which point the client gets stuck. I would advise to add a timeout 1h ./cado-nfs-client.py … --single to you command line (that already uses --single, as you said, but not timeout). I thought about this only just now and will add that to my client script.

I was irritated to see that a few WUs came through after the server got stuck, our status page showed the last incoming WU at least three hours after the IP renewal.
I suspect that a client is in the middle of a WU transfer when the renewal occurs and since they're locked, the IP change confuses them.

Thanks for the mention of "timeout." I will look into adding that to my scripts as well. (Probably, not today, though.)

Our status page should be looking at WUs being sent out for the check, rather than WUs received. I think it's doing that, isn't it? That should flag if there is no new WU sent out shown in the log after our set time.
EdH is offline   Reply With Quote
Old 2021-11-11, 14:51   #246
kruoli
 
kruoli's Avatar
 
"Oliver"
Sep 2017
Porta Westfalica, DE

11001111102 Posts
Default

Quote:
Originally Posted by EdH View Post
Our status page should be looking at WUs being sent out for the check, rather than WUs received. I think it's doing that, isn't it? That should flag if there is no new WU sent out shown in the log after our set time.
I thought it was doing both? But this should not change the weirdness of this behaviour.
kruoli is offline   Reply With Quote
Old 2021-11-11, 15:01   #247
EdH
 
EdH's Avatar
 
"Ed Hall"
Dec 2009
Adirondack Mtns

101278 Posts
Default

Quote:
Originally Posted by kruoli View Post
I thought it was doing both? But this should not change the weirdness of this behaviour.
It's curious if the clients are taking that long to process a WU, although that is possible. But it may just be that those clients took that long retrying and finally uploaded their results. It's good you have a long timeout for the WUs.
EdH is offline   Reply With Quote
Old 2021-11-12, 20:56   #248
pinhodecarlos
 
pinhodecarlos's Avatar
 
"Carlos Pinho"
Oct 2011
Milton Keynes, UK

138D16 Posts
Default

Oliver, can you please provide me with the full command to run the CADO client to point to your server? TIA
pinhodecarlos is online now   Reply With Quote
Old 2021-11-13, 19:23   #249
EdH
 
EdH's Avatar
 
"Ed Hall"
Dec 2009
Adirondack Mtns

418310 Posts
Default

This is very rough and it's quite possible that I am off in my calculations, but I tried modifying some clients on a machine with enough RAM, based on info from VBCurtis some time ago.

Since I have some machines with a little more RAM, I cut the threads on some of the clients and made new clients with those cut threads. Specifically, I tried it with a Z620 12c/24t dual Xeon that has 48GB RAM. It was running three clients, each using 8 threads and 5.5GB RAM. I am now running 6 clients, each using 4 threads and 5.5GB RAM. It still has some RAM room.

If my timing data calculations are correct, I have gained about 9% in throughput. I believe this corresponds with the info from VBCurtis about such.

Based on my perceived success, I will be trying to change some other machines to see if this holds true for others capable of meeting the RAM needs.

Thanks Curtis! It took me a while to implement this, but it may very well get me to modify the scripts for all future CADO-NFS work, both local and team.
EdH is offline   Reply With Quote
Old 2021-11-13, 22:01   #250
kruoli
 
kruoli's Avatar
 
"Oliver"
Sep 2017
Porta Westfalica, DE

2·5·83 Posts
Default

We just hit 1,000,000,000 relations.
kruoli is offline   Reply With Quote
Old 2021-11-15, 23:38   #251
charybdis
 
charybdis's Avatar
 
Apr 2020

24716 Posts
Default

Quote:
Maximum relations returned from single WU: 12408 (483824000-483826000)
What's going on here? Was this something like A=32? I hope it wasn't higher lpbs because then the extra relations would be useless.
charybdis is offline   Reply With Quote
Old 2021-11-16, 06:18   #252
kruoli
 
kruoli's Avatar
 
"Oliver"
Sep 2017
Porta Westfalica, DE

2·5·83 Posts
Default

Quote:
Originally Posted by charybdis View Post
Was this something like A=32?
Exactly, I hit it after three WUs.
kruoli is offline   Reply With Quote
Old 2021-11-16, 09:57   #253
kruoli
 
kruoli's Avatar
 
"Oliver"
Sep 2017
Porta Westfalica, DE

2·5·83 Posts
Default

Finally, Seth's stats view is also available. It is linked to from within the other status page. He anonymised client details after I wished for it until we find a better solution (some did not want to share them, and it was quicker to do it this way rather than removing all the client details (I guess)).

We have one more client than real participants because there is a machine I could not associate safely with its owner. Thus, it is listed like it was a separate user.

Also, Seth added a graph which shows the WU yield against Q. You can quickly spot where we changed the sieving strategy (at least I thought the first big jump is that, but IIRC we switched the strategy later, didn't we?), where I experimented with A=31 and maybe even the few outliers because of A=32.

The page gets refreshed every half an hour.
kruoli is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Using 16e on smaller numbers fivemack Factoring 3 2017-09-19 08:52
NFS on smaller numbers? skan YAFU 6 2013-02-26 13:57
Bernoulli(200) c204 akruppa Factoring 114 2012-08-20 14:01
checking smaller number fortega Data 2 2005-06-16 22:48
Factoring Smaller Numbers marc Factoring 6 2004-10-09 14:17

All times are UTC. The time now is 17:24.


Tue Jan 18 17:24:56 UTC 2022 up 179 days, 11:53, 0 users, load averages: 1.50, 1.19, 1.16

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.

≠ ± ∓ ÷ × · − √ ‰ ⊗ ⊕ ⊖ ⊘ ⊙ ≤ ≥ ≦ ≧ ≨ ≩ ≺ ≻ ≼ ≽ ⊏ ⊐ ⊑ ⊒ ² ³ °
∠ ∟ ° ≅ ~ ‖ ⟂ ⫛
≡ ≜ ≈ ∝ ∞ ≪ ≫ ⌊⌋ ⌈⌉ ∘ ∏ ∐ ∑ ∧ ∨ ∩ ∪ ⨀ ⊕ ⊗ 𝖕 𝖖 𝖗 ⊲ ⊳
∅ ∖ ∁ ↦ ↣ ∩ ∪ ⊆ ⊂ ⊄ ⊊ ⊇ ⊃ ⊅ ⊋ ⊖ ∈ ∉ ∋ ∌ ℕ ℤ ℚ ℝ ℂ ℵ ℶ ℷ ℸ 𝓟
¬ ∨ ∧ ⊕ → ← ⇒ ⇐ ⇔ ∀ ∃ ∄ ∴ ∵ ⊤ ⊥ ⊢ ⊨ ⫤ ⊣ … ⋯ ⋮ ⋰ ⋱
∫ ∬ ∭ ∮ ∯ ∰ ∇ ∆ δ ∂ ℱ ℒ ℓ
𝛢𝛼 𝛣𝛽 𝛤𝛾 𝛥𝛿 𝛦𝜀𝜖 𝛧𝜁 𝛨𝜂 𝛩𝜃𝜗 𝛪𝜄 𝛫𝜅 𝛬𝜆 𝛭𝜇 𝛮𝜈 𝛯𝜉 𝛰𝜊 𝛱𝜋 𝛲𝜌 𝛴𝜎 𝛵𝜏 𝛶𝜐 𝛷𝜙𝜑 𝛸𝜒 𝛹𝜓 𝛺𝜔