mersenneforum.org  

Go Back   mersenneforum.org > Factoring Projects > Factoring

Reply
 
Thread Tools
Old 2021-01-12, 20:49   #881
ryanp
 
ryanp's Avatar
 
Jun 2012
Boulder, CO

2·3·41 Posts
Default

Quote:
Originally Posted by VBCurtis View Post
No. The numbers should look quite similar to the first pass of msieve, such as these from your log on 9th Jan:
Code:
commencing in-memory singleton removal
begin with 2069585205 relations and 2015728165 unique ideals
reduce to 940662702 relations and 730460437 ideals in 20 passes
Using this log as a very rough guide, you should get output of about half your input for the first pass through remsing.

Edit: I think that happened to me the first time I tried it; an updated remsing was later posted that worked fine for me. The link posted here was to the post #608 that had the updated remsing, though. Hrmmm.....
I just grabbed the latest code from https://github.com/fivemack/factorisation-tools. Maybe fivemack (if he's reading this) can chime in? The final output was about 1/4 the original rels, which definitely seems wrong.
ryanp is offline   Reply With Quote
Old 2021-01-12, 21:13   #882
charybdis
 
Apr 2020

167 Posts
Default

Another suggestion: if the huge volume of relations is posing problems for msieve, then you could try turning this into a 33/35 job by removing all the relations with 36-bit algebraic factors using grep. Granted, you might need to sieve a bit more, but it ought to be simpler than finding and fixing a bug.
charybdis is offline   Reply With Quote
Old 2021-01-12, 22:06   #883
VBCurtis
 
VBCurtis's Avatar
 
"Curtis"
Feb 2005
Riverside, CA

29×32 Posts
Default

Or, you could just let CADO run the filtering and see how big that matrix is. I think msieve generally creates a matrix slightly bigger than cado; so if CADO's matrix comes out a tolerable size, you can stop sieving and focus on getting the dataset through msieve.

Though, Charybdis' last suggestion might mean sieving a little more anyway if msieve proves to be the problem.
VBCurtis is online now   Reply With Quote
Old 2021-01-13, 00:02   #884
ryanp
 
ryanp's Avatar
 
Jun 2012
Boulder, CO

2·3·41 Posts
Default

Quote:
Originally Posted by VBCurtis View Post
Or, you could just let CADO run the filtering and see how big that matrix is.
I would, but I'm not quite sure how to run the replay binary? (also I thought there was some question about current. compatibility between CADO's output and msieve's LA?)

In any event, here's where things currently stand with the latest msieve run, 2.1B unique's and target_density=110:

Code:
Tue Jan 12 12:21:48 2021  found 11 duplicates and 2110664553 unique relations
Tue Jan 12 12:21:48 2021  memory use: 31280.0 MB
Tue Jan 12 12:21:49 2021  reading ideals above 1591017472
Tue Jan 12 12:21:49 2021  commencing singleton removal, initial pass
Tue Jan 12 16:06:06 2021  memory use: 41024.0 MB
Tue Jan 12 16:06:07 2021  reading all ideals from disk
Tue Jan 12 16:07:00 2021  memory use: 39808.5 MB
Tue Jan 12 16:08:59 2021  commencing in-memory singleton removal
Tue Jan 12 16:10:33 2021  begin with 2110664552 relations and 2029607823 unique ideals
Tue Jan 12 16:27:46 2021  reduce to 992995519 relations and 761340257 ideals in 20 passes
Tue Jan 12 16:27:46 2021  max relations containing the same ideal: 35
Tue Jan 12 16:28:38 2021  reading ideals above 720000
Tue Jan 12 16:28:38 2021  commencing singleton removal, initial pass
ryanp is offline   Reply With Quote
Old 2021-01-14, 21:39   #885
ryanp
 
ryanp's Avatar
 
Jun 2012
Boulder, CO

111101102 Posts
Default

msieve keeps getting wedged... Trying again with 2.1B uniques and target_density=90.
ryanp is offline   Reply With Quote
Old 2021-01-15, 12:24   #886
henryzz
Just call me Henry
 
henryzz's Avatar
 
"David"
Sep 2007
Cambridge (GMT/BST)

2·2,897 Posts
Default

Would jasonp be able to give any advice on how to get past this blockage in the merge stage? I don't know whether he is reading this thread.
henryzz is offline   Reply With Quote
Old 2021-01-15, 14:59   #887
wreck
 
wreck's Avatar
 
"Bo Chen"
Oct 2005
Wuhan,China

163 Posts
Default

I'd suggest to do the 'NFS Filtering' step 50 hours first , to look what will happen then. Since the relations count is 2000 million, it will meed more patience than 1000 million.

Last fiddled with by wreck on 2021-01-15 at 15:02
wreck is offline   Reply With Quote
Old 2021-01-15, 15:06   #888
wreck
 
wreck's Avatar
 
"Bo Chen"
Oct 2005
Wuhan,China

163 Posts
Default

Repeate messages.
Some background date:
1. filter step for 2,1076+ snfs 324 (688M relations) : 15 hours.
2. filter step for 10,459- snfs 306 (737M relations) : 22 hours.

Last fiddled with by wreck on 2021-01-15 at 15:12
wreck is offline   Reply With Quote
Old 2021-01-15, 16:48   #889
ryanp
 
ryanp's Avatar
 
Jun 2012
Boulder, CO

2·3·41 Posts
Default

Quote:
Originally Posted by wreck View Post
I'd suggest to do the 'NFS Filtering' step 50 hours first , to look what will happen then. Since the relations count is 2000 million, it will meed more patience than 1000 million.
Thanks for the tip! I'll try to let this run (with 2.1B uniques and TD=90) sit for a while.
ryanp is offline   Reply With Quote
Old 2021-01-18, 21:49   #890
ryanp
 
ryanp's Avatar
 
Jun 2012
Boulder, CO

2·3·41 Posts
Default

Code:
Fri Jan 15 12:21:24 2021  commencing in-memory singleton removal
Fri Jan 15 12:22:01 2021  begin with 590365520 relations and 594141896 unique ideals
Fri Jan 15 12:35:29 2021  reduce to 585813821 relations and 580608996 ideals in 21 passes
Fri Jan 15 12:35:29 2021  max relations containing the same ideal: 155
Fri Jan 15 12:37:14 2021  relations with 0 large ideals: 307095
Fri Jan 15 12:37:14 2021  relations with 1 large ideals: 215009
Fri Jan 15 12:37:14 2021  relations with 2 large ideals: 1852650
Fri Jan 15 12:37:14 2021  relations with 3 large ideals: 10607404
Fri Jan 15 12:37:14 2021  relations with 4 large ideals: 38306704
Fri Jan 15 12:37:14 2021  relations with 5 large ideals: 90474854
Fri Jan 15 12:37:14 2021  relations with 6 large ideals: 141486075
Fri Jan 15 12:37:14 2021  relations with 7+ large ideals: 302564030
Fri Jan 15 12:37:14 2021  commencing 2-way merge
So we're now at 72+ hours and it's still running... I'll give it a few more days, but starting to lose hope.
ryanp is offline   Reply With Quote
Old 2021-01-18, 22:23   #891
pinhodecarlos
 
pinhodecarlos's Avatar
 
"Carlos Pinho"
Oct 2011
Milton Keynes, UK

37×131 Posts
Default

Maybe get in touch with Greg from NFS@Home to see if he can give any support or advise?!
pinhodecarlos is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Passive Pascal Xyzzy GPU Computing 1 2017-05-17 20:22
Tesla P100 — 5.4 DP TeraFLOPS — Pascal Mark Rose GPU Computing 52 2016-07-02 12:11
Nvidia Pascal, a third of DP firejuggler GPU Computing 12 2016-02-23 06:55
Calculating perfect numbers in Pascal Elhueno Homework Help 5 2008-06-12 16:37
Factorization attempt to a c163 - a new Odd Perfect Number roadblock jchein1 Factoring 30 2005-05-30 14:43

All times are UTC. The time now is 05:59.

Tue Jan 19 05:59:45 UTC 2021 up 47 days, 2:11, 0 users, load averages: 1.67, 1.49, 1.36

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.