mersenneforum.org  

Go Back   mersenneforum.org > Factoring Projects > CADO-NFS

Reply
 
Thread Tools
Old 2020-04-25, 06:25   #78
VBCurtis
 
VBCurtis's Avatar
 
"Curtis"
Feb 2005
Riverside, CA

447210 Posts
Default

I tried ncurves1 = 16, ETA went up 3 days.

I tried lim0=140M, lim1=100M, ETA went up 8-10 days.

So no changes to the suggestions from last post.
VBCurtis is offline   Reply With Quote
Old 2020-04-25, 12:17   #79
charybdis
 
Apr 2020

7116 Posts
Default

Just want to make sure I've got this right:

Code:
tasks.A = 28
tasks.qmin = 500000
tasks.lim0 = 100000000
tasks.lim1 = 140000000
tasks.lpb0 = 31
tasks.lpb1 = 32
tasks.sieve.lambda0 = 1.88
tasks.sieve.mfb0 = 58
tasks.sieve.mfb1 = 90
tasks.sieve.ncurves0 = 20
tasks.sieve.ncurves1 = 13
tasks.sieve.qrange = 10000
tasks.sieve.rels_wanted = 320000000
charybdis is offline   Reply With Quote
Old 2020-04-25, 16:08   #80
VBCurtis
 
VBCurtis's Avatar
 
"Curtis"
Feb 2005
Riverside, CA

23·13·43 Posts
Default

Precisely. Sorry I was too lazy to do that myself for you.
VBCurtis is offline   Reply With Quote
Old 2020-04-25, 16:34   #81
charybdis
 
Apr 2020

113 Posts
Default

Quote:
Originally Posted by VBCurtis View Post
Precisely. Sorry I was too lazy to do that myself for you.
No worries at all - if anything I'm the lazy one here.
charybdis is offline   Reply With Quote
Old 2020-04-30, 01:48   #82
charybdis
 
Apr 2020

113 Posts
Default

Managed to get a matrix with just over 320M relations after sieving Q from 500k to 136M, but it's a big one:

Code:
Thu Apr 30 00:23:42 2020  commencing relation filtering
Thu Apr 30 00:23:42 2020  setting target matrix density to 100.0
Thu Apr 30 00:23:42 2020  estimated available RAM is 15845.4 MB
Thu Apr 30 00:23:43 2020  commencing duplicate removal, pass 1
...
Thu Apr 30 00:55:20 2020  found 94773795 hash collisions in 321245930 relations
Thu Apr 30 00:55:41 2020  commencing duplicate removal, pass 2
Thu Apr 30 01:01:49 2020  found 122972626 duplicates and 198273304 unique relations
Thu Apr 30 01:01:49 2020  memory use: 2387.0 MB
Thu Apr 30 01:01:50 2020  reading ideals above 151584768
Thu Apr 30 01:01:50 2020  commencing singleton removal, initial pass
Thu Apr 30 01:17:31 2020  memory use: 5512.0 MB
Thu Apr 30 01:17:32 2020  reading all ideals from disk
Thu Apr 30 01:17:52 2020  memory use: 3537.9 MB
Thu Apr 30 01:17:57 2020  commencing in-memory singleton removal
Thu Apr 30 01:18:03 2020  begin with 198273304 relations and 195834296 unique ideals
Thu Apr 30 01:18:55 2020  reduce to 86504203 relations and 67341595 ideals in 18 passes
Thu Apr 30 01:18:55 2020  max relations containing the same ideal: 23
Thu Apr 30 01:19:01 2020  reading ideals above 720000
Thu Apr 30 01:19:01 2020  commencing singleton removal, initial pass
Thu Apr 30 01:30:14 2020  memory use: 2756.0 MB
Thu Apr 30 01:30:14 2020  reading all ideals from disk
Thu Apr 30 01:30:34 2020  memory use: 3467.0 MB
Thu Apr 30 01:30:41 2020  keeping 83938241 ideals with weight <= 200, target excess is 450665
Thu Apr 30 01:30:48 2020  commencing in-memory singleton removal
Thu Apr 30 01:30:53 2020  begin with 86504208 relations and 83938241 unique ideals
Thu Apr 30 01:32:07 2020  reduce to 86349299 relations and 83783289 ideals in 14 passes
Thu Apr 30 01:32:07 2020  max relations containing the same ideal: 200
Thu Apr 30 01:32:38 2020  removing 4545236 relations and 4145236 ideals in 400000 cliques
Thu Apr 30 01:32:39 2020  commencing in-memory singleton removal
Thu Apr 30 01:32:44 2020  begin with 81804063 relations and 83783289 unique ideals
Thu Apr 30 01:33:34 2020  reduce to 81605208 relations and 79437817 ideals in 10 passes
Thu Apr 30 01:33:34 2020  max relations containing the same ideal: 199
Thu Apr 30 01:34:03 2020  removing 3387725 relations and 2987725 ideals in 400000 cliques
Thu Apr 30 01:34:05 2020  commencing in-memory singleton removal
Thu Apr 30 01:34:10 2020  begin with 78217483 relations and 79437817 unique ideals
Thu Apr 30 01:34:52 2020  reduce to 78096236 relations and 76328142 ideals in 9 passes
Thu Apr 30 01:34:52 2020  max relations containing the same ideal: 194
Thu Apr 30 01:35:21 2020  removing 3022251 relations and 2622251 ideals in 400000 cliques
Thu Apr 30 01:35:22 2020  commencing in-memory singleton removal
Thu Apr 30 01:35:27 2020  begin with 75073985 relations and 76328142 unique ideals
Thu Apr 30 01:36:03 2020  reduce to 74969366 relations and 73600718 ideals in 8 passes
Thu Apr 30 01:36:03 2020  max relations containing the same ideal: 190
Thu Apr 30 01:36:30 2020  removing 2824610 relations and 2424610 ideals in 400000 cliques
Thu Apr 30 01:36:31 2020  commencing in-memory singleton removal
Thu Apr 30 01:36:36 2020  begin with 72144756 relations and 73600718 unique ideals
Thu Apr 30 01:37:15 2020  reduce to 72050844 relations and 71081672 ideals in 9 passes
Thu Apr 30 01:37:15 2020  max relations containing the same ideal: 188
Thu Apr 30 01:37:41 2020  removing 2697707 relations and 2297707 ideals in 400000 cliques
Thu Apr 30 01:37:42 2020  commencing in-memory singleton removal
Thu Apr 30 01:37:47 2020  begin with 69353137 relations and 71081672 unique ideals
Thu Apr 30 01:38:24 2020  reduce to 69262639 relations and 68692948 ideals in 9 passes
Thu Apr 30 01:38:24 2020  max relations containing the same ideal: 180
Thu Apr 30 01:38:49 2020  removing 430114 relations and 383195 ideals in 46919 cliques
Thu Apr 30 01:38:50 2020  commencing in-memory singleton removal
Thu Apr 30 01:38:54 2020  begin with 68832525 relations and 68692948 unique ideals
Thu Apr 30 01:39:23 2020  reduce to 68830278 relations and 68307505 ideals in 7 passes
Thu Apr 30 01:39:23 2020  max relations containing the same ideal: 180
Thu Apr 30 01:39:35 2020  relations with 0 large ideals: 1698
Thu Apr 30 01:39:35 2020  relations with 1 large ideals: 2688
Thu Apr 30 01:39:35 2020  relations with 2 large ideals: 42577
Thu Apr 30 01:39:35 2020  relations with 3 large ideals: 386727
Thu Apr 30 01:39:35 2020  relations with 4 large ideals: 2037316
Thu Apr 30 01:39:35 2020  relations with 5 large ideals: 6689570
Thu Apr 30 01:39:35 2020  relations with 6 large ideals: 14111696
Thu Apr 30 01:39:35 2020  relations with 7+ large ideals: 45558006
Thu Apr 30 01:39:35 2020  commencing 2-way merge
Thu Apr 30 01:40:12 2020  reduce to 41453428 relation sets and 40930655 unique ideals
Thu Apr 30 01:40:12 2020  commencing full merge
Thu Apr 30 01:50:00 2020  memory use: 4714.1 MB
Thu Apr 30 01:50:02 2020  found 19338169 cycles, need 19310855
Thu Apr 30 01:50:07 2020  weight of 19310855 cycles is about 1931089230 (100.00/cycle)
Thu Apr 30 01:50:07 2020  distribution of cycle lengths:
Thu Apr 30 01:50:07 2020  1 relations: 2082996
Thu Apr 30 01:50:07 2020  2 relations: 1886001
Thu Apr 30 01:50:07 2020  3 relations: 1865997
Thu Apr 30 01:50:07 2020  4 relations: 1724216
Thu Apr 30 01:50:07 2020  5 relations: 1575985
Thu Apr 30 01:50:07 2020  6 relations: 1439418
Thu Apr 30 01:50:07 2020  7 relations: 1264045
Thu Apr 30 01:50:07 2020  8 relations: 1107001
Thu Apr 30 01:50:07 2020  9 relations: 986442
Thu Apr 30 01:50:07 2020  10+ relations: 5378754
Thu Apr 30 01:50:07 2020  heaviest cycle: 28 relations
Thu Apr 30 01:50:12 2020  commencing cycle optimization
Thu Apr 30 01:50:35 2020  start with 137988190 relations
Thu Apr 30 01:53:40 2020  pruned 3943658 relations
Thu Apr 30 01:53:41 2020  memory use: 4233.3 MB
Thu Apr 30 01:53:41 2020  distribution of cycle lengths:
Thu Apr 30 01:53:41 2020  1 relations: 2082996
Thu Apr 30 01:53:41 2020  2 relations: 1934591
Thu Apr 30 01:53:41 2020  3 relations: 1936470
Thu Apr 30 01:53:41 2020  4 relations: 1772730
Thu Apr 30 01:53:41 2020  5 relations: 1624454
Thu Apr 30 01:53:41 2020  6 relations: 1464862
Thu Apr 30 01:53:41 2020  7 relations: 1283296
Thu Apr 30 01:53:41 2020  8 relations: 1116240
Thu Apr 30 01:53:41 2020  9 relations: 987568
Thu Apr 30 01:53:41 2020  10+ relations: 5107648
Thu Apr 30 01:53:41 2020  heaviest cycle: 28 relations
Thu Apr 30 01:54:12 2020  RelProcTime: 5430
Thu Apr 30 01:54:18 2020  
Thu Apr 30 01:54:18 2020  commencing linear algebra
Thu Apr 30 01:54:19 2020  read 19310855 cycles
Thu Apr 30 01:54:50 2020  cycles contain 68397133 unique relations
Thu Apr 30 02:02:14 2020  read 68397133 relations
Thu Apr 30 02:03:45 2020  using 20 quadratic characters above 4294917295
Thu Apr 30 02:08:07 2020  building initial matrix
Thu Apr 30 02:18:19 2020  memory use: 9234.0 MB
Thu Apr 30 02:18:43 2020  read 19310855 cycles
Thu Apr 30 02:18:45 2020  matrix is 19310678 x 19310855 (7913.5 MB) with weight 2405426155 (124.56/col)
Thu Apr 30 02:18:45 2020  sparse part has weight 1842743275 (95.43/col)
Thu Apr 30 02:21:26 2020  filtering completed in 2 passes
Thu Apr 30 02:21:29 2020  matrix is 19308744 x 19308921 (7913.3 MB) with weight 2405349100 (124.57/col)
Thu Apr 30 02:21:29 2020  sparse part has weight 1842727716 (95.43/col)
Thu Apr 30 02:23:23 2020  matrix starts at (0, 0)
Thu Apr 30 02:23:26 2020  matrix is 19308744 x 19308921 (7913.3 MB) with weight 2405349100 (124.57/col)
Thu Apr 30 02:23:26 2020  sparse part has weight 1842727716 (95.43/col)
Thu Apr 30 02:23:26 2020  saving the first 48 matrix rows for later
Thu Apr 30 02:23:28 2020  matrix includes 64 packed rows
Thu Apr 30 02:23:30 2020  matrix is 19308696 x 19308921 (7658.0 MB) with weight 2009697914 (104.08/col)
Thu Apr 30 02:23:30 2020  sparse part has weight 1814420535 (93.97/col)
Thu Apr 30 02:23:30 2020  using block size 8192 and superblock size 884736 for processor cache size 9216 kB
Thu Apr 30 02:24:23 2020  commencing Lanczos iteration (6 threads)
Thu Apr 30 02:24:23 2020  memory use: 7355.4 MB
Thu Apr 30 02:25:29 2020  linear algebra at 0.0%, ETA 223h 1m
The ETA has come down to ~168h, but that's still inconveniently long - I'll keep on sieving.

Sieving (so far) took 52.9M CPU-seconds, compared to 58.6M for the fastest c177 I ran (with I=15 31/32), despite the poly score being 17% worse. So it seems 3LP may be the way to go if you don't care much about the difficulty of the matrix, for example if you're running a job this size on a single machine where the sieving could take months. We'll see whether the comparison is still favourable when I've sieved enough to get a nice matrix; I imagine it might not be.
charybdis is offline   Reply With Quote
Old 2020-04-30, 03:24   #83
VBCurtis
 
VBCurtis's Avatar
 
"Curtis"
Feb 2005
Riverside, CA

23×13×43 Posts
Default

I agree that this is a terrific speedup for a single machine job- 6 * 86400 * 7 is about 3.5M cpu-sec for the matrix, so your complete job would finish in less time than the C177 took to sieve!

It's also unclear if I=15 would be faster; with 2LP on C177 you found 10% speedup there, so this could get faster still.

That tells me C178 is too late to begin 3LP; a C178 job should not be faster than a C177, especially with those poly scores. So, we should try 3LP on the C175 file.

I imagine you're going to sieve up to about the same time as the C177, and end up with a matrix somewhere near 15-16M. That's still a big win, to achieve the same sieve time with a poly 17% worse! I await your data.
VBCurtis is offline   Reply With Quote
Old 2020-04-30, 15:37   #84
EdH
 
EdH's Avatar
 
"Ed Hall"
Dec 2009
Adirondack Mtns

344510 Posts
Default

I have msieve doing LA on the 178 cofactor of 12-7_945L now. Here are the Total times I can find for CADO-NFS, which crashed due to insufficient memory during full merge:
Code:
PID28474 2020-04-20 16:27:18,736 Info:Polynomial Selection (size optimized): Total time: 2.65212e+06
PID31307 2020-04-20 17:37:53,424 Info:Polynomial Selection (size optimized): Total time: 2.65212e+06
PID31307 2020-04-20 18:00:56,820 Info:Polynomial Selection (root optimized): Total time: 58448.6
PID8786 2020-04-20 22:45:07,422 Info:Polynomial Selection (size optimized): Total time: 2.65212e+06
PID8786 2020-04-20 22:45:07,425 Info:Polynomial Selection (root optimized): Total time: 58448.6
PID8786 2020-04-28 02:06:51,549 Info:Lattice Sieving: Total time: 2.02059e+07s
Msieve refused to build at t_d=120 and 110, so I tried it at default and it came up with the following. Of note, every one of the first 1.2M relations showed error -11. Here is the successful run which is now at about 120 hours to finish:
Code:
Tue Apr 28 13:07:12 2020  Msieve v. 1.54 (SVN 1018)
Tue Apr 28 13:07:12 2020  random seeds: 6cef034c 096382c6
Tue Apr 28 13:07:12 2020  factoring 1258632688840167527990479924759660967727113832014282715541202945214604444063933854224497640052542892497254083608311352572748398102592769128719761767229021194362137011186342088871 (178 digits)
Tue Apr 28 13:07:13 2020  searching for 15-digit factors
Tue Apr 28 13:07:13 2020  commencing number field sieve (178-digit input)
Tue Apr 28 13:07:13 2020  R0: -21186307570697279371433463611848173
Tue Apr 28 13:07:13 2020  R1: 8845196529223700328463
Tue Apr 28 13:07:13 2020  A0: 2400190655725017956973353574287095281260800
Tue Apr 28 13:07:13 2020  A1: 211014402684521569088239119813217640
Tue Apr 28 13:07:13 2020  A2: -39939568153496532334089408958
Tue Apr 28 13:07:13 2020  A3: -1552818850110399495593
Tue Apr 28 13:07:13 2020  A4: 58933721795178
Tue Apr 28 13:07:13 2020  A5: 294840
Tue Apr 28 13:07:13 2020  skew 1.00, size 3.619e-17, alpha -7.825, combined = 5.648e-16 rroots = 5
Tue Apr 28 13:07:13 2020  
Tue Apr 28 13:07:13 2020  commencing relation filtering
Tue Apr 28 13:07:13 2020  estimated available RAM is 15926.6 MB
Tue Apr 28 13:07:13 2020  commencing duplicate removal, pass 1
Tue Apr 28 13:07:13 2020  error -11 reading relation 0
. . . [ Includes every relation in between ]
Tue Apr 28 13:07:35 2020  error -11 reading relation 1216455
Tue Apr 28 13:07:19 2020 error -1 reading relation 345340
Tue Apr 28 13:07:29 2020 error -1 reading relation 907378
. . .
Tue Apr 28 13:42:35 2020 error -1 reading relation 266916827
Tue Apr 28 13:43:47 2020 error -1 reading relation 276189407
Tue Apr 28 13:43:50 2020 found 90847552 hash collisions in 275423639 relations
Tue Apr 28 13:44:23 2020 added 121850 free relations
Tue Apr 28 13:44:23 2020 commencing duplicate removal, pass 2
Tue Apr 28 13:51:04 2020 found 126526927 duplicates and 149018562 unique relations
Tue Apr 28 13:51:04 2020 memory use: 1449.5 MB
Tue Apr 28 13:51:04 2020 reading ideals above 139919360
Tue Apr 28 13:51:04 2020 commencing singleton removal, initial pass
Tue Apr 28 14:07:21 2020 memory use: 3012.0 MB
Tue Apr 28 14:07:21 2020 reading all ideals from disk
Tue Apr 28 14:07:34 2020 memory use: 2421.4 MB
Tue Apr 28 14:07:39 2020 commencing in-memory singleton removal
Tue Apr 28 14:07:43 2020 begin with 149018562 relations and 146733511 unique ideals
Tue Apr 28 14:08:27 2020 reduce to 55424518 relations and 38967191 ideals in 19 passes
Tue Apr 28 14:08:27 2020 max relations containing the same ideal: 20
Tue Apr 28 14:08:29 2020 reading ideals above 720000
Tue Apr 28 14:08:30 2020 commencing singleton removal, initial pass
Tue Apr 28 14:19:03 2020 memory use: 1506.0 MB
Tue Apr 28 14:19:03 2020 reading all ideals from disk
Tue Apr 28 14:19:15 2020 memory use: 2195.2 MB
Tue Apr 28 14:19:21 2020 keeping 54432776 ideals with weight <= 200, target excess is 304675
Tue Apr 28 14:19:27 2020 commencing in-memory singleton removal
Tue Apr 28 14:19:32 2020 begin with 55424518 relations and 54432776 unique ideals
Tue Apr 28 14:20:39 2020 reduce to 54906475 relations and 53914041 ideals in 14 passes
Tue Apr 28 14:20:39 2020 max relations containing the same ideal: 200
Tue Apr 28 14:21:05 2020 removing 3380876 relations and 3061371 ideals in 319505 cliques
Tue Apr 28 14:21:06 2020 commencing in-memory singleton removal
Tue Apr 28 14:21:11 2020 begin with 51525599 relations and 53914041 unique ideals
Tue Apr 28 14:21:56 2020 reduce to 51370877 relations and 50696663 ideals in 10 passes
Tue Apr 28 14:21:56 2020 max relations containing the same ideal: 196
Tue Apr 28 14:22:20 2020 removing 2526879 relations and 2207374 ideals in 319505 cliques
Tue Apr 28 14:22:21 2020 commencing in-memory singleton removal
Tue Apr 28 14:22:26 2020 begin with 48843998 relations and 50696663 unique ideals
Tue Apr 28 14:23:04 2020 reduce to 48745655 relations and 48390321 ideals in 9 passes
Tue Apr 28 14:23:04 2020 max relations containing the same ideal: 192
Tue Apr 28 14:23:35 2020 relations with 0 large ideals: 1040
Tue Apr 28 14:23:35 2020 relations with 1 large ideals: 1286
Tue Apr 28 14:23:35 2020 relations with 2 large ideals: 18987
Tue Apr 28 14:23:35 2020 relations with 3 large ideals: 185362
Tue Apr 28 14:23:35 2020 relations with 4 large ideals: 1069605
Tue Apr 28 14:23:35 2020 relations with 5 large ideals: 3821977
Tue Apr 28 14:23:35 2020 relations with 6 large ideals: 8808829
Tue Apr 28 14:23:35 2020 relations with 7+ large ideals: 34838569
Tue Apr 28 14:23:35 2020 commencing 2-way merge
Tue Apr 28 14:24:10 2020 reduce to 28658603 relation sets and 28303270 unique ideals
Tue Apr 28 14:24:10 2020 ignored 1 oversize relation sets
Tue Apr 28 14:24:10 2020 commencing full merge
Tue Apr 28 14:31:02 2020 memory use: 3240.8 MB
Tue Apr 28 14:31:06 2020 found 15724964 cycles, need 15677470
Tue Apr 28 14:31:11 2020 weight of 15677470 cycles is about 1097547456 (70.01/cycle)
Tue Apr 28 14:31:11 2020 distribution of cycle lengths:
Tue Apr 28 14:31:11 2020 1 relations: 2291729
Tue Apr 28 14:31:11 2020 2 relations: 2282984
Tue Apr 28 14:31:11 2020 3 relations: 2192031
Tue Apr 28 14:31:11 2020 4 relations: 1842581
Tue Apr 28 14:31:11 2020 5 relations: 1578365
Tue Apr 28 14:31:11 2020 6 relations: 1260813
Tue Apr 28 14:31:11 2020 7 relations: 992679
Tue Apr 28 14:31:11 2020 8 relations: 779990
Tue Apr 28 14:31:11 2020 9 relations: 616680
Tue Apr 28 14:31:11 2020 10+ relations: 1839618
Tue Apr 28 14:31:11 2020 heaviest cycle: 22 relations
Tue Apr 28 14:31:14 2020 commencing cycle optimization
Tue Apr 28 14:31:34 2020 start with 77754198 relations
Tue Apr 28 14:32:55 2020 pruned 1290229 relations
Tue Apr 28 14:32:56 2020 memory use: 2790.2 MB
Tue Apr 28 14:32:56 2020 distribution of cycle lengths:
Tue Apr 28 14:32:56 2020 1 relations: 2291729
Tue Apr 28 14:32:56 2020 2 relations: 2325968
Tue Apr 28 14:32:56 2020 3 relations: 2254390
Tue Apr 28 14:32:56 2020 4 relations: 1867541
Tue Apr 28 14:32:56 2020 5 relations: 1592479
Tue Apr 28 14:32:56 2020 6 relations: 1254891
Tue Apr 28 14:32:56 2020 7 relations: 982745
Tue Apr 28 14:32:56 2020 8 relations: 765997
Tue Apr 28 14:32:56 2020 9 relations: 602147
Tue Apr 28 14:32:56 2020 10+ relations: 1739583
Tue Apr 28 14:32:56 2020 heaviest cycle: 22 relations
Tue Apr 28 14:33:16 2020 RelProcTime: 5163
Tue Apr 28 14:33:22 2020
Tue Apr 28 14:33:22 2020 commencing linear algebra
Tue Apr 28 14:33:24 2020 read 15677470 cycles
Tue Apr 28 14:33:44 2020 cycles contain 48314663 unique relations
Tue Apr 28 14:41:24 2020 read 48314663 relations
Tue Apr 28 14:42:25 2020 using 20 quadratic characters above 4294917295
Tue Apr 28 14:45:53 2020 building initial matrix
Tue Apr 28 14:51:45 2020 memory use: 6545.9 MB
Tue Apr 28 14:51:50 2020 read 15677470 cycles
Tue Apr 28 14:51:53 2020 matrix is 15677291 x 15677470 (4747.0 MB) with weight 1462757761 (93.30/col)
Tue Apr 28 14:51:53 2020 sparse part has weight 1071935640 (68.37/col)
Tue Apr 28 14:54:32 2020 filtering completed in 2 passes
Tue Apr 28 14:54:35 2020 matrix is 15667059 x 15667237 (4746.3 MB) with weight 1462436968 (93.34/col)
Tue Apr 28 14:54:35 2020 sparse part has weight 1071872063 (68.41/col)
Tue Apr 28 14:55:51 2020 matrix starts at (0, 0)
Tue Apr 28 14:55:54 2020 matrix is 15667059 x 15667237 (4746.3 MB) with weight 1462436968 (93.34/col)
Tue Apr 28 14:55:54 2020 sparse part has weight 1071872063 (68.41/col)
Tue Apr 28 14:55:54 2020 saving the first 48 matrix rows for later
Tue Apr 28 14:55:56 2020 matrix includes 64 packed rows
Tue Apr 28 14:55:58 2020 matrix is 15667011 x 15667237 (4594.2 MB) with weight 1171728648 (74.79/col)
Tue Apr 28 14:55:58 2020 sparse part has weight 1047677685 (66.87/col)
Tue Apr 28 14:55:58 2020 using block size 8192 and superblock size 786432 for processor cache size 8192 kB
Tue Apr 28 14:56:59 2020 commencing Lanczos iteration (8 threads)
Tue Apr 28 14:56:59 2020 memory use: 3801.9 MB
Tue Apr 28 14:57:59 2020 linear algebra at 0.0%, ETA 166h29m
Here is the t_d=120 attempt (110 was identical):
Code:
Tue Apr 28 03:55:54 2020 Msieve v. 1.54 (SVN 1018)
Tue Apr 28 03:55:54 2020 random seeds: 8f4b785c cc995584
Tue Apr 28 03:55:54 2020 factoring 1258632688840167527990479924759660967727113832014282715541202945214604444063933854224497640052542892497254083608311352572748398102592769128719761767229021194362137011186342088871 (178 digits)
Tue Apr 28 03:55:55 2020 searching for 15-digit factors
Tue Apr 28 03:55:56 2020 commencing number field sieve (178-digit input)
Tue Apr 28 03:55:56 2020 R0: -21186307570697279371433463611848173
Tue Apr 28 03:55:56 2020 R1: 8845196529223700328463
Tue Apr 28 03:55:56 2020 A0: 2400190655725017956973353574287095281260800
Tue Apr 28 03:55:56 2020 A1: 211014402684521569088239119813217640
Tue Apr 28 03:55:56 2020 A2: -39939568153496532334089408958
Tue Apr 28 03:55:56 2020 A3: -1552818850110399495593
Tue Apr 28 03:55:56 2020 A4: 58933721795178
Tue Apr 28 03:55:56 2020 A5: 294840
Tue Apr 28 03:55:56 2020 skew 1.00, size 3.619e-17, alpha -7.825, combined = 5.648e-16 rroots = 5
Tue Apr 28 03:55:56 2020
Tue Apr 28 03:55:56 2020 commencing relation filtering
Tue Apr 28 03:55:56 2020 setting target matrix density to 120.0
Tue Apr 28 03:55:56 2020 estimated available RAM is 15926.6 MB
Tue Apr 28 03:55:56 2020 commencing duplicate removal, pass 1
. . .
Tue Apr 28 04:33:20 2020 found 90847552 hash collisions in 275423639 relations
Tue Apr 28 04:33:52 2020 added 121850 free relations
Tue Apr 28 04:33:52 2020 commencing duplicate removal, pass 2
Tue Apr 28 04:40:31 2020 found 126526927 duplicates and 149018562 unique relations
Tue Apr 28 04:40:31 2020 memory use: 1449.5 MB
Tue Apr 28 04:40:32 2020 reading ideals above 139919360
Tue Apr 28 04:40:32 2020 commencing singleton removal, initial pass
Tue Apr 28 04:57:17 2020 memory use: 3012.0 MB
Tue Apr 28 04:57:18 2020 reading all ideals from disk
Tue Apr 28 04:57:38 2020 memory use: 2421.4 MB
Tue Apr 28 04:57:42 2020 commencing in-memory singleton removal
Tue Apr 28 04:57:47 2020 begin with 149018562 relations and 146733511 unique ideals
Tue Apr 28 04:58:31 2020 reduce to 55424518 relations and 38967191 ideals in 19 passes
Tue Apr 28 04:58:31 2020 max relations containing the same ideal: 20
Tue Apr 28 04:58:34 2020 reading ideals above 720000
Tue Apr 28 04:58:34 2020 commencing singleton removal, initial pass
Tue Apr 28 05:09:26 2020 memory use: 1506.0 MB
Tue Apr 28 05:09:26 2020 reading all ideals from disk
Tue Apr 28 05:09:45 2020 memory use: 2195.2 MB
Tue Apr 28 05:09:51 2020 keeping 54432776 ideals with weight <= 200, target excess is 304675
Tue Apr 28 05:09:56 2020 commencing in-memory singleton removal
Tue Apr 28 05:10:01 2020 begin with 55424518 relations and 54432776 unique ideals
Tue Apr 28 05:11:08 2020 reduce to 54906475 relations and 53914041 ideals in 14 passes
Tue Apr 28 05:11:08 2020 max relations containing the same ideal: 200
Tue Apr 28 05:11:34 2020 removing 3380876 relations and 3061371 ideals in 319505 cliques
Tue Apr 28 05:11:36 2020 commencing in-memory singleton removal
Tue Apr 28 05:11:40 2020 begin with 51525599 relations and 53914041 unique ideals
Tue Apr 28 05:12:26 2020 reduce to 51370877 relations and 50696663 ideals in 10 passes
Tue Apr 28 05:12:26 2020 max relations containing the same ideal: 196
Tue Apr 28 05:12:51 2020 removing 2526879 relations and 2207374 ideals in 319505 cliques
Tue Apr 28 05:12:52 2020 commencing in-memory singleton removal
Tue Apr 28 05:12:56 2020 begin with 48843998 relations and 50696663 unique ideals
Tue Apr 28 05:13:34 2020 reduce to 48745655 relations and 48390321 ideals in 9 passes
Tue Apr 28 05:13:34 2020 max relations containing the same ideal: 192
Tue Apr 28 05:14:06 2020 relations with 0 large ideals: 1040
Tue Apr 28 05:14:06 2020 relations with 1 large ideals: 1286
Tue Apr 28 05:14:06 2020 relations with 2 large ideals: 18987
Tue Apr 28 05:14:06 2020 relations with 3 large ideals: 185362
Tue Apr 28 05:14:06 2020 relations with 4 large ideals: 1069605
Tue Apr 28 05:14:06 2020 relations with 5 large ideals: 3821977
Tue Apr 28 05:14:06 2020 relations with 6 large ideals: 8808829
Tue Apr 28 05:14:06 2020 relations with 7+ large ideals: 34838569
Tue Apr 28 05:14:06 2020 commencing 2-way merge
Tue Apr 28 05:14:40 2020 reduce to 28658603 relation sets and 28303270 unique ideals
Tue Apr 28 05:14:40 2020 ignored 1 oversize relation sets
Tue Apr 28 05:14:40 2020 commencing full merge
Tue Apr 28 05:35:26 2020 memory use: 1309.7 MB
Tue Apr 28 05:35:26 2020 found 205766 cycles, need 5904375
Tue Apr 28 05:35:26 2020 too few cycles, matrix probably cannot build
EdH is offline   Reply With Quote
Old 2020-04-30, 16:23   #85
VBCurtis
 
VBCurtis's Avatar
 
"Curtis"
Feb 2005
Riverside, CA

23×13×43 Posts
Default

15.6M at TD 70 isn't so big to send me back to sieving (unlike Charybdis' 3LP job, which at 19M does send us back for more relations). Not getting a matrix at TD 100 means you barely built a matrix; nothing wrong with this, merely a "matrix could be faster with a few million more rels" situation. I personally benefit, since you've directed the farm to the C198 sieve project while this matrix runs!

So, we have data that 3LP yields larger matrices- as one would expect, though having same-sized jobs from the same sieve software and same LP settings come out 30% different in size is a bit more than I expected. The sieve speedup is so big that it's worth the tradeoff; I think we just need to accept 14-16M matrix sizes for C180s with 3LP.

In the next day or so, I'll post what I think are best files for C175 and C180; we happen to be optimizing for C177 and 178, but the lessons should apply for the whole range of C173-182 that these two files would cover. Development isn't finished, but I think it's helpful to not have to scroll through the thread to find the current suggestions.
VBCurtis is offline   Reply With Quote
Old 2020-04-30, 16:49   #86
charybdis
 
Apr 2020

11310 Posts
Default

Quote:
Originally Posted by VBCurtis View Post
I imagine you're going to sieve up to about the same time as the C177, and end up with a matrix somewhere near 15-16M. That's still a big win, to achieve the same sieve time with a poly 17% worse! I await your data.
Good shout, I got this with 60M CPU-seconds of sieving (TD 120 didn't build):

Code:
Thu Apr 30 15:20:48 2020  commencing relation filtering
Thu Apr 30 15:20:48 2020  setting target matrix density to 110.0
Thu Apr 30 15:20:48 2020  estimated available RAM is 15845.4 MB
Thu Apr 30 15:20:48 2020  commencing duplicate removal, pass 1
...
Thu Apr 30 15:55:36 2020  found 104136282 hash collisions in 353025118 relations
Thu Apr 30 15:55:58 2020  commencing duplicate removal, pass 2
Thu Apr 30 16:02:44 2020  found 135256670 duplicates and 217768448 unique relations
...
Thu Apr 30 17:23:44 2020  matrix is 15570888 x 15571108 (6664.9 MB) with weight 1761668903 (113.14/col)
Thu Apr 30 17:23:44 2020  sparse part has weight 1591448342 (102.21/col)
Thu Apr 30 17:23:44 2020  using block size 8192 and superblock size 884736 for processor cache size 9216 kB
Thu Apr 30 17:24:26 2020  commencing Lanczos iteration (6 threads)
Thu Apr 30 17:24:26 2020  memory use: 6339.7 MB
Thu Apr 30 17:25:05 2020  linear algebra at 0.0%, ETA 105h12m
I'll sieve a bit more to try and get a matrix at TD 120.

Curtis - I'll do a c178 with 3LP and I=15 next as you suggested; please could you give me some parameters to try?

Last fiddled with by charybdis on 2020-04-30 at 16:51
charybdis is offline   Reply With Quote
Old 2020-04-30, 17:03   #87
RichD
 
RichD's Avatar
 
Sep 2008
Kansas

C6916 Posts
Default

Quote:
Originally Posted by EdH View Post
I have msieve doing LA on the 178 cofactor of 12-7_945L now.

Msieve refused to build at t_d=120 and 110, so I tried it at default and it came up with the following. Of note, every one of the first 1.2M relations showed error -11. Here is the successful run which is now at about 120 hours to finish:
That's an awfully high dup rate. Did you sieve on the -a side?
RichD is offline   Reply With Quote
Old 2020-04-30, 18:09   #88
EdH
 
EdH's Avatar
 
"Ed Hall"
Dec 2009
Adirondack Mtns

5·13·53 Posts
Default

Quote:
Originally Posted by RichD View Post
That's an awfully high dup rate. Did you sieve on the -a side?
CADO-NFS should have defaulted to the algebraic side, as there was no task telling it different. But, I don't know if I can verify that to be the case.
EdH is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Integers congruent to last two decimal digits mod 23 enzocreti enzocreti 1 2020-03-03 18:38
Twin Primes with 128 Decimal Digits tuckerkao Miscellaneous Math 2 2020-02-16 06:23
Playing with decimal representation Nick Puzzles 9 2013-02-13 17:17
Decimal Value of Mersenne Prime vsuite GPU Computing 11 2011-02-02 04:47
Decimal Places Corbyguy Software 3 2008-06-09 18:09

All times are UTC. The time now is 20:45.

Wed Nov 25 20:45:04 UTC 2020 up 76 days, 17:56, 3 users, load averages: 1.18, 1.47, 1.54

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.