Some CADO-NFS Work At Around 175-180 Decimal Digits - Page 8

VBCurtis · 2020-04-25, 06:25

I tried ncurves1 = 16, ETA went up 3 days.

I tried lim0=140M, lim1=100M, ETA went up 8-10 days.

So no changes to the suggestions from last post.

charybdis · 2020-04-25, 12:17

Just want to make sure I've got this right:

Code:

tasks.A = 28
tasks.qmin = 500000
tasks.lim0 = 100000000
tasks.lim1 = 140000000
tasks.lpb0 = 31
tasks.lpb1 = 32
tasks.sieve.lambda0 = 1.88
tasks.sieve.mfb0 = 58
tasks.sieve.mfb1 = 90
tasks.sieve.ncurves0 = 20
tasks.sieve.ncurves1 = 13
tasks.sieve.qrange = 10000
tasks.sieve.rels_wanted = 320000000

VBCurtis · 2020-04-25, 16:08

Precisely. Sorry I was too lazy to do that myself for you.

charybdis · 2020-04-25, 16:34

Quote:

Originally Posted by VBCurtis

Precisely. Sorry I was too lazy to do that myself for you.

No worries at all - if anything I'm the lazy one here.

charybdis · 2020-04-30, 01:48

Managed to get a matrix with just over 320M relations after sieving Q from 500k to 136M, but it's a big one:

Code:

Thu Apr 30 00:23:42 2020  commencing relation filtering
Thu Apr 30 00:23:42 2020  setting target matrix density to 100.0
Thu Apr 30 00:23:42 2020  estimated available RAM is 15845.4 MB
Thu Apr 30 00:23:43 2020  commencing duplicate removal, pass 1
...
Thu Apr 30 00:55:20 2020  found 94773795 hash collisions in 321245930 relations
Thu Apr 30 00:55:41 2020  commencing duplicate removal, pass 2
Thu Apr 30 01:01:49 2020  found 122972626 duplicates and 198273304 unique relations
Thu Apr 30 01:01:49 2020  memory use: 2387.0 MB
Thu Apr 30 01:01:50 2020  reading ideals above 151584768
Thu Apr 30 01:01:50 2020  commencing singleton removal, initial pass
Thu Apr 30 01:17:31 2020  memory use: 5512.0 MB
Thu Apr 30 01:17:32 2020  reading all ideals from disk
Thu Apr 30 01:17:52 2020  memory use: 3537.9 MB
Thu Apr 30 01:17:57 2020  commencing in-memory singleton removal
Thu Apr 30 01:18:03 2020  begin with 198273304 relations and 195834296 unique ideals
Thu Apr 30 01:18:55 2020  reduce to 86504203 relations and 67341595 ideals in 18 passes
Thu Apr 30 01:18:55 2020  max relations containing the same ideal: 23
Thu Apr 30 01:19:01 2020  reading ideals above 720000
Thu Apr 30 01:19:01 2020  commencing singleton removal, initial pass
Thu Apr 30 01:30:14 2020  memory use: 2756.0 MB
Thu Apr 30 01:30:14 2020  reading all ideals from disk
Thu Apr 30 01:30:34 2020  memory use: 3467.0 MB
Thu Apr 30 01:30:41 2020  keeping 83938241 ideals with weight <= 200, target excess is 450665
Thu Apr 30 01:30:48 2020  commencing in-memory singleton removal
Thu Apr 30 01:30:53 2020  begin with 86504208 relations and 83938241 unique ideals
Thu Apr 30 01:32:07 2020  reduce to 86349299 relations and 83783289 ideals in 14 passes
Thu Apr 30 01:32:07 2020  max relations containing the same ideal: 200
Thu Apr 30 01:32:38 2020  removing 4545236 relations and 4145236 ideals in 400000 cliques
Thu Apr 30 01:32:39 2020  commencing in-memory singleton removal
Thu Apr 30 01:32:44 2020  begin with 81804063 relations and 83783289 unique ideals
Thu Apr 30 01:33:34 2020  reduce to 81605208 relations and 79437817 ideals in 10 passes
Thu Apr 30 01:33:34 2020  max relations containing the same ideal: 199
Thu Apr 30 01:34:03 2020  removing 3387725 relations and 2987725 ideals in 400000 cliques
Thu Apr 30 01:34:05 2020  commencing in-memory singleton removal
Thu Apr 30 01:34:10 2020  begin with 78217483 relations and 79437817 unique ideals
Thu Apr 30 01:34:52 2020  reduce to 78096236 relations and 76328142 ideals in 9 passes
Thu Apr 30 01:34:52 2020  max relations containing the same ideal: 194
Thu Apr 30 01:35:21 2020  removing 3022251 relations and 2622251 ideals in 400000 cliques
Thu Apr 30 01:35:22 2020  commencing in-memory singleton removal
Thu Apr 30 01:35:27 2020  begin with 75073985 relations and 76328142 unique ideals
Thu Apr 30 01:36:03 2020  reduce to 74969366 relations and 73600718 ideals in 8 passes
Thu Apr 30 01:36:03 2020  max relations containing the same ideal: 190
Thu Apr 30 01:36:30 2020  removing 2824610 relations and 2424610 ideals in 400000 cliques
Thu Apr 30 01:36:31 2020  commencing in-memory singleton removal
Thu Apr 30 01:36:36 2020  begin with 72144756 relations and 73600718 unique ideals
Thu Apr 30 01:37:15 2020  reduce to 72050844 relations and 71081672 ideals in 9 passes
Thu Apr 30 01:37:15 2020  max relations containing the same ideal: 188
Thu Apr 30 01:37:41 2020  removing 2697707 relations and 2297707 ideals in 400000 cliques
Thu Apr 30 01:37:42 2020  commencing in-memory singleton removal
Thu Apr 30 01:37:47 2020  begin with 69353137 relations and 71081672 unique ideals
Thu Apr 30 01:38:24 2020  reduce to 69262639 relations and 68692948 ideals in 9 passes
Thu Apr 30 01:38:24 2020  max relations containing the same ideal: 180
Thu Apr 30 01:38:49 2020  removing 430114 relations and 383195 ideals in 46919 cliques
Thu Apr 30 01:38:50 2020  commencing in-memory singleton removal
Thu Apr 30 01:38:54 2020  begin with 68832525 relations and 68692948 unique ideals
Thu Apr 30 01:39:23 2020  reduce to 68830278 relations and 68307505 ideals in 7 passes
Thu Apr 30 01:39:23 2020  max relations containing the same ideal: 180
Thu Apr 30 01:39:35 2020  relations with 0 large ideals: 1698
Thu Apr 30 01:39:35 2020  relations with 1 large ideals: 2688
Thu Apr 30 01:39:35 2020  relations with 2 large ideals: 42577
Thu Apr 30 01:39:35 2020  relations with 3 large ideals: 386727
Thu Apr 30 01:39:35 2020  relations with 4 large ideals: 2037316
Thu Apr 30 01:39:35 2020  relations with 5 large ideals: 6689570
Thu Apr 30 01:39:35 2020  relations with 6 large ideals: 14111696
Thu Apr 30 01:39:35 2020  relations with 7+ large ideals: 45558006
Thu Apr 30 01:39:35 2020  commencing 2-way merge
Thu Apr 30 01:40:12 2020  reduce to 41453428 relation sets and 40930655 unique ideals
Thu Apr 30 01:40:12 2020  commencing full merge
Thu Apr 30 01:50:00 2020  memory use: 4714.1 MB
Thu Apr 30 01:50:02 2020  found 19338169 cycles, need 19310855
Thu Apr 30 01:50:07 2020  weight of 19310855 cycles is about 1931089230 (100.00/cycle)
Thu Apr 30 01:50:07 2020  distribution of cycle lengths:
Thu Apr 30 01:50:07 2020  1 relations: 2082996
Thu Apr 30 01:50:07 2020  2 relations: 1886001
Thu Apr 30 01:50:07 2020  3 relations: 1865997
Thu Apr 30 01:50:07 2020  4 relations: 1724216
Thu Apr 30 01:50:07 2020  5 relations: 1575985
Thu Apr 30 01:50:07 2020  6 relations: 1439418
Thu Apr 30 01:50:07 2020  7 relations: 1264045
Thu Apr 30 01:50:07 2020  8 relations: 1107001
Thu Apr 30 01:50:07 2020  9 relations: 986442
Thu Apr 30 01:50:07 2020  10+ relations: 5378754
Thu Apr 30 01:50:07 2020  heaviest cycle: 28 relations
Thu Apr 30 01:50:12 2020  commencing cycle optimization
Thu Apr 30 01:50:35 2020  start with 137988190 relations
Thu Apr 30 01:53:40 2020  pruned 3943658 relations
Thu Apr 30 01:53:41 2020  memory use: 4233.3 MB
Thu Apr 30 01:53:41 2020  distribution of cycle lengths:
Thu Apr 30 01:53:41 2020  1 relations: 2082996
Thu Apr 30 01:53:41 2020  2 relations: 1934591
Thu Apr 30 01:53:41 2020  3 relations: 1936470
Thu Apr 30 01:53:41 2020  4 relations: 1772730
Thu Apr 30 01:53:41 2020  5 relations: 1624454
Thu Apr 30 01:53:41 2020  6 relations: 1464862
Thu Apr 30 01:53:41 2020  7 relations: 1283296
Thu Apr 30 01:53:41 2020  8 relations: 1116240
Thu Apr 30 01:53:41 2020  9 relations: 987568
Thu Apr 30 01:53:41 2020  10+ relations: 5107648
Thu Apr 30 01:53:41 2020  heaviest cycle: 28 relations
Thu Apr 30 01:54:12 2020  RelProcTime: 5430
Thu Apr 30 01:54:18 2020  
Thu Apr 30 01:54:18 2020  commencing linear algebra
Thu Apr 30 01:54:19 2020  read 19310855 cycles
Thu Apr 30 01:54:50 2020  cycles contain 68397133 unique relations
Thu Apr 30 02:02:14 2020  read 68397133 relations
Thu Apr 30 02:03:45 2020  using 20 quadratic characters above 4294917295
Thu Apr 30 02:08:07 2020  building initial matrix
Thu Apr 30 02:18:19 2020  memory use: 9234.0 MB
Thu Apr 30 02:18:43 2020  read 19310855 cycles
Thu Apr 30 02:18:45 2020  matrix is 19310678 x 19310855 (7913.5 MB) with weight 2405426155 (124.56/col)
Thu Apr 30 02:18:45 2020  sparse part has weight 1842743275 (95.43/col)
Thu Apr 30 02:21:26 2020  filtering completed in 2 passes
Thu Apr 30 02:21:29 2020  matrix is 19308744 x 19308921 (7913.3 MB) with weight 2405349100 (124.57/col)
Thu Apr 30 02:21:29 2020  sparse part has weight 1842727716 (95.43/col)
Thu Apr 30 02:23:23 2020  matrix starts at (0, 0)
Thu Apr 30 02:23:26 2020  matrix is 19308744 x 19308921 (7913.3 MB) with weight 2405349100 (124.57/col)
Thu Apr 30 02:23:26 2020  sparse part has weight 1842727716 (95.43/col)
Thu Apr 30 02:23:26 2020  saving the first 48 matrix rows for later
Thu Apr 30 02:23:28 2020  matrix includes 64 packed rows
Thu Apr 30 02:23:30 2020  matrix is 19308696 x 19308921 (7658.0 MB) with weight 2009697914 (104.08/col)
Thu Apr 30 02:23:30 2020  sparse part has weight 1814420535 (93.97/col)
Thu Apr 30 02:23:30 2020  using block size 8192 and superblock size 884736 for processor cache size 9216 kB
Thu Apr 30 02:24:23 2020  commencing Lanczos iteration (6 threads)
Thu Apr 30 02:24:23 2020  memory use: 7355.4 MB
Thu Apr 30 02:25:29 2020  linear algebra at 0.0%, ETA 223h 1m

The ETA has come down to ~168h, but that's still inconveniently long - I'll keep on sieving.

Sieving (so far) took 52.9M CPU-seconds, compared to 58.6M for the fastest c177 I ran (with I=15 31/32), despite the poly score being 17% worse. So it seems 3LP may be the way to go if you don't care much about the difficulty of the matrix, for example if you're running a job this size on a single machine where the sieving could take months. We'll see whether the comparison is still favourable when I've sieved enough to get a nice matrix; I imagine it might not be.

VBCurtis · 2020-04-30, 03:24

I agree that this is a terrific speedup for a single machine job- 6 * 86400 * 7 is about 3.5M cpu-sec for the matrix, so your complete job would finish in less time than the C177 took to sieve!

It's also unclear if I=15 would be faster; with 2LP on C177 you found 10% speedup there, so this could get faster still.

That tells me C178 is too late to begin 3LP; a C178 job should not be faster than a C177, especially with those poly scores. So, we should try 3LP on the C175 file.

I imagine you're going to sieve up to about the same time as the C177, and end up with a matrix somewhere near 15-16M. That's still a big win, to achieve the same sieve time with a poly 17% worse! I await your data.

EdH · 2020-04-30, 15:37

I have msieve doing LA on the 178 cofactor of 12-7_945L now. Here are the Total times I can find for CADO-NFS, which crashed due to insufficient memory during full merge:

Code:

PID28474 2020-04-20 16:27:18,736 Info:Polynomial Selection (size optimized): Total time: 2.65212e+06
PID31307 2020-04-20 17:37:53,424 Info:Polynomial Selection (size optimized): Total time: 2.65212e+06
PID31307 2020-04-20 18:00:56,820 Info:Polynomial Selection (root optimized): Total time: 58448.6
PID8786 2020-04-20 22:45:07,422 Info:Polynomial Selection (size optimized): Total time: 2.65212e+06
PID8786 2020-04-20 22:45:07,425 Info:Polynomial Selection (root optimized): Total time: 58448.6
PID8786 2020-04-28 02:06:51,549 Info:Lattice Sieving: Total time: 2.02059e+07s

Msieve refused to build at t_d=120 and 110, so I tried it at default and it came up with the following. Of note, every one of the first 1.2M relations showed error -11. Here is the successful run which is now at about 120 hours to finish:

Code:

Tue Apr 28 13:07:12 2020  Msieve v. 1.54 (SVN 1018)
Tue Apr 28 13:07:12 2020  random seeds: 6cef034c 096382c6
Tue Apr 28 13:07:12 2020  factoring 1258632688840167527990479924759660967727113832014282715541202945214604444063933854224497640052542892497254083608311352572748398102592769128719761767229021194362137011186342088871 (178 digits)
Tue Apr 28 13:07:13 2020  searching for 15-digit factors
Tue Apr 28 13:07:13 2020  commencing number field sieve (178-digit input)
Tue Apr 28 13:07:13 2020  R0: -21186307570697279371433463611848173
Tue Apr 28 13:07:13 2020  R1: 8845196529223700328463
Tue Apr 28 13:07:13 2020  A0: 2400190655725017956973353574287095281260800
Tue Apr 28 13:07:13 2020  A1: 211014402684521569088239119813217640
Tue Apr 28 13:07:13 2020  A2: -39939568153496532334089408958
Tue Apr 28 13:07:13 2020  A3: -1552818850110399495593
Tue Apr 28 13:07:13 2020  A4: 58933721795178
Tue Apr 28 13:07:13 2020  A5: 294840
Tue Apr 28 13:07:13 2020  skew 1.00, size 3.619e-17, alpha -7.825, combined = 5.648e-16 rroots = 5
Tue Apr 28 13:07:13 2020  
Tue Apr 28 13:07:13 2020  commencing relation filtering
Tue Apr 28 13:07:13 2020  estimated available RAM is 15926.6 MB
Tue Apr 28 13:07:13 2020  commencing duplicate removal, pass 1
Tue Apr 28 13:07:13 2020  error -11 reading relation 0
. . . [ Includes every relation in between ]
Tue Apr 28 13:07:35 2020  error -11 reading relation 1216455
Tue Apr 28 13:07:19 2020 error -1 reading relation 345340
Tue Apr 28 13:07:29 2020 error -1 reading relation 907378
. . .
Tue Apr 28 13:42:35 2020 error -1 reading relation 266916827
Tue Apr 28 13:43:47 2020 error -1 reading relation 276189407
Tue Apr 28 13:43:50 2020 found 90847552 hash collisions in 275423639 relations
Tue Apr 28 13:44:23 2020 added 121850 free relations
Tue Apr 28 13:44:23 2020 commencing duplicate removal, pass 2
Tue Apr 28 13:51:04 2020 found 126526927 duplicates and 149018562 unique relations
Tue Apr 28 13:51:04 2020 memory use: 1449.5 MB
Tue Apr 28 13:51:04 2020 reading ideals above 139919360
Tue Apr 28 13:51:04 2020 commencing singleton removal, initial pass
Tue Apr 28 14:07:21 2020 memory use: 3012.0 MB
Tue Apr 28 14:07:21 2020 reading all ideals from disk
Tue Apr 28 14:07:34 2020 memory use: 2421.4 MB
Tue Apr 28 14:07:39 2020 commencing in-memory singleton removal
Tue Apr 28 14:07:43 2020 begin with 149018562 relations and 146733511 unique ideals
Tue Apr 28 14:08:27 2020 reduce to 55424518 relations and 38967191 ideals in 19 passes
Tue Apr 28 14:08:27 2020 max relations containing the same ideal: 20
Tue Apr 28 14:08:29 2020 reading ideals above 720000
Tue Apr 28 14:08:30 2020 commencing singleton removal, initial pass
Tue Apr 28 14:19:03 2020 memory use: 1506.0 MB
Tue Apr 28 14:19:03 2020 reading all ideals from disk
Tue Apr 28 14:19:15 2020 memory use: 2195.2 MB
Tue Apr 28 14:19:21 2020 keeping 54432776 ideals with weight <= 200, target excess is 304675
Tue Apr 28 14:19:27 2020 commencing in-memory singleton removal
Tue Apr 28 14:19:32 2020 begin with 55424518 relations and 54432776 unique ideals
Tue Apr 28 14:20:39 2020 reduce to 54906475 relations and 53914041 ideals in 14 passes
Tue Apr 28 14:20:39 2020 max relations containing the same ideal: 200
Tue Apr 28 14:21:05 2020 removing 3380876 relations and 3061371 ideals in 319505 cliques
Tue Apr 28 14:21:06 2020 commencing in-memory singleton removal
Tue Apr 28 14:21:11 2020 begin with 51525599 relations and 53914041 unique ideals
Tue Apr 28 14:21:56 2020 reduce to 51370877 relations and 50696663 ideals in 10 passes
Tue Apr 28 14:21:56 2020 max relations containing the same ideal: 196
Tue Apr 28 14:22:20 2020 removing 2526879 relations and 2207374 ideals in 319505 cliques
Tue Apr 28 14:22:21 2020 commencing in-memory singleton removal
Tue Apr 28 14:22:26 2020 begin with 48843998 relations and 50696663 unique ideals
Tue Apr 28 14:23:04 2020 reduce to 48745655 relations and 48390321 ideals in 9 passes
Tue Apr 28 14:23:04 2020 max relations containing the same ideal: 192
Tue Apr 28 14:23:35 2020 relations with 0 large ideals: 1040
Tue Apr 28 14:23:35 2020 relations with 1 large ideals: 1286
Tue Apr 28 14:23:35 2020 relations with 2 large ideals: 18987
Tue Apr 28 14:23:35 2020 relations with 3 large ideals: 185362
Tue Apr 28 14:23:35 2020 relations with 4 large ideals: 1069605
Tue Apr 28 14:23:35 2020 relations with 5 large ideals: 3821977
Tue Apr 28 14:23:35 2020 relations with 6 large ideals: 8808829
Tue Apr 28 14:23:35 2020 relations with 7+ large ideals: 34838569
Tue Apr 28 14:23:35 2020 commencing 2-way merge
Tue Apr 28 14:24:10 2020 reduce to 28658603 relation sets and 28303270 unique ideals
Tue Apr 28 14:24:10 2020 ignored 1 oversize relation sets
Tue Apr 28 14:24:10 2020 commencing full merge
Tue Apr 28 14:31:02 2020 memory use: 3240.8 MB
Tue Apr 28 14:31:06 2020 found 15724964 cycles, need 15677470
Tue Apr 28 14:31:11 2020 weight of 15677470 cycles is about 1097547456 (70.01/cycle)
Tue Apr 28 14:31:11 2020 distribution of cycle lengths:
Tue Apr 28 14:31:11 2020 1 relations: 2291729
Tue Apr 28 14:31:11 2020 2 relations: 2282984
Tue Apr 28 14:31:11 2020 3 relations: 2192031
Tue Apr 28 14:31:11 2020 4 relations: 1842581
Tue Apr 28 14:31:11 2020 5 relations: 1578365
Tue Apr 28 14:31:11 2020 6 relations: 1260813
Tue Apr 28 14:31:11 2020 7 relations: 992679
Tue Apr 28 14:31:11 2020 8 relations: 779990
Tue Apr 28 14:31:11 2020 9 relations: 616680
Tue Apr 28 14:31:11 2020 10+ relations: 1839618
Tue Apr 28 14:31:11 2020 heaviest cycle: 22 relations
Tue Apr 28 14:31:14 2020 commencing cycle optimization
Tue Apr 28 14:31:34 2020 start with 77754198 relations
Tue Apr 28 14:32:55 2020 pruned 1290229 relations
Tue Apr 28 14:32:56 2020 memory use: 2790.2 MB
Tue Apr 28 14:32:56 2020 distribution of cycle lengths:
Tue Apr 28 14:32:56 2020 1 relations: 2291729
Tue Apr 28 14:32:56 2020 2 relations: 2325968
Tue Apr 28 14:32:56 2020 3 relations: 2254390
Tue Apr 28 14:32:56 2020 4 relations: 1867541
Tue Apr 28 14:32:56 2020 5 relations: 1592479
Tue Apr 28 14:32:56 2020 6 relations: 1254891
Tue Apr 28 14:32:56 2020 7 relations: 982745
Tue Apr 28 14:32:56 2020 8 relations: 765997
Tue Apr 28 14:32:56 2020 9 relations: 602147
Tue Apr 28 14:32:56 2020 10+ relations: 1739583
Tue Apr 28 14:32:56 2020 heaviest cycle: 22 relations
Tue Apr 28 14:33:16 2020 RelProcTime: 5163
Tue Apr 28 14:33:22 2020
Tue Apr 28 14:33:22 2020 commencing linear algebra
Tue Apr 28 14:33:24 2020 read 15677470 cycles
Tue Apr 28 14:33:44 2020 cycles contain 48314663 unique relations
Tue Apr 28 14:41:24 2020 read 48314663 relations
Tue Apr 28 14:42:25 2020 using 20 quadratic characters above 4294917295
Tue Apr 28 14:45:53 2020 building initial matrix
Tue Apr 28 14:51:45 2020 memory use: 6545.9 MB
Tue Apr 28 14:51:50 2020 read 15677470 cycles
Tue Apr 28 14:51:53 2020 matrix is 15677291 x 15677470 (4747.0 MB) with weight 1462757761 (93.30/col)
Tue Apr 28 14:51:53 2020 sparse part has weight 1071935640 (68.37/col)
Tue Apr 28 14:54:32 2020 filtering completed in 2 passes
Tue Apr 28 14:54:35 2020 matrix is 15667059 x 15667237 (4746.3 MB) with weight 1462436968 (93.34/col)
Tue Apr 28 14:54:35 2020 sparse part has weight 1071872063 (68.41/col)
Tue Apr 28 14:55:51 2020 matrix starts at (0, 0)
Tue Apr 28 14:55:54 2020 matrix is 15667059 x 15667237 (4746.3 MB) with weight 1462436968 (93.34/col)
Tue Apr 28 14:55:54 2020 sparse part has weight 1071872063 (68.41/col)
Tue Apr 28 14:55:54 2020 saving the first 48 matrix rows for later
Tue Apr 28 14:55:56 2020 matrix includes 64 packed rows
Tue Apr 28 14:55:58 2020 matrix is 15667011 x 15667237 (4594.2 MB) with weight 1171728648 (74.79/col)
Tue Apr 28 14:55:58 2020 sparse part has weight 1047677685 (66.87/col)
Tue Apr 28 14:55:58 2020 using block size 8192 and superblock size 786432 for processor cache size 8192 kB
Tue Apr 28 14:56:59 2020 commencing Lanczos iteration (8 threads)
Tue Apr 28 14:56:59 2020 memory use: 3801.9 MB
Tue Apr 28 14:57:59 2020 linear algebra at 0.0%, ETA 166h29m

Here is the t_d=120 attempt (110 was identical):

Code:

Tue Apr 28 03:55:54 2020 Msieve v. 1.54 (SVN 1018)
Tue Apr 28 03:55:54 2020 random seeds: 8f4b785c cc995584
Tue Apr 28 03:55:54 2020 factoring 1258632688840167527990479924759660967727113832014282715541202945214604444063933854224497640052542892497254083608311352572748398102592769128719761767229021194362137011186342088871 (178 digits)
Tue Apr 28 03:55:55 2020 searching for 15-digit factors
Tue Apr 28 03:55:56 2020 commencing number field sieve (178-digit input)
Tue Apr 28 03:55:56 2020 R0: -21186307570697279371433463611848173
Tue Apr 28 03:55:56 2020 R1: 8845196529223700328463
Tue Apr 28 03:55:56 2020 A0: 2400190655725017956973353574287095281260800
Tue Apr 28 03:55:56 2020 A1: 211014402684521569088239119813217640
Tue Apr 28 03:55:56 2020 A2: -39939568153496532334089408958
Tue Apr 28 03:55:56 2020 A3: -1552818850110399495593
Tue Apr 28 03:55:56 2020 A4: 58933721795178
Tue Apr 28 03:55:56 2020 A5: 294840
Tue Apr 28 03:55:56 2020 skew 1.00, size 3.619e-17, alpha -7.825, combined = 5.648e-16 rroots = 5
Tue Apr 28 03:55:56 2020
Tue Apr 28 03:55:56 2020 commencing relation filtering
Tue Apr 28 03:55:56 2020 setting target matrix density to 120.0
Tue Apr 28 03:55:56 2020 estimated available RAM is 15926.6 MB
Tue Apr 28 03:55:56 2020 commencing duplicate removal, pass 1
. . .
Tue Apr 28 04:33:20 2020 found 90847552 hash collisions in 275423639 relations
Tue Apr 28 04:33:52 2020 added 121850 free relations
Tue Apr 28 04:33:52 2020 commencing duplicate removal, pass 2
Tue Apr 28 04:40:31 2020 found 126526927 duplicates and 149018562 unique relations
Tue Apr 28 04:40:31 2020 memory use: 1449.5 MB
Tue Apr 28 04:40:32 2020 reading ideals above 139919360
Tue Apr 28 04:40:32 2020 commencing singleton removal, initial pass
Tue Apr 28 04:57:17 2020 memory use: 3012.0 MB
Tue Apr 28 04:57:18 2020 reading all ideals from disk
Tue Apr 28 04:57:38 2020 memory use: 2421.4 MB
Tue Apr 28 04:57:42 2020 commencing in-memory singleton removal
Tue Apr 28 04:57:47 2020 begin with 149018562 relations and 146733511 unique ideals
Tue Apr 28 04:58:31 2020 reduce to 55424518 relations and 38967191 ideals in 19 passes
Tue Apr 28 04:58:31 2020 max relations containing the same ideal: 20
Tue Apr 28 04:58:34 2020 reading ideals above 720000
Tue Apr 28 04:58:34 2020 commencing singleton removal, initial pass
Tue Apr 28 05:09:26 2020 memory use: 1506.0 MB
Tue Apr 28 05:09:26 2020 reading all ideals from disk
Tue Apr 28 05:09:45 2020 memory use: 2195.2 MB
Tue Apr 28 05:09:51 2020 keeping 54432776 ideals with weight <= 200, target excess is 304675
Tue Apr 28 05:09:56 2020 commencing in-memory singleton removal
Tue Apr 28 05:10:01 2020 begin with 55424518 relations and 54432776 unique ideals
Tue Apr 28 05:11:08 2020 reduce to 54906475 relations and 53914041 ideals in 14 passes
Tue Apr 28 05:11:08 2020 max relations containing the same ideal: 200
Tue Apr 28 05:11:34 2020 removing 3380876 relations and 3061371 ideals in 319505 cliques
Tue Apr 28 05:11:36 2020 commencing in-memory singleton removal
Tue Apr 28 05:11:40 2020 begin with 51525599 relations and 53914041 unique ideals
Tue Apr 28 05:12:26 2020 reduce to 51370877 relations and 50696663 ideals in 10 passes
Tue Apr 28 05:12:26 2020 max relations containing the same ideal: 196
Tue Apr 28 05:12:51 2020 removing 2526879 relations and 2207374 ideals in 319505 cliques
Tue Apr 28 05:12:52 2020 commencing in-memory singleton removal
Tue Apr 28 05:12:56 2020 begin with 48843998 relations and 50696663 unique ideals
Tue Apr 28 05:13:34 2020 reduce to 48745655 relations and 48390321 ideals in 9 passes
Tue Apr 28 05:13:34 2020 max relations containing the same ideal: 192
Tue Apr 28 05:14:06 2020 relations with 0 large ideals: 1040
Tue Apr 28 05:14:06 2020 relations with 1 large ideals: 1286
Tue Apr 28 05:14:06 2020 relations with 2 large ideals: 18987
Tue Apr 28 05:14:06 2020 relations with 3 large ideals: 185362
Tue Apr 28 05:14:06 2020 relations with 4 large ideals: 1069605
Tue Apr 28 05:14:06 2020 relations with 5 large ideals: 3821977
Tue Apr 28 05:14:06 2020 relations with 6 large ideals: 8808829
Tue Apr 28 05:14:06 2020 relations with 7+ large ideals: 34838569
Tue Apr 28 05:14:06 2020 commencing 2-way merge
Tue Apr 28 05:14:40 2020 reduce to 28658603 relation sets and 28303270 unique ideals
Tue Apr 28 05:14:40 2020 ignored 1 oversize relation sets
Tue Apr 28 05:14:40 2020 commencing full merge
Tue Apr 28 05:35:26 2020 memory use: 1309.7 MB
Tue Apr 28 05:35:26 2020 found 205766 cycles, need 5904375
Tue Apr 28 05:35:26 2020 too few cycles, matrix probably cannot build

VBCurtis · 2020-04-30, 16:23

15.6M at TD 70 isn't so big to send me back to sieving (unlike Charybdis' 3LP job, which at 19M does send us back for more relations). Not getting a matrix at TD 100 means you barely built a matrix; nothing wrong with this, merely a "matrix could be faster with a few million more rels" situation. I personally benefit, since you've directed the farm to the C198 sieve project while this matrix runs!

So, we have data that 3LP yields larger matrices- as one would expect, though having same-sized jobs from the same sieve software and same LP settings come out 30% different in size is a bit more than I expected. The sieve speedup is so big that it's worth the tradeoff; I think we just need to accept 14-16M matrix sizes for C180s with 3LP.

In the next day or so, I'll post what I think are best files for C175 and C180; we happen to be optimizing for C177 and 178, but the lessons should apply for the whole range of C173-182 that these two files would cover. Development isn't finished, but I think it's helpful to not have to scroll through the thread to find the current suggestions.

charybdis · 2020-04-30, 16:49

Quote:

Originally Posted by VBCurtis

I imagine you're going to sieve up to about the same time as the C177, and end up with a matrix somewhere near 15-16M. That's still a big win, to achieve the same sieve time with a poly 17% worse! I await your data.

Good shout, I got this with 60M CPU-seconds of sieving (TD 120 didn't build):

Code:

Thu Apr 30 15:20:48 2020  commencing relation filtering
Thu Apr 30 15:20:48 2020  setting target matrix density to 110.0
Thu Apr 30 15:20:48 2020  estimated available RAM is 15845.4 MB
Thu Apr 30 15:20:48 2020  commencing duplicate removal, pass 1
...
Thu Apr 30 15:55:36 2020  found 104136282 hash collisions in 353025118 relations
Thu Apr 30 15:55:58 2020  commencing duplicate removal, pass 2
Thu Apr 30 16:02:44 2020  found 135256670 duplicates and 217768448 unique relations
...
Thu Apr 30 17:23:44 2020  matrix is 15570888 x 15571108 (6664.9 MB) with weight 1761668903 (113.14/col)
Thu Apr 30 17:23:44 2020  sparse part has weight 1591448342 (102.21/col)
Thu Apr 30 17:23:44 2020  using block size 8192 and superblock size 884736 for processor cache size 9216 kB
Thu Apr 30 17:24:26 2020  commencing Lanczos iteration (6 threads)
Thu Apr 30 17:24:26 2020  memory use: 6339.7 MB
Thu Apr 30 17:25:05 2020  linear algebra at 0.0%, ETA 105h12m

I'll sieve a bit more to try and get a matrix at TD 120.

Curtis - I'll do a c178 with 3LP and I=15 next as you suggested; please could you give me some parameters to try?

RichD · 2020-04-30, 17:03

Quote:

Originally Posted by EdH

I have msieve doing LA on the 178 cofactor of 12-7_945L now.

Msieve refused to build at t_d=120 and 110, so I tried it at default and it came up with the following. Of note, every one of the first 1.2M relations showed error -11. Here is the successful run which is now at about 120 hours to finish:

That's an awfully high dup rate. Did you sieve on the -a side?

EdH · 2020-04-30, 18:09

Quote:

Originally Posted by RichD

That's an awfully high dup rate. Did you sieve on the -a side?

CADO-NFS should have defaulted to the algebraic side, as there was no task telling it different. But, I don't know if I can verify that to be the case.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Integers congruent to last two decimal digits mod 23	enzocreti	enzocreti	1	2020-03-03 18:38
Twin Primes with 128 Decimal Digits	tuckerkao	Miscellaneous Math	2	2020-02-16 06:23
Playing with decimal representation	Nick	Puzzles	9	2013-02-13 17:17
Decimal Value of Mersenne Prime	vsuite	GPU Computing	11	2011-02-02 04:47
Decimal Places	Corbyguy	Software	3	2008-06-09 18:09

2020-04-25, 06:25	#78
VBCurtis "Curtis" Feb 2005 Riverside, CA 17×271 Posts	I tried ncurves1 = 16, ETA went up 3 days. I tried lim0=140M, lim1=100M, ETA went up 8-10 days. So no changes to the suggestions from last post.

2020-04-25, 16:08	#80
VBCurtis "Curtis" Feb 2005 Riverside, CA 17·271 Posts	Precisely. Sorry I was too lazy to do that myself for you.

2020-04-30, 03:24	#83
VBCurtis "Curtis" Feb 2005 Riverside, CA 17·271 Posts	I agree that this is a terrific speedup for a single machine job- 6 * 86400 * 7 is about 3.5M cpu-sec for the matrix, so your complete job would finish in less time than the C177 took to sieve! It's also unclear if I=15 would be faster; with 2LP on C177 you found 10% speedup there, so this could get faster still. That tells me C178 is too late to begin 3LP; a C178 job should not be faster than a C177, especially with those poly scores. So, we should try 3LP on the C175 file. I imagine you're going to sieve up to about the same time as the C177, and end up with a matrix somewhere near 15-16M. That's still a big win, to achieve the same sieve time with a poly 17% worse! I await your data.

2020-04-30, 16:23	#85
VBCurtis "Curtis" Feb 2005 Riverside, CA 4607₁₀ Posts	15.6M at TD 70 isn't so big to send me back to sieving (unlike Charybdis' 3LP job, which at 19M does send us back for more relations). Not getting a matrix at TD 100 means you barely built a matrix; nothing wrong with this, merely a "matrix could be faster with a few million more rels" situation. I personally benefit, since you've directed the farm to the C198 sieve project while this matrix runs! So, we have data that 3LP yields larger matrices- as one would expect, though having same-sized jobs from the same sieve software and same LP settings come out 30% different in size is a bit more than I expected. The sieve speedup is so big that it's worth the tradeoff; I think we just need to accept 14-16M matrix sizes for C180s with 3LP. In the next day or so, I'll post what I think are best files for C175 and C180; we happen to be optimizing for C177 and 178, but the lessons should apply for the whole range of C173-182 that these two files would cover. Development isn't finished, but I think it's helpful to not have to scroll through the thread to find the current suggestions.