20200425, 06:25  #78 
"Curtis"
Feb 2005
Riverside, CA
3^{3}·163 Posts 
I tried ncurves1 = 16, ETA went up 3 days.
I tried lim0=140M, lim1=100M, ETA went up 810 days. So no changes to the suggestions from last post. 
20200425, 12:17  #79 
Apr 2020
109 Posts 
Just want to make sure I've got this right:
Code:
tasks.A = 28 tasks.qmin = 500000 tasks.lim0 = 100000000 tasks.lim1 = 140000000 tasks.lpb0 = 31 tasks.lpb1 = 32 tasks.sieve.lambda0 = 1.88 tasks.sieve.mfb0 = 58 tasks.sieve.mfb1 = 90 tasks.sieve.ncurves0 = 20 tasks.sieve.ncurves1 = 13 tasks.sieve.qrange = 10000 tasks.sieve.rels_wanted = 320000000 
20200425, 16:08  #80 
"Curtis"
Feb 2005
Riverside, CA
3^{3}·163 Posts 
Precisely. Sorry I was too lazy to do that myself for you.

20200425, 16:34  #81 
Apr 2020
109 Posts 

20200430, 01:48  #82 
Apr 2020
109_{10} Posts 
Managed to get a matrix with just over 320M relations after sieving Q from 500k to 136M, but it's a big one:
Code:
Thu Apr 30 00:23:42 2020 commencing relation filtering Thu Apr 30 00:23:42 2020 setting target matrix density to 100.0 Thu Apr 30 00:23:42 2020 estimated available RAM is 15845.4 MB Thu Apr 30 00:23:43 2020 commencing duplicate removal, pass 1 ... Thu Apr 30 00:55:20 2020 found 94773795 hash collisions in 321245930 relations Thu Apr 30 00:55:41 2020 commencing duplicate removal, pass 2 Thu Apr 30 01:01:49 2020 found 122972626 duplicates and 198273304 unique relations Thu Apr 30 01:01:49 2020 memory use: 2387.0 MB Thu Apr 30 01:01:50 2020 reading ideals above 151584768 Thu Apr 30 01:01:50 2020 commencing singleton removal, initial pass Thu Apr 30 01:17:31 2020 memory use: 5512.0 MB Thu Apr 30 01:17:32 2020 reading all ideals from disk Thu Apr 30 01:17:52 2020 memory use: 3537.9 MB Thu Apr 30 01:17:57 2020 commencing inmemory singleton removal Thu Apr 30 01:18:03 2020 begin with 198273304 relations and 195834296 unique ideals Thu Apr 30 01:18:55 2020 reduce to 86504203 relations and 67341595 ideals in 18 passes Thu Apr 30 01:18:55 2020 max relations containing the same ideal: 23 Thu Apr 30 01:19:01 2020 reading ideals above 720000 Thu Apr 30 01:19:01 2020 commencing singleton removal, initial pass Thu Apr 30 01:30:14 2020 memory use: 2756.0 MB Thu Apr 30 01:30:14 2020 reading all ideals from disk Thu Apr 30 01:30:34 2020 memory use: 3467.0 MB Thu Apr 30 01:30:41 2020 keeping 83938241 ideals with weight <= 200, target excess is 450665 Thu Apr 30 01:30:48 2020 commencing inmemory singleton removal Thu Apr 30 01:30:53 2020 begin with 86504208 relations and 83938241 unique ideals Thu Apr 30 01:32:07 2020 reduce to 86349299 relations and 83783289 ideals in 14 passes Thu Apr 30 01:32:07 2020 max relations containing the same ideal: 200 Thu Apr 30 01:32:38 2020 removing 4545236 relations and 4145236 ideals in 400000 cliques Thu Apr 30 01:32:39 2020 commencing inmemory singleton removal Thu Apr 30 01:32:44 2020 begin with 81804063 relations and 83783289 unique ideals Thu Apr 30 01:33:34 2020 reduce to 81605208 relations and 79437817 ideals in 10 passes Thu Apr 30 01:33:34 2020 max relations containing the same ideal: 199 Thu Apr 30 01:34:03 2020 removing 3387725 relations and 2987725 ideals in 400000 cliques Thu Apr 30 01:34:05 2020 commencing inmemory singleton removal Thu Apr 30 01:34:10 2020 begin with 78217483 relations and 79437817 unique ideals Thu Apr 30 01:34:52 2020 reduce to 78096236 relations and 76328142 ideals in 9 passes Thu Apr 30 01:34:52 2020 max relations containing the same ideal: 194 Thu Apr 30 01:35:21 2020 removing 3022251 relations and 2622251 ideals in 400000 cliques Thu Apr 30 01:35:22 2020 commencing inmemory singleton removal Thu Apr 30 01:35:27 2020 begin with 75073985 relations and 76328142 unique ideals Thu Apr 30 01:36:03 2020 reduce to 74969366 relations and 73600718 ideals in 8 passes Thu Apr 30 01:36:03 2020 max relations containing the same ideal: 190 Thu Apr 30 01:36:30 2020 removing 2824610 relations and 2424610 ideals in 400000 cliques Thu Apr 30 01:36:31 2020 commencing inmemory singleton removal Thu Apr 30 01:36:36 2020 begin with 72144756 relations and 73600718 unique ideals Thu Apr 30 01:37:15 2020 reduce to 72050844 relations and 71081672 ideals in 9 passes Thu Apr 30 01:37:15 2020 max relations containing the same ideal: 188 Thu Apr 30 01:37:41 2020 removing 2697707 relations and 2297707 ideals in 400000 cliques Thu Apr 30 01:37:42 2020 commencing inmemory singleton removal Thu Apr 30 01:37:47 2020 begin with 69353137 relations and 71081672 unique ideals Thu Apr 30 01:38:24 2020 reduce to 69262639 relations and 68692948 ideals in 9 passes Thu Apr 30 01:38:24 2020 max relations containing the same ideal: 180 Thu Apr 30 01:38:49 2020 removing 430114 relations and 383195 ideals in 46919 cliques Thu Apr 30 01:38:50 2020 commencing inmemory singleton removal Thu Apr 30 01:38:54 2020 begin with 68832525 relations and 68692948 unique ideals Thu Apr 30 01:39:23 2020 reduce to 68830278 relations and 68307505 ideals in 7 passes Thu Apr 30 01:39:23 2020 max relations containing the same ideal: 180 Thu Apr 30 01:39:35 2020 relations with 0 large ideals: 1698 Thu Apr 30 01:39:35 2020 relations with 1 large ideals: 2688 Thu Apr 30 01:39:35 2020 relations with 2 large ideals: 42577 Thu Apr 30 01:39:35 2020 relations with 3 large ideals: 386727 Thu Apr 30 01:39:35 2020 relations with 4 large ideals: 2037316 Thu Apr 30 01:39:35 2020 relations with 5 large ideals: 6689570 Thu Apr 30 01:39:35 2020 relations with 6 large ideals: 14111696 Thu Apr 30 01:39:35 2020 relations with 7+ large ideals: 45558006 Thu Apr 30 01:39:35 2020 commencing 2way merge Thu Apr 30 01:40:12 2020 reduce to 41453428 relation sets and 40930655 unique ideals Thu Apr 30 01:40:12 2020 commencing full merge Thu Apr 30 01:50:00 2020 memory use: 4714.1 MB Thu Apr 30 01:50:02 2020 found 19338169 cycles, need 19310855 Thu Apr 30 01:50:07 2020 weight of 19310855 cycles is about 1931089230 (100.00/cycle) Thu Apr 30 01:50:07 2020 distribution of cycle lengths: Thu Apr 30 01:50:07 2020 1 relations: 2082996 Thu Apr 30 01:50:07 2020 2 relations: 1886001 Thu Apr 30 01:50:07 2020 3 relations: 1865997 Thu Apr 30 01:50:07 2020 4 relations: 1724216 Thu Apr 30 01:50:07 2020 5 relations: 1575985 Thu Apr 30 01:50:07 2020 6 relations: 1439418 Thu Apr 30 01:50:07 2020 7 relations: 1264045 Thu Apr 30 01:50:07 2020 8 relations: 1107001 Thu Apr 30 01:50:07 2020 9 relations: 986442 Thu Apr 30 01:50:07 2020 10+ relations: 5378754 Thu Apr 30 01:50:07 2020 heaviest cycle: 28 relations Thu Apr 30 01:50:12 2020 commencing cycle optimization Thu Apr 30 01:50:35 2020 start with 137988190 relations Thu Apr 30 01:53:40 2020 pruned 3943658 relations Thu Apr 30 01:53:41 2020 memory use: 4233.3 MB Thu Apr 30 01:53:41 2020 distribution of cycle lengths: Thu Apr 30 01:53:41 2020 1 relations: 2082996 Thu Apr 30 01:53:41 2020 2 relations: 1934591 Thu Apr 30 01:53:41 2020 3 relations: 1936470 Thu Apr 30 01:53:41 2020 4 relations: 1772730 Thu Apr 30 01:53:41 2020 5 relations: 1624454 Thu Apr 30 01:53:41 2020 6 relations: 1464862 Thu Apr 30 01:53:41 2020 7 relations: 1283296 Thu Apr 30 01:53:41 2020 8 relations: 1116240 Thu Apr 30 01:53:41 2020 9 relations: 987568 Thu Apr 30 01:53:41 2020 10+ relations: 5107648 Thu Apr 30 01:53:41 2020 heaviest cycle: 28 relations Thu Apr 30 01:54:12 2020 RelProcTime: 5430 Thu Apr 30 01:54:18 2020 Thu Apr 30 01:54:18 2020 commencing linear algebra Thu Apr 30 01:54:19 2020 read 19310855 cycles Thu Apr 30 01:54:50 2020 cycles contain 68397133 unique relations Thu Apr 30 02:02:14 2020 read 68397133 relations Thu Apr 30 02:03:45 2020 using 20 quadratic characters above 4294917295 Thu Apr 30 02:08:07 2020 building initial matrix Thu Apr 30 02:18:19 2020 memory use: 9234.0 MB Thu Apr 30 02:18:43 2020 read 19310855 cycles Thu Apr 30 02:18:45 2020 matrix is 19310678 x 19310855 (7913.5 MB) with weight 2405426155 (124.56/col) Thu Apr 30 02:18:45 2020 sparse part has weight 1842743275 (95.43/col) Thu Apr 30 02:21:26 2020 filtering completed in 2 passes Thu Apr 30 02:21:29 2020 matrix is 19308744 x 19308921 (7913.3 MB) with weight 2405349100 (124.57/col) Thu Apr 30 02:21:29 2020 sparse part has weight 1842727716 (95.43/col) Thu Apr 30 02:23:23 2020 matrix starts at (0, 0) Thu Apr 30 02:23:26 2020 matrix is 19308744 x 19308921 (7913.3 MB) with weight 2405349100 (124.57/col) Thu Apr 30 02:23:26 2020 sparse part has weight 1842727716 (95.43/col) Thu Apr 30 02:23:26 2020 saving the first 48 matrix rows for later Thu Apr 30 02:23:28 2020 matrix includes 64 packed rows Thu Apr 30 02:23:30 2020 matrix is 19308696 x 19308921 (7658.0 MB) with weight 2009697914 (104.08/col) Thu Apr 30 02:23:30 2020 sparse part has weight 1814420535 (93.97/col) Thu Apr 30 02:23:30 2020 using block size 8192 and superblock size 884736 for processor cache size 9216 kB Thu Apr 30 02:24:23 2020 commencing Lanczos iteration (6 threads) Thu Apr 30 02:24:23 2020 memory use: 7355.4 MB Thu Apr 30 02:25:29 2020 linear algebra at 0.0%, ETA 223h 1m Sieving (so far) took 52.9M CPUseconds, compared to 58.6M for the fastest c177 I ran (with I=15 31/32), despite the poly score being 17% worse. So it seems 3LP may be the way to go if you don't care much about the difficulty of the matrix, for example if you're running a job this size on a single machine where the sieving could take months. We'll see whether the comparison is still favourable when I've sieved enough to get a nice matrix; I imagine it might not be. 
20200430, 03:24  #83 
"Curtis"
Feb 2005
Riverside, CA
3^{3}×163 Posts 
I agree that this is a terrific speedup for a single machine job 6 * 86400 * 7 is about 3.5M cpusec for the matrix, so your complete job would finish in less time than the C177 took to sieve!
It's also unclear if I=15 would be faster; with 2LP on C177 you found 10% speedup there, so this could get faster still. That tells me C178 is too late to begin 3LP; a C178 job should not be faster than a C177, especially with those poly scores. So, we should try 3LP on the C175 file. I imagine you're going to sieve up to about the same time as the C177, and end up with a matrix somewhere near 1516M. That's still a big win, to achieve the same sieve time with a poly 17% worse! I await your data. 
20200430, 15:37  #84 
"Ed Hall"
Dec 2009
Adirondack Mtns
3·1,129 Posts 
I have msieve doing LA on the 178 cofactor of 127_945L now. Here are the Total times I can find for CADONFS, which crashed due to insufficient memory during full merge:
Code:
PID28474 20200420 16:27:18,736 Info:Polynomial Selection (size optimized): Total time: 2.65212e+06 PID31307 20200420 17:37:53,424 Info:Polynomial Selection (size optimized): Total time: 2.65212e+06 PID31307 20200420 18:00:56,820 Info:Polynomial Selection (root optimized): Total time: 58448.6 PID8786 20200420 22:45:07,422 Info:Polynomial Selection (size optimized): Total time: 2.65212e+06 PID8786 20200420 22:45:07,425 Info:Polynomial Selection (root optimized): Total time: 58448.6 PID8786 20200428 02:06:51,549 Info:Lattice Sieving: Total time: 2.02059e+07s Code:
Tue Apr 28 13:07:12 2020 Msieve v. 1.54 (SVN 1018) Tue Apr 28 13:07:12 2020 random seeds: 6cef034c 096382c6 Tue Apr 28 13:07:12 2020 factoring 1258632688840167527990479924759660967727113832014282715541202945214604444063933854224497640052542892497254083608311352572748398102592769128719761767229021194362137011186342088871 (178 digits) Tue Apr 28 13:07:13 2020 searching for 15digit factors Tue Apr 28 13:07:13 2020 commencing number field sieve (178digit input) Tue Apr 28 13:07:13 2020 R0: 21186307570697279371433463611848173 Tue Apr 28 13:07:13 2020 R1: 8845196529223700328463 Tue Apr 28 13:07:13 2020 A0: 2400190655725017956973353574287095281260800 Tue Apr 28 13:07:13 2020 A1: 211014402684521569088239119813217640 Tue Apr 28 13:07:13 2020 A2: 39939568153496532334089408958 Tue Apr 28 13:07:13 2020 A3: 1552818850110399495593 Tue Apr 28 13:07:13 2020 A4: 58933721795178 Tue Apr 28 13:07:13 2020 A5: 294840 Tue Apr 28 13:07:13 2020 skew 1.00, size 3.619e17, alpha 7.825, combined = 5.648e16 rroots = 5 Tue Apr 28 13:07:13 2020 Tue Apr 28 13:07:13 2020 commencing relation filtering Tue Apr 28 13:07:13 2020 estimated available RAM is 15926.6 MB Tue Apr 28 13:07:13 2020 commencing duplicate removal, pass 1 Tue Apr 28 13:07:13 2020 error 11 reading relation 0 . . . [ Includes every relation in between ] Tue Apr 28 13:07:35 2020 error 11 reading relation 1216455 Tue Apr 28 13:07:19 2020 error 1 reading relation 345340 Tue Apr 28 13:07:29 2020 error 1 reading relation 907378 . . . Tue Apr 28 13:42:35 2020 error 1 reading relation 266916827 Tue Apr 28 13:43:47 2020 error 1 reading relation 276189407 Tue Apr 28 13:43:50 2020 found 90847552 hash collisions in 275423639 relations Tue Apr 28 13:44:23 2020 added 121850 free relations Tue Apr 28 13:44:23 2020 commencing duplicate removal, pass 2 Tue Apr 28 13:51:04 2020 found 126526927 duplicates and 149018562 unique relations Tue Apr 28 13:51:04 2020 memory use: 1449.5 MB Tue Apr 28 13:51:04 2020 reading ideals above 139919360 Tue Apr 28 13:51:04 2020 commencing singleton removal, initial pass Tue Apr 28 14:07:21 2020 memory use: 3012.0 MB Tue Apr 28 14:07:21 2020 reading all ideals from disk Tue Apr 28 14:07:34 2020 memory use: 2421.4 MB Tue Apr 28 14:07:39 2020 commencing inmemory singleton removal Tue Apr 28 14:07:43 2020 begin with 149018562 relations and 146733511 unique ideals Tue Apr 28 14:08:27 2020 reduce to 55424518 relations and 38967191 ideals in 19 passes Tue Apr 28 14:08:27 2020 max relations containing the same ideal: 20 Tue Apr 28 14:08:29 2020 reading ideals above 720000 Tue Apr 28 14:08:30 2020 commencing singleton removal, initial pass Tue Apr 28 14:19:03 2020 memory use: 1506.0 MB Tue Apr 28 14:19:03 2020 reading all ideals from disk Tue Apr 28 14:19:15 2020 memory use: 2195.2 MB Tue Apr 28 14:19:21 2020 keeping 54432776 ideals with weight <= 200, target excess is 304675 Tue Apr 28 14:19:27 2020 commencing inmemory singleton removal Tue Apr 28 14:19:32 2020 begin with 55424518 relations and 54432776 unique ideals Tue Apr 28 14:20:39 2020 reduce to 54906475 relations and 53914041 ideals in 14 passes Tue Apr 28 14:20:39 2020 max relations containing the same ideal: 200 Tue Apr 28 14:21:05 2020 removing 3380876 relations and 3061371 ideals in 319505 cliques Tue Apr 28 14:21:06 2020 commencing inmemory singleton removal Tue Apr 28 14:21:11 2020 begin with 51525599 relations and 53914041 unique ideals Tue Apr 28 14:21:56 2020 reduce to 51370877 relations and 50696663 ideals in 10 passes Tue Apr 28 14:21:56 2020 max relations containing the same ideal: 196 Tue Apr 28 14:22:20 2020 removing 2526879 relations and 2207374 ideals in 319505 cliques Tue Apr 28 14:22:21 2020 commencing inmemory singleton removal Tue Apr 28 14:22:26 2020 begin with 48843998 relations and 50696663 unique ideals Tue Apr 28 14:23:04 2020 reduce to 48745655 relations and 48390321 ideals in 9 passes Tue Apr 28 14:23:04 2020 max relations containing the same ideal: 192 Tue Apr 28 14:23:35 2020 relations with 0 large ideals: 1040 Tue Apr 28 14:23:35 2020 relations with 1 large ideals: 1286 Tue Apr 28 14:23:35 2020 relations with 2 large ideals: 18987 Tue Apr 28 14:23:35 2020 relations with 3 large ideals: 185362 Tue Apr 28 14:23:35 2020 relations with 4 large ideals: 1069605 Tue Apr 28 14:23:35 2020 relations with 5 large ideals: 3821977 Tue Apr 28 14:23:35 2020 relations with 6 large ideals: 8808829 Tue Apr 28 14:23:35 2020 relations with 7+ large ideals: 34838569 Tue Apr 28 14:23:35 2020 commencing 2way merge Tue Apr 28 14:24:10 2020 reduce to 28658603 relation sets and 28303270 unique ideals Tue Apr 28 14:24:10 2020 ignored 1 oversize relation sets Tue Apr 28 14:24:10 2020 commencing full merge Tue Apr 28 14:31:02 2020 memory use: 3240.8 MB Tue Apr 28 14:31:06 2020 found 15724964 cycles, need 15677470 Tue Apr 28 14:31:11 2020 weight of 15677470 cycles is about 1097547456 (70.01/cycle) Tue Apr 28 14:31:11 2020 distribution of cycle lengths: Tue Apr 28 14:31:11 2020 1 relations: 2291729 Tue Apr 28 14:31:11 2020 2 relations: 2282984 Tue Apr 28 14:31:11 2020 3 relations: 2192031 Tue Apr 28 14:31:11 2020 4 relations: 1842581 Tue Apr 28 14:31:11 2020 5 relations: 1578365 Tue Apr 28 14:31:11 2020 6 relations: 1260813 Tue Apr 28 14:31:11 2020 7 relations: 992679 Tue Apr 28 14:31:11 2020 8 relations: 779990 Tue Apr 28 14:31:11 2020 9 relations: 616680 Tue Apr 28 14:31:11 2020 10+ relations: 1839618 Tue Apr 28 14:31:11 2020 heaviest cycle: 22 relations Tue Apr 28 14:31:14 2020 commencing cycle optimization Tue Apr 28 14:31:34 2020 start with 77754198 relations Tue Apr 28 14:32:55 2020 pruned 1290229 relations Tue Apr 28 14:32:56 2020 memory use: 2790.2 MB Tue Apr 28 14:32:56 2020 distribution of cycle lengths: Tue Apr 28 14:32:56 2020 1 relations: 2291729 Tue Apr 28 14:32:56 2020 2 relations: 2325968 Tue Apr 28 14:32:56 2020 3 relations: 2254390 Tue Apr 28 14:32:56 2020 4 relations: 1867541 Tue Apr 28 14:32:56 2020 5 relations: 1592479 Tue Apr 28 14:32:56 2020 6 relations: 1254891 Tue Apr 28 14:32:56 2020 7 relations: 982745 Tue Apr 28 14:32:56 2020 8 relations: 765997 Tue Apr 28 14:32:56 2020 9 relations: 602147 Tue Apr 28 14:32:56 2020 10+ relations: 1739583 Tue Apr 28 14:32:56 2020 heaviest cycle: 22 relations Tue Apr 28 14:33:16 2020 RelProcTime: 5163 Tue Apr 28 14:33:22 2020 Tue Apr 28 14:33:22 2020 commencing linear algebra Tue Apr 28 14:33:24 2020 read 15677470 cycles Tue Apr 28 14:33:44 2020 cycles contain 48314663 unique relations Tue Apr 28 14:41:24 2020 read 48314663 relations Tue Apr 28 14:42:25 2020 using 20 quadratic characters above 4294917295 Tue Apr 28 14:45:53 2020 building initial matrix Tue Apr 28 14:51:45 2020 memory use: 6545.9 MB Tue Apr 28 14:51:50 2020 read 15677470 cycles Tue Apr 28 14:51:53 2020 matrix is 15677291 x 15677470 (4747.0 MB) with weight 1462757761 (93.30/col) Tue Apr 28 14:51:53 2020 sparse part has weight 1071935640 (68.37/col) Tue Apr 28 14:54:32 2020 filtering completed in 2 passes Tue Apr 28 14:54:35 2020 matrix is 15667059 x 15667237 (4746.3 MB) with weight 1462436968 (93.34/col) Tue Apr 28 14:54:35 2020 sparse part has weight 1071872063 (68.41/col) Tue Apr 28 14:55:51 2020 matrix starts at (0, 0) Tue Apr 28 14:55:54 2020 matrix is 15667059 x 15667237 (4746.3 MB) with weight 1462436968 (93.34/col) Tue Apr 28 14:55:54 2020 sparse part has weight 1071872063 (68.41/col) Tue Apr 28 14:55:54 2020 saving the first 48 matrix rows for later Tue Apr 28 14:55:56 2020 matrix includes 64 packed rows Tue Apr 28 14:55:58 2020 matrix is 15667011 x 15667237 (4594.2 MB) with weight 1171728648 (74.79/col) Tue Apr 28 14:55:58 2020 sparse part has weight 1047677685 (66.87/col) Tue Apr 28 14:55:58 2020 using block size 8192 and superblock size 786432 for processor cache size 8192 kB Tue Apr 28 14:56:59 2020 commencing Lanczos iteration (8 threads) Tue Apr 28 14:56:59 2020 memory use: 3801.9 MB Tue Apr 28 14:57:59 2020 linear algebra at 0.0%, ETA 166h29m Code:
Tue Apr 28 03:55:54 2020 Msieve v. 1.54 (SVN 1018) Tue Apr 28 03:55:54 2020 random seeds: 8f4b785c cc995584 Tue Apr 28 03:55:54 2020 factoring 1258632688840167527990479924759660967727113832014282715541202945214604444063933854224497640052542892497254083608311352572748398102592769128719761767229021194362137011186342088871 (178 digits) Tue Apr 28 03:55:55 2020 searching for 15digit factors Tue Apr 28 03:55:56 2020 commencing number field sieve (178digit input) Tue Apr 28 03:55:56 2020 R0: 21186307570697279371433463611848173 Tue Apr 28 03:55:56 2020 R1: 8845196529223700328463 Tue Apr 28 03:55:56 2020 A0: 2400190655725017956973353574287095281260800 Tue Apr 28 03:55:56 2020 A1: 211014402684521569088239119813217640 Tue Apr 28 03:55:56 2020 A2: 39939568153496532334089408958 Tue Apr 28 03:55:56 2020 A3: 1552818850110399495593 Tue Apr 28 03:55:56 2020 A4: 58933721795178 Tue Apr 28 03:55:56 2020 A5: 294840 Tue Apr 28 03:55:56 2020 skew 1.00, size 3.619e17, alpha 7.825, combined = 5.648e16 rroots = 5 Tue Apr 28 03:55:56 2020 Tue Apr 28 03:55:56 2020 commencing relation filtering Tue Apr 28 03:55:56 2020 setting target matrix density to 120.0 Tue Apr 28 03:55:56 2020 estimated available RAM is 15926.6 MB Tue Apr 28 03:55:56 2020 commencing duplicate removal, pass 1 . . . Tue Apr 28 04:33:20 2020 found 90847552 hash collisions in 275423639 relations Tue Apr 28 04:33:52 2020 added 121850 free relations Tue Apr 28 04:33:52 2020 commencing duplicate removal, pass 2 Tue Apr 28 04:40:31 2020 found 126526927 duplicates and 149018562 unique relations Tue Apr 28 04:40:31 2020 memory use: 1449.5 MB Tue Apr 28 04:40:32 2020 reading ideals above 139919360 Tue Apr 28 04:40:32 2020 commencing singleton removal, initial pass Tue Apr 28 04:57:17 2020 memory use: 3012.0 MB Tue Apr 28 04:57:18 2020 reading all ideals from disk Tue Apr 28 04:57:38 2020 memory use: 2421.4 MB Tue Apr 28 04:57:42 2020 commencing inmemory singleton removal Tue Apr 28 04:57:47 2020 begin with 149018562 relations and 146733511 unique ideals Tue Apr 28 04:58:31 2020 reduce to 55424518 relations and 38967191 ideals in 19 passes Tue Apr 28 04:58:31 2020 max relations containing the same ideal: 20 Tue Apr 28 04:58:34 2020 reading ideals above 720000 Tue Apr 28 04:58:34 2020 commencing singleton removal, initial pass Tue Apr 28 05:09:26 2020 memory use: 1506.0 MB Tue Apr 28 05:09:26 2020 reading all ideals from disk Tue Apr 28 05:09:45 2020 memory use: 2195.2 MB Tue Apr 28 05:09:51 2020 keeping 54432776 ideals with weight <= 200, target excess is 304675 Tue Apr 28 05:09:56 2020 commencing inmemory singleton removal Tue Apr 28 05:10:01 2020 begin with 55424518 relations and 54432776 unique ideals Tue Apr 28 05:11:08 2020 reduce to 54906475 relations and 53914041 ideals in 14 passes Tue Apr 28 05:11:08 2020 max relations containing the same ideal: 200 Tue Apr 28 05:11:34 2020 removing 3380876 relations and 3061371 ideals in 319505 cliques Tue Apr 28 05:11:36 2020 commencing inmemory singleton removal Tue Apr 28 05:11:40 2020 begin with 51525599 relations and 53914041 unique ideals Tue Apr 28 05:12:26 2020 reduce to 51370877 relations and 50696663 ideals in 10 passes Tue Apr 28 05:12:26 2020 max relations containing the same ideal: 196 Tue Apr 28 05:12:51 2020 removing 2526879 relations and 2207374 ideals in 319505 cliques Tue Apr 28 05:12:52 2020 commencing inmemory singleton removal Tue Apr 28 05:12:56 2020 begin with 48843998 relations and 50696663 unique ideals Tue Apr 28 05:13:34 2020 reduce to 48745655 relations and 48390321 ideals in 9 passes Tue Apr 28 05:13:34 2020 max relations containing the same ideal: 192 Tue Apr 28 05:14:06 2020 relations with 0 large ideals: 1040 Tue Apr 28 05:14:06 2020 relations with 1 large ideals: 1286 Tue Apr 28 05:14:06 2020 relations with 2 large ideals: 18987 Tue Apr 28 05:14:06 2020 relations with 3 large ideals: 185362 Tue Apr 28 05:14:06 2020 relations with 4 large ideals: 1069605 Tue Apr 28 05:14:06 2020 relations with 5 large ideals: 3821977 Tue Apr 28 05:14:06 2020 relations with 6 large ideals: 8808829 Tue Apr 28 05:14:06 2020 relations with 7+ large ideals: 34838569 Tue Apr 28 05:14:06 2020 commencing 2way merge Tue Apr 28 05:14:40 2020 reduce to 28658603 relation sets and 28303270 unique ideals Tue Apr 28 05:14:40 2020 ignored 1 oversize relation sets Tue Apr 28 05:14:40 2020 commencing full merge Tue Apr 28 05:35:26 2020 memory use: 1309.7 MB Tue Apr 28 05:35:26 2020 found 205766 cycles, need 5904375 Tue Apr 28 05:35:26 2020 too few cycles, matrix probably cannot build 
20200430, 16:23  #85 
"Curtis"
Feb 2005
Riverside, CA
3^{3}×163 Posts 
15.6M at TD 70 isn't so big to send me back to sieving (unlike Charybdis' 3LP job, which at 19M does send us back for more relations). Not getting a matrix at TD 100 means you barely built a matrix; nothing wrong with this, merely a "matrix could be faster with a few million more rels" situation. I personally benefit, since you've directed the farm to the C198 sieve project while this matrix runs!
So, we have data that 3LP yields larger matrices as one would expect, though having samesized jobs from the same sieve software and same LP settings come out 30% different in size is a bit more than I expected. The sieve speedup is so big that it's worth the tradeoff; I think we just need to accept 1416M matrix sizes for C180s with 3LP. In the next day or so, I'll post what I think are best files for C175 and C180; we happen to be optimizing for C177 and 178, but the lessons should apply for the whole range of C173182 that these two files would cover. Development isn't finished, but I think it's helpful to not have to scroll through the thread to find the current suggestions. 
20200430, 16:49  #86  
Apr 2020
109 Posts 
Quote:
Code:
Thu Apr 30 15:20:48 2020 commencing relation filtering Thu Apr 30 15:20:48 2020 setting target matrix density to 110.0 Thu Apr 30 15:20:48 2020 estimated available RAM is 15845.4 MB Thu Apr 30 15:20:48 2020 commencing duplicate removal, pass 1 ... Thu Apr 30 15:55:36 2020 found 104136282 hash collisions in 353025118 relations Thu Apr 30 15:55:58 2020 commencing duplicate removal, pass 2 Thu Apr 30 16:02:44 2020 found 135256670 duplicates and 217768448 unique relations ... Thu Apr 30 17:23:44 2020 matrix is 15570888 x 15571108 (6664.9 MB) with weight 1761668903 (113.14/col) Thu Apr 30 17:23:44 2020 sparse part has weight 1591448342 (102.21/col) Thu Apr 30 17:23:44 2020 using block size 8192 and superblock size 884736 for processor cache size 9216 kB Thu Apr 30 17:24:26 2020 commencing Lanczos iteration (6 threads) Thu Apr 30 17:24:26 2020 memory use: 6339.7 MB Thu Apr 30 17:25:05 2020 linear algebra at 0.0%, ETA 105h12m Curtis  I'll do a c178 with 3LP and I=15 next as you suggested; please could you give me some parameters to try? Last fiddled with by charybdis on 20200430 at 16:51 

20200430, 17:03  #87  
Sep 2008
Kansas
2^{6}×7^{2} Posts 
Quote:


20200430, 18:09  #88 
"Ed Hall"
Dec 2009
Adirondack Mtns
6473_{8} Posts 

Thread Tools  
Similar Threads  
Thread  Thread Starter  Forum  Replies  Last Post 
Integers congruent to last two decimal digits mod 23  enzocreti  enzocreti  1  20200303 18:38 
Twin Primes with 128 Decimal Digits  tuckerkao  Miscellaneous Math  2  20200216 06:23 
Playing with decimal representation  Nick  Puzzles  9  20130213 17:17 
Decimal Value of Mersenne Prime  vsuite  GPU Computing  11  20110202 04:47 
Decimal Places  Corbyguy  Software  3  20080609 18:09 