mersenneforum.org  

Go Back   mersenneforum.org > Factoring Projects > CADO-NFS

Reply
 
Thread Tools
Old 2020-09-02, 23:36   #122
charybdis
 
Apr 2020

3·31 Posts
Default

Quote:
Originally Posted by VBCurtis View Post
Sorry for the delay, been busy with some data-gathering for nfs@home queue planning.

A params.C185 file should have the usual 25-30% increase in lim's, and we should test 32/32 against the current setting.

If we stay with 31/32, I'd add another 20-30M relations wanted. 32/32 should be 30% higher than that to start with.

Poly select should be about double the C180 file- say, 60% increase in admax and 25% increase in P.
This is what I've got for c180:

Code:
###########################################################################
# Polynomial selection
###########################################################################

tasks.polyselect.degree = 5
tasks.polyselect.P = 2500000
tasks.polyselect.admin = 10080
tasks.polyselect.admax = 22e5
tasks.polyselect.adrange = 1680
tasks.polyselect.incr = 210
tasks.polyselect.nq = 15625
tasks.polyselect.nrkeep = 96
tasks.polyselect.ropteffort = 35

###########################################################################
# Sieve
###########################################################################

tasks.I = 15
tasks.qmin = 20000000
tasks.lim0 = 95000000
tasks.lim1 = 135000000
tasks.lpb0 = 31
tasks.lpb1 = 32
tasks.sieve.mfb0 = 58
tasks.sieve.mfb1 = 90
tasks.sieve.lambda0 = 2.07
# tasks.sieve.lambda1 = 3.01 ?? would match what we've done with lambda0
tasks.sieve.ncurves0 = 20
tasks.sieve.ncurves1 = 13
tasks.sieve.rels_wanted = 300000000 # for a single machine; I've been aiming for around 320M
tasks.sieve.qrange = 5000
The polyselect parameters won't be optimal, but at least they produce decent polys.
The lims probably aren't optimal either. Optimising them would probably require running the same number lots of times - easy enough at c120, but a bit of an issue at c180...

Quote:
Edit: I'd also raise qmin to 25M or 30M. The most recent CADO-factorization paper mentions that controlling the qmax/qmin ratio helps to control the duplicate rate; so as our jobs get tougher and sieve up to larger Q's, qmin should rise as well. If I understood what they said properly (a weak assumption), a ratio of 7 is a decent target, and duplicate-rates get poor once the ratio exceeds 10. We saw that back when I suggested qmin of 500k, and their paper agrees with the data you gathered. We expect Q-max of 175-200M, I think?
Thanks for sharing this! A ratio of 7 does indeed line up well with what I found. I'll try (edit: changed a bit to reflect Curtis's draft c185.params)
Code:
tasks.I = 15
tasks.qmin = 30000000
tasks.lim0 = 125000000
tasks.lim1 = 175000000
tasks.lpb0 = 31
tasks.lpb1 = 32
tasks.sieve.mfb0 = 58
tasks.sieve.mfb1 = 90
tasks.sieve.lambda0 = 2.07
tasks.sieve.ncurves0 = 20
tasks.sieve.ncurves1 = 13
for the first c184, and we'll see if you're right about needing an extra 20M-30M relations. The next number can be the trial run for 32/32.

Last fiddled with by charybdis on 2020-09-02 at 23:40
charybdis is offline   Reply With Quote
Old 2020-09-12, 18:53   #123
charybdis
 
Apr 2020

3·31 Posts
Default

First successful attempt at a matrix for the c184 from 4+3_466:

Code:
Sat Sep 12 17:35:10 2020  Msieve v. 1.54 (SVN 1030M)
Sat Sep 12 17:35:10 2020  random seeds: 24ad7ccb b689eb64
Sat Sep 12 17:35:10 2020  factoring 1288420870966541327457423401697563128187770527956826832585494726405215165841980470637608224215821394194152554733348168114523551339058369701611634537845108590062264466133701035309124657 (184 digits)
Sat Sep 12 17:35:11 2020  searching for 15-digit factors
Sat Sep 12 17:35:11 2020  commencing number field sieve (184-digit input)
Sat Sep 12 17:35:11 2020  R0: -400690796617504803266434417211713435
Sat Sep 12 17:35:11 2020  R1: 17433125019345016821281
Sat Sep 12 17:35:11 2020  A0: 974638980914360897045449737219395727892611072
Sat Sep 12 17:35:11 2020  A1: 4219797827063945184925953662650167666
Sat Sep 12 17:35:11 2020  A2: -494543283474842279204870729055
Sat Sep 12 17:35:11 2020  A3: -10129443552045375616276
Sat Sep 12 17:35:11 2020  A4: 34163940584578
Sat Sep 12 17:35:11 2020  A5: 124740
Sat Sep 12 17:35:11 2020  skew 101124293.72, size 6.600e-18, alpha -7.549, combined = 5.544e-14 rroots = 3
Sat Sep 12 17:35:11 2020  
Sat Sep 12 17:35:11 2020  commencing relation filtering
Sat Sep 12 17:35:11 2020  setting target matrix density to 100.0
Sat Sep 12 17:35:11 2020  estimated available RAM is 15845.8 MB
Sat Sep 12 17:35:11 2020  commencing duplicate removal, pass 1
Sat Sep 12 18:05:22 2020  found 83600412 hash collisions in 300946431 relations
Sat Sep 12 18:05:43 2020  commencing duplicate removal, pass 2
Sat Sep 12 18:11:32 2020  found 98891655 duplicates and 202054776 unique relations
Sat Sep 12 18:11:32 2020  memory use: 2387.0 MB
Sat Sep 12 18:11:33 2020  reading ideals above 183959552
Sat Sep 12 18:11:33 2020  commencing singleton removal, initial pass
Sat Sep 12 18:27:10 2020  memory use: 5512.0 MB
Sat Sep 12 18:27:11 2020  reading all ideals from disk
Sat Sep 12 18:27:32 2020  memory use: 3530.8 MB
Sat Sep 12 18:27:37 2020  commencing in-memory singleton removal
Sat Sep 12 18:27:42 2020  begin with 202054776 relations and 195951001 unique ideals
Sat Sep 12 18:28:34 2020  reduce to 91808076 relations and 69726710 ideals in 18 passes
Sat Sep 12 18:28:34 2020  max relations containing the same ideal: 30
Sat Sep 12 18:28:40 2020  reading ideals above 720000
Sat Sep 12 18:28:40 2020  commencing singleton removal, initial pass
Sat Sep 12 18:40:14 2020  memory use: 2756.0 MB
Sat Sep 12 18:40:14 2020  reading all ideals from disk
Sat Sep 12 18:40:38 2020  memory use: 3788.1 MB
Sat Sep 12 18:40:45 2020  keeping 89701206 ideals with weight <= 200, target excess is 486271
Sat Sep 12 18:40:53 2020  commencing in-memory singleton removal
Sat Sep 12 18:40:59 2020  begin with 91808076 relations and 89701206 unique ideals
Sat Sep 12 18:42:20 2020  reduce to 91576225 relations and 89469280 ideals in 14 passes
Sat Sep 12 18:42:20 2020  max relations containing the same ideal: 200
Sat Sep 12 18:42:54 2020  removing 4408357 relations and 4008357 ideals in 400000 cliques
Sat Sep 12 18:42:56 2020  commencing in-memory singleton removal
Sat Sep 12 18:43:02 2020  begin with 87167868 relations and 89469280 unique ideals
Sat Sep 12 18:43:52 2020  reduce to 86998225 relations and 85290168 ideals in 9 passes
Sat Sep 12 18:43:52 2020  max relations containing the same ideal: 199
Sat Sep 12 18:44:24 2020  removing 3296653 relations and 2896653 ideals in 400000 cliques
Sat Sep 12 18:44:25 2020  commencing in-memory singleton removal
Sat Sep 12 18:44:31 2020  begin with 83701572 relations and 85290168 unique ideals
Sat Sep 12 18:45:14 2020  reduce to 83597784 relations and 82289128 ideals in 8 passes
Sat Sep 12 18:45:14 2020  max relations containing the same ideal: 195
Sat Sep 12 18:45:45 2020  removing 2943680 relations and 2543680 ideals in 400000 cliques
Sat Sep 12 18:45:46 2020  commencing in-memory singleton removal
Sat Sep 12 18:45:51 2020  begin with 80654104 relations and 82289128 unique ideals
Sat Sep 12 18:46:33 2020  reduce to 80566167 relations and 79657103 ideals in 8 passes
Sat Sep 12 18:46:33 2020  max relations containing the same ideal: 192
Sat Sep 12 18:47:02 2020  removing 2416391 relations and 2071402 ideals in 344989 cliques
Sat Sep 12 18:47:04 2020  commencing in-memory singleton removal
Sat Sep 12 18:47:09 2020  begin with 78149776 relations and 79657103 unique ideals
Sat Sep 12 18:47:49 2020  reduce to 78087981 relations and 77523656 ideals in 8 passes
Sat Sep 12 18:47:49 2020  max relations containing the same ideal: 189
Sat Sep 12 18:48:28 2020  relations with 0 large ideals: 1755
Sat Sep 12 18:48:28 2020  relations with 1 large ideals: 1308
Sat Sep 12 18:48:28 2020  relations with 2 large ideals: 26394
Sat Sep 12 18:48:28 2020  relations with 3 large ideals: 279678
Sat Sep 12 18:48:28 2020  relations with 4 large ideals: 1664509
Sat Sep 12 18:48:28 2020  relations with 5 large ideals: 6065505
Sat Sep 12 18:48:28 2020  relations with 6 large ideals: 14102865
Sat Sep 12 18:48:28 2020  relations with 7+ large ideals: 55945967
Sat Sep 12 18:48:28 2020  commencing 2-way merge
Sat Sep 12 18:49:10 2020  reduce to 47771699 relation sets and 47207374 unique ideals
Sat Sep 12 18:49:10 2020  commencing full merge
Sat Sep 12 19:01:29 2020  memory use: 5643.5 MB
Sat Sep 12 19:01:33 2020  found 22554044 cycles, need 22541574
Sat Sep 12 19:01:39 2020  weight of 22541574 cycles is about 2254542524 (100.02/cycle)
Sat Sep 12 19:01:39 2020  distribution of cycle lengths:
Sat Sep 12 19:01:39 2020  1 relations: 2505630
Sat Sep 12 19:01:39 2020  2 relations: 2281308
Sat Sep 12 19:01:39 2020  3 relations: 2240340
Sat Sep 12 19:01:39 2020  4 relations: 2050168
Sat Sep 12 19:01:39 2020  5 relations: 1873938
Sat Sep 12 19:01:39 2020  6 relations: 1689463
Sat Sep 12 19:01:39 2020  7 relations: 1480064
Sat Sep 12 19:01:39 2020  8 relations: 1281871
Sat Sep 12 19:01:39 2020  9 relations: 1129919
Sat Sep 12 19:01:39 2020  10+ relations: 6008873
Sat Sep 12 19:01:39 2020  heaviest cycle: 28 relations
Sat Sep 12 19:01:42 2020  commencing cycle optimization
Sat Sep 12 19:02:11 2020  start with 157972026 relations
Sat Sep 12 19:05:44 2020  pruned 4774693 relations
Sat Sep 12 19:05:45 2020  memory use: 4817.7 MB
Sat Sep 12 19:05:45 2020  distribution of cycle lengths:
Sat Sep 12 19:05:45 2020  1 relations: 2505630
Sat Sep 12 19:05:45 2020  2 relations: 2342283
Sat Sep 12 19:05:45 2020  3 relations: 2330295
Sat Sep 12 19:05:45 2020  4 relations: 2110706
Sat Sep 12 19:05:45 2020  5 relations: 1931570
Sat Sep 12 19:05:45 2020  6 relations: 1721214
Sat Sep 12 19:05:45 2020  7 relations: 1502020
Sat Sep 12 19:05:45 2020  8 relations: 1291081
Sat Sep 12 19:05:45 2020  9 relations: 1129255
Sat Sep 12 19:05:45 2020  10+ relations: 5677520
Sat Sep 12 19:05:45 2020  heaviest cycle: 28 relations
Sat Sep 12 19:06:23 2020  RelProcTime: 5472
Sat Sep 12 19:06:30 2020  
Sat Sep 12 19:06:30 2020  commencing linear algebra
Sat Sep 12 19:06:31 2020  read 22541574 cycles
Sat Sep 12 19:07:06 2020  cycles contain 77557788 unique relations
Sat Sep 12 19:14:45 2020  read 77557788 relations
Sat Sep 12 19:16:28 2020  using 20 quadratic characters above 4294917295
Sat Sep 12 19:21:25 2020  building initial matrix
Sat Sep 12 19:33:28 2020  memory use: 10853.9 MB
Sat Sep 12 19:34:23 2020  read 22541574 cycles
Sat Sep 12 19:34:26 2020  matrix is 22541397 x 22541574 (9232.7 MB) with weight 2833980271 (125.72/col)
Sat Sep 12 19:34:26 2020  sparse part has weight 2149800401 (95.37/col)
Sat Sep 12 19:37:38 2020  filtering completed in 2 passes
Sat Sep 12 19:37:42 2020  matrix is 22540213 x 22540390 (9232.6 MB) with weight 2833930299 (125.73/col)
Sat Sep 12 19:37:42 2020  sparse part has weight 2149790384 (95.38/col)
Sat Sep 12 19:40:48 2020  matrix starts at (0, 0)
Sat Sep 12 19:40:51 2020  matrix is 22540213 x 22540390 (9232.6 MB) with weight 2833930299 (125.73/col)
Sat Sep 12 19:40:51 2020  sparse part has weight 2149790384 (95.38/col)
Sat Sep 12 19:40:51 2020  saving the first 48 matrix rows for later
Sat Sep 12 19:40:53 2020  matrix includes 64 packed rows
Sat Sep 12 19:40:56 2020  matrix is 22540165 x 22540390 (9014.3 MB) with weight 2387432529 (105.92/col)
Sat Sep 12 19:40:56 2020  sparse part has weight 2137643846 (94.84/col)
Sat Sep 12 19:40:56 2020  using block size 8192 and superblock size 884736 for processor cache size 9216 kB
Sat Sep 12 19:42:01 2020  commencing Lanczos iteration (6 threads)
Sat Sep 12 19:42:01 2020  memory use: 8657.6 MB
Sat Sep 12 19:43:06 2020  linear algebra at 0.0%, ETA 255h42m
Sat Sep 12 19:43:26 2020  checkpointing every 90000 dimensions
Increasing the lims doesn't seem to have changed the number of required relations all that much, but the matrix has got bigger.
It also looks like the higher lims give a bit of a speedup; I'll provide some more data once I have a more manageable matrix.
charybdis is offline   Reply With Quote
Old 2020-09-13, 16:21   #124
charybdis
 
Apr 2020

3·31 Posts
Default

Sieving Q from 30M to 201M took 109.9M CPU-seconds, and produced:
Code:
Sun Sep 13 13:55:54 2020  commencing relation filtering
Sun Sep 13 13:55:54 2020  setting target matrix density to 110.0
Sun Sep 13 13:55:54 2020  estimated available RAM is 15845.8 MB
Sun Sep 13 13:55:54 2020  commencing duplicate removal, pass 1
Sun Sep 13 14:28:58 2020  found 92069979 hash collisions in 327933354 relations
Sun Sep 13 14:29:20 2020  commencing duplicate removal, pass 2
Sun Sep 13 14:35:46 2020  found 109446093 duplicates and 218487261 unique relations
Sun Sep 13 14:35:46 2020  memory use: 2387.0 MB
Sun Sep 13 14:35:46 2020  reading ideals above 200998912
Sun Sep 13 14:35:46 2020  commencing singleton removal, initial pass
Sun Sep 13 14:52:41 2020  memory use: 5512.0 MB
Sun Sep 13 14:52:42 2020  reading all ideals from disk
Sun Sep 13 14:53:09 2020  memory use: 3752.4 MB
Sun Sep 13 14:53:14 2020  commencing in-memory singleton removal
Sun Sep 13 14:53:20 2020  begin with 218487261 relations and 200826425 unique ideals
...
Sun Sep 13 16:09:52 2020  matrix is 18797898 x 18798123 (8118.4 MB) with weight 2166084557 (115.23/col)
Sun Sep 13 16:09:52 2020  sparse part has weight 1940221126 (103.21/col)
Sun Sep 13 16:09:52 2020  using block size 8192 and superblock size 884736 for processor cache size 9216 kB
Sun Sep 13 16:10:46 2020  commencing Lanczos iteration (6 threads)
Sun Sep 13 16:10:46 2020  memory use: 7721.7 MB
Sun Sep 13 16:11:38 2020  linear algebra at 0.0%, ETA 171h51m
Higher lims don't seem to require more unique relations to build a matrix, though they do increase the duplication rate because more of the sieving is below lim1. The matrix hasn't got much larger either.
Taking into account the poly scores, speedup relative to the lower lims is about 5%.

I'm going to do the c183 from 4-3_443 next, as Sean's test-sieving showed that GNFS ought to be slightly faster than SNFS. I'll use lpb 32/32, mfb 60/90.
charybdis is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Integers congruent to last two decimal digits mod 23 enzocreti enzocreti 1 2020-03-03 18:38
Twin Primes with 128 Decimal Digits tuckerkao Miscellaneous Math 2 2020-02-16 06:23
Playing with decimal representation Nick Puzzles 9 2013-02-13 17:17
Decimal Value of Mersenne Prime vsuite GPU Computing 11 2011-02-02 04:47
Decimal Places Corbyguy Software 3 2008-06-09 18:09

All times are UTC. The time now is 09:40.

Thu Sep 24 09:40:21 UTC 2020 up 14 days, 6:51, 0 users, load averages: 1.41, 1.59, 1.49

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.