mersenneforum.org

mersenneforum.org (https://www.mersenneforum.org/index.php)
-   NFS@Home (https://www.mersenneforum.org/forumdisplay.php?f=98)
-   -   2020 16e post processing reservations and results (https://www.mersenneforum.org/showthread.php?t=25961)

swellman 2020-09-14 17:07

2020 16e post processing reservations and results
 
Currently downloading C191_M61_k32 to see it’s ready for SNFS.

Lucas(1510) aim for 360Mrels can be moved to sieving status at any time - I’m reluctant to move it without understanding the desired Q range.

swellman 2020-09-15 23:02

I bumped Q up to 160M for Lucas(1510).

fivemack 2020-10-04 10:11

I'm doing an initial filtering run on L1510 today.

fivemack 2020-10-04 20:24

That's interesting; the status page [url]https://escatter11.fullerton.edu/nfs/crunching_fs.php[/url] says there are 390 million relations, I only see 311875466 relations of which about 249650000 unique and about 180400000 survive singleton removal, and that's not then enough for a matrix. There's plenty of free space on the processing disc so I don't think that's the issue.

I don't know if this is something frmky can usefully look at; I suspect it's easier just to throw more computrons at the problem, so I've extended the range by 20MQ.

frmky 2020-10-04 22:45

The script just counts the number of lines. A simple
zcat L1510.dat.gz | wc -l
agrees with the webpage. Sometimes the project gets odd garbage in returned files as we use a forgiving validation check. Likely that.

Edit: Doesn't seem to be that. I just did a quick remdups and got
Found 305246658 unique, 88901570 duplicate (22.6% of total), and 57712 bad relations.
Largest dimension used: 1000 of 1000
Average dimension used: 931.4 of 1000
*** Some redundant relations may have been retained (increase DIM)
*** 47650 (quasi-unique) relations were not hashed

So seems like >300M unique ones there.

fivemack 2020-10-05 11:36

[QUOTE=frmky;558891]The script just counts the number of lines. A simple
zcat L1510.dat.gz | wc -l
agrees with the webpage[/QUOTE]

Thanks for looking at that; my script was clearly misbehaving somewhere. Rerunning, I'm seeing 405321355 relations of which 405266903 are in the correct form, 312.9M unique, singleton removal running happily and I'll expect at least 255M after that pass.

(and now I have a 31M density-90 matrix and am trying to optimise the density)

fivemack 2020-10-10 10:16

L1510 linalg started, should be done 16 October evening

fivemack 2020-10-16 08:30

L1510 complete
 
1 Attachment(s)
[code]
Fri Oct 16 06:41:07 2020 p93 factor: 768278079468147872006161615793478445262891405249833298882663471356153278846031859145179203921
Fri Oct 16 06:41:07 2020 p112 factor: 3998301491227939181761854883689691516394446820135772189170217349181287770175361143916814142602476105295172951001
[/code]

133 hours on 20 cores Skylake Xeon 4114 for a 29.38M matrix at density 106

Log attached and at [url]https://pastebin.com/3e7jQc6b[/url]

swellman 2020-10-21 13:34

C191_M61_k32 Factored
 
[CODE]
p84 factor: 548495967839253555860650689244596928240665623636601859336571489439754186678079415649
p107 factor: 50144064156698295308606156707972010557985318544494830853525957506091319040013078433900267278158370866053089
[/CODE]

Details at [url]https://pastebin.com/6kNmDaEu[/url]

jyb 2020-11-02 19:12

Taking 3p2_1578M.

jyb 2020-11-03 23:08

[QUOTE=jyb;561983]Taking 3p2_1578M.[/QUOTE]

Now in linear algebra.

jyb 2020-11-10 06:10

3p2_1578M factored
 
[code]
p87 factor: 314389616949051947856531832346566233331973715733290450537058841292768618820674371082757
p112 factor: 2048934494035023127337362640577649880117135008394199282868650700432273546535823221707812398078222322032523951457
[/code]

[url]https://pastebin.com/p0DWC9ZV[/url]

VBCurtis 2020-11-29 16:37

3366_2224 is in postprocessing.

606M raw relations yielded 483M uniques, enough to build a 35.9M matrix at TD 124. It'll take 3 weeks to solve.

jyb 2020-12-18 17:46

Taking 8p3_834L.

VBCurtis 2020-12-18 18:11

[QUOTE=jyb;566577]Taking 8p3_834L.[/QUOTE]

I haven't tried one of these big quartic jobs- if you could post memory use during filtering and the size of the resulting matrix, I'd appreciate it.

jyb 2020-12-19 00:14

[QUOTE=VBCurtis;566582]I haven't tried one of these big quartic jobs- if you could post memory use during filtering and the size of the resulting matrix, I'd appreciate it.[/QUOTE]

Sure, though I probably won't start for a few days, until most of the outstanding work units have trickled in.

jyb 2020-12-22 21:54

[QUOTE=VBCurtis;566582]I haven't tried one of these big quartic jobs- if you could post memory use during filtering and the size of the resulting matrix, I'd appreciate it.[/QUOTE]

[code]
Tue Dec 22 09:26:03 2020 commencing relation filtering
Tue Dec 22 09:26:03 2020 setting target matrix density to 120.0
...
Tue Dec 22 10:03:52 2020 commencing duplicate removal, pass 2
Tue Dec 22 10:05:44 2020 found 0 duplicates and 376779347 unique relations
Tue Dec 22 10:05:44 2020 memory use: 1321.5 MB
Tue Dec 22 10:05:44 2020 reading ideals above 309919744
Tue Dec 22 10:05:44 2020 commencing singleton removal, initial pass
Tue Dec 22 10:31:57 2020 memory use: 6024.0 MB
Tue Dec 22 10:31:58 2020 reading all ideals from disk
Tue Dec 22 10:32:03 2020 memory use: 6904.4 MB
Tue Dec 22 10:32:19 2020 commencing in-memory singleton removal
Tue Dec 22 10:32:33 2020 begin with 376779347 relations and 310396245 unique ideals
Tue Dec 22 10:35:25 2020 reduce to 260546128 relations and 183665697 ideals in 14 passes
Tue Dec 22 10:35:25 2020 max relations containing the same ideal: 49
Tue Dec 22 10:35:44 2020 reading ideals above 720000
Tue Dec 22 10:35:45 2020 commencing singleton removal, initial pass
Tue Dec 22 11:01:01 2020 memory use: 6024.0 MB
Tue Dec 22 11:01:02 2020 reading all ideals from disk
Tue Dec 22 11:01:11 2020 memory use: 11439.4 MB
...
Tue Dec 22 12:11:07 2020 commencing 2-way merge
Tue Dec 22 12:11:58 2020 reduce to 55760982 relation sets and 54121813 unique ideals
Tue Dec 22 12:11:58 2020 commencing full merge
Tue Dec 22 12:35:29 2020 memory use: 7038.1 MB
...
Tue Dec 22 12:35:54 2020 commencing cycle optimization
Tue Dec 22 12:36:53 2020 start with 224975857 relations
Tue Dec 22 12:47:49 2020 pruned 10679506 relations
Tue Dec 22 12:47:49 2020 memory use: 5800.7 MB
...
Tue Dec 22 13:23:52 2020 matrix is 24785706 x 24785883 (11728.7 MB) with weight 3320871442 (133.98/col)
Tue Dec 22 13:23:52 2020 sparse part has weight 2801974712 (113.05/col)
Tue Dec 22 13:23:52 2020 saving the first 48 matrix rows for later
Tue Dec 22 13:23:56 2020 matrix includes 64 packed rows
Tue Dec 22 13:23:58 2020 matrix is 24785658 x 24785883 (11249.3 MB) with weight 2871892645 (115.87/col)
Tue Dec 22 13:23:58 2020 sparse part has weight 2701077747 (108.98/col)

[/code]
Hopefully this gives you what you want to know. I'll post the full log when the job completes.

VBCurtis 2020-12-22 22:27

3366_2224 has factors:
[code]p71 factor: 18437836149618370434281620971869325865705306903528887274585655227576391
p125 factor: 75850361765365741605637348986331036062471006912738915817734014124420263971333307633217450014316434148733029960124938048103847
[/code]

483M unique 32/33LP relations built a 35.9M matrix at TD=124. This took ~23 days to solve on 10 cores of Ivy Bridge- Xeon.

Log at [url]https://pastebin.com/FFdgRNch[/url]

jyb 2020-12-22 23:32

8p3_834L now in linear algebra.

VBCurtis 2020-12-23 00:22

[QUOTE=jyb;567022]Hopefully this gives you what you want to know. I'll post the full log when the job completes.[/QUOTE]

Thanks! That tells me a 16GB machine would be enough to solve the matrix, though not one used for other tasks in the meantime.

jyb 2020-12-31 05:22

8p3_834L factored
 
[code]
p64 factor: 5386615734827920616029575531764652188196347636472473209711568761
p152 factor: 62370657862363077291574785799128273676421390467762922777213566905164376399690598317917531084078601547482547033055023736429949223064689741704179177271793
[/code]

[url]https://pastebin.com/MmA7r0f8[/url]


All times are UTC. The time now is 10:34.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.