mersenneforum.org  

Go Back   mersenneforum.org > Factoring Projects > Aliquot Sequences

Reply
 
Thread Tools
Old 2010-10-11, 20:18   #34
axn
 
axn's Avatar
 
Jun 2003

2·32·7·37 Posts
Default

Quote:
Originally Posted by em99010pepe View Post
Code:
Mon Oct 11 20:53:31 2010  found 12742177 hash collisions in 25484354 relations
Mon Oct 11 20:54:04 2010  added 119945 free relations
Mon Oct 11 20:54:04 2010  commencing duplicate removal, pass 2
Mon Oct 11 20:54:17 2010  found 13148629 duplicates and 12455670 unique relations
WTH? You must've accidentally copied the same file twice or something. That's way too many duplicates.
axn is offline   Reply With Quote
Old 2010-10-11, 20:52   #35
em99010pepe
 
em99010pepe's Avatar
 
Sep 2004

B0E16 Posts
Default

Quote:
Originally Posted by axn View Post
WTH? You must've accidentally copied the same file twice or something. That's way too many duplicates.
I downloaded bsquared's files, unziped the bz2 files and merged all dat files by using the following script:

Code:
@echo off
type *.dat>>msieve.dat
EDIT: You are right, the script duplicated the merge! When extracting all bz2, getting lots of dat files, the sum of all of them is only 1.35 GB in size. How can I fix this? It is a pain to merge dat file by dat file.

Last fiddled with by em99010pepe on 2010-10-11 at 21:03
em99010pepe is offline   Reply With Quote
Old 2010-10-11, 21:13   #36
bsquared
 
bsquared's Avatar
 
"Ben"
Feb 2007

3,271 Posts
Default

The problem is that *.dat matches msieve.dat too, so that msieve.dat gets copied to the end of itself. A slight modification of your script would probably do it: change *.dat to something which matches all desired files but not msieve.dat. For example, all my files have the string 4788.2549 in the file name, so doing "type 4788.2549*.dat >> msieve.dat" would probably work.
bsquared is offline   Reply With Quote
Old 2010-10-11, 21:18   #37
em99010pepe
 
em99010pepe's Avatar
 
Sep 2004

2·5·283 Posts
Default

Quote:
Originally Posted by bsquared View Post
The problem is that *.dat matches msieve.dat too, so that msieve.dat gets copied to the end of itself. A slight modification of your script would probably do it: change *.dat to something which matches all desired files but not msieve.dat. For example, all my files have the string 4788.2549 in the file name, so doing "type 4788.2549*.dat >> msieve.dat" would probably work.
Thank you. That worked.

Code:
Mon Oct 11 22:15:24 2010  
Mon Oct 11 22:15:24 2010  
Mon Oct 11 22:15:24 2010  Msieve v. 1.47
Mon Oct 11 22:15:24 2010  random seeds: 8e06bfcc eb8a4915
Mon Oct 11 22:15:24 2010  factoring 31312681856591762976684825948611411853648506930718408786922952694966820760977803934965693400499529851375037912983239126649207012737394067178518887401399185420987310860499 (170 digits)
Mon Oct 11 22:15:25 2010  searching for 15-digit factors
Mon Oct 11 22:15:25 2010  commencing number field sieve (170-digit input)
Mon Oct 11 22:15:25 2010  R0: -217612366832903667482868415880575
Mon Oct 11 22:15:25 2010  R1:  542063406908335635313
Mon Oct 11 22:15:25 2010  A0:  3449752476991340409710593294897864121568
Mon Oct 11 22:15:25 2010  A1:  3679068299798050640485923392826756
Mon Oct 11 22:15:25 2010  A2: -55695962181000919237307903624
Mon Oct 11 22:15:25 2010  A3:  5626603601260154351771
Mon Oct 11 22:15:25 2010  A4:  6624408564633178
Mon Oct 11 22:15:25 2010  A5:  64149120
Mon Oct 11 22:15:25 2010  skew 2848875.02, size 1.089e-016, alpha -8.144, combined = 2.852e-013 rroots = 5
Mon Oct 11 22:15:25 2010  
Mon Oct 11 22:15:25 2010  commencing relation filtering
Mon Oct 11 22:15:25 2010  estimated available RAM is 8183.1 MB
Mon Oct 11 22:15:25 2010  commencing duplicate removal, pass 1
Mon Oct 11 22:16:42 2010  found 900938 hash collisions in 12742177 relations
Mon Oct 11 22:17:14 2010  added 119945 free relations
Mon Oct 11 22:17:14 2010  commencing duplicate removal, pass 2
Mon Oct 11 22:17:18 2010  found 406452 duplicates and 12455670 unique relations
Mon Oct 11 22:17:18 2010  memory use: 49.3 MB
Mon Oct 11 22:17:18 2010  reading ideals above 720000
Mon Oct 11 22:17:18 2010  commencing singleton removal, initial pass
em99010pepe is offline   Reply With Quote
Old 2010-10-12, 06:25   #38
schickel
 
schickel's Avatar
 
"Frank <^>"
Dec 2004
CDP Janesville

2·1,061 Posts
Thumbs up

Thanks guys! It was starting to feel kinda lonely out here....
schickel is offline   Reply With Quote
Old 2010-10-12, 18:09   #39
bchaffin
 
Sep 2010
Portland, OR

1011100112 Posts
Default

Well that wasn't so bad, less than 2 days for a million:

30m-31m

I'll take 47.2m-50m next.
bchaffin is offline   Reply With Quote
Old 2010-10-12, 18:41   #40
em99010pepe
 
em99010pepe's Avatar
 
Sep 2004

2×5×283 Posts
Default

Quote:
Originally Posted by bchaffin View Post
Well that wasn't so bad, less than 2 days for a million:

30m-31m

I'll take 47.2m-50m next.
Which machine do you have?
Downloaded.
Relations received: 14.2M unique
(found 552507 duplicates and 14287022 unique relations)

Last fiddled with by em99010pepe on 2010-10-12 at 18:42
em99010pepe is offline   Reply With Quote
Old 2010-10-12, 21:22   #41
bchaffin
 
Sep 2010
Portland, OR

17316 Posts
Default

Quote:
Originally Posted by em99010pepe View Post
Which machine do you have?
Running on a Xeon X5670, aka Westmere 6-core. I'm running 6 threads, but there's a bunch of other stuff running as well so hard to say how many cores I'm getting on average. But it's wicked fast, anyway. :)
bchaffin is offline   Reply With Quote
Old 2010-10-12, 21:35   #42
em99010pepe
 
em99010pepe's Avatar
 
Sep 2004

2·5·283 Posts
Default

Mini-Geek,

Unique relations received so far is 14287022 not in bchaffin's range.

30M to 31M has 2040094 unique relations

Last fiddled with by em99010pepe on 2010-10-12 at 21:35
em99010pepe is offline   Reply With Quote
Old 2010-10-12, 21:42   #43
Mini-Geek
Account Deleted
 
Mini-Geek's Avatar
 
"Tim Sorbera"
Aug 2006
San Antonio, TX USA

426710 Posts
Default

Quote:
Originally Posted by em99010pepe View Post
Mini-Geek,

Unique relations received so far is 14287022 not in bchaffin's range.

30M to 31M has 2040094 unique relations
Oh, I see. Fixed. But unless I've missed something or am misunderstanding how unique relations work, something doesn't quite add up: 40-47.2M has 12455670 unique rels, and 30-31M has 2040094. 12455670+2040094=14495764, but you're reporting 14287022. It's not a very big difference (14.5M vs 14.3M), but I'm still curious. Do you know why that is?
Mini-Geek is offline   Reply With Quote
Old 2010-10-12, 21:45   #44
em99010pepe
 
em99010pepe's Avatar
 
Sep 2004

2·5·283 Posts
Default

Quote:
Originally Posted by Mini-Geek View Post
Oh, I see. Fixed. But unless I've missed something or am misunderstanding how unique relations work, something doesn't quite add up: 40-47.2M has 12455670 unique rels, and 30-31M has 2040094. 12455670+2040094=14495764, but you're reporting 14287022. It's not a very big difference (14.5M vs 14.3M), but I'm still curious. Do you know why that is?
I only reported what msieve gave me while doing -nc.
em99010pepe is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Team sieve #44: C158 from 4788:i5212 RichD Aliquot Sequences 29 2014-04-13 01:55
Team sieve #42: C161 from 4788:i5193 RichD Aliquot Sequences 49 2013-12-17 12:27
Team sieve #34: c148 from 4788:i2910 jrk Aliquot Sequences 14 2012-02-24 15:10
ECM work on 4788:2549.c170 schickel Aliquot Sequences 51 2011-01-05 02:32
Team sieve #3: c131 from 4788:2382 10metreh Aliquot Sequences 39 2009-05-03 14:02

All times are UTC. The time now is 21:29.

Mon Aug 3 21:29:02 UTC 2020 up 17 days, 17:15, 0 users, load averages: 1.61, 1.48, 1.43

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.