Reserved for MF - Sequence 3408 - Page 30

pinhodecarlos · 2016-10-07, 17:13

Quote:

Originally Posted by EdH

It's a week and I'm a little less than half way (~35M unique) to the expected necessary relations. This is actually slower than I had anticipated. If my estimate is also off, this will still be quite a while...

Don't worry, I'll still post-process it. Just don't forget to send me by PM the link to download the relations file.

EdH · 2016-10-08, 02:23

Quote:

Originally Posted by pinhodecarlos

Don't worry, I'll still post-process it. Just don't forget to send me by PM the link to download the relations file.

OK, I'll start testing for a matrix at about 75M and let you know. I'm still going to try to find out if my cluster could handle it and what ETA it would give me. I would like to see how it compares to yours. If it says it would wok and it's not that far off, I'll let you decide which of us finishes it. Thanks.

EdH · 2016-10-10, 00:52

Well, I have enough relations for a matrix according to msieve, at a little under 50M. My trouble is that I can't get any file hosting service to accept anything of size. I'm currently trying to get sendspace to accept them, but at 150KB/s, it'll be tomorrow before I can get "all the little pieces" up on line.

And, yes, I compressed them.

I used split to make smaller parts - cat can sew them back together. I .zipped each one and am trying to upload them to sendspace. I tried some other file hosting places, but nothing else worked.

On the bright side, if I let my cluster do it, it says ~59 hours. Might be sooner than it will take to transfer the relations and start another machine.

Thoughts?

After-thought: Maybe I should have been sending groups of raw relations all along, rather than waiting to compile a file of unique relations...

Sergei Chernykh · 2016-10-10, 07:29

Quote:

Originally Posted by EdH

Well, I have enough relations for a matrix according to msieve, at a little under 50M. My trouble is that I can't get any file hosting service to accept anything of size. I'm currently trying to get sendspace to accept them, but at 150KB/s, it'll be tomorrow before I can get "all the little pieces" up on line.

And, yes, I compressed them.

What's the size of your files? drive.google.com offers 15 GB of free space for example.

EdH · 2016-10-10, 13:05

Quote:

Originally Posted by Sergei Chernykh

What's the size of your files? drive.google.com offers 15 GB of free space for example.

My total file is about 2.7G compressed. I also tried breaking it into 2, 4, 8 pieces. But, all the sites that said they would accept it, either wouldn't at all or had some error page show up. I finally went with sendspace, which I have used in the past, but they insist on uploads of less than 300M.

I'll check out drive.google.com.

Thanks...

EdH · 2016-10-10, 13:09

Quote:

Originally Posted by pinhodecarlos

Don't worry, I'll still post-process it. Just don't forget to send me by PM the link to download the relations file.

PM sent...

pinhodecarlos · 2016-10-10, 15:12

Quote:

Originally Posted by EdH

PM sent...

Hi Ed,

I'm sorry for there's some sort of daily download quote from sendspace and I can't download all files today. Finish the first 4 but I am blocked for download for the next 8 hours. At this download pace you better run yourself the post-processing.
This is so stupid this sendspace rule.

Carlos

EDIT: Trying to download the files with different IP's in different machines.

EdH · 2016-10-10, 15:22

Quote:

Originally Posted by pinhodecarlos

Hi Ed,

I'm sorry for there's some sort of daily download quote from sendspace and I can't download all files today. Finish the first 4 but I am blocked for download for the next 8 hours. At this download pace you better run yourself the post-processing.
This is so stupid this sendspace rule.

Carlos

Thanks Carlos,

I should have the factors on Wednesday morning from my cluster. I'll do some research and come up with a better method for next time. Even if I found a good place to put them, my upload speed isn't all that great, so it would still be quite a while before they would be available.

Take Care,
Ed

henryzz · 2016-10-10, 15:27

I have used wetransfer several times. There is a limit of 2GB but you can do multiple files. Dropbox, google drive, one drive etc are probably the most helpful options for this sort of thing.

pinhodecarlos · 2016-10-10, 15:31

Ed,

Are the fb and ini files on the zipped files?

EDIT: do you know how many unique relations do you have so I can guess which target density to use on msieve?
EDIT2: Missing downloads should be completed within 1 hour. Then I guess in 1h30 I will have an ETA for the LA.

EdH · 2016-10-10, 15:51

Quote:

Originally Posted by pinhodecarlos

Ed,

Are the fb and ini files on the zipped files?

I did not include those. This is the fb file:

Code:

N 273160738474933720738173971888648839004631254638334337328524154446360567876622758785071571728319901973105785355719274809547476812666409616142295140388748295147911
R0 -12041698219452787828222430533215
R1 3878686267217897
A0 -801873829760148253152787721272602612832
A1 2224566967366623497028146775700034
A2 -80044704608077672201472505
A3 -160143293651048845430
A4 424445477332
A5 1078896
SKEW 6380639.92

This is the number file:

Code:

N 273160738474933720738173971888648839004631254638334337328524154446360567876622758785071571728319901973105785355719274809547476812666409616142295140388748295147911

I used the following command lines:

Code:

./msieve -i number -s totalRels -l test.log -nf TeamPoly.fb -nc1

Code:

mpirun -n 3 --hostfile ./hostsfile ../msieve/msieve -t 2 -i number -s totalRels -l test.log -nf TeamPoly.fb -nc2 3,1

2016-10-10, 00:52	#322
EdH "Ed Hall" Dec 2009 Adirondack Mtns 2×3×5×11² Posts	Well, I have enough relations for a matrix according to msieve, at a little under 50M. My trouble is that I can't get any file hosting service to accept anything of size. I'm currently trying to get sendspace to accept them, but at 150KB/s, it'll be tomorrow before I can get "all the little pieces" up on line. And, yes, I compressed them. I used split to make smaller parts - cat can sew them back together. I .zipped each one and am trying to upload them to sendspace. I tried some other file hosting places, but nothing else worked. On the bright side, if I let my cluster do it, it says ~59 hours. Might be sooner than it will take to transfer the relations and start another machine. Thoughts? After-thought: Maybe I should have been sending groups of raw relations all along, rather than waiting to compile a file of unique relations... Last fiddled with by EdH on 2016-10-10 at 01:06 Reason: accuracy

2016-10-10, 15:31	#329
pinhodecarlos "Carlos Pinho" Oct 2011 Milton Keynes, UK 5·7·139 Posts	Ed, Are the fb and ini files on the zipped files? EDIT: do you know how many unique relations do you have so I can guess which target density to use on msieve? EDIT2: Missing downloads should be completed within 1 hour. Then I guess in 1h30 I will have an ETA for the LA. Last fiddled with by pinhodecarlos on 2016-10-10 at 15:48

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Reserved for MF - Sequence 3366	RichD	Aliquot Sequences	468	2021-01-27 01:16
Reserved for MF - Sequence 4788	schickel	Aliquot Sequences	2934	2021-01-07 18:52
Reserved for MF - Sequence 276	kar_bon	Aliquot Sequences	127	2020-12-17 10:05
Team Sieve #37: 3408:i1287	RichD	Aliquot Sequences	14	2013-08-02 17:02
80M to 64 bits ... but not really reserved	petrw1	Lone Mersenne Hunters	82	2010-01-11 01:57

2016-10-10, 15:27	#328
henryzz Just call me Henry "David" Sep 2007 Cambridge (GMT/BST) 2×2,909 Posts	I have used wetransfer several times. There is a limit of 2GB but you can do multiple files. Dropbox, google drive, one drive etc are probably the most helpful options for this sort of thing.