mersenneforum.org  

Go Back   mersenneforum.org > Great Internet Mersenne Prime Search > Data > mersenne.ca

Reply
 
Thread Tools
Old 2020-11-15, 16:21   #12
James Heinrich
 
James Heinrich's Avatar
 
"James Heinrich"
May 2004
ex-Northern Ontario

327110 Posts
Default

Switched my brain back on, wrote a script to run through the 1080 .sql.gz files that need importing. Found the new server doesn't have PHP-cli installed, had to fight with that for a while, but now the import is going. This will take quite a few hours, no ETA yet.
James Heinrich is offline   Reply With Quote
Old 2020-11-15, 18:36   #13
James Heinrich
 
James Heinrich's Avatar
 
"James Heinrich"
May 2004
ex-Northern Ontario

CC716 Posts
Default

Looking at the rough progress in terms of bytes processed per time, my ETA for importing the remaining data is currently 8 hours from now.
James Heinrich is offline   Reply With Quote
Old 2020-11-15, 19:29   #14
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

2·11·431 Posts
Default

Quote:
Originally Posted by James Heinrich View Post
Looking at the rough progress in terms of bytes processed per time, my ETA for importing the remaining data is currently 8 hours from now.
Thanks, James, for the work you do to keep us all situationally aware with your site.

We all appreciated that a non-trivial amount of (volunteer) work is involved.

A bit of down-time is not unreasonable for a once-every-few-years migration to better hardware.
chalsall is online now   Reply With Quote
Old 2020-11-15, 20:14   #15
James Heinrich
 
James Heinrich's Avatar
 
"James Heinrich"
May 2004
ex-Northern Ontario

63078 Posts
Default

Pretty graphs, if anyone cares. Database import is highly CPU-limited (single-core), and you can see how the different data table structure affects IOPS: earlier it was doing very small rows (12 bytes/record I think) with a single key, right now when it's importing larger rows with multiple indexes. ETA says 3.9h
Attached Thumbnails
Click image for larger version

Name:	graph1.png
Views:	54
Size:	102.2 KB
ID:	23792  
James Heinrich is offline   Reply With Quote
Old 2020-11-15, 22:17   #16
Uncwilly
6809 > 6502
 
Uncwilly's Avatar
 
"""""""""""""""""""
Aug 2003
101×103 Posts

11×853 Posts
Default

https://www.mersenneforum.org/avatars/avatar164_5.gif

Your site is such a good help for us all.
Uncwilly is online now   Reply With Quote
Old 2020-11-16, 01:29   #17
James Heinrich
 
James Heinrich's Avatar
 
"James Heinrich"
May 2004
ex-Northern Ontario

CC716 Posts
Default

That was fun... watching the graphs and all of a sudden I see disk free space tank at an alarming rate and no idea why, disk got up to 98% full before I found the enabled-by-default backup option in Plesk. Killed that, resuming import...
James Heinrich is offline   Reply With Quote
Old 2020-11-16, 03:14   #18
James Heinrich
 
James Heinrich's Avatar
 
"James Heinrich"
May 2004
ex-Northern Ontario

63078 Posts
Default

Just finished importing the last database table. Now to try and plug everything together to get the site online again...
James Heinrich is offline   Reply With Quote
Old 2020-11-16, 04:17   #19
James Heinrich
 
James Heinrich's Avatar
 
"James Heinrich"
May 2004
ex-Northern Ontario

3,271 Posts
Default

And, no surprise, DNS is giving me grief...
James Heinrich is offline   Reply With Quote
Old 2020-11-16, 05:30   #20
James Heinrich
 
James Heinrich's Avatar
 
"James Heinrich"
May 2004
ex-Northern Ontario

3,271 Posts
Default

Apparently IONOS has a very strict default firewall policy, I had to manually open port 53 for DNS queries.
James Heinrich is offline   Reply With Quote
Old 2020-11-16, 05:42   #21
axn
 
axn's Avatar
 
Jun 2003

4,861 Posts
Default

The site now renders. GIMPS Progress Visualization looks like needs to be generated for the first time in new server; presumably after the last couple of days' data is ingested, it will get generated.
axn is offline   Reply With Quote
Old 2020-11-16, 05:51   #22
Mark Rose
 
Mark Rose's Avatar
 
"/X\(‘-‘)/X\"
Jan 2013

29×101 Posts
Default

In the future, you can pipe the output of mysqldump to the mysql command on the remote server using nc. It's too late now, but something to keep in mind. And to do it encrypted you could forward a port using ssh. The only downside is that it's not a resumable process, so I would run the commands on both systems in screen or tmux.
Mark Rose is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Password recovery for v4 migration edr077 Information & Answers 1 2014-12-26 15:45
FactorDB is moving to another server this night -> some downtime Syd FactorDB 34 2012-02-03 19:18
Migration from Core 2 Quad to i7 965 Freightyard Hardware 30 2010-02-01 17:09
Planned downtime on GB servers mdettweiler No Prime Left Behind 35 2009-11-22 01:50

All times are UTC. The time now is 19:44.

Mon Mar 8 19:44:36 UTC 2021 up 95 days, 15:55, 1 user, load averages: 1.14, 1.25, 1.38

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.