mersenneforum.org  

Go Back   mersenneforum.org > Great Internet Mersenne Prime Search > PrimeNet

Reply
 
Thread Tools
Old 2014-09-07, 04:48   #650
kladner
 
kladner's Avatar
 
"Kieren"
Jul 2011
In My Own Galaxy!

998310 Posts
Default

4:45 AM UTC, 9/7/14

Rather than start a separate thread, I will note here that GPU72's Assignments page is responding with:
Quote:
500 Internal Server Error

Internal Server Error

The server encountered an internal error or misconfiguration and was unable to complete your request.
Please contact the server administrator, chalsall@ideas4lease.com and inform them of the time the error occurred, and anything you might have done that may have caused the error.
More information about this error may be available in the server error log.
I'll also drop Chris an email.

Last fiddled with by kladner on 2014-09-07 at 04:51
kladner is offline   Reply With Quote
Old 2014-09-07, 05:31   #651
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

29×113 Posts
Default

Quote:
Originally Posted by kladner View Post
4:45 AM UTC, 9/7/14

Rather than start a separate thread, I will note here that GPU72's Assignments page is responding with [...]
I'll also drop Chris an email.
Since the manual submission page got a reworking, and that's what GPU72 uses, I'm going to guess Chris might need to tweak something in there.

I haven't looked at the new manual pages myself so I don't have any idea what changes might be needed, if any.
Madpoo is offline   Reply With Quote
Old 2014-09-07, 05:41   #652
kladner
 
kladner's Avatar
 
"Kieren"
Jul 2011
In My Own Galaxy!

67×149 Posts
Default

The page is back to normal now. 5:40 UTC
kladner is offline   Reply With Quote
Old 2014-09-07, 17:35   #653
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

29·113 Posts
Default Any feedback on the performance?

Besides changes on the software side of things, how are y'all liking the server performance itself?

Just to recap, we've had 2 different migrations.

First one was from the old hardware to a temporary virtual server. That was on Aug 19/20 and involved most of the heavy lifting with upgrading the OS, SQL, PHP, and fixing up things that needed it as a result of the updates.

That temp virtual machine had 16 GB of RAM and had a C: and D: drive for the SQL data/log, and it did pretty well for itself.

The second migration is the one we did Thursday (Sep 4) to it's new server. It's still a virtual machine for easier migrations in the future, but it's on a dedicated physical box.

The new setup has 54 GB (I saved 6 for the host OS) and has dedicated virtual drives, each on their own physical disks, for the SQL data, log, and now a separate array just for the indexes.

With that amount of RAM, the entire DB could basically fit in memory, and over time SQL would do just that. Disk reads and writes are still fast, but having things cached in RAM is a pretty big deal. :)

I wanted to share some of those nitty gritty details for the geeks out there, and also to get any feedback on the "feel" of the site. It's one thing to look at a bunch of numbers and graphs, but the "perceived" performance is what matters.
Madpoo is offline   Reply With Quote
Old 2014-09-07, 20:13   #654
S485122
 
S485122's Avatar
 
Sep 2006
Brussels, Belgium

2×787 Posts
Default

All of the GIMPS participants thank you and also of course Scott, James, George and ... !

I do not use the site a lot these days, but it does seem much more responsive.

Thanks again.

Jacob
S485122 is online now   Reply With Quote
Old 2014-09-07, 20:43   #655
M29
 
M29's Avatar
 
Dec 2003

163 Posts
Default

Madpoo, you could talk a bit about power (consumption, monitoring, and managing). I know nothing about it.

About the data base, physical disks, tables, indices, and logs .... I cut my teeth on data bases, but that was back in 1980. At the time, I got best performance by logging to a dedicated device (because logs are written sequentially)

Index files went to a device other than their table. In other words, not all indices to one device and all tables to a different device. That was just a rule of thumb, an initial allocation before profiling, balancing, and optimizing. It was also in the day when a 4 MB drive cost a fortune and memory was at a premium.

Last fiddled with by M29 on 2014-09-07 at 20:44
M29 is offline   Reply With Quote
Old 2014-09-08, 02:50   #656
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

327710 Posts
Default

Quote:
Originally Posted by M29 View Post
Madpoo, you could talk a bit about power (consumption, monitoring, and managing). I know nothing about it.

About the data base, physical disks, tables, indices, and logs .... I cut my teeth on data bases, but that was back in 1980. At the time, I got best performance by logging to a dedicated device (because logs are written sequentially)

Index files went to a device other than their table. In other words, not all indices to one device and all tables to a different device. That was just a rule of thumb, an initial allocation before profiling, balancing, and optimizing. It was also in the day when a 4 MB drive cost a fortune and memory was at a premium.
The colocation the server is in is providing 312W (1.5A @ 208V), so I had to enable the power capping feature on the Proliant server at 312W. In truth, capping it didn't really do much. To test it, I used Prime95 running on all cores and then checked how much power it drew if left unrestricted, and it went up past 400W.

Capped at 312W, all it really had to do was set the processor cores into P1 state, basically turning off the turbo boost. If I set the cap even lower like 250W it would throttle the cores even more, down to P3/P4 territory, lowering the 2.67GHz CPU's down to below 2GHz, but that was enough to keep things under the limit.

In practice, the server doesn't use that much CPU and it's power use is under the cap anyway.

On the DB side, if you consider that the old physical server had everything crammed onto a single pair of 72GB drives (OS, web files, SQL data/log/index), it's easy to appreciate the new setup. The OS and web files are still sharing a drive with the SQL data (MDF) files, but since those tend to be more read-heavy, and it's a 4-disk RAID 5, it has no problem keeping up.

The separate 2-drive RAID 1 arrays for the SQL logs and indexes are also easily able to keep up with the write demands. Moving the indexes from one table in particular, which is basically a log of each client transaction, was a big help. The index is bigger than the table itself by a good amount, and it does get updated all through a typical day, so it kind of blew the whole concept of the data file being mostly reads... the index on it made it more write-heavy.

It also helps out when the index is being reorganized. Actually I haven't done that yet since moving to the new system because they were all rebuilt at the time, but in theory, it should make the reorg run a lot faster.
Madpoo is offline   Reply With Quote
Old 2014-09-08, 03:18   #657
Xyzzy
 
Xyzzy's Avatar
 
"Mike"
Aug 2002

7,699 Posts
Default

How much interaction have you have with Scott with this makeover?
Xyzzy is offline   Reply With Quote
Old 2014-09-08, 03:42   #658
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

CCD16 Posts
Default

Quote:
Originally Posted by M29 View Post
Madpoo, you could talk a bit about power (consumption, monitoring, and managing). I know nothing about it.
On the monitoring side, for now I've added the host and guest OS to my own monitoring suite (Solarwinds NPM). It's pulling system stats every 15 minutes. I'll probably set some alerts to ping me when drive usage gets high or if the CPU starts spiking for prolonged periods.

Managing it for now will probably just be standard stuff... make sure it's patched with the latest Microsoft and PHP things, ensuring backups are happening, and generally following the "proper care and feeding of a Windows server" instruction book.

Let's see if I can successfully attach a PNG that shows the ambient server temp for the past 24 hours. Long term I probably can't keep monitoring the system with my own software so we'll find something that can do the basic monitoring and alerting. Disk space is probably tops on the list since there have been several examples of the log file filling the drive and causing errors. But the Solarwinds product is so cool, I had to make use of it while I can. :)
Attached Thumbnails
Click image for larger version

Name:	Server_temp.png
Views:	61
Size:	39.0 KB
ID:	11682  
Madpoo is offline   Reply With Quote
Old 2014-09-08, 15:15   #659
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

63158 Posts
Default

Quote:
Originally Posted by Xyzzy View Post
How much interaction have you have with Scott with this makeover?
He and the rest of the gang (George, Luke, et al) were involved in a lot of the decision making like the selection process for a new colocation for the server. As far as hands on it was basically George, James and myself.

I hope they had as much fun as I did. Upgrading a system like this and being able to track some real time progress is kind of fun.

For instance, we updated the robots.txt file the other day and there was an almost immediate improvement in the # of instances where www.mersenne.org is showing up in someone's search results. That plus the performance increases gives me that warm, satisfied feeling of a job well done.
Madpoo is offline   Reply With Quote
Old 2014-09-08, 15:48   #660
kladner
 
kladner's Avatar
 
"Kieren"
Jul 2011
In My Own Galaxy!

67·149 Posts
Default

Quote:
Originally Posted by Madpoo View Post
He and the rest of the gang (George, Luke, et al) were involved in a lot of the decision making like the selection process for a new colocation for the server. As far as hands on it was basically George, James and myself.

I hope they had as much fun as I did. Upgrading a system like this and being able to track some real time progress is kind of fun.*

For instance, we updated the robots.txt file the other day and there was an almost immediate improvement in the # of instances where www.mersenne.org is showing up in someone's search results. That plus the performance increases gives me that warm, satisfied feeling of a job well done.
*It has been fascinating and educational to follow the discussions, and to watch the whole enterprise come into focus. Many thanks to all who put thought and effort into this accomplishment.
kladner is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Official "Faits erronés dans de belles-lettres" thread ewmayer Lounge 39 2015-05-19 01:08
Official "all-Greek-to-me Fiction Literature and Cinema" Thread ewmayer Science & Technology 41 2014-04-16 11:54
Official "Lasciate ogne speranza" whinge-thread cheesehead Soap Box 56 2013-06-29 01:42
Official "Ernst is a deceiving bully and George is a meanie" thread cheesehead Soap Box 61 2013-06-11 04:30
Official "String copy Statement Considered Harmful" thread Dubslow Programming 19 2012-05-31 17:49

All times are UTC. The time now is 16:44.

Tue Oct 20 16:44:51 UTC 2020 up 40 days, 13:55, 1 user, load averages: 1.91, 2.51, 2.66

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.