mersenneforum.org  

Go Back   mersenneforum.org > Great Internet Mersenne Prime Search > PrimeNet

Reply
 
Thread Tools
Old 2014-09-09, 21:27   #672
kladner
 
kladner's Avatar
 
"Kieren"
Jul 2011
In My Own Galaxy!

3·3,313 Posts
Default

This isn't really a problem, just an oddity. I expect it to resolve itself. The upper portion is the communication with PrimeNet; the lower is from P95 Status.
Attached Thumbnails
Click image for larger version

Name:	PrimeNet Response.JPG
Views:	46
Size:	58.8 KB
ID:	11689  
kladner is offline   Reply With Quote
Old 2014-09-09, 21:30   #673
garo
 
garo's Avatar
 
Aug 2002
Termonfeckin, IE

AC216 Posts
Default

Manual assigments page is very slow when given a range. For example, I just tried to get lowest first-time tests with range 68M-80M. Without a range it is blazingly fast. With a range it took over 100 seconds to return the assignments. Example AID:
45CDF8382E4DFB8B4E822BA914F5838E

to help with the logs.
garo is offline   Reply With Quote
Old 2014-09-09, 22:44   #674
Prime95
P90 years forever!
 
Prime95's Avatar
 
Aug 2002
Yeehaw, FL

11011100000012 Posts
Default

Over the coming days, maybe weeks, I'll be cleaning up the PHP code that is called when prime95 contacts the server. There are numerous poor programming practices that must be eliminated. There are inconsistencies between the way the web pages do their work and the way the API does its work. There are places where the web pages and API should be sharing code.

Don't be surprised if I break something every now and then. Thanks for your patience.
Prime95 is offline   Reply With Quote
Old 2014-09-10, 08:33   #675
LaurV
Romulan Interpreter
 
LaurV's Avatar
 
Jun 2011
Thailand

22×17×127 Posts
Default

Quote:
Originally Posted by kladner View Post
This isn't really a problem, just an oddity. I expect it to resolve itself. The upper portion is the communication with PrimeNet; the lower is from P95 Status.
As we have seen some values/fields magically disappeared (zerorized) on the server during the transfer to a new home, this may be caused by the same phenomenon, if the "hours to work per day" was cleaned on the server side. Your P95 knows that you are working 24 (or 12, or 59, hehe) hours per day for this expo, but the server believe you are only working much less amount of hours per day (zero?) so the time to arrival is longer...

This should solve by itself after few talks (progress reports) to the server, indeed, if that's the case.

Last fiddled with by LaurV on 2014-09-10 at 08:34
LaurV is offline   Reply With Quote
Old 2014-09-10, 14:28   #676
kladner
 
kladner's Avatar
 
"Kieren"
Jul 2011
In My Own Galaxy!

3·3,313 Posts
Default

Quote:
Originally Posted by LaurV View Post
.....
This should solve by itself after few talks (progress reports) to the server, indeed, if that's the case.
Indeed it did, next time it checked in.
kladner is offline   Reply With Quote
Old 2014-09-10, 17:50   #677
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

2·1,637 Posts
Default

Quote:
Originally Posted by LaurV View Post
As we have seen some values/fields magically disappeared (zerorized) on the server during the transfer to a new home, this may be caused by the same phenomenon, if the "hours to work per day" was cleaned on the server side. Your P95 knows that you are working 24 (or 12, or 59, hehe) hours per day for this expo, but the server believe you are only working much less amount of hours per day (zero?) so the time to arrival is longer...

This should solve by itself after few talks (progress reports) to the server, indeed, if that's the case.
It *probably* wasn't due to the server move itself so much as some other back end changes that might have been done to the check in code.

The DB itself was migrated over pretty easily from SQL 2005 to SQL 2012, thank goodness (and 32-bit to 64-bit).

We didn't really experience any incompatibilities in the queries or sprocs with the SQL version updates, which was a relief. Most of the work revolved around changes between PHP versions during the upgrade (5.2 up to 5.5) and some deprecated language, functions, etc. which required some tinkering.

There were also some old warnings that had been suppressed previously that we started to notice after the move since the PHP logging level was a little different. Things that had always been there, and weren't really critical but annoying enough that James has been doing a good job at squashing.

Point being, once the nitty gritty of the upgrade was done and tested, it was also an opportunity to look at some old PHP code and get it fixed up or just brought up to modern standards.

If you do see more odd behavior from the site (that wasn't there before), be sure to point those things out. There has been real good feedback so far.
Madpoo is offline   Reply With Quote
Old 2014-09-10, 18:22   #678
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

2·1,637 Posts
Default

Quote:
Originally Posted by garo View Post
Manual assigments page is very slow when given a range. For example, I just tried to get lowest first-time tests with range 68M-80M. Without a range it is blazingly fast. With a range it took over 100 seconds to return the assignments. Example AID:
45CDF8382E4DFB8B4E822BA914F5838E

to help with the logs.
Is that something you've done in the past, and it worked okay (when selecting a range for new assignments)?

I'd have to see what kind of query is happening behind the scenes when a request like that comes in.

I couldn't actually find that assignment ID anywhere. I looked at all assignments and also the ones for your account specifically but I didn't see it. Has it already been checked in?

Were these requests for TF work (not likely in that range) or was this for first time LL?
Madpoo is offline   Reply With Quote
Old 2014-09-10, 18:40   #679
garo
 
garo's Avatar
 
Aug 2002
Termonfeckin, IE

2×34×17 Posts
Default

Quote:
Originally Posted by Madpoo View Post
Is that something you've done in the past, and it worked okay (when selecting a range for new assignments)?

I'd have to see what kind of query is happening behind the scenes when a request like that comes in.

I couldn't actually find that assignment ID anywhere. I looked at all assignments and also the ones for your account specifically but I didn't see it. Has it already been checked in?

Were these requests for TF work (not likely in that range) or was this for first time LL?
I do not know if this is a new problem because I rarely use the manual assignments page. So many pages were slow or broken previously that I wouldn't have noticed. Also apologies for sending you on a wild goose chase but I unreserved the AID after 24 hours when no one responded.

To confirm slowness you can try to retrieve two LLs yourself. I chose first time tests in the dropdown.
garo is offline   Reply With Quote
Old 2014-09-10, 19:11   #680
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

2·1,637 Posts
Default

Quote:
Originally Posted by garo View Post
I do not know if this is a new problem because I rarely use the manual assignments page. So many pages were slow or broken previously that I wouldn't have noticed. Also apologies for sending you on a wild goose chase but I unreserved the AID after 24 hours when no one responded.

To confirm slowness you can try to retrieve two LLs yourself. I chose first time tests in the dropdown.
I decided to look into the code itself at the query that grabs first time LL work. If I do it directly in SQL and use a range of 68M - 80M it took about 3 seconds to run and showed a couple exponents in that range that would be first time LL tests.

Note that it will apparently run this same query once for each exponent you want assigned. So presumably, 3 seconds if you're just getting one, and then multiply by the # of assignments you're hoping to get. When you tried, were you just looking for a single LL test or did you ask it for more?

You may have just stumbled onto a busy period on the server. Around-about that same time I saw GPU72 was "crawling" and getting assignments, so it very well may have been that you just tried getting assignments at the same time and it took a while for yours to run.

I guess I'd suggest trying again and see what happens, using the same range, same settings as before and see if it's better.

This is my first look at the manual assignments SQL queries and it's a little hard to get through all the things it's doing, some interesting clauses here and there to take into account the reliability of clients, version of software, etc. so that makes it fun and in my artificial test I may have defaulted one of those to something that makes the query run better than the real world.
Madpoo is offline   Reply With Quote
Old 2014-09-10, 19:31   #681
Madpoo
Serpentine Vermin Jar
 
Madpoo's Avatar
 
Jul 2014

CCA16 Posts
Default

Quote:
Originally Posted by Madpoo View Post
I guess I'd suggest trying again and see what happens, using the same range, same settings as before and see if it's better.
I ate my own dogfood and got 2 first time assignments for myself using the manual page. Yeah, it wasn't 100 seconds, but it wasn't fast either, more like 15 seconds.

It could probably be improved by selecting more than one assignment at a time if a person is requesting more than one. Otherwise it iterates and just seems like a waste of cycles if there were an easier way to run the query once and grab a range.

There's also some overhead with not only getting exponents but also "checking them out" and writing info to the database about "this user is now assigned these exponents". I'd probably have to do a lot more PHP debugging to see how long each of those things takes and I just don't feel like doing that.
Madpoo is offline   Reply With Quote
Old 2014-09-10, 19:49   #682
garo
 
garo's Avatar
 
Aug 2002
Termonfeckin, IE

2·34·17 Posts
Default

Thanks for looking at this. I tried to get 20 assignments. And it took ~ 2 minutes. Just repeated that right now and same deal. Yes I guess a big part of the problem is repeating the SQL query for each assignment. It should really do only a single query for each request. Note that if I don't specify a range it is more or less instant. (And I get 64M assignments or Cat3). So I don't think the problem has to do with the checkout or PHP and much more likely inefficient SQL.


Quote:
Originally Posted by Madpoo View Post
I ate my own dogfood and got 2 first time assignments for myself using the manual page. Yeah, it wasn't 100 seconds, but it wasn't fast either, more like 15 seconds.

It could probably be improved by selecting more than one assignment at a time if a person is requesting more than one. Otherwise it iterates and just seems like a waste of cycles if there were an easier way to run the query once and grab a range.

There's also some overhead with not only getting exponents but also "checking them out" and writing info to the database about "this user is now assigned these exponents". I'd probably have to do a lot more PHP debugging to see how long each of those things takes and I just don't feel like doing that.
garo is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Official "Faits erronés dans de belles-lettres" thread ewmayer Lounge 39 2015-05-19 01:08
Official "all-Greek-to-me Fiction Literature and Cinema" Thread ewmayer Science & Technology 41 2014-04-16 11:54
Official "Lasciate ogne speranza" whinge-thread cheesehead Soap Box 56 2013-06-29 01:42
Official "Ernst is a deceiving bully and George is a meanie" thread cheesehead Soap Box 61 2013-06-11 04:30
Official "String copy Statement Considered Harmful" thread Dubslow Programming 19 2012-05-31 17:49

All times are UTC. The time now is 11:41.

Fri Aug 14 11:41:45 UTC 2020 up 1 day, 8:17, 0 users, load averages: 2.29, 2.38, 2.34

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.