mersenneforum.org  

Go Back   mersenneforum.org > Factoring Projects > FactorDB

Reply
 
Thread Tools
Old 2022-09-16, 19:17   #1
maxal
 
maxal's Avatar
 
Feb 2005

22·5·13 Posts
Default long-term sustainability

I'm sorry if this was discussed before, but I have a concern about long-term sustainability of factordb.com
Some time ago I tried to find an option to download the whose database and did not find any.
Are we in danger of loosing all the data (gathered over the years) if something awful happen with the server and/or its maintainers? (God forbids!)

Last fiddled with by maxal on 2022-09-16 at 19:19
maxal is offline   Reply With Quote
Old 2022-09-16, 20:57   #2
a1call
 
a1call's Avatar
 
"Rashid Naimi"
Oct 2015
Remote to Here/There

22×52×23 Posts
Default

Assuming you mean "Whois Database",
I could find the entry easily at domaintools.com.
The registration is active.

ETA: Perhaps you are worried about the domain registrar, they must have been taken over by GoDaddy.

Quote:
Is Mesh Digital GoDaddy?
Who We Are. Domainbox.com is a brand of Mesh Digital Limited, a wholly-owned subsidiary of GoDaddy Inc.

Last fiddled with by a1call on 2022-09-16 at 21:02
a1call is offline   Reply With Quote
Old 2022-09-16, 21:10   #3
Stargate38
 
Stargate38's Avatar
 
"Daniel Jackson"
May 2011
14285714285714285714

739 Posts
Default

I think they meant to say "download the whole database". Maybe Syd could offer a weekly/monthly torrent as a backup option for those with enough disk space to store it (several TB). That way the DB won't be lost if something serious happens.
Stargate38 is offline   Reply With Quote
Old 2022-09-16, 22:14   #4
maxal
 
maxal's Avatar
 
Feb 2005

22×5×13 Posts
Default

Thanks for the correction. Yes, I worry mostly about the loss of data ("whole database") than about the domain or software. Although I'd not mind if the server software will go open source some day ;)

Last fiddled with by maxal on 2022-09-16 at 22:14
maxal is offline   Reply With Quote
Old 2022-09-16, 22:25   #5
a1call
 
a1call's Avatar
 
"Rashid Naimi"
Oct 2015
Remote to Here/There

22×52×23 Posts
Default

The database would probably be not very useful without the query formats/syntax/exact-labels built into the web app.
a1call is offline   Reply With Quote
Old 2022-09-16, 23:56   #6
R.D. Silverman
 
R.D. Silverman's Avatar
 
"Bob Silverman"
Nov 2003
North of Boston

23×937 Posts
Default

Quote:
Originally Posted by maxal View Post
Thanks for the correction. Yes, I worry mostly about the loss of data ("whole database") than about the domain or software. Although I'd not mind if the server software will go open source some day ;)
The discussion seems quite timely. I have been unable to access the database for the last day. Attempts
to access are now yielding "fixing database tables".
R.D. Silverman is offline   Reply With Quote
Old 2022-09-17, 06:35   #7
gd_barnes
 
gd_barnes's Avatar
 
May 2007
Kansas; USA

32×1,283 Posts
Default

The FactorDB has been down for slightly over 2 days as of this post. The last time I remember being able to access it was around 12-12:30AM CDT U.S. (5-5:30AM GMT) on Sept. 15th. I believe it went down less than an hour after that.

I do not ever recall it being down this long before. I also am concerned about its long-term sustainability.

Last fiddled with by gd_barnes on 2022-09-17 at 06:39
gd_barnes is offline   Reply With Quote
Old 2022-09-17, 06:54   #8
bur
 
bur's Avatar
 
Aug 2020
79*6581e-4;3*2539e-3

601 Posts
Default

The initial error message was "power outage". I would think that would in the worst case result in the loss of a few entries, but who knows.

Generally, yes, there's a lot of unique data stored there. Especially the aliquot sequences, I assume the vast majority of contributors don't store the results for the individual terms. Basically loosing all aliquot data is not a nice prospect.

Quote:
The database would probably be not very useful without the query formats/syntax/exact-labels built into the web app.
I'm not so sure about that. The nature of the entries should be relatively easy to figure out. So at least the data wouldn't be loss, but of course someone would have to write a tool to extract it. I guess that'd happen pretty quickly though. :)

Last fiddled with by bur on 2022-09-17 at 06:56
bur is offline   Reply With Quote
Old 2022-09-17, 10:22   #9
thyrex
 
Jun 2021

368 Posts
Default

The most valuable things in the database is the set of P19+ primes.

Especially those n-digit numbers that exceed the download limit.

Last fiddled with by thyrex on 2022-09-17 at 10:29
thyrex is offline   Reply With Quote
Old 2022-09-17, 10:30   #10
Happy5214
 
Happy5214's Avatar
 
"Alexander"
Nov 2008
The Alamo City

86010 Posts
Default

Quote:
Originally Posted by gd_barnes View Post
The FactorDB has been down for slightly over 2 days as of this post. The last time I remember being able to access it was around 12-12:30AM CDT U.S. (5-5:30AM GMT) on Sept. 15th. I believe it went down less than an hour after that.

I do not ever recall it being down this long before. I also am concerned about its long-term sustainability.
Regarding timing, I had an elf running at the time the server went down, and the last yafu SIQS save was timestamped at 12:56 AM CDT on September 15. I don't keep logs (it's a RAM drive on a box with no working hard drive), and there may have been a couple of non-SIQS numbers after that, but it probably went down within 5 or so minutes of that.

I think it was down for a lot longer than a few days a year or two ago. I concur that it would be useful to have another, off-site, copy of the site data and code, though the code itself is sub-optimal (no real API, formula parsing bugs, a limiter that's obviously really easy to get around, a user system that's literally just for show(ing credit), etc.). The code could easily go on GitHub, assuming Markus is willing and can remove any server secrets (i.e. IP addresses, database logins, absolute paths) from it. The database data would probably have to be split up in order to be distributed via torrent, and you'd probably need patch update torrents to prevent unwieldy full re-downloads of almost 3 TB (raw size, not text size) of data.
Happy5214 is offline   Reply With Quote
Old 2022-09-17, 12:49   #11
gd_barnes
 
gd_barnes's Avatar
 
May 2007
Kansas; USA

32×1,283 Posts
Default

Site just came back up in the last hour. Officially around 7 AM CDT (noon GMT). Down just over 54 hours by my best estimate.
gd_barnes is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
seasonal or long term trends kriesel Cloud Computing 19 2021-05-26 16:51
Long term evidence of civilization. xilman Science & Technology 65 2021-05-07 12:26
Using long long's in Mingw with 32-bit Windows XP grandpascorpion Programming 7 2009-10-04 12:13
I think it's gonna be a long, long time panic Hardware 9 2009-09-11 05:11
Long-term Primenet archive delta_t Data 3 2005-08-25 00:31

All times are UTC. The time now is 15:25.


Sun Nov 27 15:25:53 UTC 2022 up 101 days, 12:54, 1 user, load averages: 1.31, 1.04, 0.96

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.

≠ ± ∓ ÷ × · − √ ‰ ⊗ ⊕ ⊖ ⊘ ⊙ ≤ ≥ ≦ ≧ ≨ ≩ ≺ ≻ ≼ ≽ ⊏ ⊐ ⊑ ⊒ ² ³ °
∠ ∟ ° ≅ ~ ‖ ⟂ ⫛
≡ ≜ ≈ ∝ ∞ ≪ ≫ ⌊⌋ ⌈⌉ ∘ ∏ ∐ ∑ ∧ ∨ ∩ ∪ ⨀ ⊕ ⊗ 𝖕 𝖖 𝖗 ⊲ ⊳
∅ ∖ ∁ ↦ ↣ ∩ ∪ ⊆ ⊂ ⊄ ⊊ ⊇ ⊃ ⊅ ⊋ ⊖ ∈ ∉ ∋ ∌ ℕ ℤ ℚ ℝ ℂ ℵ ℶ ℷ ℸ 𝓟
¬ ∨ ∧ ⊕ → ← ⇒ ⇐ ⇔ ∀ ∃ ∄ ∴ ∵ ⊤ ⊥ ⊢ ⊨ ⫤ ⊣ … ⋯ ⋮ ⋰ ⋱
∫ ∬ ∭ ∮ ∯ ∰ ∇ ∆ δ ∂ ℱ ℒ ℓ
𝛢𝛼 𝛣𝛽 𝛤𝛾 𝛥𝛿 𝛦𝜀𝜖 𝛧𝜁 𝛨𝜂 𝛩𝜃𝜗 𝛪𝜄 𝛫𝜅 𝛬𝜆 𝛭𝜇 𝛮𝜈 𝛯𝜉 𝛰𝜊 𝛱𝜋 𝛲𝜌 𝛴𝜎𝜍 𝛵𝜏 𝛶𝜐 𝛷𝜙𝜑 𝛸𝜒 𝛹𝜓 𝛺𝜔