mersenneforum.org  

Go Back   mersenneforum.org > Extra Stuff > Miscellaneous Math

Reply
 
Thread Tools
Old 2019-09-04, 16:14   #23
dabler
 
dabler's Avatar
 
"David Barina"
Jul 2016
Brno

3×11 Posts
Default Distributed computing project

I decided to start a distributed computing project. The aim is to raise the threshold below which the convergence of the Collatz problem is verified, particularly from 87 × 2^60 to 88 × 2^60. I keep checksums of each verified block, so my research can be verified. All source code is open, and all compute nodes are already running. The nodes involved in this distributed computing are nodes in a cluster available at our university and nodes in IT4I. For those who are interested, the progress can be tracked here.
dabler is offline   Reply With Quote
Old 2019-09-04, 21:40   #24
Dylan14
 
Dylan14's Avatar
 
"Dylan"
Mar 2017

50010 Posts
Default

I’ve managed to compile the code on a Ubuntu 19.04 VM (it doesn’t compile using Windows 64 bit and mingw64) and I have attached my computer to the project. My question is how large are the work units? As when I run ./client I have assignments 91231623-91231628 and you are currently searching the superblock 88*2^60?
Dylan14 is offline   Reply With Quote
Old 2019-09-05, 00:46   #25
Dylan14
 
Dylan14's Avatar
 
"Dylan"
Mar 2017

50010 Posts
Default

Quote:
Originally Posted by Dylan14 View Post
My question is how large are the work units?
My machine just turned in its first results for the project. Running 6 tasks at once, it takes about 2h 22m to do the tasks. If I know the size of the tasks, I can compute the rate of the calculation.
FYI, I am using an Intel i7-8750H to run this.
Dylan14 is offline   Reply With Quote
Old 2019-09-05, 17:01   #26
dabler
 
dabler's Avatar
 
"David Barina"
Jul 2016
Brno

3×11 Posts
Default

Hi Dylan,

The code requires 64-bit long int type, and GCC's __int128 extension. It should compile fine on 64-bit Linux machines. The size of a single work unit is 2^40 numbers (currently somewhere between 87 × 2^60 and 88 × 2^60).

Today I was faced some technical issues. The master server could not handle the number of connected clients (tens of thousands). For this reason, I had to rewrite the communication protocol to distribute the assignments in batches. However, everything is already done, and the computation nodes are running again. The current progress can be tracked at: http://pcbarina2.fit.vutbr.cz/~ibari...-bin/status.sh

If you want to join the project, please use "mclient" instead of the older "client". The mclient communicates using single TCP/IP connection, saving the server resources.

A single work unit (2^40 number) usually takes something between one and five hours, depending on the machine.
dabler is offline   Reply With Quote
Old 2019-09-05, 17:13   #27
dabler
 
dabler's Avatar
 
"David Barina"
Jul 2016
Brno

3×11 Posts
Default

Just for the sake of curiosity, most clients run on this computing cluster. So tens of thousands of TCP/IP connections soon became a bottleneck.
dabler is offline   Reply With Quote
Old 2019-09-05, 19:00   #28
Dylan14
 
Dylan14's Avatar
 
"Dylan"
Mar 2017

1111101002 Posts
Default

Quote:
Originally Posted by dabler View Post
The size of a single work unit is 2^40 numbers (currently somewhere between 87 × 2^60 and 88 × 2^60).
With that in mind I get a throughput of about 7.74*10^8 numbers per second on 6 threads of a i7-8750H. I will also recompile the code and use mclient instead.
A suggestion (in the case more people get interested in running this, not so much if this will be just a long running job on your cluster): say after the client has run 2^35 numbers (about 3% of the workunit), write a checkpoint file and then if the user needs to interrupt the computation they can launch the client again and the client will restart from the number recorded in the checkpoint file.
Dylan14 is offline   Reply With Quote
Old 2019-09-06, 12:16   #29
dabler
 
dabler's Avatar
 
"David Barina"
Jul 2016
Brno

3310 Posts
Default

Good point for an improvement. However, when I chose this work unit (2^40), I estimated that modern computers would give it in about one hour.

One more question: When you said "Running 6 tasks at once, it takes about 2h 22m to do the tasks", you meant running 6 tasks on 6 cpu cores, not on a single core (that would be extremely fast), right?
dabler is offline   Reply With Quote
Old 2019-09-06, 12:31   #30
Dylan14
 
Dylan14's Avatar
 
"Dylan"
Mar 2017

50010 Posts
Default

By that statement, I mean 6 cores, each working on 1 task, not a single core running 6 tasks.
Dylan14 is offline   Reply With Quote
Old 2019-09-08, 07:35   #31
dabler
 
dabler's Avatar
 
"David Barina"
Jul 2016
Brno

2116 Posts
Default Windows build

According to this post, you should be able to compile the code for 64-bit windows using Cygwin x86_64. Mingw-w64 doest not work as expected. Would you be willing to try it?
dabler is offline   Reply With Quote
Old 2019-09-08, 12:51   #32
Dylan14
 
Dylan14's Avatar
 
"Dylan"
Mar 2017

22×53 Posts
Default

I was able to get the Collatz code to compile under Windows 10 64 bit using Cygwin.
Dylan14 is offline   Reply With Quote
Old 2019-09-08, 13:09   #33
dabler
 
dabler's Avatar
 
"David Barina"
Jul 2016
Brno

3·11 Posts
Default

Cool! And does the client work properly? I mean whether the client connects to the server, computes its assignment, and returns the result correctly to the server.
dabler is offline   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
Collatz 3x+1 problem Cybertronic Miscellaneous Math 4 2019-03-20 08:40
Collatz Conjecture Proof Steve One Miscellaneous Math 21 2018-03-08 08:18
this thread is for a Collatz conjecture again MattcAnderson MattcAnderson 16 2018-02-28 19:58
Collatz conjecture MattcAnderson MattcAnderson 4 2017-03-12 07:39
Related to Collatz conjecture nibble4bits Math 1 2007-08-04 07:09

All times are UTC. The time now is 12:53.

Sat Aug 15 12:53:23 UTC 2020 up 2 days, 9:28, 1 user, load averages: 2.15, 2.35, 2.08

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.