View Single Post
Old 2020-10-16, 12:15   #2
tServo's Avatar
May 2009
near the Tannhäuser Gate

7·89 Posts

Originally Posted by petrw1 View Post
I realize P1 as a separate task is discontinued ... however ...

I am still running the version that allows it:
Does it seems reasonable that for the various Colab GPUs available I am seeing relative Stage1 iteration times of (based on my specific B1 but still relative):

P4: 3,600
T4: 2,630
K80: 1,800
P100: 470 (yes 4 to 8 times faster)
Yes, these times make perfect sense.

Neither the P4 nor the T4 have many FP64 cores available. These cores are essential for performance doing Stage1. Their specs are fairly close but since the T4 is newer with faster memory & a few other things, it should be faster than the P4.
Even tho the K80 is quite old, it still has decent FP64 performance AND it has 2 GPUs.
The P100 has lots of FP64 cores and they will yield the best performance.

AFAIK the P4 and T4 are touted as being designed explicitly for training AIs since they do not require high percision computations.

Last fiddled with by tServo on 2020-10-16 at 12:16
tServo is offline   Reply With Quote