Thanks Guys,
I saw no error messages and these are the duplicate removals:
Code:
Mon Dec 12 06:30:50 2011 found 3884965 hash collisions in 23001181 relations
Mon Dec 12 06:31:29 2011 added 36 free relations
Mon Dec 12 06:31:29 2011 commencing duplicate removal, pass 2
Mon Dec 12 06:33:09 2011 found 3653999 duplicates and 19347218 unique
I guess that's about 16% duplication?
I'm going to evaluate the ease of both methods and "maybe" write some steps to take to add machines. That way I'll know where to remind myself how and maybe someone else can find it useful.