question about Rpvm, SNOW, etc.

A.J. Rossini
20 Aug 2002 12:53:09 -0700

>>>>> "michael" == Michael Na Li <> writes:

    michael> I got similar timing with our cluster.  Saving and loading the object to/from
    michael> a file require about 1.5 seconds each, which I assume is the cost of the
    michael> serialization (plus file reading and writing).  Then it seems the packing (as
    michael> bytes), transferring, and unpacking the object take 7-8 seconds??

    michael> I wonder how much the serialization itself hurts the performance.  Would
    michael> sending raw numbers with pvm routines improve the performance?

It might.  It is "well-known" that PVM (and MPI, and other
message-passing systems) have a marshalling overhead that can be
easily beat by RPC or direct socket programming.  This suggests that
the lower/rawer the data at the message passing stage, the faster it
might be.  


A.J. Rossini				Rsrch. Asst. Prof. of Biostatistics
U. of Washington Biostatistics	
FHCRC/SCHARP/HIV Vaccine Trials Net
-------------- ----------------
FHCRC: M: 206-667-7025 (fax=4812)|Voicemail is pretty sketchy/use Email
UW:   Th: 206-543-1044 (fax=3286)|Change last 4 digits of phone to FAX
(my tuesday/wednesday/friday locations are completely unpredictable.)

r-devel mailing list -- Read
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !)  To: