question about Rpvm, SNOW, etc.

[A.J. Rossini]

>>>>> "michael" == Michael Na Li <lina@u.washington.edu> writes:

    michael> I got similar timing with our cluster.  Saving and loading the object to/from
    michael> a file require about 1.5 seconds each, which I assume is the cost of the
    michael> serialization (plus file reading and writing).  Then it seems the packing (as
    michael> bytes), transferring, and unpacking the object take 7-8 seconds??

    michael> I wonder how much the serialization itself hurts the performance.  Would
    michael> sending raw numbers with pvm routines improve the performance?

It might.  It is "well-known" that PVM (and MPI, and other
message-passing systems) have a marshalling overhead that can be
easily beat by RPC or direct socket programming.  This suggests that
the lower/rawer the data at the message passing stage, the faster it
might be.  

best,
-tony

-- 
A.J. Rossini				Rsrch. Asst. Prof. of Biostatistics
U. of Washington Biostatistics		rossini@u.washington.edu	
FHCRC/SCHARP/HIV Vaccine Trials Net	rossini@scharp.org
-------------- http://software.biostat.washington.edu/ ----------------
FHCRC: M: 206-667-7025 (fax=4812)|Voicemail is pretty sketchy/use Email
UW:   Th: 206-543-1044 (fax=3286)|Change last 4 digits of phone to FAX
(my tuesday/wednesday/friday locations are completely unpredictable.)



-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-
r-devel mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !)  To: r-devel-request@stat.math.ethz.ch
_._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._