[R] Snow & rvpm

Martin Morgan mtmorgan at fhcrc.org
Thu Dec 1 20:03:05 CET 2005


In the example at
http://www.stat.uiowa.edu/~luke/R/cluster/cluster.html clusterCall
divides the parameter R by the number of nodes -- what you've done is
calculate 999 bootstraps on each node, and compared the execution time
to 999 bootstraps on one node.

You probably want 'clusterCall' to be smart enough to partition the
bootstraps between nodes, and then collate the results. It doesn't do
that.

Martin

vittorio <vdemart1 at tin.it> writes:

> At office, using the internal LAN at my disposal,  I'm having a go at parallel 
> computing - to begin with - with pvm, rpvm & snow.
> The two boxes are as follows
>
> Remote machine uffbsd:
> CPU: Intel(R) Pentium(R) 4 CPU 2.00GHz (1994.13-MHz 686-class CPU)
>   Origin = "GenuineIntel"  Id = 0xf24  Stepping = 4
>  real memory  = 260046848 (248 MB)
>
> This machine NbBSD:
> CPU: Mobile Intel(R) Pentium(R) 4 - M CPU 2.00GHz (1993.54-MHz 686-class CPU)
> real memory  = 536674304 (511 MB)
>
> And starting library snow under R I have the following situation
>
> clusterCall(cl, function() Sys.info()[c("sysname", 
> "release","nodename","machine")])
> [[1]]
>       sysname       release      nodename       machine
>     "FreeBSD" "5.4-RELEASE" "uffbsd.myd"        "i386"
>
> [[2]]
>          sysname          release         nodename          machine
>        "FreeBSD"    "6.0-RELEASE" "NbBSD.myd"           "i386"
>
> NOW,
> using the example of boot in the end of page 
> http://www.stat.uiowa.edu/~luke/R/cluster/cluster.html
>
> I find this amazing result:
>
>> system.time(cl.nuke.boot<- 
> clusterCall(cl,boot,nuke.data,nuke.fun,R=999,m=1,fit.pred=new.fit,x.pred=new.data))
> [1]  0.0078125  0.0078125 27.9609375  0.0000000  0.0000000
>>  system.time(nuke.boot<- 
> boot(nuke.data,nuke.fun,R=999,m=1,fit.pred=new.fit,x.pred=new.data))
> [1] 26.976562  0.109375 28.484375  0.000000  0.000000
>> 
> There's not that much gain in time between my cluster and the local 
> computation, isn't it.
> Now my question is:
> What could have been gone wrong and what should I verify?
>
> Ciao
> Vittorio
>
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide! http://www.R-project.org/posting-guide.html




More information about the R-help mailing list