[R] Large datasets under R

[Stephen R. Laniel]

Hello,

I recall reading a thread months ago on this mailing list about handling
very datasets under R, but I can't seem to find it.  This has become
particularly important recently, because I've been playing with a dataset
containing information about every fatal car accident in the U.S. since
1975; in total, the relevant files are about 120 megs.  I'd like to load
all of these into R at once and do some longitudinal analyses.  R seems to
choke on tables above a few megabytes.  From what I can tell, these are
memory management issues; the user must allocate memory using command-line
switches.

I'm using R 0.90 under Windows NT 4.0.  Have things improved in more recent
versions?  Are they expected to improve soon?  In the meantime, what can we
do to make large-dataset analysis more convenient?

Thanks,
Steve

Stephen R. Laniel            |  "Farewell Angelina
Carnegie Mellon University   |   The sky is erupting
laniel at cmu.edu               |   I must go where it's quiet."
www.stat.cmu.edu/~laniel/    |   --Bob Dylan
-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-
r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !)  To: r-help-request at stat.math.ethz.ch
_._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._