[R] Can R work on very large of data?

Duncan Murdoch murdoch at stats.uwo.ca
Wed Jul 21 16:20:59 CEST 2004

On Wed, 21 Jul 2004 09:05:18 -0500, Hayashi Soichi - shayas
<Soichi.Hayashi at acxiom.com> wrote :

>Is there anyway I can tweak R around so that it will start processing as
>data comes and not load everthing on memory at once?

See the ?connections help topic.  You can open a file, and then read
lines from it in groups.  For example,

f <- file('MyData')
read.table(f, nrows=100)
read.table(f, nrows=100)



and so on.

Most functions in R won't know what do do with data handled in this
way; you'll have to do a lot of work to do your calculations in

Duncan Murdoch

More information about the R-help mailing list