[R] Can R work on very large of data?

[Duncan Murdoch]

On Wed, 21 Jul 2004 09:05:18 -0500, Hayashi Soichi - shayas
<Soichi.Hayashi at acxiom.com> wrote :

>Is there anyway I can tweak R around so that it will start processing as
>data comes and not load everthing on memory at once?

See the ?connections help topic.  You can open a file, and then read
lines from it in groups.  For example,

f <- file('MyData')
open(f)
read.table(f, nrows=100)
read.table(f, nrows=100)

  ...

close(f)

and so on.

Most functions in R won't know what do do with data handled in this
way; you'll have to do a lot of work to do your calculations in
pieces.

Duncan Murdoch