[R] Large data set

arun smartpink111 at yahoo.com
Mon Jul 23 23:22:58 CEST 2012


You can try dbLoad() from hash package.  Not sure whether it will be successful.


----- Original Message -----
From: Lorcan Treanor <lorcan.treanor at idiro.com>
To: r-help at r-project.org
Sent: Monday, July 23, 2012 8:02 AM
Subject: [R] Large data set

Hi all,

Have a problem. Trying to read in a data set that has about 112,000,000
rows and 8 columns and obviously enough it was too big for R to handle. The
columns are mode up of 2 integer columns and 6 logical columns. The text
file is about 4.2 Gb in size. Also I have 4 Gb of RAM and 218 Gb of
available space on the hard drive. I tried the dumpDF function but it was
too big. Also tried bring in the data is 10 sets of about 12,000,000. Are
there are other ways of getting around the size of the data.



    [[alternative HTML version deleted]]

R-help at r-project.org mailing list
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.

More information about the R-help mailing list