[R] How to read large file

Darren Norris doon75 at hotmail.com
Mon Mar 16 21:47:25 CET 2009


Try putting "memory limit linux" or "mem.limits" in the nabble help. Or type
?mem.limits in the R gui.
Also have a look at:
http://www.nabble.com/RAM%2C-swap%2C-Error%3A-cannot-allocate-vector-of-size%2C-Linux%3A-tt11680213.html#a11680213

Think you also need to check / understand how R deals with what you want to
do so you know how many copies of the data it will need to hold in memory.

Hope that helps,
Darren




Dongyan Song wrote:
> 
> Dear all,
> 
> I want to read a 1.2 G file with 136,736,218 numbers with scan function,
> and then want make a histogram with those numbers, but it showed Error:
> cannot allocate vector of size 2.0 Gb. How can I import the file then?
> 
> The version I used:
>> sessionInfo()
> R version 2.8.1 (2008-12-22) 
> i686-pc-linux-gnu
>> mem.limits()
> nsize vsize 
>    NA    NA
> and the computer I use has 4G memory in total.
> 
> Thank you very much! 
> 
> Dongyan Song
>  
> 
> 

-- 
View this message in context: http://www.nabble.com/How-to-read-large-file-tp22540291p22547077.html
Sent from the R help mailing list archive at Nabble.com.




More information about the R-help mailing list