[R] reading a big file

[Christoph Scherber]

Dear Remigijus,

You should change memory allocation in Windows XP, as described in

http://cran.r-project.org/bin/windows/base/rw-FAQ.html#There-seems-to-be-a-limit-on-the-memory-it-uses_0021

Hope this helps.

Best wishes
Christoph


--
Christoph Scherber
DNPW, Agroecology
University of Goettingen
Waldweg 26
D-37073 Goettingen

+49-(0)551-39-8807




Remigijus Lapinskas schrieb:
> Dear All,
> 
> I am on WindowsXP with 512 MB of RAM, R 2.4.0, and I want to read in a
> big file mln100.txt. The file is 390MB big, it contains a column of 100 
> millions integers.
> 
>> mln100=scan("mln100.txt")
> Error: cannot allocate vector of size 512000 Kb
> In addition: Warning messages:
> 1: Reached total allocation of 511Mb: see help(memory.size)
> 2: Reached total allocation of 511Mb: see help(memory.size)
> 
> In fact, I would be quite happy if I could read, say, every tenth 
> integer (line) of the file. Is it possible to do this?
> 
> Cheers,
> Rem
> 
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
> 
> .
>