[R] problem loading large xlsx file into r
jholtman at gmail.com
Mon Jul 22 12:50:17 CEST 2013
did you try converting xlsx to xls (if possible). the xlsx format puts a large demand on both memory and cpu resources.
Sent from my iPad
On Jul 22, 2013, at 6:09, S N V Krishna <krishna at primps.com.sg> wrote:
> Thanks Jim, I tried XLConnect but faced with same error.
>> options(java.parameters = '-Xmx5g')
> Loading required package: rJava
> XLConnect 0.2-5 by Mirai Solutions GmbH
> http://www.mirai-solutions.com ,
>> cftc = readWorksheetFromFile("d:\\Krishna\\Research\\CFTC_COT\\cftcdata.xlsx", sheet = 'Sheet1')
> Error: OutOfMemoryError (Java): Java heap space
> What is the maximum file size to load into R? is there a better way to load large excel files to R?
> Many thanks for the help.
> -----Original Message-----
> From: Jim Holtman [mailto:jholtman at gmail.com]
> Sent: Monday, July 22, 2013 5:10 PM
> To: S N V Krishna
> Cc: r-help at r-project.org
> Subject: Re: [R] problem loading large xlsx file into r
> try the "XLConnect" package and if possible change the "xlsx" to "xls" format for better performance.
> Sent from my iPad
> On Jul 22, 2013, at 1:24, S N V Krishna <krishna at primps.com.sg> wrote:
>> I am facing trouble when trying to read large xlsx file into R. please find the code and error below. The file I was trying to read has 36,500 rows X 188 col, ~ 37 MB size.
>>> options( java.parameters = "-Xmx4g" )
>> Loading required package: xlsxjars
>> Loading required package: rJava
>>> cftc = read.xlsx("d:\\Krishna\\Research\\CFTC_COT\\cftcdata.xlsx", 1)
>> Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl, :
>> R version 3.0.1 (2013-05-16)
>> Platform: x86_64-w64-mingw32/x64 (64-bit)
>>  LC_COLLATE=English_United States.1252 LC_CTYPE=English_United
>> States.1252  LC_MONETARY=English_United States.1252 LC_NUMERIC=C
>>  LC_TIME=English_United States.1252
>> attached base packages:
>>  stats graphics grDevices utils datasets methods base
>> other attached packages:
>>  xlsx_0.5.1 xlsxjars_0.5.0 rJava_0.9-5
>> Many thanks for the help and guidance.
>> [[alternative HTML version deleted]]
>> R-help at r-project.org mailing list
>> PLEASE do read the posting guide
>> and provide commented, minimal, self-contained, reproducible code.
More information about the R-help