did you try converting xlsx to xls (if possible). the xlsx format puts a large demand on both memory and cpu resources.
Sent from my iPad On Jul 22, 2013, at 6:09, S N V Krishna <kris...@primps.com.sg> wrote: > Thanks Jim, I tried XLConnect but faced with same error. > >> options(java.parameters = '-Xmx5g') > >> library(XLConnect) > Loading required package: rJava > XLConnect 0.2-5 by Mirai Solutions GmbH > http://www.mirai-solutions.com , > http://miraisolutions.wordpress.com > >> cftc = >> readWorksheetFromFile("d:\\Krishna\\Research\\CFTC_COT\\cftcdata.xlsx", >> sheet = 'Sheet1') > Error: OutOfMemoryError (Java): Java heap space > > What is the maximum file size to load into R? is there a better way to load > large excel files to R? > > Many thanks for the help. > > Regards, > > Krishna > > -----Original Message----- > From: Jim Holtman [mailto:jholt...@gmail.com] > Sent: Monday, July 22, 2013 5:10 PM > To: S N V Krishna > Cc: r-help@r-project.org > Subject: Re: [R] problem loading large xlsx file into r > > try the "XLConnect" package and if possible change the "xlsx" to "xls" format > for better performance. > > Sent from my iPad > > On Jul 22, 2013, at 1:24, S N V Krishna <kris...@primps.com.sg> wrote: > >> Hi, >> >> I am facing trouble when trying to read large xlsx file into R. please find >> the code and error below. The file I was trying to read has 36,500 rows X >> 188 col, ~ 37 MB size. >> >>> options( java.parameters = "-Xmx4g" ) >> >>> library(xlsx) >> Loading required package: xlsxjars >> Loading required package: rJava >> >>> cftc = read.xlsx("d:\\Krishna\\Research\\CFTC_COT\\cftcdata.xlsx", 1) >> Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl, : >> >> >>> sessionInfo() >> R version 3.0.1 (2013-05-16) >> Platform: x86_64-w64-mingw32/x64 (64-bit) >> >> locale: >> [1] LC_COLLATE=English_United States.1252 LC_CTYPE=English_United >> States.1252 [3] LC_MONETARY=English_United States.1252 LC_NUMERIC=C >> [5] LC_TIME=English_United States.1252 >> >> attached base packages: >> [1] stats graphics grDevices utils datasets methods base >> >> other attached packages: >> [1] xlsx_0.5.1 xlsxjars_0.5.0 rJava_0.9-5 >> >> Many thanks for the help and guidance. >> >> Regards, >> >> Krishna >> >> [[alternative HTML version deleted]] >> >> ______________________________________________ >> R-help@r-project.org mailing list >> https://stat.ethz.ch/mailman/listinfo/r-help >> PLEASE do read the posting guide >> http://www.R-project.org/posting-guide.html >> and provide commented, minimal, self-contained, reproducible code. ______________________________________________ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.