[R] Using very large matrix

Jay Emerson jayemerson at gmail.com
Mon Mar 2 14:52:51 CET 2009


Steve et.al.,

The old version is still on CRAN, but I strongly encourage anyone
interested to email me directly and I'll make the new version available.
In fact, I wouldn't mind just pulling the old version off of CRAN, but of course
that's not a great idea.  !-)

Jay


On Mon, Mar 2, 2009 at 8:47 AM,  <Steve_Friedman at nps.gov> wrote:
> I'm very interested in the bigmemory package for windows 32-bit
> environments.  Who do I need to contact to request the Beta version?
>
> Thanks
> Steve
>
> Steve Friedman Ph. D.
> Spatial Statistical Analyst
> Everglades and Dry Tortugas National Park
> 950 N Krome Ave (3rd Floor)
> Homestead, Florida 33034
>
> Steve_Friedman at nps.gov
> Office (305) 224 - 4282
> Fax     (305) 224 - 4147
>
>
>
>             Corrado
>             <ct529 at york.ac.uk
>             >                                                          To
>             Sent by:                  john.emerson at yale.edu, Tony Breyal
>             r-help-bounces at r-         <tony.breyal at googlemail.com>
>             project.org                                                cc
>                                       r-help at r-project.org
>                                                                   Subject
>             03/02/2009 10:46          Re: [R] Using very large matrix
>             AM GMT
>
>
>
>
>
>
>
>
>
> Thanks a lot!
>
> Unfortunately, the R package I have to sue for my research was only
> released
> on 32 bit R on 32 bit MS Windows and only closed source ....  I normally
> use
> 64 bit R on 64 bit Linux .... :)
>
> I tried to use the bigmemory in cran with 32 bit windows, but I had some
> serious problems.
>
> Best,
>
> On Thursday 26 February 2009 15:43:11 Jay Emerson wrote:
>> Corrado,
>>
>> Package bigmemory has undergone a major re-engineering and will be
>> available soon (available now in Beta version upon request).  The version
>> currently on CRAN
>> is probably of limited use unless you're in Linux.
>>
>> bigmemory may be useful to you for data management, at the very least,
>> where
>>
>> x <- filebacked.big.matrix(80000, 80000, init=n, type="double")
>>
>> would accomplish what you want using filebacking (disk space) to hold
>> the object.
>> But even this requires 64-bit R (Linux or Mac, or perhaps a Beta
>> version of Windows 64-bit
>> R that REvolution Computing is working on).
>>
>> Subsequent operations (e.g. extraction of a small portion for analysis)
> are
>> then easy enough:
>>
>> y <- x[1,]
>>
>> would give you the first row of x as an object y in R.  Note that x is
>> not itself an R matrix,
>> and most existing R analytics can't work on x directly (and would max
>> out the RAM if they
>> tried, anyway).
>>
>> Feel free to email me for more information (and this invitation
>> applies to anyone who is
>> interested in this).
>>
>> Cheers,
>>
>> Jay
>>
>> #Dear friends,
>> #
>> #I have to use a very large matrix. Something of the sort of
>> #matrix(80000,80000,n) .... where n is something numeric of the sort
>> 0.xxxxxx #
>> #I have not found a way of doing it. I keep getting the error
>> #
>> #Error in matrix(nrow = 80000, ncol = 80000, 0.2) : too many elements
>> specified #
>> #Any suggestions? I have searched the mailing list, but to no avail.
>> #
>> #Best,
>> #--
>> #Corrado Topi
>> #
>> #Global Climate Change & Biodiversity Indicators
>> #Area 18,Department of Biology
>> #University of York, York, YO10 5YW, UK
>> #Phone: + 44 (0) 1904 328645, E-mail: ct529 at york.ac.uk
>
>
> --
> Corrado Topi
>
> Global Climate Change & Biodiversity Indicators
> Area 18,Department of Biology
> University of York, York, YO10 5YW, UK
> Phone: + 44 (0) 1904 328645, E-mail: ct529 at york.ac.uk
>
> ______________________________________________
> R-help at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>
>
>



-- 
John W. Emerson (Jay)
Assistant Professor of Statistics
Department of Statistics
Yale University
http://www.stat.yale.edu/~jay




More information about the R-help mailing list