[R] Need help: Loading a large data set.
roger at ysidro.econ.uiuc.edu
Sun Nov 23 21:41:36 CET 2008
Both SparseM and Matrix have facilities for rbind and cbind
that allow you to concatenate pieces of sparse matrices together.
On Nov 23, 2008, at 2:19 PM, Atul Kulkarni wrote:
> Hi All,
> I am dealing with a large data set which translates in to a sparse
> matrix, I
> want to load this data that is spread in approximately 17000+ files
> defining a row and each file has variable number of records that
> come with
> its column number and the value that they store.
> I wish to load this data in memory from these files one by one. Is
> anyway I can do this in R, before I start processing? I am sure this
> is not
> the first time R or the community is confronted with this kind of a
> but I could not find the documentation for loading data in to sparse
> I found quite a few packages for sparse matrix but they all were
> concentrating on how to do various operations with the matrix once the
> matrix is loaded. I need to first load the data in the system before
> I can
> think about analysing.
> Graduate Student,
> Department of Computer Science,
> University of Minnesota Duluth,
> Duluth, MN, 55812.
> [[alternative HTML version deleted]]
> R-help at r-project.org mailing list
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
More information about the R-help