paul s wrote:
On 07/14/2010 06:15 PM, Peter Dalgaard wrote:
A quick calculation reveals that a matrix of that size requires about
2.7 TERAbytes of storage, so I'm a bit confused as to how you might
expect to fit it into 16GB of RAM...
However, even with terabytes of memory, you would be
On 07/15/2010 05:07 AM, Peter Dalgaard wrote:
paul s wrote:
On 07/14/2010 06:15 PM, Peter Dalgaard wrote:
A quick calculation reveals that a matrix of that size requires about
2.7 TERAbytes of storage, so I'm a bit confused as to how you might
expect to fit it into 16GB of RAM...
However,
hi -
i just started using R as i am trying to figure out how perform a linear
regression on a huge matrix.
i am sure this topic has passed through the email list before but could
not find anything in the archives.
i have a matrix that is 2,000,000 x 170,000 the values right now are
On Wed, Jul 14, 2010 at 4:23 PM, paul s r-project@queuemail.com wrote:
hi -
i just started using R as i am trying to figure out how perform a linear
regression on a huge matrix.
i am sure this topic has passed through the email list before but could not
find anything in the archives.
paul s wrote:
hi -
i just started using R as i am trying to figure out how perform a linear
regression on a huge matrix.
i am sure this topic has passed through the email list before but could
not find anything in the archives.
i have a matrix that is 2,000,000 x 170,000 the values
On 14/07/2010 5:23 PM, paul s wrote:
hi -
i just started using R as i am trying to figure out how perform a linear
regression on a huge matrix.
i am sure this topic has passed through the email list before but could
not find anything in the archives.
i have a matrix that is 2,000,000 x
On 07/14/2010 06:15 PM, Peter Dalgaard wrote:
A quick calculation reveals that a matrix of that size requires about
2.7 TERAbytes of storage, so I'm a bit confused as to how you might
expect to fit it into 16GB of RAM...
However, even with terabytes of memory, you would be running into the
On 07/14/2010 06:10 PM, Douglas Bates wrote:
R stores matrices and other data objects in memory. A matrix of that
size would require
2e+06*17*8/2^30
[1] 2533.197
great, that is my understanding as well..
probably easier, rethink your problem.
yes. i am starting to do that now as i
On 07/14/2010 07:07 PM, Duncan Murdoch wrote:
It is capable of handling large data, but not that large in a single
matrix. The limit on the number of entries in any vector (and matrices
are stored as vectors) is about 2^31 ~ 2 billion. Your matrix needs
about 340 billion entries, so it's too
If the system is sparse and you have a really large cluster to play
with, then maybe (emphasis) PETSc/TAO is the right combination of tools
for your problem.
http://www.mcs.anl.gov/petsc/petsc-as/
Christos
10 matches
Mail list logo
