2009/7/23 Charles R Harris :
>> Maybe I am measuring memory usage wrong?
>
> Hmm, I don't know what you should be looking at in XP. Memmapped files are
> sort of like virtual memory and exist in the address space even if they
> aren't in physical memory. When you address an element that isn't in
>
On Thu, Jul 23, 2009 at 7:48 AM, Kim Hansen wrote:
> 2009/7/23 Charles R Harris :
> >
> >
> >>
> >> Is it due to the 32 bit OS I am using?
> >
> > It could be. IIRC, 32 bit windows gives user programs 2 GB of addressable
> > memory, so your files need to fit in that space even if the data is on
>
2009/7/23 Charles R Harris :
>
>
>>
>> Is it due to the 32 bit OS I am using?
>
> It could be. IIRC, 32 bit windows gives user programs 2 GB of addressable
> memory, so your files need to fit in that space even if the data is on disk.
> You aren't using that much memory but you are close and it cou
On Thu, Jul 23, 2009 at 5:36 AM, Kim Hansen wrote:
> OS. Win XP SP3, 32 bits
> Python: 2.5.4
> Numpy: 1.3.0
>
> I have am having some major problems converting a 750 MB recarray into
> a 850 MB recarray
>
> To save RAM I would like to use a read-only and a writeable memap for
> the two recarrays
OS. Win XP SP3, 32 bits
Python: 2.5.4
Numpy: 1.3.0
I have am having some major problems converting a 750 MB recarray into
a 850 MB recarray
To save RAM I would like to use a read-only and a writeable memap for
the two recarrays during the conversion.
So I do something like:
import os
from stat
