Re: 64 bit memory usage

2010-12-11 Thread Steve Holden
On 12/10/2010 2:03 PM, Rob Randall wrote: I manged to get my python app past 3GB on a smaller 64 bit machine. On a test to check memory usage with gc disabled only an extra 6MB was used. The figures were 1693MB to 1687MB. This is great. Thanks again for the help. Do remember, though,

Re: 64 bit memory usage

2010-12-10 Thread Rob Randall
You guys are right. If I disable the gc it will use all the virtual RAM in my test. The application I have been running these tests for is a port of a program written in a LISP-based tool running on Unix. It does a mass of stress calculations. The port has been written using a python-based

Re: 64 bit memory usage

2010-12-10 Thread Rob Randall
I manged to get my python app past 3GB on a smaller 64 bit machine. On a test to check memory usage with gc disabled only an extra 6MB was used. The figures were 1693MB to 1687MB. This is great. Thanks again for the help. On 10 December 2010 13:54, Rob Randall rob.randa...@gmail.com wrote:

Re: Re: 64 bit memory usage

2010-12-09 Thread Heather Brown
On 01/-10/-28163 02:59 PM, Dennis Lee Bieber wrote: On Wed, 8 Dec 2010 14:44:30 +, Rob Randallrob.randa...@gmail.com declaimed the following in gmane.comp.python.general: I am trying to understand how much memory is available to a 64 bit python process running under Windows XP 64 bit.

Re: 64 bit memory usage

2010-12-09 Thread Nobody
Rob Randall rob.randa...@gmail.com wrote: I am trying to understand how much memory is available to a 64 bit python process running under Windows XP 64 bit. When I run tests just creating a series of large dictionaries containing string keys and float values I do not seem to be able to grow

Re: 64 bit memory usage

2010-12-09 Thread Antoine Pitrou
On Wed, 8 Dec 2010 14:44:30 + Rob Randall rob.randa...@gmail.com wrote: I am trying to understand how much memory is available to a 64 bit python process running under Windows XP 64 bit. When I run tests just creating a series of large dictionaries containing string keys and float values

Re: 64 bit memory usage

2010-12-09 Thread Rob Randall
But the C++ program using up memory does not slow up. It has gone to 40GB without much trouble. Does anyone have a 64 bit python application that uses more the 2GB? On 9 December 2010 16:54, Antoine Pitrou solip...@pitrou.net wrote: On Wed, 8 Dec 2010 14:44:30 + Rob Randall

Re: 64 bit memory usage

2010-12-09 Thread Rob Randall
Basically the process runs at around 1% and it never seems to grow in size again. When running the C++ with python app the process slows when a new 'page' is required but then goes back to 'full' speed. It does this until basically all the virtual memory is used. I have had memory exceptions when

Re: 64 bit memory usage

2010-12-09 Thread John Nagle
On 12/8/2010 11:40 PM, Ian Kelly wrote: Since a process need not have all its pages in physical memory simultaneously, there is no reason to suppose that a single process could not consume the entirety of the available virtual memory (minus what is used by the operating system) on a 64-bit

Re: 64 bit memory usage

2010-12-09 Thread Benjamin Kaplan
On Thursday, December 9, 2010, Rob Randall rob.randa...@gmail.com wrote: But the C++ program using up memory does not slow up. It has gone to 40GB without much trouble. Your C++ program probably doesn't have a garbage collector traversing the entire allocated memory looking for reference

Re: 64 bit memory usage

2010-12-09 Thread Rob Randall
I will give it a try with the garbage collector disabled. On 9 December 2010 17:29, Benjamin Kaplan benjamin.kap...@case.edu wrote: On Thursday, December 9, 2010, Rob Randall rob.randa...@gmail.com wrote: But the C++ program using up memory does not slow up. It has gone to 40GB without much

Re: 64 bit memory usage

2010-12-09 Thread Antoine Pitrou
On Thu, 9 Dec 2010 17:18:58 + Rob Randall rob.randa...@gmail.com wrote: Basically the process runs at around 1% and it never seems to grow in size again. When running the C++ with python app the process slows when a new 'page' is required but then goes back to 'full' speed. It does this

Re: 64 bit memory usage

2010-12-09 Thread John Nagle
On 12/8/2010 10:42 PM, Dennis Lee Bieber wrote: On Wed, 8 Dec 2010 14:44:30 +, Rob Randallrob.randa...@gmail.com declaimed the following in gmane.comp.python.general: I am trying to understand how much memory is available to a 64 bit python process running under Windows XP 64 bit. When I

64 bit memory usage

2010-12-08 Thread Rob Randall
I am trying to understand how much memory is available to a 64 bit python process running under Windows XP 64 bit. When I run tests just creating a series of large dictionaries containing string keys and float values I do not seem to be able to grow the process beyond the amount of RAM present.

Re: 64 bit memory usage

2010-12-08 Thread Ian Kelly
On 12/8/2010 11:42 PM, Dennis Lee Bieber wrote: The page file can be larger than physical memory because it contains memory images for multiple processes. However, all those images have to map into the physically addressable memory -- so a process is likely limited to physical memory,