Thanks Francesc, >>> tables.print_versions() -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- =-=-=-= PyTables version: 2.0 HDF5 version: 1.6.5 NumPy version: 1.0.3 Zlib version: 1.2.3 BZIP2 version: 1.0.2 (30-Dec-2001) Python version: 2.4.3 (#1, Mar 30 2006, 11:02:16) [GCC 4.0.1 (Apple Computer, Inc. build 5250)] Platform: darwin-i386 Byte-ordering: little -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- =-=-=-= >>> My RAM is 256Mb on OSX 10.4.10 (the latest).
It may be something to do with the way the OS manages memory. I've heard it's pretty aggressive, so if the number of groups is large, parts may be cached out before being accessed again. I don't know what I'm talking about really :-) but if you think that it is likely, perhaps I could raise the issue on the pythonmac-SIG. ? Also, is there any reason why I can't/shouldn't use 2 or more .h5 files in parallel (split the 3500+ top-level groups into two DBs)? ciao, David On 14/08/2007, at 10:00 PM, Francesc Altet wrote: > A Monday 13 August 2007, David Worrall escrigué: >> Hola Francesc, >> >> Attached is a test that generates the Seg Fault. > > I've been trying to run your test, but I haven't been able to get any > segfault yet (using Linux on top of Intel here). I'll try further > with > other configurations anyway. > > I don't know how much memory your system has, but if it is a large > amount (say, 1 GB or more) you may want to try to change the variable > NODE_MAX_SLOTS (in tables/parameters.py) from 256 (default) to a > bigger > value. You may try also with a lower one. If your system has > really a > very large amount of memory (>= 8GB) available, you may want to set > NODE_MAX_SLOTS to 0 so that the node cache is completely disabled. > Please, report back your experiences. > > Also, can you send the output of tables.print_versions()? > > Cheers, > > -- >> 0,0< Francesc Altet http://www.carabos.com/ > V V Cárabos Coop. V. Enjoy Data > "-" > > ---------------------------------------------------------------------- > --- > This SF.net email is sponsored by: Splunk Inc. > Still grepping through log files to find problems? Stop. > Now Search log events and configuration files using AJAX and a > browser. > Download your FREE copy of Splunk now >> http://get.splunk.com/ > _______________________________________________ > Pytables-users mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/pytables-users > _________________________________________________ experimental polymedia: www.avatar.com.au Sonic Communications Research Group, University of Canberra: www.canberra.edu.au/vc-forum/scrg vip=Verbal Interactivity Project ------------------------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ Pytables-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/pytables-users
