A Tuesday 14 December 2010 21:09:51 [email protected] escrigué:
> So I now am keeping summaries in a separate table (3 actually, 2
> VLArrays for the attributes and dtypes and 1 Table for the numeric
> data). It is 30 times faster to load for a small set of tables (59
> mS compared to 1.7S), and
] MemoryError on reading attributes
David, your screen captures were too large and your message bounced.
I'm copying your message here. Your scripts are also attached. See my
comments interspersed in your message.
A Monday 13 December 2010 10:56:04 [email protected] escrigué:
> ;o) he
David, your screen captures were too large and your message bounced.
I'm copying your message here. Your scripts are also attached. See my
comments interspersed in your message.
A Monday 13 December 2010 10:56:04 [email protected] escrigué:
> ;o) here's the screen captures
>
> The file I
A Monday 13 December 2010 10:56:04 [email protected] escrigué:
> Hi Francesc,
>
> The challenge I face is getting it off my machine - I've ordered an
> encrypted USB stick that I'll post to you in due course.
Okay.
> Currently, it appears that memory is consumed in the numpy loadtxt
> code (w
file
open. I can't even reopen that file.
I'll post more when I've a better sense of where the problems lie.
Thanks
David
-Original Message-
From: Francesc Alted [mailto:[email protected]]
Sent: Thu 9-Dec-2010 08:01
To: [email protected]
Subj
A Wednesday 08 December 2010 19:07:24 [email protected] escrigué:
> Hi Francesc
>
> It's 1.2GByte so I'll have to burn a DVD and post it to you - first I
> need to find out how to do that.
Well, 1.2 GB is not that much for nowadays ADSL lines, so if you can
upload it to an accessible place th
4, float32, float32,
float32, float32, int64) with 500k rows.
Regards,
David
-Original Message-
From: Francesc Alted [mailto:[email protected]]
Sent: Wed 8-Dec-2010 13:59
To: [email protected]
Subject: Re: [Pytables-users] MemoryError on reading attributes
A We
A Wednesday 08 December 2010 13:23:25 [email protected] escrigué:
> Hi
>
> I'm using a negative number so I can search for the table using the
> getTables function (as recommended in a previous post). Problems
> reproduces for 256, -256 and 2000.
>
> Pretty sure the MemoryError is on the PyTab
n.Row(self)
File "tableExtension.pyx", line 751, in tables.tableExtension.Row.__cinit__
(tables\tableExtension.c:6736)
File "tableExtension.pyx", line 786, in tables.tableExtension.Row._newBuffer
(tables\tableExtension.c:7192)
File "c:\python26qv\lib\site-packages\tabl
A Wednesday 08 December 2010 01:32:12 [email protected] escrigué:
> Hi
>
> I have loaded around 2200 table total of 1.1GB (I have a lot more to
> load - csv size is 12GB). The load crash with a memory error:
[clip]
> File "c:\python26qv\lib\site-packages\tables\table.py", line 687,
> in _get
Hi
I have loaded around 2200 table total of 1.1GB (I have a lot more to
load - csv size is 12GB). The load crash with a memory error:
Script run-time error
-
Traceback (most recent call last):
File "c:\QuantView\App\a2\ubs-packages\qa\scripting.py", line 48, in
executeScrip
11 matches
Mail list logo
