Re: How pickle helps in reading huge files?

2013-10-16 Thread Irmen de Jong
On 16-10-2013 23:04, Peter Cacioppi wrote: > On Tuesday, October 15, 2013 11:55:26 PM UTC-7, Harsh Jha wrote: >> I've a huge csv file and I want to read stuff from it again and again. Is it >> useful >> to pickle it and keep and then unpickle it whenever I need to use that data? >> Is it >> faste

Re: How pickle helps in reading huge files?

2013-10-16 Thread Peter Cacioppi
On Tuesday, October 15, 2013 11:55:26 PM UTC-7, Harsh Jha wrote: > I've a huge csv file and I want to read stuff from it again and again. Is it > useful to pickle it and keep and then unpickle it whenever I need to use that > data? Is it faster that accessing that file simply by opening it again

Re: How pickle helps in reading huge files?

2013-10-16 Thread Roy Smith
In article <0044bfd0-f07f-4f7b-b976-5df034b6f...@googlegroups.com>, Harsh Jha wrote: > I've a huge csv file and I want to read stuff from it again and again. Is it > useful to pickle it and keep and then unpickle it whenever I need to use that > data? Is it faster that accessing that file simp

Re: How pickle helps in reading huge files?

2013-10-16 Thread Chris Angelico
On Wed, Oct 16, 2013 at 7:51 PM, rusi wrote: > On Wednesday, October 16, 2013 12:35:42 PM UTC+5:30, Stéphane Wirtel wrote: >> Keep it in memory > > Thats a strange answer given that the OP says his file is huge. > Of course 'huge' may not really be huge -- that really depends on the h/w > he's us

Re: How pickle helps in reading huge files?

2013-10-16 Thread rusi
On Wednesday, October 16, 2013 12:35:42 PM UTC+5:30, Stéphane Wirtel wrote: > Keep it in memory Thats a strange answer given that the OP says his file is huge. Of course 'huge' may not really be huge -- that really depends on the h/w he's using. -- https://mail.python.org/mailman/listinfo/pytho

Re: How pickle helps in reading huge files?

2013-10-16 Thread Mark Lawrence
On 16/10/2013 07:55, Harsh Jha wrote: I've a huge csv file and I want to read stuff from it again and again. Is it useful to pickle it and keep and then unpickle it whenever I need to use that data? Is it faster that accessing that file simply by opening it again and again? Please explain, why

Re: How pickle helps in reading huge files?

2013-10-16 Thread Stephane Wirtel
Keep it in memory > On 16 oct. 2013, at 08:55 AM, Harsh Jha wrote: > > I've a huge csv file and I want to read stuff from it again and again. Is it > useful to pickle it and keep and then unpickle it whenever I need to use that > data? Is it faster that accessing that file simply by opening i

How pickle helps in reading huge files?

2013-10-16 Thread Harsh Jha
I've a huge csv file and I want to read stuff from it again and again. Is it useful to pickle it and keep and then unpickle it whenever I need to use that data? Is it faster that accessing that file simply by opening it again and again? Please explain, why? Thank you. -- https://mail.python.or