Re: Joining Big Files

2007-08-31 Thread vasudevram
On Aug 27, 12:43 am, mcl [EMAIL PROTECTED] wrote: All, Thank you very much. As my background is much smaller memory machines than today's giants - 64k being abigmachine and 640k being gigantic. I get very worried about crashing machines when copying or editingbigfiles, especially in a

Re: Joining Big Files

2007-08-26 Thread vasudevram
On Aug 26, 6:48 am, Paul McGuire [EMAIL PROTECTED] wrote: On Aug 25, 8:15 pm, Paul McGuire [EMAIL PROTECTED] wrote: On Aug 25, 4:57 am, mosscliffe [EMAIL PROTECTED] wrote: I have 4 text files each approx 50mb. yawn 50mb? Really? Did you actually try this and find out it was a

Re: Joining Big Files

2007-08-26 Thread mcl
On 26 Aug, 15:45, vasudevram [EMAIL PROTECTED] wrote: On Aug 26, 6:48 am, Paul McGuire [EMAIL PROTECTED] wrote: On Aug 25, 8:15 pm, Paul McGuire [EMAIL PROTECTED] wrote: On Aug 25, 4:57 am,mosscliffe[EMAIL PROTECTED] wrote: I have 4 text files each approx 50mb. yawn 50mb?

Joining Big Files

2007-08-25 Thread mosscliffe
I have 4 text files each approx 50mb. I need to join these into one large text file. I only need to do this very occasionally, as the problem has occurred because of upload limitations. Bearing in mind filesize and memory useage, would I be better reading every line in every file and writing

Re: Joining Big Files

2007-08-25 Thread Marc 'BlackJack' Rintsch
On Sat, 25 Aug 2007 02:57:24 -0700, mosscliffe wrote: I have 4 text files each approx 50mb. I need to join these into one large text file. I only need to do this very occasionally, as the problem has occurred because of upload limitations. Bearing in mind filesize and memory useage,

Re: Joining Big Files

2007-08-25 Thread beginner
On Aug 25, 4:57 am, mosscliffe [EMAIL PROTECTED] wrote: I have 4 text files each approx 50mb. I need to join these into one large text file. I only need to do this very occasionally, as the problem has occurred because of upload limitations. Bearing in mind filesize and memory useage,

Re: Joining Big Files

2007-08-25 Thread Paul McGuire
On Aug 25, 4:57 am, mosscliffe [EMAIL PROTECTED] wrote: I have 4 text files each approx 50mb. yawn 50mb? Really? Did you actually try this and find out it was a problem? Try this: import time start = time.clock() outname = temp.dat outfile = file(outname,w) for inname in ['file1.dat',

Re: Joining Big Files

2007-08-25 Thread Paul McGuire
On Aug 25, 8:15 pm, Paul McGuire [EMAIL PROTECTED] wrote: On Aug 25, 4:57 am, mosscliffe [EMAIL PROTECTED] wrote: I have 4 text files each approx 50mb. yawn 50mb? Really? Did you actually try this and find out it was a problem? Try this: import time start = time.clock() outname =