Re: Working with Huge Text Files

2005-03-19 Thread cwazir
John Machin wrote: > More meaningful names wouldn't go astray either :-) I heartily concur! Instead of starting with: fields = line.strip().split(',') you could use something like: (f_name, f_date, f_time, ...) = line.strip().split(',') Of course then you won't be able to use ', '.join(fiel

Re: Working with Huge Text Files

2005-03-19 Thread cwazir
Lorn Davies wrote: > if (fields[8] == 'N' or 'P') and (fields[6] == '0' or '1'): > ## This line above doesn't work, can't figure out how to struct? In Python you would need to phrase that as follows: if (fields[8] == 'N' or fields[8] == 'P') and (fields[6] == '0' or fields[6] == '1'): or al

Re: Working with Huge Text Files

2005-03-18 Thread cwazir
Hi, Lorn Davies wrote: > . working with text files that range from 100MB to 1G in size. > . > XYZ,04JAN1993,9:30:27,28.87,7600,40,0,Z,N > XYZ,04JAN1993,9:30:28,28.87,1600,40,0,Z,N > . I've found that for working with simple large text files like this, nothing beats the plain old buil