Sorting Large File (Code/Performance)

Hello all, I have an Unicode text file with 1.6 billon lines (~2GB) that I'd like to sort based on first two characters. I'd greatly appreciate if someone can post sample code that can help me do this. Also, any ideas on approximately how long is the sort process going to take (XP, Dual Core

Re: Sorting Large File (Code/Performance)

Thanks to all who replied. It's very appreciated. Yes, I had to doublecheck line counts and the number of lines is ~16 million (insetead of stated 1.6B). Also: What is a Unicode text file? How is it encoded: utf8, utf16, utf16le, utf16be, ??? If you don't know, do this: The file is UTF-8 Do

Filtering content of a text file

Hello All, I'd greatly appreciate if you can take a look at the task I need help with. It'd be outstanding if someone can provide some sample Python code. Thanks a lot, Ira --- Problem

Re: Filtering content of a text file

Thanks all for the input. This is going to be a great basis for starting. And, yeah - I wish it was a homework. Best, Ira -- http://mail.python.org/mailman/listinfo/python-list