[issue1142] code sample showing errors reading large files with py 2.5/3.0

Amaury Forgeot d'Arc added the comment: issue1744752 describes why it's probably a bug in the C library. possible workarounds are to open the files in universal mode, to use io.open(), or to switch to python 3! -- nosy: +amaury.forgeotdarc resolution: -> wont fix status: open -> close

[issue1142] code sample showing errors reading large files with py 2.5/3.0

Changes by Guido van Rossum : -- nosy: -gvanrossum ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.

[issue1142] code sample showing errors reading large files with py 2.5/3.0

Changes by Tim Golden : -- nosy: +tim.golden ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.

[issue1142] code sample showing errors reading large files with py 2.5/3.0

Changes by Daniel Diniz : -- components: +IO nosy: +benjamin.peterson, pitrou stage: -> test needed versions: +Python 2.6, Python 3.1 -Python 2.5 ___ Python tracker ___ _

[issue1142] code sample showing errors reading large files with py 2.5/3.0

Sean Reifschneider <[EMAIL PROTECTED]> added the comment: I have run this under the current py3k SVN version on an 64-bit Linux (Fedora 8), and it runs fine, FYI. ISTR that I had a patch which fixed something that sounds very much like this, but I can't find that other issue. -- nosy: +

[issue1142] code sample showing errors reading large files with py 2.5/3.0

Guido van Rossum added the comment: Cool. This helps track down the bug a bit more; it's either in (our routine) getline_via_fgets or it's in Microsoft's text mode line end translation (which universal newlines bypasses). I'm assigning this to Tim Peters, who probably still has a Windows box and

[issue1142] code sample showing errors reading large files with py 2.5/3.0

christen added the comment: Bug is still there but pb is solved, simply use oepn('file', 'U') see outputs : fichin=open('test.txt','U') ===> (2, 5, 0, 'final', 0) 2007-09-12 08:00:43 (500, 9.31236239624) (1000, 22.31236239624) (1500, 35.094000101089478) (2000, 47.8123

[issue1142] code sample showing errors reading large files with py 2.5/3.0

Guido van Rossum added the comment: Folks, please focus on one issue at a time, and don't post such long transcripts. I know Py3k text I/O is very slow; it's written in Python and uses UTF-8 as the default encoding. We've got a summer of code student working on an accelerating this. (And if he

[issue1142] code sample showing errors reading large files with py 2.5/3.0

christen added the comment: Hi Guido It is not the end of the file that is not read (see also below) I found about that about one year ago when I was parsing very large files resulting from "blast" on the human genome My parser chock after 4 Go, well before the end of the file : one line was

[issue1142] code sample showing errors reading large files with py 2.5/3.0

Stefan Sonnenberg-Carstens added the comment: I can confirm that under Linux (Linux nx6310 2.6.22-1-mepis-smp #1 SMP PREEMPT Wed Sep 5 22:23:08 EDT 2007 i686 GNU/Linux, SimplyMepis 7.0b3) 1. using Python 3.0a1 is _very_ slow 2. it eats all your cpu (see my post) I did not take the time to wait fo

[issue1142] code sample showing errors reading large files with py 2.5/3.0

Guido van Rossum added the comment: PythonMeister, what do you mean, "confirmed"? Your read loop ends printing ('total lines read ', 85014960) which is the expected output. (It's one less than the number of lines written due to a bug in the program -- it prints the 0-based ordinal of the last

[issue1142] code sample showing errors reading large files with py 2.5/3.0

Changes by Stefan Sonnenberg-Carstens: -- components: +Interpreter Core title: code sample showing errors reading large files with py 2.5 -> code sample showing errors reading large files with py 2.5/3.0 versions: +Python 3.0 __ Tracker <[EMAIL PROTECTED