[issue34010] tarfile stream read performance

2018-07-03 Thread hajoscher
hajoscher added the comment: Yes, it performance is really bad for large files, and memory consumption as well. I will write something for NEWS. -- ___ Python tracker <https://bugs.python.org/issue34

[issue34010] tarfile stream read performance

2018-06-30 Thread hajoscher
New submission from hajoscher : Buffer read of large files in a compressed tarfile stream performs poorly. The buffered read in tarfile _Stream is extending a bytes object. It is much more efficient to use a list followed by a join. Using a list can mean seconds instead of minutes