On 2015-02-24 11:51, Kevin Ryde wrote: > [...] > > Incidentally for performance perhaps you've thought about mmap to slurp > (non-gzipped content). I've had some joy from File::Map (not in debian > currently). > > The only disadvantage I've noticed is mmap reads seem higher kernel > priority then plain reads, or something, making them apparently get > ahead of other processes a bit. > >
Actually, I had not considered using mmap for speed itself. But given the recent findings (#779224 - excessive memory), I have looked into mmap for reducing the memory usage. Sadly, I suspect our primary memory usage occurs from other things than simple file slurping that can trivially be mmap'ed. But at least it is a start. The branch (if you are interested) is available from [1]. ~Niels [1] http://anonscm.debian.org/cgit/users/nthykier/lintian.git/log/?h=memory-reduction -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org