Bug#815103: memory use increases with more files; OOM

2016-02-20 Thread Joey Hess
> 366 added objects in 5 minutes, and the memory increased by 55 mb. The meliae dumps for that time period grew from 807 mb to 813 mb. I don't know if that 6 mb of serialized data could use 55 mb in memory or not. Of the 3556035 lines in the last meliae dump, 3394078 were of type: str. The

Bug#815103: memory use increases with more files; OOM

2016-02-20 Thread Joey Hess
Lars Wirzenius wrote: > Hmm. The number of Python objects seems to be pretty steady, but the > memory use keeps going up. That seems to indicate a memory leak > somewhere. Well, the number of objects seems to be going up over time. 366 added objects in 5 minutes, and the memory increased by 55

Bug#815103: memory use increases with more files; OOM

2016-02-20 Thread Lars Wirzenius
On Thu, Feb 18, 2016 at 04:13:14PM -0400, Joey Hess wrote: > obnam grows in size to fill all 2 gb of memory on the system and > OOMs. Ouch. I've not had that problem, but Obnam is currently know to not be careful about spending memory. > Summarizing it: Hmm. The number of Python objects seems

Bug#815103: memory use increases with more files; OOM

2016-02-18 Thread Joey Hess
Package: obnam Version: 1.19.1-1 Severity: normal obnam grows in size to fill all 2 gb of memory on the system and OOMs. Memory use seems to increase the more files are backed up. I did try setting lru-size to half of the default, but this did not change much memory use. I have a meliae profile