Re: how's memory usage on public-inbox-httpd?

2019-06-06 Thread Konstantin Ryabitsev
On Thu, Jun 06, 2019 at 10:10:09PM +, Eric Wong wrote: > All those endpoints should detect backpressure from a slow > client (varnish/nginx in your case) using the ->getline method. Wouldn't that spike up and down? The size I'm seeing stays pretty constant without any significant changes

Re: how's memory usage on public-inbox-httpd?

2019-06-06 Thread Eric Wong
Konstantin Ryabitsev wrote: > On Thu, Jun 06, 2019 at 08:37:52PM +, Eric Wong wrote: > > Do you have commit 7d02b9e64455831d3bda20cd2e64e0c15dc07df5? > > ("view: stop storing all MIME objects on large threads") > > That was most significant. > > Yes. We're running 743ac758 with a few

Re: how's memory usage on public-inbox-httpd?

2019-06-06 Thread Konstantin Ryabitsev
On Thu, Jun 06, 2019 at 08:37:52PM +, Eric Wong wrote: Do you have commit 7d02b9e64455831d3bda20cd2e64e0c15dc07df5? ("view: stop storing all MIME objects on large threads") That was most significant. Yes. We're running 743ac758 with a few cherry-picked patches on top of that (like epoch

Re: how's memory usage on public-inbox-httpd?

2019-06-06 Thread Eric Wong
Konstantin Ryabitsev wrote: > Is that normal, and if not, what can I do to help troubleshoot where it's > all going? Oh, another thing is to check if any of that is from mmap-ed files or if its all anon heap memory. The SQLite I'm using from Debian doesn't seem to mmap files (I've never had to

Re: how's memory usage on public-inbox-httpd?

2019-06-06 Thread Eric Wong
Konstantin Ryabitsev wrote: > Hello: > > This is an old-ish discussion, but we finally had a chance to run the httpd > daemon for a long time without restarting it to add more lists, and the > memory usage on it is actually surprising: Thanks for getting back to this. > $ ps -eF | grep

Re: how's memory usage on public-inbox-httpd?

2019-06-06 Thread Konstantin Ryabitsev
Hello: This is an old-ish discussion, but we finally had a chance to run the httpd daemon for a long time without restarting it to add more lists, and the memory usage on it is actually surprising: $ ps -eF | grep public-inbox publici+ 17741 1 0 52667 24836 8 May24 ?00:00:00