Re: tcp tuning

2014-12-16 Thread Sage Weil
> > Disable TCP slow start on idle connections > > net.ipv4.tcp_slow_start_after_idle = 0 This looks like it's generically applicable and sensible? > > Disable source routing and redirects > > net.ipv4.conf.all.send_redirects = 0 > > net.ipv4.conf.all.accept_redirects = 0 > > net.ipv4.conf.all.ac

Re: tcp tuning

2014-12-16 Thread Blair Bethwaite
;> net.ipv4.conf.all.send_redirects = 0 >> net.ipv4.conf.all.accept_redirects = 0 >> net.ipv4.conf.all.accept_source_route = 0 >> >> I added the net.core.somaxconn after this experience, since the default is >> 128. This represents the allowed socket backlog in the

Re: tcp tuning

2014-12-16 Thread Mark Nelson
est performance for both solutions. At the time this wasn't needed (and made little difference) on the OSDs, but it appears that maybe TCP tuning in general is something we need to look more closely. echo 33554432 | sudo tee /proc/sys/net/core/rmem_default echo 33554432 | sudo tee /proc

tcp tuning

2014-12-16 Thread Sage Weil
I stumbled across this comment in the bug tracker from Jake Young: http://tracker.ceph.com/issues/9844 It's unrelated to the original bug, but wanted to post it here for comment as a quick glance at this makes me think some of these tunings would be good for users in general. sage "My