[squid-users] Squid: Small packets and low performance between squid and icap

2015-11-04 Thread Prashanth Prabhu
Hi folks, I have a setup with ICAP running a custom server alongside Squid. While testing file upload scenarios, I ran into a slow upload issue and have narrowed it down to slowness between squid and icap, especially in the request handling path. The slowness is down to extremely small packets se

Re: [squid-users] Squid: Small packets and low performance between squid and icap

2015-11-04 Thread Amos Jeffries
On 5/11/2015 3:43 p.m., Prashanth Prabhu wrote: > Hi folks, > > I have a setup with ICAP running a custom server alongside Squid. > While testing file upload scenarios, I ran into a slow upload issue > and have narrowed it down to slowness between squid and icap, > especially in the request handli

Re: [squid-users] Squid: Small packets and low performance between squid and icap

2015-11-04 Thread Amos Jeffries
On 5/11/2015 4:30 p.m., Amos Jeffries wrote: > On 5/11/2015 3:43 p.m., Prashanth Prabhu wrote: >> Hi folks, >> >> I have a setup with ICAP running a custom server alongside Squid. >> While testing file upload scenarios, I ran into a slow upload issue >> and have narrowed it down to slowness between

Re: [squid-users] Squid: Small packets and low performance between squid and icap

2015-11-05 Thread Prashanth Prabhu
Hello Amos, Thanks for the quick response. I failed to mention that I am on 3.5.1. And, readSomeData() is already "fixed": void ConnStateData::readSomeData() { if (reading()) return; debugs(33, 4, HERE << clientConnection << ": reading request..."); if (!in.maybeMakeSpa

Re: [squid-users] Squid: Small packets and low performance between squid and icap

2015-11-05 Thread Amos Jeffries
On 5/11/2015 10:41 p.m., Prashanth Prabhu wrote: > Hello Amos, > > Thanks for the quick response. > > I failed to mention that I am on 3.5.1. And, readSomeData() is already > "fixed": Bug 4353 exists because the initial fix for 4206 was not enough to fully remove the behaviour. Sometimes yes, s

Re: [squid-users] Squid: Small packets and low performance between squid and icap

2015-11-05 Thread Prashanth Prabhu
Hi Amos, >> I failed to mention that I am on 3.5.1. And, readSomeData() is already >> "fixed": > > Bug 4353 exists because the initial fix for 4206 was not enough to fully > remove the behaviour. Sometimes yes, sometimes no. > > Only the nasty hack of allocating buffers twice and throwing one awa

Re: [squid-users] Squid: Small packets and low performance between squid and icap

2016-02-09 Thread Prashanth Prabhu
Hi Amos, I have had a chance to perform some further investigation into the slow-upload issue. And, it appears to be due to how the buffer is used when reading from the client-socket. Here's the behavior I have seen: When the connection is set up, the buffer gets a size of 16KB (default). Squid r

Re: [squid-users] Squid: Small packets and low performance between squid and icap

2016-02-09 Thread Alex Rousskov
[this should be on squid-dev instead] On 02/09/2016 01:20 PM, Prashanth Prabhu wrote: > Here's the behavior I have seen: When the connection is set up, the > buffer gets a size of 16KB (default). Squid reads from the socket, > parses the data, and then sends it towards c-icap as appropriate. Now,

Re: [squid-users] Squid: Small packets and low performance between squid and icap

2016-02-23 Thread Prashanth Prabhu
[+ squid-dev; bcc ssquid-users] Hi Alex, Sorry about the late reply. Please see inline. >> Here's the behavior I have seen: When the connection is set up, the >> buffer gets a size of 16KB (default). Squid reads from the socket, >> parses the data, and then sends it towards c-icap as appropriat