Re: [squid-users] Youtube upload cpu problem
Hi guys, my problem with youtube uploads persists. Every day some users have to make upload to youtube. Attached to this email: eth0-day.png: Shows the link utilization (green for download and blue for upload) perf-day.png: Shows the cpu(green) and memory(blue line) utilization of my firewall running squid. Look at the eth0-day, at 10:00h: A user starts a upload to youtube. See the same hour in the perf-day, the cpu goes to 100%. The link utilization goes down, because squid goes very slow in the other requests. The users starts to call me (Hehehe) ! Thanks for all help. 2010/10/23 Amos Jeffries squ...@treenet.co.nz On 23/10/10 19:15, Nyamul Hassan wrote: But that still does not explain the problem, does it? I find it strange, coz, can't seen to reproduce in my scenario. Or may be, I am not looking in the right place. What do you think Amos? I'm thinking the problem is that delay pools as implemented in the stable series accounts for data based on the reply bytes going from server to client. Normally this is the bulk of traffic. However with video uploads the balance goes seriously out of whack and one seconds worth of read data could be matched by thousands of times more write data. Amos On 2010-10-23, Amos Jeffriessqu...@treenet.co.nz wrote: On 23/10/10 01:50, Marcelo Grassi F. Melgaço wrote: Is there a way to limit upload speed for domain upload.youtube.com in squid? Maybe this help to resolve my problem.. Thanks Not with any of the stable or older releases. Upload speed delay pools has just been accepted for addition to 3.2 today. It should be in the net 3.2 beta release. The patch can be found under Client-side bandwidth limits in squid-dev. I've no idea if it will apply to 3.1 cleanly yet. Amos -- Please be using Current Stable Squid 2.7.STABLE9 or 3.1.8 Beta testers wanted for 3.2.0.2 -- Please be using Current Stable Squid 2.7.STABLE9 or 3.1.8 Beta testers wanted for 3.2.0.2 attachment: eth0-day.pngattachment: perf-day.png
Re: [squid-users] Youtube upload cpu problem
But that still does not explain the problem, does it? I find it strange, coz, can't seen to reproduce in my scenario. Or may be, I am not looking in the right place. What do you think Amos? Regards HASSAN On 2010-10-23, Amos Jeffries squ...@treenet.co.nz wrote: On 23/10/10 01:50, Marcelo Grassi F. Melgaço wrote: Is there a way to limit upload speed for domain upload.youtube.com in squid? Maybe this help to resolve my problem.. Thanks Not with any of the stable or older releases. Upload speed delay pools has just been accepted for addition to 3.2 today. It should be in the net 3.2 beta release. The patch can be found under Client-side bandwidth limits in squid-dev. I've no idea if it will apply to 3.1 cleanly yet. Amos -- Please be using Current Stable Squid 2.7.STABLE9 or 3.1.8 Beta testers wanted for 3.2.0.2 -- Sent from my mobile device
Re: [squid-users] Youtube upload cpu problem
On 23/10/10 19:15, Nyamul Hassan wrote: But that still does not explain the problem, does it? I find it strange, coz, can't seen to reproduce in my scenario. Or may be, I am not looking in the right place. What do you think Amos? I'm thinking the problem is that delay pools as implemented in the stable series accounts for data based on the reply bytes going from server to client. Normally this is the bulk of traffic. However with video uploads the balance goes seriously out of whack and one seconds worth of read data could be matched by thousands of times more write data. Amos On 2010-10-23, Amos Jeffriessqu...@treenet.co.nz wrote: On 23/10/10 01:50, Marcelo Grassi F. Melgaço wrote: Is there a way to limit upload speed for domain upload.youtube.com in squid? Maybe this help to resolve my problem.. Thanks Not with any of the stable or older releases. Upload speed delay pools has just been accepted for addition to 3.2 today. It should be in the net 3.2 beta release. The patch can be found under Client-side bandwidth limits in squid-dev. I've no idea if it will apply to 3.1 cleanly yet. Amos -- Please be using Current Stable Squid 2.7.STABLE9 or 3.1.8 Beta testers wanted for 3.2.0.2 -- Please be using Current Stable Squid 2.7.STABLE9 or 3.1.8 Beta testers wanted for 3.2.0.2
Re: [squid-users] Youtube upload cpu problem
As far as I know, that version is not recommended. Please use the latest stable versions and see if problem persists. Regards HASSAN On 2010-10-22, Marcelo Grassi F. Melgaço mgfra...@gmail.com wrote: nobody? Em 20 de outubro de 2010 11:10, Marcelo Grassi F. Melgaço mgfra...@gmail.com escreveu: Greetings! I have a Firewall with Ubuntu 9.10 Server + Squid 3.0.STABLE18 (apt-get) My problem is, when a user start a upload in youtube, the cpu used by squid process go to 100% !! The others requests goes slow. I don't know whats is causing this. I have authentication with basic scheme and just some blocking acl for some domains. I have try to put the domain upload.youtube.com in no_cache, no sucess. Anyone can help me? After searching google i found nothing about it. Thanks a lot! -- Sent from my mobile device
Re: [squid-users] Youtube upload cpu problem
I'll try to update. Thanks 2010/10/22 Nyamul Hassan mnhas...@usa.net: As far as I know, that version is not recommended. Please use the latest stable versions and see if problem persists. Regards HASSAN On 2010-10-22, Marcelo Grassi F. Melgaço mgfra...@gmail.com wrote: nobody? Em 20 de outubro de 2010 11:10, Marcelo Grassi F. Melgaço mgfra...@gmail.com escreveu: Greetings! I have a Firewall with Ubuntu 9.10 Server + Squid 3.0.STABLE18 (apt-get) My problem is, when a user start a upload in youtube, the cpu used by squid process go to 100% !! The others requests goes slow. I don't know whats is causing this. I have authentication with basic scheme and just some blocking acl for some domains. I have try to put the domain upload.youtube.com in no_cache, no sucess. Anyone can help me? After searching google i found nothing about it. Thanks a lot! -- Sent from my mobile device
Re: [squid-users] Youtube upload cpu problem
On 23/10/10 00:07, Marcelo Grassi F. Melgaço wrote: I'll try to update. Thanks This may help the update: https://launchpad.net/~yadi/+archive/ppa Amos -- Please be using Current Stable Squid 2.7.STABLE9 or 3.1.8 Beta testers wanted for 3.2.0.2
Re: [squid-users] Youtube upload cpu problem
Thank you very much ! I'll test upload now and them report here. Thanks again ! 2010/10/22 Amos Jeffries squ...@treenet.co.nz: On 23/10/10 00:07, Marcelo Grassi F. Melgaço wrote: I'll try to update. Thanks This may help the update: https://launchpad.net/~yadi/+archive/ppa Amos -- Please be using Current Stable Squid 2.7.STABLE9 or 3.1.8 Beta testers wanted for 3.2.0.2
Re: [squid-users] Youtube upload cpu problem
I update squid for 3.1.8 using the repository above. But, when i made a upload for youtube, still have the same problem. CPU goes to 100% and other requests goes slow. The access log shows this many times: 1287751157.275 2059 192.168.10.86 TCP_MISS/200 440 GET http://upload.youtube.com/api/upload_feedback? - DIRECT/74.125.47.118 text/plain Thanks for any help. 2010/10/22 Amos Jeffries squ...@treenet.co.nz: On 23/10/10 00:07, Marcelo Grassi F. Melgaço wrote: I'll try to update. Thanks This may help the update: https://launchpad.net/~yadi/+archive/ppa Amos -- Please be using Current Stable Squid 2.7.STABLE9 or 3.1.8 Beta testers wanted for 3.2.0.2
Re: [squid-users] Youtube upload cpu problem
Is there a way to limit upload speed for domain upload.youtube.com in squid? Maybe this help to resolve my problem.. Thanks Em 22 de outubro de 2010 10:40, Marcelo Grassi F. Melgaço mgfra...@gmail.com escreveu: I update squid for 3.1.8 using the repository above. But, when i made a upload for youtube, still have the same problem. CPU goes to 100% and other requests goes slow. The access log shows this many times: 1287751157.275 2059 192.168.10.86 TCP_MISS/200 440 GET http://upload.youtube.com/api/upload_feedback? - DIRECT/74.125.47.118 text/plain Thanks for any help. 2010/10/22 Amos Jeffries squ...@treenet.co.nz: On 23/10/10 00:07, Marcelo Grassi F. Melgaço wrote: I'll try to update. Thanks This may help the update: https://launchpad.net/~yadi/+archive/ppa Amos -- Please be using Current Stable Squid 2.7.STABLE9 or 3.1.8 Beta testers wanted for 3.2.0.2
Re: [squid-users] Youtube upload cpu problem
On 23/10/10 01:50, Marcelo Grassi F. Melgaço wrote: Is there a way to limit upload speed for domain upload.youtube.com in squid? Maybe this help to resolve my problem.. Thanks Not with any of the stable or older releases. Upload speed delay pools has just been accepted for addition to 3.2 today. It should be in the net 3.2 beta release. The patch can be found under Client-side bandwidth limits in squid-dev. I've no idea if it will apply to 3.1 cleanly yet. Amos -- Please be using Current Stable Squid 2.7.STABLE9 or 3.1.8 Beta testers wanted for 3.2.0.2
