Re: Higher Throughputs

2008-06-14 Thread Quintin Beukes
To keep you updated. I haven't been able to improve my speeds above 30mb/s, but using HttpCore has proven much more powerful. Especially since the connection management is done by me, I was able to implement my other feature (smart reuse based on URL), limit concurrent connections myself, and all

Re: Documentation on WIKI; was Re: Higher Throughputs

2008-06-14 Thread Quintin Beukes
One thing you should be bear in mind though. Content published to the project wiki effectively becomes public domain. Other people, primarily project committers, can copy, modify and even delete it at some point. I, for one, would like to be able to reuse some bits and pieces for the

Re: Higher Throughputs

2008-06-13 Thread Quintin Beukes
Hey, That's an idea (to first get the code optimized before squeezing it into tomcat). I guess I just continued this way, as our current system is using HttpURLConnection. So I wanted to get an idea of how it will compare. I'll take your advice on running it in separate java apps? I assume that

Re: Higher Throughputs

2008-06-13 Thread Oleg Kalnichevski
On Fri, 2008-06-13 at 08:35 +0200, Quintin Beukes wrote: Hey, That's an idea (to first get the code optimized before squeezing it into tomcat). I guess I just continued this way, as our current system is using HttpURLConnection. So I wanted to get an idea of how it will compare. I'll

Re: Higher Throughputs

2008-06-13 Thread Quintin Beukes
How would I increase this? Q On Fri, Jun 13, 2008 at 2:53 PM, Oleg Kalnichevski [EMAIL PROTECTED] wrote: On Fri, 2008-06-13 at 11:56 +0200, Quintin Beukes wrote: Not getting expected rate when running inside tomcat. Here are my benchmark results for running as an application (direct

Re: Higher Throughputs

2008-06-13 Thread Quintin Beukes
I made some modifications to running it inside a servlet, and 51mb/s HttpCore, gets 30mb/s inside the servlet (while streaming it out). The servlet is also changed a bit, not wrapping the output stream in a BufferedOutputStream, and others. Either way, when the concurrency is 1 I get this 30mb/s,

Re: Higher Throughputs

2008-06-13 Thread Oleg Kalnichevski
On Fri, 2008-06-13 at 17:05 +0200, Quintin Beukes wrote: I made some modifications to running it inside a servlet, and 51mb/s HttpCore, gets 30mb/s inside the servlet (while streaming it out). The servlet is also changed a bit, not wrapping the output stream in a BufferedOutputStream, and

Re: Higher Throughputs

2008-06-12 Thread Oleg Kalnichevski
Quintin Beukes wrote: Hey, I made some basic servlets to test throughputs for HttpClient, HttpCore and sun's sun.net.www.protocol.http.HttpURLConnection (or something along those lines, I don't have an API at hand now). I basically just put up an apache session listening on port 8580, and then