Re: Connection timing out
Hi, Does httpClient have features to provide any kind of client-side caching of web objects ? For eg, incase of frequently visited sites that tend to have a lot of images on them , does httpClient cache them on the client-side ? Does it retrieve these objects everytime ? Do you think this feature needs to be implemented in a layer above httpClient ? Regards Vinay On Fri, 15 Oct 2004 09:54:33 +0530, Vinay Murthy [EMAIL PROTECTED] wrote: Hi Oleg, I guess upgrading to HttpClient 2.0.2 seems to work as far as the connection timeout issue is concerned. Thanks for that.Was that an issue in 2.0-rc2 ? But I guess, I seem to be having problems with regard to cookie handling. I believe that the cookie that is sent by Yahoo! upon signing in, is not being handled properly by my code ; as a result of which it seems expired to the server. And hence I am led to the Verify Password page. The httpclient page does mention about Yahoo!'s cookies posing problems. Does the problem still persist? Secondly, I got the following log warning: Oct 15, 2004 9:42:28 AM org.apache.commons.httpclient.HttpMethodBase getResponseBody WARNING: Going to buffer response body of large or unknown size. Using getResponseAsStream instead is recommended. Regards Vinay On Thu, 14 Oct 2004 19:02:23 +0200, Oleg Kalnichevski [EMAIL PROTECTED] wrote: Please upgrade to HttpClient 2.0.2 and retest. In the future please do send your response to the list Oleg On Thu, 2004-10-14 at 18:58, Vinay Murthy wrote: Hi, JRE = 1.4.2 httpClient =2.0-rc2 (.jar) Hope that helps, Regards Vinay On Thu, 14 Oct 2004 18:51:17 +0200, Oleg Kalnichevski [EMAIL PROTECTED] wrote: Vinay, What HttpClient and JRE version are you using? Oleg On Thu, 2004-10-14 at 18:31, Vinay Murthy wrote: Hi, I am using httpClient as a part of htmlUnit. I tried logging into my mail account (Yahoo!), but unfortunately ended with an exception trace: java.net.ConnectException: Connection timed out: connect at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(Unknown Source) at java.net.PlainSocketImpl.connectToAddress(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.init(Unknown Source) at java.net.Socket.init(Unknown Source) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:105) at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:663) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:661) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:529) How can work around this problem ? Can someboby help ? Regards Vinay - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: Connection timing out
On Fri, 2004-10-15 at 06:24, Vinay Murthy wrote: Hi Oleg, I guess upgrading to HttpClient 2.0.2 seems to work as far as the connection timeout issue is concerned. Thanks for that.Was that an issue in 2.0-rc2 ? I am not aware of any connection timeout related issue with any of RC releases. We usually have a policy of supporting the latest stable release and CVS HEAD only. That's the reason I asked you to upgrade But I guess, I seem to be having problems with regard to cookie handling. I believe that the cookie that is sent by Yahoo! upon signing in, is not being handled properly by my code ; as a result of which it seems expired to the server. And hence I am led to the Verify Password page. The httpclient page does mention about Yahoo!'s cookies posing problems. Does the problem still persist? Yahoo does a lot of nasty tricks to make scripted (non-interactive) logins VERY difficult. I know of only one application, called MrPostman, that provides some degree of support for Yahoo services http://cvs.sourceforge.net/viewcvs.py/mrpostman/mrpostman/src/org/mrbook/mrpostman/yahoo/YahooMailSession.java?view=markup My advice is to take a very good look at the YahooMailSession source code and tweak it to your specific needs Secondly, I got the following log warning: Oct 15, 2004 9:42:28 AM org.apache.commons.httpclient.HttpMethodBase getResponseBody WARNING: Going to buffer response body of large or unknown size. Using getResponseAsStream instead is recommended. I believe the warning is self-explanatory HttpMethod#getResponseBody tries to buffer the entire response content in memory, which may be a pretty bad idea when dealing with large response entities. Therefore we recommend using non-buffering HttpMethod#getResponseAsStream method and implement a content retrieval/buffering logic that is best suited for your specific application. Hope this helps Oleg Regards Vinay On Thu, 14 Oct 2004 19:02:23 +0200, Oleg Kalnichevski [EMAIL PROTECTED] wrote: Please upgrade to HttpClient 2.0.2 and retest. In the future please do send your response to the list Oleg On Thu, 2004-10-14 at 18:58, Vinay Murthy wrote: Hi, JRE = 1.4.2 httpClient =2.0-rc2 (.jar) Hope that helps, Regards Vinay On Thu, 14 Oct 2004 18:51:17 +0200, Oleg Kalnichevski [EMAIL PROTECTED] wrote: Vinay, What HttpClient and JRE version are you using? Oleg On Thu, 2004-10-14 at 18:31, Vinay Murthy wrote: Hi, I am using httpClient as a part of htmlUnit. I tried logging into my mail account (Yahoo!), but unfortunately ended with an exception trace: java.net.ConnectException: Connection timed out: connect at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(Unknown Source) at java.net.PlainSocketImpl.connectToAddress(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.init(Unknown Source) at java.net.Socket.init(Unknown Source) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:105) at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:663) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:661) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:529) How can work around this problem ? Can someboby help ? Regards Vinay - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] *** The information in this email is confidential and may be legally privileged. Access to this email by anyone other than the intended addressee is unauthorized. If you are not the intended recipient of this message, any review, disclosure, copying, distribution, retention, or any action taken or omitted to be taken in reliance on it is prohibited and may be unlawful. If you are not the intended recipient, please reply to or forward a copy of this message to the sender and delete the message, any attachments, and any copies thereof from your system. *** - To unsubscribe, e-mail:
Re: Connection timing out
On Fri, 2004-10-15 at 12:08, Vinay Murthy wrote: Hi, Does httpClient have features to provide any kind of client-side caching of web objects ? For eg, incase of frequently visited sites that tend to have a lot of images on them , does httpClient cache them on the client-side ? Does it retrieve these objects everytime ? Do you think this feature needs to be implemented in a layer above httpClient Yes, we do. We are convinced HttpClient should stay what it is, an HTTP transport library, and we have no plans to make a web browser or a vacuum cleaner out of it ? Regards Vinay On Fri, 15 Oct 2004 09:54:33 +0530, Vinay Murthy [EMAIL PROTECTED] wrote: Hi Oleg, I guess upgrading to HttpClient 2.0.2 seems to work as far as the connection timeout issue is concerned. Thanks for that.Was that an issue in 2.0-rc2 ? But I guess, I seem to be having problems with regard to cookie handling. I believe that the cookie that is sent by Yahoo! upon signing in, is not being handled properly by my code ; as a result of which it seems expired to the server. And hence I am led to the Verify Password page. The httpclient page does mention about Yahoo!'s cookies posing problems. Does the problem still persist? Secondly, I got the following log warning: Oct 15, 2004 9:42:28 AM org.apache.commons.httpclient.HttpMethodBase getResponseBody WARNING: Going to buffer response body of large or unknown size. Using getResponseAsStream instead is recommended. Regards Vinay On Thu, 14 Oct 2004 19:02:23 +0200, Oleg Kalnichevski [EMAIL PROTECTED] wrote: Please upgrade to HttpClient 2.0.2 and retest. In the future please do send your response to the list Oleg On Thu, 2004-10-14 at 18:58, Vinay Murthy wrote: Hi, JRE = 1.4.2 httpClient =2.0-rc2 (.jar) Hope that helps, Regards Vinay On Thu, 14 Oct 2004 18:51:17 +0200, Oleg Kalnichevski [EMAIL PROTECTED] wrote: Vinay, What HttpClient and JRE version are you using? Oleg On Thu, 2004-10-14 at 18:31, Vinay Murthy wrote: Hi, I am using httpClient as a part of htmlUnit. I tried logging into my mail account (Yahoo!), but unfortunately ended with an exception trace: java.net.ConnectException: Connection timed out: connect at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(Unknown Source) at java.net.PlainSocketImpl.connectToAddress(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.init(Unknown Source) at java.net.Socket.init(Unknown Source) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:105) at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:663) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:661) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:529) How can work around this problem ? Can someboby help ? Regards Vinay - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] *** The information in this email is confidential and may be legally privileged. Access to this email by anyone other than the intended addressee is unauthorized. If you are not the intended recipient of this message, any review, disclosure, copying, distribution, retention, or any action taken or omitted to be taken in reliance on it is prohibited and may be unlawful. If you are not the intended recipient, please reply to or forward a copy of this message to the sender and delete the message, any attachments, and any copies thereof from your system. *** - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Connection timing out
Hi, I am using httpClient as a part of htmlUnit. I tried logging into my mail account (Yahoo!), but unfortunately ended with an exception trace: java.net.ConnectException: Connection timed out: connect at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(Unknown Source) at java.net.PlainSocketImpl.connectToAddress(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.init(Unknown Source) at java.net.Socket.init(Unknown Source) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:105) at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:663) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:661) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:529) How can work around this problem ? Can someboby help ? Regards Vinay - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: Connection timing out
Vinay, What HttpClient and JRE version are you using? Oleg On Thu, 2004-10-14 at 18:31, Vinay Murthy wrote: Hi, I am using httpClient as a part of htmlUnit. I tried logging into my mail account (Yahoo!), but unfortunately ended with an exception trace: java.net.ConnectException: Connection timed out: connect at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(Unknown Source) at java.net.PlainSocketImpl.connectToAddress(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.init(Unknown Source) at java.net.Socket.init(Unknown Source) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:105) at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:663) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:661) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:529) How can work around this problem ? Can someboby help ? Regards Vinay - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: Connection timing out
Hi Oleg, I guess upgrading to HttpClient 2.0.2 seems to work as far as the connection timeout issue is concerned. Thanks for that.Was that an issue in 2.0-rc2 ? But I guess, I seem to be having problems with regard to cookie handling. I believe that the cookie that is sent by Yahoo! upon signing in, is not being handled properly by my code ; as a result of which it seems expired to the server. And hence I am led to the Verify Password page. The httpclient page does mention about Yahoo!'s cookies posing problems. Does the problem still persist? Secondly, I got the following log warning: Oct 15, 2004 9:42:28 AM org.apache.commons.httpclient.HttpMethodBase getResponseBody WARNING: Going to buffer response body of large or unknown size. Using getResponseAsStream instead is recommended. Regards Vinay On Thu, 14 Oct 2004 19:02:23 +0200, Oleg Kalnichevski [EMAIL PROTECTED] wrote: Please upgrade to HttpClient 2.0.2 and retest. In the future please do send your response to the list Oleg On Thu, 2004-10-14 at 18:58, Vinay Murthy wrote: Hi, JRE = 1.4.2 httpClient =2.0-rc2 (.jar) Hope that helps, Regards Vinay On Thu, 14 Oct 2004 18:51:17 +0200, Oleg Kalnichevski [EMAIL PROTECTED] wrote: Vinay, What HttpClient and JRE version are you using? Oleg On Thu, 2004-10-14 at 18:31, Vinay Murthy wrote: Hi, I am using httpClient as a part of htmlUnit. I tried logging into my mail account (Yahoo!), but unfortunately ended with an exception trace: java.net.ConnectException: Connection timed out: connect at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(Unknown Source) at java.net.PlainSocketImpl.connectToAddress(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at java.net.Socket.init(Unknown Source) at java.net.Socket.init(Unknown Source) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:105) at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:663) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:661) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:529) How can work around this problem ? Can someboby help ? Regards Vinay - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
