Re: Odd problem
It is. For cookie parsing though I had to implement my own parser. HttpClient would not handle cookies like: Set-Cookie:stickytags=T1:byMeU53W,T2:byMeU53W,T3:byMeU53W,T4:byMeU53W, T5:byMeU53W,T6:byMeU53W,T7:byMeU53W,T8:byMeU53W,T9:byMeU53W,T10:byMeU5 3W,T11:byMeU53W,T12:byMeU53W,T13:byMeU53W,T14:byMeU53W,T15:byMeU53W,T1 6:byMeU53W;Path=/ - Original Message - From: "Michael Becke" <[EMAIL PROTECTED]> To: "Commons HttpClient Project" <[EMAIL PROTECTED]> Sent: Monday, February 02, 2004 4:39 PM Subject: Re: Odd problem > Hi Brett, > > This is a bit of a guess, but it could be because of the cookie format. > Try using the cookie compatibility setting: > > CookiePolicy.setDefaultPolicy(CookiePolicy.COMPATIBILITY); > > Mike > > > On Feb 2, 2004, at 3:57 PM, Brett Knights wrote: > > > That's what I thought when I first looked at it but it appears to use > > the JDK connection classes. > > A grinder transcript using HttpUnit (succeeds) and HttpClient (fails) > > follows. One thing that's odd is that the HttpClient transaction looks > > more like the transcript I get with IE than does the one using > > HttpUnit. > > > > HTH > > > > With HttpUnit: > > ** > > *** > > > > > > --- localhost:4078->server.com:443 closed -- > > --- server.com:443->localhost:4078 closed -- > > --- localhost:4345->server.com:443 opened -- > > --- server.com:443->localhost:4345 opened -- > > -- localhost:4345->server.com:443 -- > > POST /app/login/nllogin.nl HTTP/1.1 > > User-Agent: httpunit/1.5 > > Host: server.com > > Content-Type: application/x-www-form-urlencoded > > Accept: text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2 > > Cache-Control: no-cache > > Pragma: no-cache > > Connection: keep-alive > > Content-Length: 66 > > > > > > -- localhost:4345->server.com:443 -- > > password=blah&email=brett%40knightsofthenet.com&ct=0&jsenabled=T > > -- server.com:443->localhost:4345 -- > > HTTP/1.1 302 Moved Temporarily > > Date: Mon, 02 Feb 2004 15:08:23 GMT > > Server: Oracle9iAS/9.0.2 Oracle HTTP Server > > Set-Cookie: NS_VER=9.1; domain=server.com; path=/ > > Set-Cookie: > > JSESSIONID=9b62d46494a44d2588f987b65288ca51.mkbxr2PEmlnva34P-BbQmkLz-A > > Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0LbgTvmQbO-kDv > > rA4KahiIqRnvp6iIpAjOp6jynQjM-AbJpgaQch0PbwbCpQPz8QvJpkixn6jAmljGr5XDqQ > > LvpAe_; Path=/ > > Set-Cookie: lastUser=ACCT102534_3_3; Expires=Mon, 09-Feb-2004 15:08:24 > > GMT; Path=/ > > Set-Cookie: loginredirect=T; Domain=server.com; Expires=Fri, > > 02-Apr-2004 15:08:24 GMT; Path=/ > > Set-Cookie: > > stickytags=T1:byMeU53W,T2:byMeU53W,T3:byMeU53W,T4:byMeU53W,T5:byMeU53W > > ,T6:byMeU53W,T7:byMeU53W,T8:byMeU53W,T9:byMeU53W,T10:byMeU53W,T11:byMe > > U53W,T12:byMeU53W,T13:byMeU53W,T14:byMeU53W,T15:byMeU53W,T16:byMeU53W; > > Path=/ > > Cache-Control: private > > Location: /app/center/card.nl?sc=-29 > > P3P: CP="CAO PSAa OUR BUS PUR" > > Keep-Alive: timeout=15, max=1000 > > Connection: Keep-Alive > > Transfer-Encoding: chunked > > Content-Type: text/html; charset=iso-8859-1 > > > > 0 > > > > > > -- localhost:4345->server.com:443 -- > > GET /app/external/xml/upload/upload.nl HTTP/1.1 > > User-Agent: httpunit/1.5 > > > > -- localhost:4345->server.com:443 -- > > Cookie: > > JSESSIONID=9b62d46494a44d2588f987b65288ca51.mkbxr2PEmlnva34P-BbQmkLz-A > > Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0LbgTvmQbO-kDv > > rA4KahiIqRnvp6iIpAjOp6jynQjM-AbJpgaQch0PbwbCpQPz8QvJpkixn6jAmljGr5XDqQ > > LvpAe_;lastUser=ACCT102534_3_3;stickytags=T1:byMeU53W,T2:byMeU53W,T3:b > > yMeU53W,T4:byMeU53W,T5:byMeU53W,T6:byMeU53W,T7:byMeU53W,T8:byMeU53W,T9 > > :byMeU53W,T10:byMeU53W,T11:byMeU53W,T12:byMeU53W,T13:byMeU53W,T14:byMe > > U53W,T15:byMeU53W,T16:byMeU53W > > Host: server.com > > Cache-Control: no-cache > > > > -- localhost:4345->server.com:443 -- > > Pragma: no-cache > > Accept: text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2 > > Connection: keep-alive > > > > > > -- server.com:443->localhost:4345 -- > > HTTP/1.1 200 OK > > Date: Mon, 02 Feb 2004 15:08:24 GMT > > Server: Oracle9iAS/9.0.2 Oracle HTTP Server > > Set-Cookie: > > JSESSIONID=9b62d46494a44d2588f987b65288ca51.mkbxr2PEmlnva34P-BbQ
Re: Odd problem
Hi Brett, This is a bit of a guess, but it could be because of the cookie format. Try using the cookie compatibility setting: CookiePolicy.setDefaultPolicy(CookiePolicy.COMPATIBILITY); Mike On Feb 2, 2004, at 3:57 PM, Brett Knights wrote: That's what I thought when I first looked at it but it appears to use the JDK connection classes. A grinder transcript using HttpUnit (succeeds) and HttpClient (fails) follows. One thing that's odd is that the HttpClient transaction looks more like the transcript I get with IE than does the one using HttpUnit. HTH With HttpUnit: ** *** --- localhost:4078->server.com:443 closed -- --- server.com:443->localhost:4078 closed -- --- localhost:4345->server.com:443 opened -- --- server.com:443->localhost:4345 opened -- -- localhost:4345->server.com:443 -- POST /app/login/nllogin.nl HTTP/1.1 User-Agent: httpunit/1.5 Host: server.com Content-Type: application/x-www-form-urlencoded Accept: text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2 Cache-Control: no-cache Pragma: no-cache Connection: keep-alive Content-Length: 66 -- localhost:4345->server.com:443 -- password=blah&email=brett%40knightsofthenet.com&ct=0&jsenabled=T -- server.com:443->localhost:4345 -- HTTP/1.1 302 Moved Temporarily Date: Mon, 02 Feb 2004 15:08:23 GMT Server: Oracle9iAS/9.0.2 Oracle HTTP Server Set-Cookie: NS_VER=9.1; domain=server.com; path=/ Set-Cookie: JSESSIONID=9b62d46494a44d2588f987b65288ca51.mkbxr2PEmlnva34P-BbQmkLz-A Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0LbgTvmQbO-kDv rA4KahiIqRnvp6iIpAjOp6jynQjM-AbJpgaQch0PbwbCpQPz8QvJpkixn6jAmljGr5XDqQ LvpAe_; Path=/ Set-Cookie: lastUser=ACCT102534_3_3; Expires=Mon, 09-Feb-2004 15:08:24 GMT; Path=/ Set-Cookie: loginredirect=T; Domain=server.com; Expires=Fri, 02-Apr-2004 15:08:24 GMT; Path=/ Set-Cookie: stickytags=T1:byMeU53W,T2:byMeU53W,T3:byMeU53W,T4:byMeU53W,T5:byMeU53W ,T6:byMeU53W,T7:byMeU53W,T8:byMeU53W,T9:byMeU53W,T10:byMeU53W,T11:byMe U53W,T12:byMeU53W,T13:byMeU53W,T14:byMeU53W,T15:byMeU53W,T16:byMeU53W; Path=/ Cache-Control: private Location: /app/center/card.nl?sc=-29 P3P: CP="CAO PSAa OUR BUS PUR" Keep-Alive: timeout=15, max=1000 Connection: Keep-Alive Transfer-Encoding: chunked Content-Type: text/html; charset=iso-8859-1 0 -- localhost:4345->server.com:443 -- GET /app/external/xml/upload/upload.nl HTTP/1.1 User-Agent: httpunit/1.5 -- localhost:4345->server.com:443 -- Cookie: JSESSIONID=9b62d46494a44d2588f987b65288ca51.mkbxr2PEmlnva34P-BbQmkLz-A Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0LbgTvmQbO-kDv rA4KahiIqRnvp6iIpAjOp6jynQjM-AbJpgaQch0PbwbCpQPz8QvJpkixn6jAmljGr5XDqQ LvpAe_;lastUser=ACCT102534_3_3;stickytags=T1:byMeU53W,T2:byMeU53W,T3:b yMeU53W,T4:byMeU53W,T5:byMeU53W,T6:byMeU53W,T7:byMeU53W,T8:byMeU53W,T9 :byMeU53W,T10:byMeU53W,T11:byMeU53W,T12:byMeU53W,T13:byMeU53W,T14:byMe U53W,T15:byMeU53W,T16:byMeU53W Host: server.com Cache-Control: no-cache -- localhost:4345->server.com:443 -- Pragma: no-cache Accept: text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2 Connection: keep-alive -- server.com:443->localhost:4345 -- HTTP/1.1 200 OK Date: Mon, 02 Feb 2004 15:08:24 GMT Server: Oracle9iAS/9.0.2 Oracle HTTP Server Set-Cookie: JSESSIONID=9b62d46494a44d2588f987b65288ca51.mkbxr2PEmlnva34P-BbQmkLz-A Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0LbgTvmQbO-kDv rA4KahiIqRnvp6iIpAjOp6jynQjM-AbJpgaQch0PbwbCpQPz8QvJpkixn6jAmljGr5XDqQ LvpAe_; Path=/ Set-Cookie: NLVisitorId=GEVsNl-JAHPkxcOm; Expires=Sun, 23-Jan-2005 15:08:24 GMT; Path=/ Last-Modified: Mon, 02 Feb 2004 15:08:23 GMT Expires: 0 P3P: CP="CAO PSAa OUR BUS PUR" Pragma: No-Cache Cache-Control: No-Cache Keep-Alive: timeout=15, max=999 Connection: Keep-Alive Transfer-Encoding: chunked Content-Type: text/html; charset=iso-8859-1 -- server.com:443->localhost:4345 -- 1ffa -- server.com:443->localhost:4345 -- ... ** *** With HttpClient: ** *** --- localhost:4345->server.com:443 closed -- --- server.com:443->localhost:4345 closed -- --- localhost:2001->server.com:443 opened -- --- server.com:443->localhost:2001 opened -- -- localhost:2001->server.com:443 -- POST /app/login/nllogin.nl HTTP/1.1 User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461) Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7 Keep-Alive: 300 Connection: keep-alive Accept: */* Host: server.com Content-Length: 66 Content-Type: application/x-www-form-urlencoded -- localhost:2001->server.com:443 -- email=brett%40knightsofthenet.com&password=blah&jsenabled=T&ct=0 -- server.com:443->localhost:2001 -- HTTP/1.1 302 Moved Temporarily Date: Mon, 02 Feb 2004 17:05:41 GMT Server: Oracle9iAS/9.0.2 Oracle HTTP Server
Re: Odd problem
That's what I thought when I first looked at it but it appears to use the JDK connection classes. A grinder transcript using HttpUnit (succeeds) and HttpClient (fails) follows. One thing that's odd is that the HttpClient transaction looks more like the transcript I get with IE than does the one using HttpUnit. HTH With HttpUnit: ** *** --- localhost:4078->server.com:443 closed -- --- server.com:443->localhost:4078 closed -- --- localhost:4345->server.com:443 opened -- --- server.com:443->localhost:4345 opened -- -- localhost:4345->server.com:443 -- POST /app/login/nllogin.nl HTTP/1.1 User-Agent: httpunit/1.5 Host: server.com Content-Type: application/x-www-form-urlencoded Accept: text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2 Cache-Control: no-cache Pragma: no-cache Connection: keep-alive Content-Length: 66 -- localhost:4345->server.com:443 -- password=blah&email=brett%40knightsofthenet.com&ct=0&jsenabled=T -- server.com:443->localhost:4345 -- HTTP/1.1 302 Moved Temporarily Date: Mon, 02 Feb 2004 15:08:23 GMT Server: Oracle9iAS/9.0.2 Oracle HTTP Server Set-Cookie: NS_VER=9.1; domain=server.com; path=/ Set-Cookie: JSESSIONID=9b62d46494a44d2588f987b65288ca51.mkbxr2PEmlnva34P-BbQmkLz-A Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0LbgTvmQbO-kDv rA4KahiIqRnvp6iIpAjOp6jynQjM-AbJpgaQch0PbwbCpQPz8QvJpkixn6jAmljGr5XDqQ LvpAe_; Path=/ Set-Cookie: lastUser=ACCT102534_3_3; Expires=Mon, 09-Feb-2004 15:08:24 GMT; Path=/ Set-Cookie: loginredirect=T; Domain=server.com; Expires=Fri, 02-Apr-2004 15:08:24 GMT; Path=/ Set-Cookie: stickytags=T1:byMeU53W,T2:byMeU53W,T3:byMeU53W,T4:byMeU53W,T5:byMeU53W ,T6:byMeU53W,T7:byMeU53W,T8:byMeU53W,T9:byMeU53W,T10:byMeU53W,T11:byMe U53W,T12:byMeU53W,T13:byMeU53W,T14:byMeU53W,T15:byMeU53W,T16:byMeU53W; Path=/ Cache-Control: private Location: /app/center/card.nl?sc=-29 P3P: CP="CAO PSAa OUR BUS PUR" Keep-Alive: timeout=15, max=1000 Connection: Keep-Alive Transfer-Encoding: chunked Content-Type: text/html; charset=iso-8859-1 0 -- localhost:4345->server.com:443 -- GET /app/external/xml/upload/upload.nl HTTP/1.1 User-Agent: httpunit/1.5 -- localhost:4345->server.com:443 -- Cookie: JSESSIONID=9b62d46494a44d2588f987b65288ca51.mkbxr2PEmlnva34P-BbQmkLz-A Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0LbgTvmQbO-kDv rA4KahiIqRnvp6iIpAjOp6jynQjM-AbJpgaQch0PbwbCpQPz8QvJpkixn6jAmljGr5XDqQ LvpAe_;lastUser=ACCT102534_3_3;stickytags=T1:byMeU53W,T2:byMeU53W,T3:b yMeU53W,T4:byMeU53W,T5:byMeU53W,T6:byMeU53W,T7:byMeU53W,T8:byMeU53W,T9 :byMeU53W,T10:byMeU53W,T11:byMeU53W,T12:byMeU53W,T13:byMeU53W,T14:byMe U53W,T15:byMeU53W,T16:byMeU53W Host: server.com Cache-Control: no-cache -- localhost:4345->server.com:443 -- Pragma: no-cache Accept: text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2 Connection: keep-alive -- server.com:443->localhost:4345 -- HTTP/1.1 200 OK Date: Mon, 02 Feb 2004 15:08:24 GMT Server: Oracle9iAS/9.0.2 Oracle HTTP Server Set-Cookie: JSESSIONID=9b62d46494a44d2588f987b65288ca51.mkbxr2PEmlnva34P-BbQmkLz-A Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0LbgTvmQbO-kDv rA4KahiIqRnvp6iIpAjOp6jynQjM-AbJpgaQch0PbwbCpQPz8QvJpkixn6jAmljGr5XDqQ LvpAe_; Path=/ Set-Cookie: NLVisitorId=GEVsNl-JAHPkxcOm; Expires=Sun, 23-Jan-2005 15:08:24 GMT; Path=/ Last-Modified: Mon, 02 Feb 2004 15:08:23 GMT Expires: 0 P3P: CP="CAO PSAa OUR BUS PUR" Pragma: No-Cache Cache-Control: No-Cache Keep-Alive: timeout=15, max=999 Connection: Keep-Alive Transfer-Encoding: chunked Content-Type: text/html; charset=iso-8859-1 -- server.com:443->localhost:4345 -- 1ffa -- server.com:443->localhost:4345 -- ... ** *** With HttpClient: ** *** --- localhost:4345->server.com:443 closed -- --- server.com:443->localhost:4345 closed -- --- localhost:2001->server.com:443 opened -- --- server.com:443->localhost:2001 opened -- -- localhost:2001->server.com:443 -- POST /app/login/nllogin.nl HTTP/1.1 User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461) Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7 Keep-Alive: 300 Connection: keep-alive Accept: */* Host: server.com Content-Length: 66 Content-Type: application/x-www-form-urlencoded -- localhost:2001->server.com:443 -- email=brett%40knightsofthenet.com&password=blah&jsenabled=T&ct=0 -- server.com:443->localhost:2001 -- HTTP/1.1 302 Moved Temporarily Date: Mon, 02 Feb 2004 17:05:41 GMT Server: Oracle9iAS/9.0.2 Oracle HTTP Server Set-Cookie: NS_VER=9.1; domain=server.com; path=/ Set-Cookie: JSESSIONID=0d19260c44084c0b86afcf5b3ddeee62.mkbxr2PEmlnva30T-BbQmkLz-A Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0KcgTvmQbO-kDv rA4Ka3yIqRnvp6iIpAjOp6jynQ
RE: Odd problem
Brett, I believe HttpUnit uses HttpClient internally, albeit an older version. Do you see any difference between HTTP requests generated by HttpClient and those generated by WebClient of HttpUnit? Oleg -Original Message- From: Brett Knights [mailto:[EMAIL PROTECTED] Sent: Monday, February 02, 2004 05:49 To: Commons HttpClient Project Subject: Re: Odd problem FWIW when I replaced HttpClient with the WebClient classes from HttpUnit it all works again. - Original Message - From: "Brett Knights" <[EMAIL PROTECTED]> To: "Commons HttpClient Project" <[EMAIL PROTECTED]> Sent: Tuesday, January 27, 2004 3:39 PM Subject: Re: Odd problem > Thanks for the info. The error is so weird (There is nothing in my > trace logs to indicate I am asking for url / and there isn't anything > on the server's port 444.) > I am wondering if the site is somehow detecting that I am not really a > browser and is kicking back that response. > > I'm stumped. > > - Original Message - > From: "Roland Weber" <[EMAIL PROTECTED]> > To: "Commons HttpClient Project" > <[EMAIL PROTECTED]> > Sent: Monday, January 26, 2004 10:24 PM > Subject: Re: Odd problem > > > > Hello Brett, > > > > the 11b should be part of the "chunked" encoding used by > > the server to send back the error page. No reason to worry. > > > > I wonder why the server reports a missing page "/" although > > that's not the page you requested. Without knowledge of > > the server application, it is hard to tell how the server > > determines the page it should return. Here is my guess... > > > > HttpClient: > > Referer: https://target.com/app/login/nllogin.nl[\r][\n] > > > > IE: > > Referer: > > https://target.com/pages/login.jsp?rdt=%2Fapp%2Fcenter%2Fmyroles.nl > > > > You could try to set a different "Referer" header in your request. > > > > best regards, > > Roland > > > > > > > > > > > > > > "Brett Knights" <[EMAIL PROTECTED]> > > 27.01.2004 06:15 > > Please respond to "Commons HttpClient Project" > > > > To: "Commons HttpClient Project" > > <[EMAIL PROTECTED]> > > cc: > > Subject:Odd problem > > > > > > Hi, > > > > I am using RC3 with jdk 1.4.2_03 > > > > When I use http client to get to the site I get a 404 (http client > > wire log follows then grinder generated IE trace). I just can't see > > what is going wrong. Any suggestions are appreciated. This is part > of > > a larger scripted operation so I am wondering if if is possible that > I > > am stepping on something by not releasing connections correctly. The > > "11b" at 26 Jan 2004 20:54:20,38726 Jan 2004 20:54:20,387 seems > rather > > odd. > > > > DEBUG [main] httpclient.wire - >> "GET /app/center/myroles.nl > > HTTP/1.1[\r][\n]": 26 Jan 2004 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "User-Agent: Mozilla/4.0 > > (compatible; MSIE 6.0; Windows NT 5.1; Q312461)[\r][\n]": 26 Jan > 2004 > > 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "Referer: > > https://target.com/app/login/nllogin.nl[\r][\n]": 26 Jan 2004 > > 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "Host: target.com[\r][\n]": 26 Jan > > 2004 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "Cookie: NS_VER=9.1[\r][\n]": 26 > Jan > > 2004 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "Cookie: > > > JSESSIONID=536c011ea00848b78315913117b9c243.mkbxr2PEmlnva30N-BbQmkLz-A > > > Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0KaMTvmQbO-kDv > > > rA4Ka3aIqRnvp6iIpAjOp6jynQjM-AbJpgaTax4SbwbCpQPz8QvJpkixn6jAmljGr5XDqQ > > LvpAe_[\r][\n]": 26 Jan 2004 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "Cookie: > > lastUser=ACCT102534_3_3[\r][\n]": 26 Jan 2004 20:54:20,257 > > DEBUG [main] httpclient.wire - >> "Cookie: T16:byMeU53W=[\r][\n]": > 26 > > Jan 2004 20:54:20,257 > > DEBUG [main] httpclient.wire - >> "[\r][\n]": 26 Jan 2004 > 20:54:20,257 > > DEBUG [main] httpclient.wire - << "HTTP/1.1 404 Not Found[\r][\n]": > 26 > > Jan 2004 20:54:20,387 > > DEBUG [main] httpclient.wire - << "Date: Tue, 27 Jan 2004 04:54:26 > > GMT[\r][\n]": 26 Jan 2004 20:54:20,387 > > DEBUG [main] httpclient.wire - &
Re: Odd problem
FWIW when I replaced HttpClient with the WebClient classes from HttpUnit it all works again. - Original Message - From: "Brett Knights" <[EMAIL PROTECTED]> To: "Commons HttpClient Project" <[EMAIL PROTECTED]> Sent: Tuesday, January 27, 2004 3:39 PM Subject: Re: Odd problem > Thanks for the info. The error is so weird (There is nothing in my > trace logs to indicate I am asking for url / and there isn't anything > on the server's port 444.) > I am wondering if the site is somehow detecting that I am not really a > browser and is kicking back that response. > > I'm stumped. > > - Original Message - > From: "Roland Weber" <[EMAIL PROTECTED]> > To: "Commons HttpClient Project" > <[EMAIL PROTECTED]> > Sent: Monday, January 26, 2004 10:24 PM > Subject: Re: Odd problem > > > > Hello Brett, > > > > the 11b should be part of the "chunked" encoding used by > > the server to send back the error page. No reason to worry. > > > > I wonder why the server reports a missing page "/" although > > that's not the page you requested. Without knowledge of > > the server application, it is hard to tell how the server > > determines the page it should return. Here is my guess... > > > > HttpClient: > > Referer: https://target.com/app/login/nllogin.nl[\r][\n] > > > > IE: > > Referer: > > https://target.com/pages/login.jsp?rdt=%2Fapp%2Fcenter%2Fmyroles.nl > > > > You could try to set a different "Referer" header in your request. > > > > best regards, > > Roland > > > > > > > > > > > > > > "Brett Knights" <[EMAIL PROTECTED]> > > 27.01.2004 06:15 > > Please respond to "Commons HttpClient Project" > > > > To: "Commons HttpClient Project" > > <[EMAIL PROTECTED]> > > cc: > > Subject:Odd problem > > > > > > Hi, > > > > I am using RC3 with jdk 1.4.2_03 > > > > When I use http client to get to the site I get a 404 (http client > > wire log follows then grinder generated IE trace). I just can't see > > what is going wrong. Any suggestions are appreciated. This is part > of > > a larger scripted operation so I am wondering if if is possible that > I > > am stepping on something by not releasing connections correctly. The > > "11b" at 26 Jan 2004 20:54:20,38726 Jan 2004 20:54:20,387 seems > rather > > odd. > > > > DEBUG [main] httpclient.wire - >> "GET /app/center/myroles.nl > > HTTP/1.1[\r][\n]": 26 Jan 2004 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "User-Agent: Mozilla/4.0 > > (compatible; MSIE 6.0; Windows NT 5.1; Q312461)[\r][\n]": 26 Jan > 2004 > > 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "Referer: > > https://target.com/app/login/nllogin.nl[\r][\n]": 26 Jan 2004 > > 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "Host: target.com[\r][\n]": 26 Jan > > 2004 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "Cookie: NS_VER=9.1[\r][\n]": 26 > Jan > > 2004 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "Cookie: > > > JSESSIONID=536c011ea00848b78315913117b9c243.mkbxr2PEmlnva30N-BbQmkLz-A > > > Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0KaMTvmQbO-kDv > > > rA4Ka3aIqRnvp6iIpAjOp6jynQjM-AbJpgaTax4SbwbCpQPz8QvJpkixn6jAmljGr5XDqQ > > LvpAe_[\r][\n]": 26 Jan 2004 20:54:20,247 > > DEBUG [main] httpclient.wire - >> "Cookie: > > lastUser=ACCT102534_3_3[\r][\n]": 26 Jan 2004 20:54:20,257 > > DEBUG [main] httpclient.wire - >> "Cookie: T16:byMeU53W=[\r][\n]": > 26 > > Jan 2004 20:54:20,257 > > DEBUG [main] httpclient.wire - >> "[\r][\n]": 26 Jan 2004 > 20:54:20,257 > > DEBUG [main] httpclient.wire - << "HTTP/1.1 404 Not Found[\r][\n]": > 26 > > Jan 2004 20:54:20,387 > > DEBUG [main] httpclient.wire - << "Date: Tue, 27 Jan 2004 04:54:26 > > GMT[\r][\n]": 26 Jan 2004 20:54:20,387 > > DEBUG [main] httpclient.wire - << "Server: Oracle9iAS/9.0.2 Oracle > > HTTP Server[\r][\n]": 26 Jan 2004 20:54:20,387 > > DEBUG [main] httpclient.wire - << "Transfer-Encoding: > > chunked[\r][\n]": 26 Jan 2004 20:54:20,387 > > DEBUG [main] httpclient.wire - << "Content-Type: text/html; > > charset=iso-8859-1[\r][\n]": 26 Jan 20
Re: Odd problem
Thanks for the info. The error is so weird (There is nothing in my trace logs to indicate I am asking for url / and there isn't anything on the server's port 444.) I am wondering if the site is somehow detecting that I am not really a browser and is kicking back that response. I'm stumped. - Original Message - From: "Roland Weber" <[EMAIL PROTECTED]> To: "Commons HttpClient Project" <[EMAIL PROTECTED]> Sent: Monday, January 26, 2004 10:24 PM Subject: Re: Odd problem > Hello Brett, > > the 11b should be part of the "chunked" encoding used by > the server to send back the error page. No reason to worry. > > I wonder why the server reports a missing page "/" although > that's not the page you requested. Without knowledge of > the server application, it is hard to tell how the server > determines the page it should return. Here is my guess... > > HttpClient: > Referer: https://target.com/app/login/nllogin.nl[\r][\n] > > IE: > Referer: > https://target.com/pages/login.jsp?rdt=%2Fapp%2Fcenter%2Fmyroles.nl > > You could try to set a different "Referer" header in your request. > > best regards, > Roland > > > > > > > "Brett Knights" <[EMAIL PROTECTED]> > 27.01.2004 06:15 > Please respond to "Commons HttpClient Project" > > To: "Commons HttpClient Project" > <[EMAIL PROTECTED]> > cc: > Subject:Odd problem > > > Hi, > > I am using RC3 with jdk 1.4.2_03 > > When I use http client to get to the site I get a 404 (http client > wire log follows then grinder generated IE trace). I just can't see > what is going wrong. Any suggestions are appreciated. This is part of > a larger scripted operation so I am wondering if if is possible that I > am stepping on something by not releasing connections correctly. The > "11b" at 26 Jan 2004 20:54:20,38726 Jan 2004 20:54:20,387 seems rather > odd. > > DEBUG [main] httpclient.wire - >> "GET /app/center/myroles.nl > HTTP/1.1[\r][\n]": 26 Jan 2004 20:54:20,247 > DEBUG [main] httpclient.wire - >> "User-Agent: Mozilla/4.0 > (compatible; MSIE 6.0; Windows NT 5.1; Q312461)[\r][\n]": 26 Jan 2004 > 20:54:20,247 > DEBUG [main] httpclient.wire - >> "Referer: > https://target.com/app/login/nllogin.nl[\r][\n]": 26 Jan 2004 > 20:54:20,247 > DEBUG [main] httpclient.wire - >> "Host: target.com[\r][\n]": 26 Jan > 2004 20:54:20,247 > DEBUG [main] httpclient.wire - >> "Cookie: NS_VER=9.1[\r][\n]": 26 Jan > 2004 20:54:20,247 > DEBUG [main] httpclient.wire - >> "Cookie: > JSESSIONID=536c011ea00848b78315913117b9c243.mkbxr2PEmlnva30N-BbQmkLz-A > Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0KaMTvmQbO-kDv > rA4Ka3aIqRnvp6iIpAjOp6jynQjM-AbJpgaTax4SbwbCpQPz8QvJpkixn6jAmljGr5XDqQ > LvpAe_[\r][\n]": 26 Jan 2004 20:54:20,247 > DEBUG [main] httpclient.wire - >> "Cookie: > lastUser=ACCT102534_3_3[\r][\n]": 26 Jan 2004 20:54:20,257 > DEBUG [main] httpclient.wire - >> "Cookie: T16:byMeU53W=[\r][\n]": 26 > Jan 2004 20:54:20,257 > DEBUG [main] httpclient.wire - >> "[\r][\n]": 26 Jan 2004 20:54:20,257 > DEBUG [main] httpclient.wire - << "HTTP/1.1 404 Not Found[\r][\n]": 26 > Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << "Date: Tue, 27 Jan 2004 04:54:26 > GMT[\r][\n]": 26 Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << "Server: Oracle9iAS/9.0.2 Oracle > HTTP Server[\r][\n]": 26 Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << "Transfer-Encoding: > chunked[\r][\n]": 26 Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << "Content-Type: text/html; > charset=iso-8859-1[\r][\n]": 26 Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << "1": 26 Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << "1": 26 Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << "b": 26 Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << "[\r]": 26 Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << " HTML 2.0//EN">[\n]": 26 Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 > 20:54:20,387 > DEBUG [main] httpclient.wire - << "404 Not Found[\n]": > 26 Jan 2004 20:54:20,387 > DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 > 20:54:20,387 > D
Re: Odd problem
Hello Brett, the 11b should be part of the "chunked" encoding used by the server to send back the error page. No reason to worry. I wonder why the server reports a missing page "/" although that's not the page you requested. Without knowledge of the server application, it is hard to tell how the server determines the page it should return. Here is my guess... HttpClient: Referer: https://target.com/app/login/nllogin.nl[\r][\n] IE: Referer: https://target.com/pages/login.jsp?rdt=%2Fapp%2Fcenter%2Fmyroles.nl You could try to set a different "Referer" header in your request. best regards, Roland "Brett Knights" <[EMAIL PROTECTED]> 27.01.2004 06:15 Please respond to "Commons HttpClient Project" To: "Commons HttpClient Project" <[EMAIL PROTECTED]> cc: Subject:Odd problem Hi, I am using RC3 with jdk 1.4.2_03 When I use http client to get to the site I get a 404 (http client wire log follows then grinder generated IE trace). I just can't see what is going wrong. Any suggestions are appreciated. This is part of a larger scripted operation so I am wondering if if is possible that I am stepping on something by not releasing connections correctly. The "11b" at 26 Jan 2004 20:54:20,38726 Jan 2004 20:54:20,387 seems rather odd. DEBUG [main] httpclient.wire - >> "GET /app/center/myroles.nl HTTP/1.1[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461)[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "Referer: https://target.com/app/login/nllogin.nl[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "Host: target.com[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "Cookie: NS_VER=9.1[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "Cookie: JSESSIONID=536c011ea00848b78315913117b9c243.mkbxr2PEmlnva30N-BbQmkLz-A Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0KaMTvmQbO-kDv rA4Ka3aIqRnvp6iIpAjOp6jynQjM-AbJpgaTax4SbwbCpQPz8QvJpkixn6jAmljGr5XDqQ LvpAe_[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "Cookie: lastUser=ACCT102534_3_3[\r][\n]": 26 Jan 2004 20:54:20,257 DEBUG [main] httpclient.wire - >> "Cookie: T16:byMeU53W=[\r][\n]": 26 Jan 2004 20:54:20,257 DEBUG [main] httpclient.wire - >> "[\r][\n]": 26 Jan 2004 20:54:20,257 DEBUG [main] httpclient.wire - << "HTTP/1.1 404 Not Found[\r][\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Date: Tue, 27 Jan 2004 04:54:26 GMT[\r][\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Server: Oracle9iAS/9.0.2 Oracle HTTP Server[\r][\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Transfer-Encoding: chunked[\r][\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Content-Type: text/html; charset=iso-8859-1[\r][\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "1": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "1": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "b": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\r]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "404 Not Found[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Not Found[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "The requested URL / was not found on this server.[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Oracle HTTP Server/1.3.22 Server at target.com Port 444[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "[\r]": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "0": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "[\r]": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "[\r]": 26
Odd problem
Hi, I am using RC3 with jdk 1.4.2_03 When I use http client to get to the site I get a 404 (http client wire log follows then grinder generated IE trace). I just can't see what is going wrong. Any suggestions are appreciated. This is part of a larger scripted operation so I am wondering if if is possible that I am stepping on something by not releasing connections correctly. The "11b" at 26 Jan 2004 20:54:20,38726 Jan 2004 20:54:20,387 seems rather odd. DEBUG [main] httpclient.wire - >> "GET /app/center/myroles.nl HTTP/1.1[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461)[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "Referer: https://target.com/app/login/nllogin.nl[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "Host: target.com[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "Cookie: NS_VER=9.1[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "Cookie: JSESSIONID=536c011ea00848b78315913117b9c243.mkbxr2PEmlnva30N-BbQmkLz-A Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0KaMTvmQbO-kDv rA4Ka3aIqRnvp6iIpAjOp6jynQjM-AbJpgaTax4SbwbCpQPz8QvJpkixn6jAmljGr5XDqQ LvpAe_[\r][\n]": 26 Jan 2004 20:54:20,247 DEBUG [main] httpclient.wire - >> "Cookie: lastUser=ACCT102534_3_3[\r][\n]": 26 Jan 2004 20:54:20,257 DEBUG [main] httpclient.wire - >> "Cookie: T16:byMeU53W=[\r][\n]": 26 Jan 2004 20:54:20,257 DEBUG [main] httpclient.wire - >> "[\r][\n]": 26 Jan 2004 20:54:20,257 DEBUG [main] httpclient.wire - << "HTTP/1.1 404 Not Found[\r][\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Date: Tue, 27 Jan 2004 04:54:26 GMT[\r][\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Server: Oracle9iAS/9.0.2 Oracle HTTP Server[\r][\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Transfer-Encoding: chunked[\r][\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Content-Type: text/html; charset=iso-8859-1[\r][\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "1": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "1": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "b": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\r]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "404 Not Found[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Not Found[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "The requested URL / was not found on this server.[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "Oracle HTTP Server/1.3.22 Server at target.com Port 444[\n]": 26 Jan 2004 20:54:20,387 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "[\r]": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "0": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "[\r]": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "[\r]": 26 Jan 2004 20:54:20,397 DEBUG [main] httpclient.wire - << "[\n]": 26 Jan 2004 20:54:20,397 When I use IE I get the page expected: -- localhost:2290->target.com:443 -- GET /app/center/myroles.nl HTTP/1.1 Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, application/msword, application/x-shockwave-flash, application/vnd.ms-excel, */* Referer: https://target.com/pages/login.jsp?rdt=%2Fapp%2Fcenter%2Fmyroles.nl Accept-Language: en-us Accept-Encoding: gzip, deflate User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461) Host: target.com Connection: Keep-Alive Cache-Control: no-cache Cookie: lastUser=ACCT102534_3_3; NLVisitorId=GEVsNmOJAOKYoS-W; JSESSIONID=91ac67ead38b4e579f08f7f791d86f8f.mkbxr2PEmlnva30S-BbQmkLz-A Tzr6Lzn6rzqwTxpQOUc30KaNDvmQbJrkTOokTBrxyL8Q5xmReHoA5Qmh0Kc2TvmQbO-kDv rA4Ka3uIqRnvp6iIpAjOp6jynQjM-AbJpgaLbheLaNqxo6XHngbCpQPz8QfznA5Pp7ftol bGmkTy; NS_VER=9.1; stickytags=T1:byMeU53W,T2:byMeU53W,T3:byMeU53W,T4:byMeU53W,T5:byMeU53W ,T6:byMeU53W,T7:byMeU53W,T8:byMeU53W,T9:byMeU53W,T10:byMeU53W,T11:byMe U53W,T12:byMeU53W,T13:byMeU53W,T14:byMeU53W,T15:byMeU53W,T16:byMeU53W; loginredirect=T; PREF=ID=10fcf1af58cafe4f:TM=1072562878:LM=1072562878:S=80KxPEiJisEzgB4 2 -- target.com:443->localhost:2290 -- HTTP/1.1 200 OK Date: Tue, 27 Jan 2004 03:45:19 GMT Server: Oracle9iAS/9.0.2 Oracle HTTP Server Content-Length: 4942 Set-Cookie: JSESSIONID=91ac67ead38b4e579f08f7f791d86f8f.mkbxr2PEmlnva30S-BbQmkLz-A Tzr6Lzn6rz