Good catch @Tim !
Indeed Java:
Padded plaintext before ENCRYPTION: len = 176
0000: 47 45 54 20 2F 20 48 54 54 50 2F 31 2E 31 0D 0A GET / HTTP/1.1..
0010: 43 6F 6E 6E 65 63 74 69 6F 6E 3A 20 6B 65 65 70 Connection: keep
0020: 2D 61 6C 69 76 65 0D 0A 55 73 65 72 2D 41 67 65 -alive..User-Age
0030: 6E 74 3A 20 4A 61 76 61 2F 31 2E 38 2E 30 5F 34 nt: Java/1.8.0_4
0040: 35 0D 0A 48 6F 73 74 3A 20 73 6F 2E 6E 31 31 2E 5..Host: so.n11.
0050: 63 6F 6D 0D 0A 41 63 63 65 70 74 3A 20 74 65 78 com..Accept: tex
0060: 74 2F 68 74 6D 6C 2C 20 69 6D 61 67 65 2F 67 69 t/html, image/gi
0070: 66 2C 20 69 6D 61 67 65 2F 6A 70 65 67 2C 20 2A f, image/jpeg, *
0080: 3B 20 71 3D 2E 32 2C 20 2A 2F 2A 3B 20 71 3D 2E ; q=.2, */*; q=.
0090: 32 0D 0A 0D 0A 32 8B 87 7A BA 17 82 81 CD BB C5 2....2..z.......
00A0: F8 E3 E0 C4 B1 53 A6 09 63 06 06 06 06 06 06 06 .....S..c.......
Thread Group 1-1, WRITE: TLSv1 Application Data, length = 176
HttpClient:
Padded plaintext before ENCRYPTION: len = 144
0000: 47 45 54 20 2F 20 48 54 54 50 2F 31 2E 31 0D 0A GET / HTTP/1.1..
0010: 43 6F 6E 6E 65 63 74 69 6F 6E 3A 20 6B 65 65 70 Connection: keep
0020: 2D 61 6C 69 76 65 0D 0A 48 6F 73 74 3A 20 73 6F -alive..Host: so
0030: 2E 6E 31 31 2E 63 6F 6D 0D 0A 55 73 65 72 2D 41 .n11.com..User-A
0040: 67 65 6E 74 3A 20 41 70 61 63 68 65 2D 48 74 74 gent: Apache-Htt
0050: 70 43 6C 69 65 6E 74 2F 34 2E 35 2E 32 2D 53 4E pClient/4.5.2-SN
0060: 41 50 53 48 4F 54 20 28 4A 61 76 61 2F 31 2E 38 APSHOT (Java/1.8
0070: 2E 30 5F 34 35 29 0D 0A 0D 0A 68 D5 4F F4 33 6B .0_45)....h.O.3k
0080: 1B 37 6F 3B CC 01 D2 D8 7F 95 02 FB 58 3A 01 01 .7o;........X:..
Thread Group 1-1, WRITE: TLSv1 Application Data, length = 144
Learnt something today , thanks !
On Mon, Feb 22, 2016 at 9:03 PM, Tim Jacomb [DATACOM] <ti...@datacom.co.nz>
wrote:
> Try adding an Accept Header, the server you are contacting appears to
> reject all requests without one
>
> httpGet.addHeader("Accept",
> "text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8");
>
> Tim
> ________________________________________
> From: Murat Balkan <mrbal...@gmail.com>
> Sent: Tuesday, 23 February 2016 8:38 a.m.
> To: HttpClient User Discussion
> Subject: Re: HttpClient SSL Connection Issue
>
> Hi, Please find it below: The version does not matter. Whatever version I
> tried failed. I even installed Java 8 to test. My current versions in the
> built path are: httpclient4.5.1,httpcore4.4.3,httpmime 4.5.1, jna 4.1.0,
> jna-platform4.1.0,httpclient-cache4.5.1
>
> SSLContext sslContext = SSLContexts.createDefault();
> SSLConnectionSocketFactory sslConnectionFactory = new
> SSLConnectionSocketFactory(sslContext,NoopHostnameVerifier.INSTANCE);
> Registry<ConnectionSocketFactory> socketFactoryRegistry =
> RegistryBuilder.<ConnectionSocketFactory>create()
> .register("http", PlainConnectionSocketFactory.getSocketFactory())
> .register("https", sslConnectionFactory)
> .build();
> PoolingHttpClientConnectionManager cm = new
> PoolingHttpClientConnectionManager(socketFactoryRegistry);
> cm.setDefaultMaxPerRoute(1);
> CloseableHttpClient httpClient = HttpClientBuilder.create()
> .disableContentCompression()
> .disableAutomaticRetries()
> .setUserAgent("User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:44.0)
> Gecko/20100101 Firefox/44.0")
> .build();
> HttpGet httpGet = new HttpGet("https://so.n11.com";);
> httpClient.execute(httpGet);
> System.out.println("I can never reach this point");
>
> On Mon, Feb 22, 2016 at 2:33 PM, Philippe Mouawad <
> philippe.moua...@gmail.com> wrote:
>
> > hi,
> > Can you show your httpclient code and mention which versions you used for
> > httpcore and httpclient and java exact version
> >
> > thx
> >
> > On Monday, February 22, 2016, Murat Balkan <mrbal...@gmail.com> wrote:
> >
> > > I tried the following with URL class this time:
> > >
> > > URL my_url = new URL("https://so.n11.com";);
> > > BufferedReader br = new BufferedReader(new
> > > InputStreamReader(my_url.openStream()));
> > > String strTemp = "";
> > > while(null != (strTemp = br.readLine())){
> > > System.out.println(strTemp);
> > > }
> > >
> > > Even this works. So far URL, HttpURLConnection and Browsers are able to
> > > fetch the page. Apache HttpClient cannot.
> > > I also tried Fluent from the same package. It fails too.
> > >
> > >
> > >
> > >
> > >
> > > On Mon, Feb 22, 2016 at 12:40 PM, Oleg Kalnichevski <ol...@apache.org
> > > <javascript:;>>
> > > wrote:
> > >
> > > > On Mon, 2016-02-22 at 11:27 -0500, Murat Balkan wrote:
> > > > > Can you please suggest me how HttpClient can get the page like
> > > > > HttpUrlConnection? or Google Chrome?
> > > >
> > > > Capture a session between a browser or HttpUrlConnection using
> > Wireshark
> > > > or browser plugin of your choosing. Configure HttpClient to generate
> > > > identical messages. See what happens.
> > > >
> > > > > If I go to the site admin, wouldnt he say the site is totally
> > > reachable?
> > > > >
> > > >
> > > > The admin can say that Earth is flat for all I care, but their server
> > > > drops connections without sending back a status code like all well
> > > > behaved, spec complaint HTTP servers are supposed to do.
> > > >
> > > > Oleg
> > > >
> > > >
> > > >
> > > > > On Mon, Feb 22, 2016 at 11:22 AM, Oleg Kalnichevski <
> > ol...@apache.org
> > > <javascript:;>>
> > > > > wrote:
> > > > >
> > > > > > On Mon, 2016-02-22 at 11:18 -0500, Murat Balkan wrote:
> > > > > > > Hi Oleg,
> > > > > > > I do not aggree, other Http libraries does not have this
> problem.
> > > As
> > > > I
> > > > > > said
> > > > > > > HttpUrlConnection gets the page, all types of browsers can get
> > the
> > > > page.
> > > > > > It
> > > > > > > is clear that this is an error that is related with the Apache
> > > > Client.
> > > > > > > Thnaks
> > > > > > > Murat
> > > > > >
> > > > > > You are very welcome to disagree.
> > > > > >
> > > > > > Your own log clearly show that the problem has nothing to do with
> > SSL
> > > > > > and is caused by peer connection reset.
> > > > > >
> > > > > > Oleg
> > > > > >
> > > > > >
> > > > > > >
> > > > > > > On Mon, Feb 22, 2016 at 11:14 AM, Oleg Kalnichevski <
> > > > ol...@apache.org <javascript:;>>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > On Mon, 2016-02-22 at 10:57 -0500, Murat Balkan wrote:
> > > > > > > > > I enabled the debug log and it seems the connection is
> > > > established .
> > > > > > Any
> > > > > > > > > ideas? Attaching below:
> > > > > > > > >
> > > > > > > > > 2016/02/22 10:49:45:146 EST [DEBUG]
> > > > > > DefaultHttpClientConnectionOperator -
> > > > > > > > > Connection established 142.133.240.86:34018<->
> > > 176.41.133.12:443
> > > > > > > > > 2016/02/22 10:49:45:146 EST [DEBUG] MainClientExec -
> > Executing
> > > > > > request
> > > > > > > > GET
> > > > > > > > > / HTTP/1.1
> > > > > > > > > 2016/02/22 10:49:45:146 EST [DEBUG] MainClientExec - Target
> > > auth
> > > > > > state:
> > > > > > > > > UNCHALLENGED
> > > > > > > > > 2016/02/22 10:49:45:146 EST [DEBUG] MainClientExec - Proxy
> > auth
> > > > > > state:
> > > > > > > > > UNCHALLENGED
> > > > > > > > > 2016/02/22 10:49:45:147 EST [DEBUG] headers -
> http-outgoing-3
> > > >>
> > > > GET
> > > > > > /
> > > > > > > > > HTTP/1.1
> > > > > > > > > 2016/02/22 10:49:45:147 EST [DEBUG] headers -
> http-outgoing-3
> > > >>
> > > > > > Host:
> > > > > > > > > so.n11.com
> > > > > > > > > 2016/02/22 10:49:45:147 EST [DEBUG] headers -
> http-outgoing-3
> > > >>
> > > > > > > > > Connection: Keep-Alive
> > > > > > > > > 2016/02/22 10:49:45:147 EST [DEBUG] headers -
> http-outgoing-3
> > > >>
> > > > > > > > > User-Agent: Apache-HttpClient/4.5.1 (Java/1.7.0_79)
> > > > > > > > > 2016/02/22 10:49:45:148 EST [DEBUG] headers -
> http-outgoing-3
> > > >>
> > > > > > > > > Accept-Encoding: gzip,deflate
> > > > > > > > > 2016/02/22 10:49:45:419 EST [DEBUG]
> > > > > > DefaultManagedHttpClientConnection -
> > > > > > > > > http-outgoing-3: Close connection
> > > > > > > > > 2016/02/22 10:49:45:419 EST [DEBUG]
> > > > > > DefaultManagedHttpClientConnection -
> > > > > > > > > http-outgoing-3: Shutdown connection
> > > > > > > > > 2016/02/22 10:49:45:419 EST [DEBUG] MainClientExec -
> > Connection
> > > > > > discarded
> > > > > > > > >
> > > > > > > >
> > > > > > > > The connection is dropped by the server due to an internal
> > error
> > > of
> > > > > > some
> > > > > > > > sort. You need to take it up with the server admin.
> > > > > > > >
> > > > > > > > Oleg
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > ---------------------------------------------------------------------
> > > > > > > > To unsubscribe, e-mail:
> > > httpclient-users-unsubscr...@hc.apache.org <javascript:;>
> > > > > > > > For additional commands, e-mail:
> > > > httpclient-users-h...@hc.apache.org <javascript:;>
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > ---------------------------------------------------------------------
> > > > > > To unsubscribe, e-mail:
> httpclient-users-unsubscr...@hc.apache.org
> > > <javascript:;>
> > > > > > For additional commands, e-mail:
> > httpclient-users-h...@hc.apache.org
> > > <javascript:;>
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: httpclient-users-unsubscr...@hc.apache.org
> > > <javascript:;>
> > > > For additional commands, e-mail: httpclient-users-h...@hc.apache.org
> > > <javascript:;>
> > > >
> > > >
> > >
> > >
> > > --
> > > Murat Balkan
> > >
> >
> >
> > --
> > Cordialement.
> > Philippe Mouawad.
> >
>
>
>
> --
> Murat Balkan
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: httpclient-users-unsubscr...@hc.apache.org
> For additional commands, e-mail: httpclient-users-h...@hc.apache.org
>
>
--
Cordialement.
Philippe Mouawad.
