[
https://issues.apache.org/jira/browse/HDFS-11189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15729485#comment-15729485
]
Oscar Guadilla commented on HDFS-11189:
---------------------------------------
Hi Weiwei,
The problem was that HttpURLConnection in some cases had the global
FollowRedirects atribute as false and in this cases the get operation didn't
work fine because the WebHdfs call to the namenode returned 307 and it wasn't
made a second request to the datanode because http was said not to follow. A
bit tricky but understable.
From a standalone it works fine. It fails only from a web environment. In
our case we are using it from weblogic 10.3.6. I can't reproduce the problem
without using a third party application....
Regards,
Oscar
> WebHDFS and FollowRedirects
> ---------------------------
>
> Key: HDFS-11189
> URL: https://issues.apache.org/jira/browse/HDFS-11189
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: webhdfs
> Affects Versions: 2.7.3
> Environment: We are using webhdfs from a j2ee environment with java
> 6. In the web application we have a lot of libraries: spring, jersey,
> jackson...
> Reporter: Oscar Guadilla
> Attachments: WebHdfsFileSystem.java
>
>
> In some cases with simple operations (get file - non two step operation) we
> detect that FollowRedirects flag of http comes as "false" and it makes
> webhdfs crash.
> We don't really know which library change this behavior and it is really
> strange because the change is done directly in the jvm because in other
> wars/ears of the same j2ee server it fails also. If we restart the j2ee
> server it starts working again.
> To fix the problem we changed the WebHdfsFileSystem class adding
> "setInstanceFollowRedirects(true)" in the connection management instead of
> supposing that it should be true and it works fine.
> The same problem arises both in 1.x and 2.x webhdfs. We didn't test in 3.x
> Could you fix it? We did it in our environment but it would fine in it could
> be included in the next releases.
> Thanks in advance,
> Oscar
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
