Hi Sandeep ,
The Jira talks about the the filename with spaces. Here the issues looks
different
1) The URL rewrite is not happening
direction: IN via rule: WEBHDFS/webhdfs/inbound/datanode, status: FAILURE
at
org.apache.hadoop.gateway.filter.rewrite.api.UrlRewriteServletFilter.doFilter(UrlRewriteServletFilter.java:60)
2) While uploading file the KNOX generates a uRL with DATANODE, But the
datanode hostname is not right causing unknown host exception.
So where this issue hiding here not sure . Looks liek the Rewrite templates
generated by knox-v10 would not be right.
\Rajesh
On Tuesday 24 October 2017, 6:16:27 AM GMT-7, Sandeep More
<[email protected]> wrote:
Hello Rajesh,
Does the hostname or url have special characters (spaces etc.) ? looking at the
encoded URL that would be my guess at this point. It was fixed in 0.13.0
https://issues.apache.org/jira/browse/KNOX-949. Can you try upgrading to 0.13.0
and see whether you get the same error.
Best,Sandeep
On Tue, Oct 24, 2017 at 2:42 AM, Rajesh Chandramohan <[email protected]>
wrote:
Hi Knox-Users/ Kevin,
We have a ongoing issues related to Knox failing to re-write URL or the
Rewritten uRLS has malformed Datanode info. Is this any known issue with
KNOX-v0.10.0 ?
Anybody here has pointer here what might be causing this issue ? Most of the
transaction goes through only some of the file trasfer getting issues like
this.
Failed to Rewrite URL +++
2017-10-13 09:03:26,752 ERROR hadoop.gateway
(UrlRewriteProcessor.java:rewrite(169)) - Failed to rewrite URL:
https://hadoop-knox.hostname.com:443/gateway/cluster/webhdfs/data/v1/webhdfs/v1/datadir1/dir2/files2017-10-13_7_days_8_coviews.tsv/part-00116?_=AAAACAAAABAAAAEgDsS9yKt-rqKV7qdUqqbwno19mDGqYPaBkh1il5XFuxqJSwF7KSGFiPu-9CLdVMWH48VTyvOewPtKblok0gkpNZaO31K1w-ERjpLpFLH2ZSJPeAZrHl4Ug_5w16-gmMY3HC2VQYehGr6nGxtmQZA_qM2Fr4qOaHYLQFG5FfjKpGyYDRsV5URWYC-6PPAZGaK0uBENH4TF62-ZxJPPPe38cuLo_2OkraZOm-fquDLU7zIvydwgQak6v_hLsG-4WQAua37bRenz8BAru_VCgRQ7GnZva1M0I7JecBmJOZRQIDMo1OcAeLhmL-jiDbGJ2qMI2neByW2gKB3Ur_1X_JvXYemhatHfd6d_R6Q3Az-GTHzP4k_8k4aXFxhn4XTRtKwoWRqoSSyv1G_a0G5J7v_TAfRVhjv1WYxb,
direction: IN via rule: WEBHDFS/webhdfs/inbound/datanode, status: FAILURE
at
org.apache.hadoop.gateway.filter.rewrite.api.UrlRewriteServletFilter.doFilter(UrlRewriteServletFilter.java:60)
Another errors: Where the the rewritten URLs has bad Datanode info:
2017-10-18 13:01:56,834 WARN hadoop.gateway
(DefaultDispatch.java:executeOutboundRequest(146)) - Connection exception
dispatching request: https://hadoopdnhdc46dn10%00%5D%7E%0
5%EF%BF%BD%EF%BF%BDBW%D6%AE%EF%BF%BD%EF%BF%BDvv%004bay.com:500y%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%3C%EF%BF%BD%18%08%5B%EF%BF%BD5%EF%BF%BDXi%1CAFYl9uZ2MGYl9rbm%EF%BF%BD%06%
2C%7B%2C%EF%BF%BD%EF%BF%BDQ%13+%02%EF%BF%BD%1A%EF%BF%BD%EF%BF%BD%EF%BF%BD%1B%EF%BF%BD4%EF%BF%BD%EF%BF%BD%18%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%C8%B7x%EF%BF%BDQMFL-yOB7EU8g0
E4rliRbxhUILDEozIW-H%0CE%1Fn%0C%13%EF%BF%BDw%EF%BF%BD%EF%BF%BD%3B%7C%EF%BF%BDE%EF%BF%BDG%EF%BF%BD%7B%EF%BF%BDj%EF%BF%BDFY%EF%BF%BD%0C%11%EF%BF%BD%7B%04%5C%EF%BF%BDMxMC4xMTUu
MjA2LjExNDo4MDIw/webhdfs/v1/datadir1/datadir2/hourly/2017/10/18/12/file_name-file0.map?namenoderpcaddress=cluster
-ph%22%EF%BF%BD5%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%3FZ%EE%98%A0E%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BDt%EF%BF%BD%1D%EF%BF%BD%0B%09te&createf%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%
BF%BD%0B%EF%BF%BDvy%EF%BF%BDy%24%EF%BF%BD=%5Bxt&doAs=b_ngc
java.net.UnknownHostException: hadoopdnhdc46dn10
Thanks
\Rajesh
