[ https://issues.apache.org/jira/browse/HDFS-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905815#comment-16905815 ]
Masatake Iwasaki commented on HDFS-14423: ----------------------------------------- The result of manual testing: {noformat} [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ bin/hadoop fs -touchz 'webhdfs://localhost/%' [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ bin/hadoop fs -touchz 'webhdfs://localhost/a+b' [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ bin/hadoop fs -touchz 'webhdfs://localhost/a%b' [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ bin/hadoop fs -touchz 'webhdfs://localhost/a;b' [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ bin/hadoop fs -mkdir 'webhdfs://localhost/c+d' [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ bin/hadoop fs -mkdir 'webhdfs://localhost/c%d' [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ bin/hadoop fs -mkdir 'webhdfs://localhost/c;d' [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ bin/hdfs dfs -ls / Found 7 items -rw-r--r-- 1 centos supergroup 0 2019-08-13 13:44 /% -rw-r--r-- 1 centos supergroup 0 2019-08-13 13:44 /a%b -rw-r--r-- 1 centos supergroup 0 2019-08-13 13:44 /a+b -rw-r--r-- 1 centos supergroup 0 2019-08-13 13:44 /a;b drwxr-xr-x - centos supergroup 0 2019-08-13 13:44 /c%d drwxr-xr-x - centos supergroup 0 2019-08-13 13:44 /c+d drwxr-xr-x - centos supergroup 0 2019-08-13 13:44 /c;d [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ echo foobar > foobar.txt [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ bin/hadoop fs -rm 'webhdfs://localhost/%' Deleted webhdfs://localhost/% [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ bin/hadoop fs -put foobar.txt 'webhdfs://localhost/%' [centos@centos7 hadoop-3.3.0-SNAPSHOT-HDFS-14423]$ bin/hadoop fs -cat 'webhdfs://localhost/%' foobar {noformat} > Percent (%) and plus (+) characters no longer work in WebHDFS > ------------------------------------------------------------- > > Key: HDFS-14423 > URL: https://issues.apache.org/jira/browse/HDFS-14423 > Project: Hadoop HDFS > Issue Type: Bug > Components: webhdfs > Affects Versions: 3.2.0, 3.1.2 > Environment: Ubuntu 16.04, but I believe this is irrelevant. > Reporter: Jing Wang > Assignee: Masatake Iwasaki > Priority: Major > Attachments: HDFS-14423.001.patch, HDFS-14423.002.patch, > HDFS-14423.003.patch > > > The following commands with percent (%) no longer work starting with version > 3.1: > {code:java} > $ hadoop/bin/hdfs dfs -touchz webhdfs://localhost/% > $ hadoop/bin/hdfs dfs -cat webhdfs://localhost/% > cat: URLDecoder: Incomplete trailing escape (%) pattern > {code} > Also, plus (+ ) characters get turned into spaces when doing DN operations: > {code:java} > $ hadoop/bin/hdfs dfs -touchz webhdfs://localhost/a+b > $ hadoop/bin/hdfs dfs -mkdir webhdfs://localhost/c+d > $ hadoop/bin/hdfs dfs -ls / > Found 4 items > -rw-r--r-- 1 jing supergroup 0 2019-04-12 11:20 /a b > drwxr-xr-x - jing supergroup 0 2019-04-12 11:21 /c+d > {code} > I can confirm that these commands work correctly on 2.9 and 3.0. Also, the > usual hdfs:// client works as expected. > I suspect a relation with HDFS-13176 or HDFS-13582, but I'm not sure what the > right fix is. Note that Hive uses % to escape special characters in partition > values, so banning % might not be a good option. For example, Hive will > create a paths like {{table_name/partition_key=%2F}} when > {{partition_key='/'}}. -- This message was sent by Atlassian JIRA (v7.6.14#76016) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org