Eric Lin created IMPALA-8557: -------------------------------- Summary: Impala on ABFS failed with error "IllegalArgumentException: ABFS does not allow files or directories to end with a dot." Key: IMPALA-8557 URL: https://issues.apache.org/jira/browse/IMPALA-8557 Project: IMPALA Issue Type: Bug Components: Backend Affects Versions: Impala 3.2.0 Reporter: Eric Lin
HDFS introduced below feature to stop users from creating a file that ends with "." on ABFS: https://issues.apache.org/jira/browse/HADOOP-15860 As a result of this change, Impala now writes to ABFS fails with such error. I can see that it generates temp file using this format "$0.$1.$2": https://github.com/cloudera/Impala/blob/cdh6.2.0/be/src/exec/hdfs-table-sink.cc#L329 $2 is the file extension and will be empty if it is TEXT file format: https://github.com/cloudera/Impala/blob/cdh6.2.0/be/src/exec/hdfs-text-table-writer.cc#L65 Since HADOOP-15860 was backported into CDH6.2, it is currently only affecting 6.2 and works in older versions. There is no way to override this empty file extension so no workaround is possible, unless user choose another file format. -- This message was sent by Atlassian JIRA (v7.6.3#76005)