[
https://issues.apache.org/jira/browse/IMPALA-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17470237#comment-17470237
]
ASF subversion and git services commented on IMPALA-10934:
----------------------------------------------------------
Commit 7131ee34d25b2609c4eb0cc596bc1d99d6232acd in impala's branch
refs/heads/master from Zoltan Haindrich
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=7131ee3 ]
IMPALA-10934 (Part 1): Enable table definition over a single file
Implements an abstraction layer to show files in a single directory.
Impala side part - filesystem drivers are in HIVE-25569.
Suppose that the filesystem has a directory in which there are multiple
files:
hdfs://somedir/f1.txt
hdfs://somedir/f2.txt
In case of a HMS backed table(s) - the contents of a directory could be
considered as table.
This patch enables a new file system wrapper 'sfs+' (sfs = single file
system) which provides a view of a single file in a directory.' The '+'
indicates that this wrapper can be added on top of multiple underlying
file systems/object storage such as HDFS, S3 etc. The directory which
contains the file could be specified:
sfs+hdfs://somedir/f1.txt/#SINGLEFILE#
This will be a directory containing only the f1.txt and nothing else.
This patch was tested locally - with a custom build of Hive version
which also had HIVE-25569.
Change-Id: I32be936243aa4c8320f5d06d2b7fbf98822f82e7
Reviewed-on: http://gerrit.cloudera.org:8080/17878
Reviewed-by: Aman Sinha <[email protected]>
Tested-by: Aman Sinha <[email protected]>
> Enable table definition over a single file
> ------------------------------------------
>
> Key: IMPALA-10934
> URL: https://issues.apache.org/jira/browse/IMPALA-10934
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Zoltan Haindrich
> Priority: Major
>
> Some improvements are needed to enable table definition over a single file
> (HIVE-25569) to work from Impala as well.
> note: that these changes will not work by themselfs - they will need the FS
> drivers which are in HIVE-25569 to be available
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
