[ https://issues.apache.org/jira/browse/HIVE-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860153#comment-15860153 ]
Sahil Takiar edited comment on HIVE-15856 at 2/9/17 8:36 PM: ------------------------------------------------------------- [~zyork] it seems that HIVE-13463 fixes issues when trying to import across filesystems, but in order for an export / import command to run against a filesystem, the scheme of the filesystem uri must be in the list {{hive.exim.uri.scheme.whitelist}} - currently there are no S3 schemes in that list. At least, the following query fails: {code} export table src to '${hiveconf:test.blobstore.path.unique}/exim/src'; {code} with the following exception: {code} org.apache.hadoop.hive.ql.parse.SemanticException: Invalid path only the following file systems accepted for export/import : hdfs,pfile,file at org.apache.hadoop.hive.ql.parse.EximUtil.getValidatedURI(EximUtil.java:187) at org.apache.hadoop.hive.ql.parse.ExportSemanticAnalyzer.analyzeInternal(ExportSemanticAnalyzer.java:73) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:258) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:514) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1319) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1459) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1239) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1229) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:336) ... {code} was (Author: stakiar): [~zyork] it seems that HIVE-13463 fixes issues when trying to import across filesystems, but in order for an export / import command to run against a filesystem, the scheme of the filesystem uri must be in the list {{hive.exim.uri.scheme.whitelist}} - currently there are no S3 schemes in that list. At least, the following query fails: {quote} export table src to '${hiveconf:test.blobstore.path.unique}/exim/src'; {quote} with the following exception: {quote} org.apache.hadoop.hive.ql.parse.SemanticException: Invalid path only the following file systems accepted for export/import : hdfs,pfile,file at org.apache.hadoop.hive.ql.parse.EximUtil.getValidatedURI(EximUtil.java:187) at org.apache.hadoop.hive.ql.parse.ExportSemanticAnalyzer.analyzeInternal(ExportSemanticAnalyzer.java:73) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:258) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:514) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1319) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1459) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1239) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1229) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:336) ... {quote} > Hive export/import (hive.exim.uri.scheme.whitelist) to support s3a > ------------------------------------------------------------------ > > Key: HIVE-15856 > URL: https://issues.apache.org/jira/browse/HIVE-15856 > Project: Hive > Issue Type: Bug > Components: Hive > Reporter: Sahil Takiar > Assignee: Sahil Takiar > > Add support for export / import operations on S3. -- This message was sent by Atlassian JIRA (v6.3.15#6346)