[
https://issues.apache.org/jira/browse/SQOOP-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shailendra Kumar updated SQOOP-3455:
------------------------------------
Comment: was deleted
(was: [~BoglarkaEgyed] when can we expect this fixes .
My sqoop version - 1.4.7)
> Sqoop job fails while importing to S3 as Parquet
> ------------------------------------------------
>
> Key: SQOOP-3455
> URL: https://issues.apache.org/jira/browse/SQOOP-3455
> Project: Sqoop
> Issue Type: Bug
> Components: sqoop2-kite-connector
> Affects Versions: 1.4.7
> Reporter: Kriti Jha
> Priority: Blocker
>
> A Sqoop job to import data from a MySQL database into S3 fails on using
> --as-parquetfile with the error as shown below:
> ----
> {{ERROR sqoop.Sqoop: Got exception running Sqoop:
> org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI pattern:
> dataset:s3://sqoop-trial-bucket/sqoop-trial/trial
> Check that JARs for s3 datasets are on the classpath
> org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI pattern:
> dataset:s3://}}{{sqoop-trial-bucket}}{{/sqoop-trial/trial Check that JARs for
> s3 datasets are on the classpath at
> org.kitesdk.data.spi.Registration.lookupDatasetUri(Registration.java:128) at
> org.kitesdk.data.Datasets.exists(Datasets.java:624) at
> org.kitesdk.data.Datasets.exists(Datasets.java:646) at
> org.apache.sqoop.mapreduce.ParquetJob.configureImportJob(ParquetJob.java:118)
> at
> org.apache.sqoop.mapreduce.DataDrivenImportJob.configureMapper(DataDrivenImportJob.java:132)
> at
> org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:264) at
> org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692) at
> org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127) at
> org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:520) at
> org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628) at
> org.apache.sqoop.Sqoop.run(Sqoop.java:147) at
> org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at
> org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183) at
> org.apache.sqoop.Sqoop.runTool(Sqoop.java:234) at
> org.apache.sqoop.Sqoop.runTool(Sqoop.java:243) at
> org.apache.sqoop.Sqoop.main(Sqoop.java:252)}}
> ----
> {{}}
> {{All the JARs for S3 are present in the classpath. Further, the same works
> on simply removing the argument --as-parquetfile, i.e. with any other
> format.}}
> {{}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
