Hi Abe, thanks for having a look I really appreciate it...
Version is 1.4.3.1.3.2.0-111
Command:
sqoop export --connect jdbc:oracle:thin:@xxx-scan.main.xxx.com:1521/xxxxx
--table SOME_SCHEMA.SOME_TABLE --export-dir
/user/directory/subdirectory/tabledirectory --username xyz --password xyz
Error portion (replaced schema_table name with SCHEMA_TABLE):
13/09/30 18:48:52 INFO mapred.JobClient: Running job: job_201309301054_0021
13/09/30 18:48:53 INFO mapred.JobClient: map 0% reduce 0%
13/09/30 18:49:00 INFO mapred.JobClient: Task Id :
attempt_201309301054_0021_m_000001_0, Status : FAILED
java.io.IOException: Can't export data, please check task tracker logs
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at
org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be
yyyy-mm-dd hh:mm:ss[.fffffffff]
at java.sql.Timestamp.valueOf(Timestamp.java:185)
at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
... 10 more
13/09/30 18:49:01 INFO mapred.JobClient: Task Id :
attempt_201309301054_0021_m_000003_0, Status : FAILED
java.io.IOException: Can't export data, please check task tracker logs
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at
org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be
yyyy-mm-dd hh:mm:ss[.fffffffff]
at java.sql.Timestamp.valueOf(Timestamp.java:185)
at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
... 10 more
13/09/30 18:49:06 INFO mapred.JobClient: Task Id :
attempt_201309301054_0021_m_000001_1, Status : FAILED
java.io.IOException: Can't export data, please check task tracker logs
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at
org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be
yyyy-mm-dd hh:mm:ss[.fffffffff]
at java.sql.Timestamp.valueOf(Timestamp.java:185)
at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
... 10 more
13/09/30 18:49:07 INFO mapred.JobClient: Task Id :
attempt_201309301054_0021_m_000003_1, Status : FAILED
java.io.IOException: Can't export data, please check task tracker logs
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at
org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be
yyyy-mm-dd hh:mm:ss[.fffffffff]
at java.sql.Timestamp.valueOf(Timestamp.java:185)
at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
... 10 more
13/09/30 18:49:10 INFO mapred.JobClient: Task Id :
attempt_201309301054_0021_m_000002_0, Status : FAILED
java.io.IOException: Can't export data, please check task tracker logs
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at
org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be
yyyy-mm-dd hh:mm:ss[.fffffffff]
at java.sql.Timestamp.valueOf(Timestamp.java:185)
at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
... 10 more
13/09/30 18:49:10 INFO mapred.JobClient: Task Id :
attempt_201309301054_0021_m_000001_2, Status : FAILED
java.io.IOException: Can't export data, please check task tracker logs
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at
org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be
yyyy-mm-dd hh:mm:ss[.fffffffff]
at java.sql.Timestamp.valueOf(Timestamp.java:185)
at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
at
org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
... 10 more
13/09/30 18:49:17 INFO mapred.JobClient: Job complete: job_201309301054_0021
13/09/30 18:49:17 INFO mapred.JobClient: Counters: 8
13/09/30 18:49:17 INFO mapred.JobClient: Job Counters
13/09/30 18:49:17 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=71819
13/09/30 18:49:17 INFO mapred.JobClient: Total time spent by all reduces
waiting after reserving slots (ms)=0
13/09/30 18:49:17 INFO mapred.JobClient: Total time spent by all maps
waiting after reserving slots (ms)=0
13/09/30 18:49:17 INFO mapred.JobClient: Rack-local map tasks=5
13/09/30 18:49:17 INFO mapred.JobClient: Launched map tasks=10
13/09/30 18:49:17 INFO mapred.JobClient: Data-local map tasks=2
13/09/30 18:49:17 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0
13/09/30 18:49:17 INFO mapred.JobClient: Failed map tasks=1
13/09/30 18:49:17 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 26.2385
seconds (0 bytes/sec)
13/09/30 18:49:17 INFO mapreduce.ExportJobBase: Exported 0 records.
13/09/30 18:49:17 ERROR tool.ExportTool: Error during export: Export job failed!
From: Abraham Elmahrek [mailto:[email protected]]
Sent: Monday, September 30, 2013 6:36 PM
To: [email protected]
Subject: Re: Sqoop from/to Oracle
Nick,
What is the exact command you are using and the exact error you are seeing?
Also, what version of sqoop are you using?
-Abe
On Mon, Sep 30, 2013 at 3:32 PM, Martin, Nick
<[email protected]<mailto:[email protected]>> wrote:
Hi all,
I have a table I've imported from Oracle into HDFS and now I want to export it
into an Oracle Db (import and export table schemas are identical).
My initial attempt at exporting from HDFS (using Sqoop) to Oracle failed (data
types failures). So, my question is what's the best way for me to accomplish
this? My source table is a mixture of NUMBER, VARCHAR, DATE fields. Am I better
off importing into a Hive table I define and then exporting into Oracle from
there? Or do I just need to do some export formatting in my Sqoop export
statement?
Any other intel you'd need to make a recommendation?
Thanks in advance,
Nick
Sent from my iPhone