Hi Joanne,

If you can query data from specified table with datetime fields translated, you 
can use `--query [QUERY]` instead of `--table [TABLE]`.

--Stanley (Qian) Xu

From: Joanne Chan [mailto:[email protected]]
Sent: Thursday, December 18, 2014 1:13 PM
To: [email protected]
Subject: Sqoop free form query import with invalid dates

I've noticed that invalid dates is causing the entire import to fail when 
trying to change an existing sqoop import to free form query import.

There's no issues on the same data set when not using free form query.

Is this a known issue?  Is there any workaround?

The error:
14/12/18 00:11:33 INFO mapred.JobClient: Task Id : 
attempt_201412171757_0484_m_000000_1, Status : FAILED
java.io.IOException: SQLException in nextKeyValue
        at 
org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:266)
        at 
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:483)
        at 
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:76)
        at 
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:85)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:139)
        at 
org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
        at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.sql


Thanks in advance!

Best,
Joanne

Reply via email to