Hello Everyone, I am trying to push incremental updates from mysql to hdfs using sqoop import command with Mergekey option and incremental mode as "lastmodified".
My table has some timestamp columns. I don't see any problems as long as timestamp columns has some values. But, Problem arises only when it has NULL values. I copied the below exception from my logs. Also, Incase of Non-timestamp columns having null values, there is no issues. Error: java.lang.RuntimeException: Can't parse input data: '\N' at dim_scd_table.__loadFromFields(dim_scd_table.java:473) at dim_scd_table.parse(dim_scd_table.java:391) at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53) at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:775) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff] at java.sql.Timestamp.valueOf(Timestamp.java:202) at dim_scd_table.__loadFromFields(dim_scd_table.java:455) ... 11 more Kindly let me know on this. Thanks, Mani
