Li Junjun created SQOOP-2098:
--------------------------------
Summary: CSVIntermediateDataFormat check null shoud ignore case
Key: SQOOP-2098
URL: https://issues.apache.org/jira/browse/SQOOP-2098
Project: Sqoop
Issue Type: Bug
Affects Versions: 1.99.4
Reporter: Li Junjun
Priority: Critical
CSVIntermediateDataFormat
line 188:
if (fields[i].equals("NULL")) {
out[i] = null;
continue;
}
if fields[i] equal null
then you will get this exception and job exit
at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:99)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot
write to the data writer
at
org.apache.sqoop.job.mr.SqoopMapper$SqoopMapDataWriter.writeContent(SqoopMapper.java:148)
at
org.apache.sqoop.job.mr.SqoopMapper$SqoopMapDataWriter.writeArrayRecord(SqoopMapper.java:122)
at
org.apache.sqoop.connector.jdbc.GenericJdbcExtractor.extract(GenericJdbcExtractor.java:62)
at
org.apache.sqoop.connector.jdbc.GenericJdbcExtractor.extract(GenericJdbcExtractor.java:31)
at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:94)
... 7 more
Caused by: java.lang.IllegalArgumentException: Invalid format: "null"
at
org.joda.time.format.DateTimeFormatter.parseLocalDateTime(DateTimeFormatter.java:854)
at
org.joda.time.format.DateTimeFormatter.parseLocalDate(DateTimeFormatter.java:798)
at org.joda.time.LocalDate.parse(LocalDate.java:179)
at org.joda.time.LocalDate.parse(LocalDate.java:168)
at
org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.getObjectData(CSVIntermediateDataFormat.java:221)
at
org.apache.sqoop.job.mr.SqoopMapper$SqoopMapDataWriter.writeContent(SqoopMapper.java:143)
... 11 more
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
