Here's the schema of the mysql table CREATE TABLE `test` ( `id` int(11) DEFAULT NULL, `value` varchar(255) DEFAULT NULL, `zid` int(11) NOT NULL AUTO_INCREMENT, `ts` timestamp NOT NULL DEFAULT '0000-00-00 00:00:00' ON UPDATE CURRENT_TIMESTAMP, PRIMARY KEY (`zid`) ) ENGINE=InnoDB AUTO_INCREMENT=19 DEFAULT CHARSET=latin1
On Tue, Oct 22, 2013 at 12:17 PM, Yash Ranadive <[email protected]>wrote: > I see the following error in the MapReduce logs when trying to execute a > sqoop2 job that gets data from a mysql table with a timestamp column. A > table with no timestamps gets loaded fine. > > Does sqoop2 not support timestamp columns? Sounds counterintuitive. > > > > 2013-10-22 12:03:02,570 FATAL [IPC Server handler 2 on 42160] > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: > attempt_1381794869316_1175_m_000000_0 - exited : > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during > extractor run > at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:756) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:338) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152) > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot > write to the data writer > at > org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146) > at > org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeArrayRecord(SqoopMapper.java:128) > at > org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:61) > at > org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:31) > at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:93) > ... 7 more > Caused by: java.io.IOException: org.apache.sqoop.common.SqoopException: > MAPRED_EXEC_0012:The type is not supported - java.sql.Timestamp > at org.apache.sqoop.job.io.Data.writeArray(Data.java:309) > at org.apache.sqoop.job.io.Data.write(Data.java:171) > at > org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:100) > at > org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:84) > at > org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1112) > at > org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:685) > at > org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89) > at > org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112) > at > org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:144) > ... 11 more > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0012:The type > is not supported - java.sql.Timestamp > ... 20 more > > 2013-10-22 12:03:02,570 INFO [IPC Server handler 2 on 42160] > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from > attempt_1381794869316_1175_m_000000_0: Error: > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during > extractor run > at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:756) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:338) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152) > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot > write to the data writer > at > org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146) > at > org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeArrayRecord(SqoopMapper.java:128) > at > org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:61) > at > org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:31) > at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:93) > ... 7 more > Caused by: java.io.IOException: org.apache.sqoop.common.SqoopException: > MAPRED_EXEC_0012:The type is not supported - java.sql.Timestamp > at org.apache.sqoop.job.io.Data.writeArray(Data.java:309) > at org.apache.sqoop.job.io.Data.write(Data.java:171) > at > org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:100) > at > org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:84) > at > org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1112) > at > org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:685) > at > org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89) > at > org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112) > at > org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:144) > ... 11 more > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0012:The type > is not supported - java.sql.Timestamp > ... 20 more > > 2013-10-22 12:03:02,572 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics > report from attempt_1381794869316_1175_m_000000_0: Error: > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during > extractor run > at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:756) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:338) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152) > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot > write to the data writer > at > org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146) > at > org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeArrayRecord(SqoopMapper.java:128) > at > org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:61) > at > org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:31) > at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:93) > ... 7 more > Caused by: java.io.IOException: org.apache.sqoop.common.SqoopException: > MAPRED_EXEC_0012:The type is not supported - java.sql.Timestamp > at org.apache.sqoop.job.io.Data.writeArray(Data.java:309) > at org.apache.sqoop.job.io.Data.write(Data.java:171) > at > org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:100) > at > org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:84) > at > org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1112) > at > org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:685) > at > org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89) > at > org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112) > at > org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:144) > ... 11 more > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0012:The type > is not supported - java.sql.Timestamp > ... 20 more > > 2013-10-22 12:03:02,573 INFO [AsyncDispatcher event handler] > org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: > attempt_1381794869316_1175_m_000000_0 TaskAttempt Transitioned from RUNNING > to FAIL_CONTAINER_CLEANUP > >
