[ https://issues.apache.org/jira/browse/SQOOP-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304095#comment-14304095 ]
ASF subversion and git services commented on SQOOP-1862: -------------------------------------------------------- Commit 27d87b4f2f7fcbcdb52503016446b4de1dd5709a in sqoop's branch refs/heads/sqoop2 from [~abec] [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=27d87b4 ] SQOOP-1862: Sqoop2: JDBC Connector To side needs to handle converting JODA objects to sql date (Veena Basavaraj via Abraham Elmahrek) > Sqoop2: JDBC Connector To side needs to handle converting JODA objects to > sql date > ------------------------------------------------------------------------------------ > > Key: SQOOP-1862 > URL: https://issues.apache.org/jira/browse/SQOOP-1862 > Project: Sqoop > Issue Type: Bug > Affects Versions: 1.99.5 > Reporter: Qian Xu > Assignee: Veena Basavaraj > Priority: Blocker > Fix For: 1.99.5 > > Attachments: SQOOP-1862-v2.patch, SQOOP-1862-v3.patch, > SQOOP-1862.patch > > > I did a round-trip data import test with unexpected results. > 1. I used JdbcConnector as FROM and HdfsConnector as TO. Data (200k records) > was written onto HDFS expectedly. > 2. I used HdfsConnector as FROm and JdbcConnector as TO. Data is expected to > be written into an empty mysql table. Schema is exactly the same as it is in > step 1. > Now the progress is blocked at 0%. Here is the error message: > {code} > 2014-12-09 12:17:23,653 ERROR [OutputFormatLoader-consumer] > org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor: Error while loading > data out of MR job. > org.apache.sqoop.common.SqoopException: GENERIC_JDBC_CONNECTOR_0002:Unable to > execute the SQL statement > at > org.apache.sqoop.connector.jdbc.GenericJdbcExecutor.executeBatch(GenericJdbcExecutor.java:189) > at > org.apache.sqoop.connector.jdbc.GenericJdbcLoader.load(GenericJdbcLoader.java:58) > at > org.apache.sqoop.connector.jdbc.GenericJdbcLoader.load(GenericJdbcLoader.java:25) > at > org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$ConsumerThread.run(SqoopOutputFormatLoadExecutor.java:249) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.sql.BatchUpdateException: Data truncation: Incorrect date > value: '’' for column 'date' at row 1 > at > com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1981) > at > com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1388) > at > org.apache.sqoop.connector.jdbc.GenericJdbcExecutor.executeBatch(GenericJdbcExecutor.java:183) > ... 8 more > Caused by: com.mysql.jdbc.MysqlDataTruncation: Data truncation: Incorrect > date value: '’' for column 'date' at row 1 > at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4224) > at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4158) > at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2615) > at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2776) > at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2840) > at > com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2082) > at > com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2334) > at > com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1933) > ... 10 more > {code} > The date type of the column is "DATE". Dumped context looks like > "20014-10-10". It seems the field value is not correct. "’" stands for ascii > code 170 and 161. > Here is the schema in MySQL: > {code} > CREATE TABLE IF NOT EXISTS `test_table1` ( > `id` int(11) NOT NULL AUTO_INCREMENT, > `date` date NOT NULL, > `file_id` int(11) NOT NULL, > `count` int(10) unsigned NOT NULL, > PRIMARY KEY (`id`), > KEY `test_table1_80945c99` (`file_id`) > ) ENGINE=MyISAM DEFAULT CHARSET=utf8; > {code} > Here is data snippet in HDFS: > {code} > 51778,'2014-10-10',493,2801571 > 51779,'2014-10-10',494,388826 > 51780,'2014-10-10',495,143153 > 51781,'2014-10-10',496,317225 > 51782,'2014-10-10',497,290522 > 51783,'2014-10-10',498,288734 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)