[
https://issues.apache.org/jira/browse/SQOOP-3247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Szabo updated SQOOP-3247:
--------------------------------
Fix Version/s: (was: 1.4.7)
1.5.0
> Sqoop doesn't handle unsigned bigints at least with MySQL
> ---------------------------------------------------------
>
> Key: SQOOP-3247
> URL: https://issues.apache.org/jira/browse/SQOOP-3247
> Project: Sqoop
> Issue Type: Bug
> Components: connectors/mysql
> Affects Versions: 1.4.6
> Reporter: Yulei Wang
> Labels: patch
> Fix For: 1.5.0
>
> Attachments: SQOOP-3247.patch
>
>
> mysql> desc mysql2hdfs;
> +---------+---------------------+------+-----+---------+-------+
> | Field | Type | Null | Key | Default | Extra |
> +---------+---------------------+------+-----+---------+-------+
> | id | bigint(20) unsigned | YES | | NULL | |
> | address | varchar(20) | YES | | NULL | |
> +---------+---------------------+------+-----+---------+-------+
> 2 rows in set (0.00 sec)
> mysql> select * from mysql2hdfs;
> +----------------------+---------+
> | id | address |
> +----------------------+---------+
> | 18446744073709551615 | suzhou |
> | 18446744073709551615 | suzhou |
> +----------------------+---------+
> 2 rows in set (0.00 sec)
> Get's the following error
> 17/10/30 15:05:01 ERROR tool.ImportTool: Encountered IOException running
> import job: java.io.IOException:
> com.mysql.jdbc.exceptions.jdbc4.MySQLDataException: '18446744073709551615' in
> column '1' is outside valid range for the datatype BIGINT.
> at
> org.apache.sqoop.mapreduce.db.DataDrivenDBInputFormat.getSplits(DataDrivenDBInputFormat.java:174)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:608)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:625)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:494)
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1326)
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1323)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1858)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1323)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1344)
> at
> org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:196)
> at
> org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:169)
> at
> org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:266)
> at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:673)
> at
> org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:118)
> at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
> at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
> at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
> at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
> Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLDataException:
> '18446744073709551615' in column '1' is outside valid range for the datatype
> BIGINT.
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at com.mysql.jdbc.Util.handleNewInstance(Util.java:409)
> at com.mysql.jdbc.Util.getInstance(Util.java:384)
> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1025)
> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:973)
> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:918)
> at
> com.mysql.jdbc.ResultSetImpl.throwRangeException(ResultSetImpl.java:7875)
> at
> com.mysql.jdbc.ResultSetImpl.parseLongAsDouble(ResultSetImpl.java:7092)
> at com.mysql.jdbc.ResultSetImpl.getLong(ResultSetImpl.java:2977)
> at com.mysql.jdbc.ResultSetImpl.getLong(ResultSetImpl.java:2942)
> at
> org.apache.sqoop.mapreduce.db.IntegerSplitter.split(IntegerSplitter.java:44)
> at
> org.apache.sqoop.mapreduce.db.DataDrivenDBInputFormat.getSplits(DataDrivenDBInputFormat.java:171)
> ... 23 more
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
