Hi,
I am trying to import data from Netezza to HDFS. I am able to successfully
import few tables.
However I am getting following error message for few tables.
Failing tables have primary key constraint on netezza and I see the Sqoop
Split-by is using primary key column. I tried changing the split-by to
different column and increased the split count as well. But it didn't work for
me.
16/03/15 14:00:23 INFO mapreduce.Job: Task Id :
attempt_1456951008977_0160_m_000000_0, Status : FAILED Error:
java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native
Method) at org.netezza.sql.NzConnection.receiveDbosTuple(NzConnection.java:739)
at org.netezza.internal.QueryExecutor.getNextResult(QueryExecutor.java:177) at
org.netezza.internal.QueryExecutor.execute(QueryExecutor.java:73) at
org.netezza.sql.NzConnection.execute(NzConnection.java:2688) at
org.netezza.sql.NzStatement._execute(NzStatement.java:849) at
org.netezza.sql.NzPreparedStatament.executeQuery(NzPreparedStatament.java:169)
at
org.apache.sqoop.mapreduce.db.DBRecordReader.executeQuery(DBRecordReader.java:111)
at
org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:235)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:556)
at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) at
org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at
org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:415) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
16/03/15 14:00:43 INFO mapreduce.Job: Task Id :
attempt_1456951008977_0160_m_000000_1, Status : FAILED Error:
java.lang.ArrayIndexOutOfBoundsException at
org.netezza.sql.NzConnection.receiveDbosTuple(NzConnection.java:739) at
org.netezza.internal.QueryExecutor.update(QueryExecutor.java:340) at
org.netezza.sql.NzConnection.updateResultSet(NzConnection.java:2704) at
org.netezza.sql.NzResultSet.next(NzResultSet.java:1924) at
org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:237)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:556)
at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) at
org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at
org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:415) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Thanks
Aruna
This email (including any attachments) is intended for the designated
recipient(s) only, and may be confidential, non-public, proprietary, and/or
protected by the attorney-client or other privilege. Unauthorized reading,
distribution, copying or other use of this communication is prohibited and may
be unlawful. Receipt by anyone other than the intended recipient(s) should not
be deemed a waiver of any privilege or protection. If you are not the intended
recipient or if you believe that you have received this email in error, please
notify the sender immediately and delete all copies from your computer system
without reading, saving, printing or using it in any manner. Although it has
been checked for viruses and other malicious software ("malware"), we do not
warrant, represent or guarantee in any way that this communication is free of
malware or potentially damaging defects. All liability for any actual or
alleged loss, damage, or injury arising out of or resulting in any way from the
receipt, opening or use of this email is expressly disclaimed.
