GitHub user Seandity opened a pull request:
https://github.com/apache/hive/pull/405
There a negative number of splits need be avoided
I am facing issues when exec insert on hive2.2-tez0.84 :
I follow the tez api source code ,but I still dont konw why here would get
a a negative number
java.lang.IllegalArgumentException: Illegal Capacity: -1
at java.util.ArrayList.<init>(ArrayList.java:157)
at
org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:339)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:519)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:768)
at
org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:211)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Seandity/hive patch-1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hive/pull/405.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #405
----
commit 842ced5337e837413761e13754b5a3f23ab3ee77
Author: jiahuilliu <liujiahuimail@...>
Date: 2018-07-31T08:39:54Z
There a negative number of splits need be avoided
I am facing issues when exec insert on hive2.2-tez0.84 :
I follow the tez api source code ,but I still dont konw why here would get
a a negative number
java.lang.IllegalArgumentException: Illegal Capacity: -1
at java.util.ArrayList.<init>(ArrayList.java:157)
at
org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:339)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:519)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:768)
at
org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:211)
----
---
