As pointed out on the Hadoop mailing list - The OpenJDK’s java.utils.Collection.sort() is broken - such that the default TimSort implementation would cause ArrayIndexOutOfBoundsException for number of elements larger than 67108864.
I wonder if we can have such a huge collection in Drill and might hit this bug ? We do have Collections.sort used in multiple places including DrillTextRecordReader but do we need to consider workaround for this ? Thoughts ? Links: http://envisage-project.eu/timsort-specification-and-verification/ https://bugs.openjdk.java.net/browse/JDK-8072909
