Yiqun Zhang created ORC-1146: -------------------------------- Summary: Float category does not check if the statistic sum is a finite value Key: ORC-1146 URL: https://issues.apache.org/jira/browse/ORC-1146 Project: ORC Issue Type: Bug Components: Java Affects Versions: 1.7.3 Reporter: Yiqun Zhang
[https://github.com/apache/orc/blob/70c504cbd759342476d2fb2c9cc75a5025cb7c11/java/core/src/java/org/apache/orc/impl/RecordReaderImpl.java#L696-L703] {code:java} } else if (category == TypeDescription.Category.DOUBLE) { DoubleColumnStatistics dstas = (DoubleColumnStatistics) cs; if (!Double.isFinite(dstas.getSum())) { LOG.debug("Not using predication pushdown on {} because stats contain NaN values", predicate.getColumnName()); return dstas.hasNull() ? TruthValue.YES_NO_NULL : TruthValue.YES_NO; } } {code} Currently only the Double category is checked. the Float category is also only pushed down if the statistics sum to a finite value. -- This message was sent by Atlassian Jira (v8.20.1#820001)