[
https://issues.apache.org/jira/browse/ORC-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17655404#comment-17655404
]
deshanxiao commented on ORC-1343:
---------------------------------
[~Penglei Shi] Actually, we should not build the filter when the index is
turned off.
{code:java}
// RecordReaderImpl
if (sarg != null && rowIndexStride > 0) {
sargApp = new SargApplier(sarg,
rowIndexStride,
evolution,
writerVersion,
fileReader.useUTCTimestamp,
fileReader.writerUsedProlepticGregorian(),
fileReader.options.getConvertToProlepticGregorian());
sargApp.setRowIndexCols(rowIndexCols);
} else {
sargApp = null;
} {code}
> Reading ORC files without index occurs error using latested spark
> -----------------------------------------------------------------
>
> Key: ORC-1343
> URL: https://issues.apache.org/jira/browse/ORC-1343
> Project: ORC
> Issue Type: Bug
> Reporter: Penglei Shi
> Priority: Major
>
> https://issues.apache.org/jira/browse/ORC-1283 this issue has fixed the
> problem that ENABLE_INDEXES does not take effect. But without index, filters
> pushdown will occur error, this seems to be because of the code below in
> RecordReaderImpl.java
> {code:java}
> if (indexes[columnIx] == null) {
> throw new AssertionError("Index is not populated for " + columnIx);
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
