Black-max12138 opened a new issue, #4275: URL: https://github.com/apache/carbondata/issues/4275
Look at this line of code. `boolean hasNext = currentReader.nextKeyValue();` If hasNext returns false and currentReader is not the last one, it indicates that the iterator exits and subsequent data is not parsed. How to solve this problem? ``` /** * Return true if has next row */ public boolean hasNext() throws IOException, InterruptedException { if (0 == readers.size() || currentReader == null) { return false; } validateReader(); if (currentReader.nextKeyValue()) { return true; } else { if (index == readers.size() - 1) { // no more readers return false; } else { // current reader is closed currentReader.close(); // no need to keep a reference to CarbonVectorizedRecordReader, // until all the readers are processed. // If readers count is very high, // we get OOM as GC not happened for any of the content in CarbonVectorizedRecordReader readers.set(index, null); index++; currentReader = readers.get(index); boolean hasNext = currentReader.nextKeyValue(); if (hasNext) { return true; } } } return false; } ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org