Hi all, I found a possible bug in parquet-mr. I found if you set up a read over a parquet file with a filter that ends at the end of the file. Then read the file again with a new filter, the last event read will be updated to be the last event in the file, regardless of the file.
I’ve set up a reproduction in https://github.com/jacomago/parquetentrybug where the test src/test/java/MainTest.java<https://github.com/jacomago/parquetentrybug%20where%20the%20test%20src/test/java/MainTest.java>. Should pass, but currently does not. Thanks Sky