kevinjqliu opened a new issue, #3670: URL: https://github.com/apache/parquet-java/issues/3670
## Feature request Add integration tests that run against every Parquet file in the [`apache/parquet-testing`](https://github.com/apache/parquet-testing) repository. ## Problem `parquet-java` currently [tests only selected files](https://github.com/apache/parquet-java/blob/b6fb9e2f4d08961d32d88ff6e45f454d16c32255/parquet-hadoop/src/test/java/org/apache/parquet/hadoop/InterOpTester.java#L36) from `parquet-testing`. As a result, new interoperability fixtures are not automatically tested, and compatibility regressions may go undetected. There are already several [`parquet-java` issues involving files from `parquet-testing`](https://github.com/apache/parquet-java/issues?q=is%3Aissue%20state%3Aopen%20parquet%20testing). ## Proposed solution Add integration tests that classify files into two groups: - **Valid files:** must open successfully and allow all row groups and columns to be read. - **Invalid files:** must fail during footer parsing or record decoding with an expected exception. `InterOpTester` already supports downloading individual files from `parquet-testing`. This feature would extend that approach to provide repository-wide coverage. ## Acceptance criteria - [ ] Every Parquet file in the pinned revision is classified. - [ ] All valid files are read successfully. - [ ] All invalid files fail as expected. - [ ] Each file is reported as an independent test. - [ ] Unclassified files cause the test to fail. - [ ] Exclusions require an explicit entry linked to a tracking issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
