ErikBPF commented on PR #5786: URL: https://github.com/apache/datafusion-comet/pull/5786#issuecomment-5683791081
Agreed on landing #5654 first. The remaining nested-only patch is green on Apollo: 231 native Parquet tests, 6 native Iceberg tests, and 140 Scala tests passed (0 failures; existing skips remain); native build, root Maven verify, formatting, and all-target workspace Clippy also passed. Publication is awaiting #5654 landing so this PR does not import another author's unmerged history. These results describe the isolated candidate, not a newly pushed revision of this PR. The separate mixed INT64/INT32 duplicate-root finding is now tracked in #5964, with fixture source and Spark 4.1.3 reproduction. With Spark filter pushdown disabled, separate single-ID reads produce paired `[1,1],[3,0],[null,null]`, versus `[1,1],[3,3],[null,null]` in the local first-wins Comet experiment. Apollo reproduces the anomalous Spark value; an isolated first-physical-descriptor decoder check returns the normal values. This remains upstream Spark/parquet-java investigation, not an accepted policy to reproduce anomalous values or a completed SQL-level fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
