peter-toth commented on PR #58513: URL: https://github.com/apache/spark/pull/58513#issuecomment-5540716845
Below 3.5 is EOL and 3.5 only takes security fixes, so `branch-4.0`, `branch-4.1` and `branch-4.2` are the ones in scope. **This one.** Please open them. The fix stands on its own there: the wrong-value bug needs only a pruned projection, no scan merging, so `SELECT sum(c) FROM t` is enough to hit it. Those branches also have no gate keeping avro out of V1 scan merging, since that gate is what #58411 added on 4.3, so a merged read can widen an avro projection there with nothing in front of it. That makes the position mapping worth more on those branches than on 4.3, not less. **SPARK-59107.** I would not port it. A new catalyst-side seam on three maintenance branches is more than this warrants, so let us record it as a known limitation on SPARK-59107 with the fix starting at 4.3. Put the 4.2 and 3.5 numbers you measured on the ticket. They are what anyone who hits it will need. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
