vishnuprakaz opened a new pull request, #17445:
URL: https://github.com/apache/iceberg/pull/17445
Setting `read.split.target-size`, `read.split.planning-lookback`, or
`read.split.open-file-cost` as a table property has no effect on Flink reads.
The split options in `FlinkReadOptions` declare default values, so
`FlinkConfParser` always returns the Flink default and never reaches the table
property fallback in `FlinkReadConf`, even though the docs promise read option,
then Flink configuration, then table property. This is a regression from #5967,
which introduced the read options with declared defaults; before that the
planner only set the split scan options when explicitly configured and the
table properties were honored.
The split options now declare no default, like the write options, and the
defaults are applied in `FlinkReadConf` after the table property lookup. Needs
a backport to 1.20 and 2.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
