Hi Farooq, Projection pushdown is often used to pushdown projection from flink to storage server. However, Kafka is a row format, and kafka broker not support it. Thus, the pushdown only be applied in kafka source. It will make the connector more complex, will it improve a lot?
Best Hongshun On Tue, May 27, 2025 at 12:09 AM Farooq Qaiser <farooq.qai...@shopify.com.invalid> wrote: > Hey folks, > > Just wanted to give this thread a quick bump for visibility. > > Thanks, > Farooq > > On Fri, May 9, 2025 at 12:04 PM Farooq Qaiser <farooq.qai...@shopify.com> > wrote: > > > Hi folks, > > > > Just wanted to share a PR I've been working on to add support for > > projection pushdown to the Flink Kafka Table connector: > > https://github.com/apache/flink-connector-kafka/pull/174 > > > > I think this could improve performance and even resiliency in some cases > > (see the PR description for more details). > > > > Would love to hear thoughts from the community on the proposed change and > > if there are people who are interested in helping review this. > > > > Thanks, > > Farooq > > >
