+1 I don't think there is an ongoing effort in this direction. Feel free to take up. I would suggest starting with RFC design proposal. There are a few things to note, such as SparkContext and RDD are deprecated. Connect client works with DataFrame API and results are Arrow-encoded rows.
Regards, Sagar On Thu, Sep 12, 2024 at 8:38 AM Prabodh Agarwal <prabodh1...@gmail.com> wrote: > Hi, > > Are there any PRs for spark connect support in the HudiStreamer > application? I tried browsing around the Jira board and didn't find any > tickets. > If no effort is going on right now, I'll take this up. > > Thank you. >
