Hi Ashish, We've discussed this use case quite a bit, but I don't think that there are currently any readers that expose the deletes as a stream. Right now, all of the readers produce records from the current tables state. I think @OpenInx <open...@gmail.com> and @Jingsong Li <jingsongl...@gmail.com> have some plans to expose such a reader for Flink, though. Maybe they can work with you to on some milestones and a roadmap.
rb On Fri, Oct 16, 2020 at 11:28 AM Ashish Mehta <mehta.ashis...@gmail.com> wrote: > Hi, > > Is there a spec/proposal/milestone issue that talks about Incremental > reads for UPSERT? i.e. allowing clients to read a dataSet's APPEND/DELETES > with some options of exposing actually deleted rows. > > I am in view that exposing deleted rows might be trivial with positional > deletes, so an option might be actually helpful if the client would be > creating positional deletes in his use case. > > Thanks, > Ashish > -- Ryan Blue Software Engineer Netflix
