But how does the connector know how to delete records? I see shallProcessUpdates True/false but there no indictation how to tell it to remove the record based on a value in the JSON record.
At this point it seems it's easier just to right a consumer and handle it myself. On Fri, Mar 22, 2019, 6:58 PM Denis Magda, <dma...@apache.org> wrote: > Hey John, > > Check this integration out. It should support what you are looking for: > https://docs.gridgain.com/docs/certified-kafka-connector > > - > Denis > > > On Fri, Mar 22, 2019 at 6:17 AM John Smith <java.dev....@gmail.com> wrote: > >> Or are you saying I need to write custom streamer? >> >> On the streamer how do we get notified of data coming in? The examples >> don't show that. They only show how to connect... Or is that the only >> function of streamer? >> >> On Fri, Mar 22, 2019, 9:12 AM John Smith, <java.dev....@gmail.com> wrote: >> >>> You mean I need to write my own Kafka connect connector using the cache >>> API and from there decide to do put or remove? >>> >>> On Tue, Mar 19, 2019, 8:02 PM aealexsandrov, <aealexsand...@gmail.com> >>> wrote: >>> >>>> Hi, >>>> >>>> Yes, looks like the KafkaStreamer doesn't support the DELETE behavior. >>>> It >>>> was created to loading data to Ignite. >>>> >>>> However, deleting data from Ignite is possible using Interface >>>> IgniteDataStreamer API: >>>> >>>> >>>> https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/IgniteDataStreamer.html#removeData-K- >>>> >>>> So you just require to proceed the Kafka stream and use >>>> IgniteDataStreamer >>>> (or IgniteCache API) somewhere in sink function. Possible that you >>>> should >>>> take a look at Kafka connector: >>>> >>>> https://kafka.apache.org/documentation.html#quickstart_kafkaconnect >>>> >>>> BR, >>>> Andrei >>>> >>>> >>>> >>>> -- >>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >>>> >>>
