> On Jul 17, 2017, at 11:08 AM, Ron <ron.a...@gmail.com> wrote: > > I am looking into the possibility of putting the changes in SQLite database > into kafka, similar to this: > https://www.confluent.io/blog/bottled-water-real-time-integration-of-postgresql-and-kafka/ > > <https://www.confluent.io/blog/bottled-water-real-time-integration-of-postgresql-and-kafka/>
I suggest looking at the source code of the Sessions extension, which “provide[s] a mechanism for recording changes to some or all of the rowid tables in an SQLite database, and packaging those changes into a "changeset" or "patchset" file that can later be used to apply the same set of changes to another database with the same schema and compatible starting data.” It looks as though the changesets produced by the extension aren’t intended to be readable, but its implementation must be doing something similar to what you want to do, i.e. discovering all the changes to tables made since some prior time. So you should be able to modify the extension to take those changes and send them to Kafka instead of writing them into a blob. https://www.sqlite.org/sessionintro.html —Jens _______________________________________________ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
