GitHub user weisong44 opened a pull request:
https://github.com/apache/samza/pull/611
SAMZA-1812: Added configuration for changelog to local store backed tables
Currently changelog for tables can be supported implicitly by adding user
defined configuration, to be more user friendly we want to expose it though
table API. This is applicable to RocksDB and in memory table implementation.
- By default, changelog is enabled with auto-generated name
<job-name><job-id>-table<table-id>
- Added ability to disable changelog
- Added ability to set changelog stream name, by default
- Added validation of changelog stream name, and modify to confirm to
Kafka topic name spec
- Added configuration for replication factor
- Disable changelog when user enables side input
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/weisong44/samza fix-changelog
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/611.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #611
----
commit 3f7ed71f8f5d6efe3567f039734ac96bb12679b6
Author: Wei Song <wsong@...>
Date: 2018-07-25T01:34:06Z
Added self to committer list
commit 5cbf9af9c12b96c5773a37274538f8baea8347e1
Author: Wei Song <wsong@...>
Date: 2018-08-03T20:38:41Z
Merge remote-tracking branch 'upstream/master'
commit a15a7c9a231adcc1b441351963e15a7855ea5879
Author: Wei Song <wsong@...>
Date: 2018-08-06T18:49:30Z
Merge remote-tracking branch 'upstream/master'
commit aae0f380e49950bc36a18e34d08041d554fc13a7
Author: Wei Song <wsong@...>
Date: 2018-08-16T17:50:45Z
Merge remote-tracking branch 'upstream/master'
commit 9ec54788a9a048781ab2ab3810235d76966dbdd1
Author: Wei Song <wsong@...>
Date: 2018-08-20T18:39:57Z
SAMZA-1812: Added configuration for changelog to local store backed tables
- By default, changelog is enabled with auto-generated name
<job-name><job-id>-table<table-id>
- Added ability to disable changelog
- Added ability to set changelog stream name, by default
- Added validation of changelog stream name, and modify to confirm to
Kafka topic name spec
- Added configuration for replication factor
commit 0440f75fcd16061d8ff87e775d4a1e731936ece0
Author: Wei Song <wsong@...>
Date: 2018-08-20T18:42:56Z
Merge remote-tracking branch 'upstream/master'
commit 83b7c2d5e45a419db40d9d875465c7d29898060d
Author: Wei Song <wsong@...>
Date: 2018-08-20T18:43:16Z
Merge branch 'master' into fix-changelog
----
---