This is an automated email from the ASF dual-hosted git repository.
pmaheshwari pushed a change to branch 1.3.0
in repository https://gitbox.apache.org/repos/asf/samza.git.
from e2928e1 SAMZA-2354: Improve UDF discovery in samza-sql. (#1192)
new 0de2385 SAMZA-2352: Use min.compaction.lag.ms to avoid compacting the
Kafka changelog topic (#1190)
new 1b1af6e Moving writeMetadataFile() invocation to ContainerLaunchUtil
from LocalContainerRunner (#1198)
new cb2707f SAMZA-2356: [Transactional State] Do not trim changelog if
time since last checkpoint is greater than min.compaction.lag. (#1196)
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../org/apache/samza/checkpoint/CheckpointId.java | 82 +++++++
.../checkpoint/CheckpointedChangelogOffset.java | 82 +++++++
.../org/apache/samza/storage/StorageEngine.java | 5 +-
.../org/apache/samza/storage/kv/KeyValueStore.java | 5 +-
.../org/apache/samza/config/StorageConfig.java | 16 ++
.../java/org/apache/samza/config/TaskConfig.java | 8 +-
.../operators/util/InternalInMemoryStore.java | 3 +-
.../apache/samza/runtime/ContainerLaunchUtil.java | 1 +
.../apache/samza/runtime/LocalContainerRunner.java | 3 -
.../TransactionalStateTaskRestoreManager.java | 62 ++++--
.../org/apache/samza/container/TaskInstance.scala | 23 +-
.../NonTransactionalStateTaskStorageManager.scala | 8 +-
.../apache/samza/storage/TaskStorageManager.scala | 5 +-
.../TransactionalStateTaskStorageManager.scala | 12 +-
.../org/apache/samza/config/TestStorageConfig.java | 14 ++
.../operators/impl/store/TestInMemoryStore.java | 4 +-
.../apache/samza/storage/MockStorageEngine.java | 3 +-
.../TestTransactionalStateTaskRestoreManager.java | 241 +++++++++++++++++++--
.../apache/samza/container/TestTaskInstance.scala | 22 +-
.../samza/storage/TestContainerStorageManager.java | 2 +-
.../TestTransactionalStateTaskStorageManager.java | 20 +-
.../org/apache/samza/config/KafkaConfig.scala | 12 +-
.../org/apache/samza/config/TestKafkaConfig.scala | 15 +-
.../kv/inmemory/InMemoryKeyValueStore.scala | 4 +-
.../samza/storage/kv/RocksDbKeyValueStore.scala | 12 +-
.../samza/storage/kv/LargeMessageSafeStore.java | 3 +-
.../samza/storage/kv/AccessLoggedStore.scala | 3 +-
.../org/apache/samza/storage/kv/CachedStore.scala | 5 +-
.../samza/storage/kv/KeyValueStorageEngine.scala | 4 +-
.../org/apache/samza/storage/kv/LoggedStore.scala | 3 +-
.../samza/storage/kv/NullSafeKeyValueStore.scala | 4 +-
.../samza/storage/kv/SerializedKeyValueStore.scala | 4 +-
.../samza/storage/kv/MockKeyValueStore.scala | 4 +-
.../kv/TransactionalStateIntegrationTest.java | 2 +-
...ransactionalStateMultiStoreIntegrationTest.java | 2 +-
35 files changed, 584 insertions(+), 114 deletions(-)
create mode 100644
samza-api/src/main/java/org/apache/samza/checkpoint/CheckpointId.java
create mode 100644
samza-api/src/main/java/org/apache/samza/checkpoint/CheckpointedChangelogOffset.java
