-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/32892/
-----------------------------------------------------------
Review request for samza, Yan Fang, Chinmay Soman, Chris Riccomini, Milinda
Pathirage, Navina Ramesh, and Naveen Somasundaram.
Bugs: SAMZA-639
https://issues.apache.org/jira/browse/SAMZA-639
Repository: samza
Description
-------
Merge w/ master:
Change lists:
--------------------------------------------------------------------------------------------------------------------------
SAMZA-455; post jdk support policy to the website
SAMZA-584; fix race condition in kafka system consumer
SAMZA-505; warn when using an array as a key in cached store
SAMZA-506; gracefully shutdown container on SIGTERM
SAMZA-590; kafka broker proxy should relinquish ownership for all partitions
when its consumer fails
SAMZA-550; remove dead code from serializer config
SAMZA-596; upgrade scala test to 2.2.4
SAMZA-576; fork a new process for every test in samza-kafka to try and fix
TestKafkaSystemAdmin.testShouldGetOldestNewestAndNextOffsets
SAMZA-597; support JSON encoding for log4j stream appender
SAMZA-592; ignore replica not available exceptions, and be more aggressive
about refreshing kafka topic metadata
SAMZA-600: Move Java tests into src/test/java in samza-kafka
SAMZA-602; fix compilation issue with scala/java dependencies in samza-kafka
SAMZA-599; upgrade to kafka 0.8.2.1
SAMZA-589; sanitize sensitive data beore displaying configs to UI
SAMZA-568; allow tasks to override offsets in init method
SAMZA-605; fix jobrunner package name in docs
SAMZA-543; disable WAL for rocksdb kv store
SAMZA-567; allow stores to work from init method
SAMZA-456; add samza-yarn and samza-core to multinode yarn tutorial
SAMZA-586; disable compressed messages when sending to a store's changelog
topic from a kafka system
SAMZA-458; closing kafka system producers flushes all buffered messages
SAMZA-611: added Yan Fang's public key
SAMZA-612: remove "incubating" in release.gradle
SAMZA-588; expose SamzaContainerContext through TaskContext
SAMZA-613: update 0.9.0 release version. bump up to 0.10.0-SNAPSHOT
SAMZA-367: add Timer to the docs
SAMZA-620; torture test checker should start from oldest offset
SAMZA-621; fix zopkio test package path for 0.10.0
update download page for 0.9.0
SAMZA-627: add 0.9.0 release to Archive category
SAMZA-633; expose configuration to Kafka's encoder and decoder
SAMZA-482; create samza-sql module, and add a basic set of non-functional
operators into it
SAMZA-484; define serialization for tuples in samza-sql
SAMZA-483; begin samza calcite integration
SAMZA-575; add an AvroData serde
SAMZA-582; add an avro to calcite schema converter
SAMZA-637: minor cleanup and merge
Diffs
-----
KEYS e5dc701259c91946ddf4347c5a179b84543a339a
build.gradle 97de3a28f6379e3862eec845da87587b1d4f742e
docs/_config.yml a3bb8d48a31b5542b9a10dc3e5c741a244e0d77d
docs/_layouts/default.html 839aadfec96b9e7ae51749c05bf2a6d2feeea66b
docs/archive/index.html 1bfeb9be28122d17f98c2ec4d7e4fee1b089581b
docs/learn/documentation/versioned/container/metrics.md
11a62f9c8bb8b7a448714a81c8ab08c6a0375562
docs/learn/documentation/versioned/jobs/configuration-table.html
e09146024d7a56673c39fc6e7a03c7a67caf7e57
docs/learn/documentation/versioned/jobs/configuration.md
c0ebb699feb42b386702c048bcd16dcb8239aa36
docs/learn/documentation/versioned/jobs/job-runner.md
5f0607f4498b6bbebcaa89ce627b2eefbbb253fc
docs/learn/documentation/versioned/jobs/logging.md
1d13d151316bd51c7a3730e40450000433b7968e
docs/learn/tutorials/versioned/run-in-multi-node-yarn.md
312efafdc735a5fdcf79953f10e1db56d8d964a6
docs/startup/download/index.md 37f948b794748a68250733f656d436532c0b41b6
gradle.properties b18c0cb62aec7592e8bfb1f2aa83c6b8eada867f
gradle/dependency-versions.gradle ee6dfc411b7ab90b187df79f109884127953862e
gradle/release.gradle e501098559a95779c76216cf4b01bdd33c8a12ff
samza-api/src/main/java/org/apache/samza/config/Config.java
2b990506864c38ec2c46d55f27c2ba2f98f271ea
samza-api/src/main/java/org/apache/samza/config/MapConfig.java
38d7424429d4bf81614311c39630b165236d8fbb
samza-api/src/main/java/org/apache/samza/task/TaskContext.java
5b337a6fc7921d5d335543db1152ff7fba4b4cbb
samza-api/src/test/java/org/apache/samza/config/TestConfig.java
d9f378d8de6da3bdf002e69dfb1e4605c3d90cec
samza-core/src/main/scala/org/apache/samza/config/SerializerConfig.scala
8e3eb57e43f1d0f7e91b8539b0dc100d4ac70084
samza-core/src/main/scala/org/apache/samza/config/StorageConfig.scala
be3f1068f7921c9c8f8697577efea6580672813e
samza-core/src/main/scala/org/apache/samza/container/RunLoop.scala
4098235c8c13fad68c8aded3b2a8a4ef07c216e7
samza-core/src/main/scala/org/apache/samza/container/SamzaContainer.scala
5416dd620b2f65ffb09cf5f8c07b1a547df82bab
samza-core/src/main/scala/org/apache/samza/container/TaskInstance.scala
c5a5ea5dea9a950fc741625238f5bf8b1f362180
samza-core/src/main/scala/org/apache/samza/serializers/ByteBufferSerde.scala
05c3e38ba4bb1437fcc0ee19b16f0959866438d8
samza-core/src/main/scala/org/apache/samza/serializers/ByteSerde.scala
968da267ffbcc6ad557e9d247210a33b0849aa83
samza-core/src/test/scala/org/apache/samza/config/TestStorageConfig.scala
81a35ec719975052f50af249dfcc17249e8342d1
samza-core/src/test/scala/org/apache/samza/container/TestRunLoop.scala
2a0897f0670f41d481cbe9d8ceca973272980bc0
samza-core/src/test/scala/org/apache/samza/container/TestSamzaContainer.scala
cab31ca6452e45c73808f20b12d39a30c117119a
samza-core/src/test/scala/org/apache/samza/container/TestTaskInstance.scala
7caad28c9298485753ab861da76793cf925953ed
samza-core/src/test/scala/org/apache/samza/serializers/TestByteBufferSerde.scala
9401d70aee3b5b033251f0762b9a55be263075d7
samza-core/src/test/scala/org/apache/samza/system/TestStreamMetadataCache.scala
4716d97701be1311d484e01bd4dca7bd26cf1416
samza-kafka/src/main/scala/org/apache/samza/checkpoint/kafka/KafkaCheckpointManager.scala
c9504ecf1d1edbc116ca6d794678062fddeee7fa
samza-kafka/src/main/scala/org/apache/samza/checkpoint/kafka/KafkaCheckpointManagerFactory.scala
3dfa26a23c88f9b5b8ffbfd64b59c4061a8ed2e7
samza-kafka/src/main/scala/org/apache/samza/config/KafkaSerdeConfig.scala
ed2bd40d8112a594484f2d9f30e30cb24dc1edab
samza-kafka/src/main/scala/org/apache/samza/serializers/KafkaSerde.scala
d626b79938847b1d84a92544d4f691e87ea7a117
samza-kafka/src/main/scala/org/apache/samza/system/kafka/BrokerProxy.scala
614f33f09bbbe4a23cc1f2a1a166d73e34f6e656
samza-kafka/src/main/scala/org/apache/samza/system/kafka/GetOffset.scala
5528702070e5d079d79ac867bfd63402094644a9
samza-kafka/src/main/scala/org/apache/samza/system/kafka/KafkaSystemAdmin.scala
f783c5790f442928ea83b13359ac6b2a5bcb02e5
samza-kafka/src/main/scala/org/apache/samza/system/kafka/KafkaSystemConsumer.scala
de00320408b3e2d3519c17be1a148f741e92d9ea
samza-kafka/src/main/scala/org/apache/samza/system/kafka/KafkaSystemFactory.scala
c84ceb75b84eb6d2ce115396ba54cf9e455d905c
samza-kafka/src/main/scala/org/apache/samza/system/kafka/KafkaSystemProducer.scala
19bc37d8f80e73add66882303993bf748079bc2e
samza-kafka/src/main/scala/org/apache/samza/system/kafka/TopicMetadataCache.scala
82ecf1aee9639fbd3615f12edc4b462dafb358e7
samza-kafka/src/main/scala/org/apache/samza/util/KafkaUtil.scala
a7a095b4d2f19be5ad6119d5bfc715bffaeb68af
samza-kafka/src/test/scala/org/apache/samza/config/TestKafkaSerdeConfig.scala
d6899b8a7d663fc500c35903ef94d27153f3a43c
samza-kafka/src/test/scala/org/apache/samza/system/kafka/MockKafkaProducer.java
samza-kafka/src/test/scala/org/apache/samza/system/kafka/TestBrokerProxy.scala
e285decbea75e7026ce54e81e5f924997891ac57
samza-kafka/src/test/scala/org/apache/samza/system/kafka/TestKafkaSystemAdmin.scala
0380d35121f4feb99efc7d092b4232030d12db01
samza-kafka/src/test/scala/org/apache/samza/system/kafka/TestKafkaSystemFactory.scala
ce84b6d1cd9df233b617a3ebfa6b9a5b2141b0df
samza-kafka/src/test/scala/org/apache/samza/system/kafka/TestKafkaSystemProducer.scala
ef5a55b6a6a14e08d36a549813570a8bf38f1e28
samza-kafka/src/test/scala/org/apache/samza/system/kafka/TestTopicMetadataCache.scala
50c13ababb7a964f87100a11e0ba82915a3236e6
samza-kafka/src/test/scala/org/apache/samza/utils/TestKafkaUtil.scala
848cfc8fcc0848e688e48a6c9dfa1275a1be9c52
samza-kafka/src/test/scala/org/apache/samza/utils/TestUtils.java
samza-kv-rocksdb/src/main/scala/org/apache/samza/storage/kv/RocksDbKeyValueStorageEngineFactory.scala
5ab68590a4ed2686d730344665e25776cade6add
samza-kv-rocksdb/src/main/scala/org/apache/samza/storage/kv/RocksDbKeyValueStore.scala
66c2a0dc2e38e21f951727a30f0987776ac52fe2
samza-kv/src/main/scala/org/apache/samza/storage/kv/CachedStore.scala
61bb3f6acb080b653f8b11176538549738255acc
samza-kv/src/test/scala/org/apache/samza/storage/kv/TestCachedStore.scala
d03ec925b103ccf3c1561de0461fbc39cbe9d9ca
samza-log4j/src/main/java/org/apache/samza/config/Log4jSystemConfig.java
d5e24f20b8199d3e7be7bdde33abd9e811505d40
samza-log4j/src/main/java/org/apache/samza/logging/log4j/StreamAppender.java
d3f25c0e03a727e64a774581384ef5aae9ef9c1c
samza-log4j/src/main/java/org/apache/samza/logging/log4j/serializers/LoggingEventJsonSerde.java
fd1c4762d64a4d0aafaa3a77aa7ac1281e53b18b
samza-log4j/src/main/java/org/apache/samza/logging/log4j/serializers/LoggingEventJsonSerdeFactory.java
9fdc8ae1c052cdc4a32991236c96d6db82655220
samza-log4j/src/test/java/org/apache/samza/config/TestLog4jSystemConfig.java
6314a3ed7ae6d49328ba3f32af5d9d1097899009
samza-log4j/src/test/java/org/apache/samza/logging/log4j/TestStreamAppender.java
3e812405edf1ad4fca43784b1668ab3ae6ff6475
samza-sql/src/main/java/org/apache/samza/sql/metadata/AvroSchemaConverter.java
PRE-CREATION
samza-sql/src/test/java/org/apache/samza/sql/data/serializers/SqlAvroSerdeTest.java
PRE-CREATION
samza-sql/src/test/java/org/apache/samza/sql/test/metadata/TestAvroSchemaConverter.java
PRE-CREATION
samza-test/src/main/config/join/checker.samza
c0e3df7264c2bdc8bb7590783ddc5f4b61c62088
samza-test/src/main/config/perf/kv-perf.properties
33fcd8d1aea14ecea47bbadb24936f737feedb39
samza-test/src/main/python/configs/tests.json
30be820d1f8f27629ab15f853533d558af8b53a5
samza-test/src/main/scala/org/apache/samza/test/performance/TestKeyValuePerformance.scala
0858b981add6581230960356f65fe6f6e6ab108f
samza-test/src/test/scala/org/apache/samza/test/integration/TestStatefulTask.scala
d66b3bd070a4cef4b1d3dded1d79a33cbe3fa09b
samza-yarn/src/main/scala/org/apache/samza/webapp/ApplicationMasterRestServlet.scala
4c855bf03ccfcc7830136a4c9410c85165ff21f1
samza-yarn/src/main/scala/org/apache/samza/webapp/ApplicationMasterWebServlet.scala
7fd51221149ba59e7ea1bc0b51d58726ec17a7d7
Diff: https://reviews.apache.org/r/32892/diff/
Testing
-------
Passed ./bin/check-all.sh
Thanks,
Yi Pan (Data Infrastructure)
