----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35676/ -----------------------------------------------------------
(Updated July 8, 2015, 1:41 a.m.) Review request for samza. Repository: samza Description ------- SAMZA-615: Checkpoint migration Diffs (updated) ----- build.gradle a5f54106a822dc91ff82270df27217a8765a0d80 checkstyle/import-control.xml 3374f0c432e61ac4cda275377604cfd481f0cddf samza-core/src/main/java/org/apache/samza/coordinator/stream/CoordinatorStreamMessage.java 6c1e488d00d8593d59c89b57e673e0b6b90fd7d2 samza-core/src/main/java/org/apache/samza/coordinator/stream/CoordinatorStreamSystemProducer.java 92f8907f3cbd490ccafb2d963091a644604eb49b samza-core/src/main/scala/org/apache/samza/job/JobRunner.scala 1c178a661e449c6bdfc4ce431aef9bb2d261a6c2 samza-core/src/main/scala/org/apache/samza/migration/JobRunnerMigration.scala PRE-CREATION samza-core/src/main/scala/org/apache/samza/migration/MigrationPlan.java PRE-CREATION samza-core/src/test/java/org/apache/samza/coordinator/stream/MockCoordinatorStreamSystemFactory.java 647cadb3a4e51bec8204197d77ad35a6b29afcec samza-core/src/test/java/org/apache/samza/coordinator/stream/MockCoordinatorStreamWrappedConsumer.java e454593ebd2b09f0cfb7a7531f05394348253e9b samza-core/src/test/java/org/apache/samza/coordinator/stream/TestCoordinatorStreamMessage.java ac26a015596688a1a9fe5a078ce506de64364938 samza-core/src/test/scala/org/apache/samza/job/TestJobRunner.scala 52057edbbcd08b7d6edde7e898466d26534f52f6 samza-kafka/src/main/scala/old/checkpoint/KafkaCheckpointLogKey.scala PRE-CREATION samza-kafka/src/main/scala/old/checkpoint/KafkaCheckpointManager.scala PRE-CREATION samza-kafka/src/main/scala/old/checkpoint/KafkaCheckpointManagerFactory.scala PRE-CREATION samza-kafka/src/main/scala/old/checkpoint/KafkaCheckpointMigration.scala PRE-CREATION samza-kafka/src/main/scala/org/apache/samza/system/kafka/KafkaSystemProducer.scala 39c54aa4ee27736c0400d295904872ca6fa3fb88 samza-kafka/src/test/scala/old/checkpoint/TestKafkaCheckpointManager.scala PRE-CREATION samza-test/src/main/config/join/common.properties ac87e81aeea4015b2fc83942a62e3d16c4fbbd2b Diff: https://reviews.apache.org/r/35676/diff/ Testing ------- Unit test added, test will hello-samza in progress Hello-samza test: OUTPUT FROM 0.9: ~/Documents/hello-samza(branch:latest) » deploy/kafka/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic __samza_checkpoint_ver_1_for_wikipedia-parser_1 --from-beginning nsomasun@nsomasun-mn1 {"Partition 0":0} {} {"SystemStreamPartition [kafka, wikipedia-raw, 0]":{"system":"kafka","partition":"0","offset":"1674","stream":"wikipedia-raw"}} {"SystemStreamPartition [kafka, wikipedia-raw, 0]":{"system":"kafka","partition":"0","offset":"1808","stream":"wikipedia-raw"}} {"SystemStreamPartition [kafka, wikipedia-raw, 0]":{"system":"kafka","partition":"0","offset":"1950","stream":"wikipedia-raw"}} {"SystemStreamPartition [kafka, wikipedia-raw, 0]":{"system":"kafka","partition":"0","offset":"2103","stream":"wikipedia-raw"}} ------------------------------------------------------------ OUTPUT FROM 0.10.0: ~/Documents/hello-samza(branch:latest) » deploy/kafka/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic __samza_coordinator_wikipedia-parser_1 --from-beginning nsomasun@nsomasun-mn1 {"host":"172.21.136.130","source":"CHECKPOINTMIGRATION","values":{"kafka.wikipedia-raw.0":"2103"},"username":"nsomasun","timestamp":1435870948879} Thanks, Naveen Somasundaram