----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29754/ -----------------------------------------------------------
Review request for samza. Repository: samza Description ------- 2nd draft of SQL operator API - Simplified data object interface * NOTE that the following two issues are still pending revision: i) nested data struct / schema; ii) multiple schema in a single stream? - Simplified operator constructor * provided simple constructor of build-in operators w/o the need to use spec object and factory - Added runtime context to allow operators to send out their output * this reduced the types of the operators to only two: RelationOperator and TupleOperator - Added optional routing context to connect operators to each other - Added two examples: * i) a fully specified application that generates operators via factory and automatically executes the operators via routing context * ii) a "random" application that construct operators on-fly and use the runtime context to get the intermediate results back Diffs ----- build.gradle 38383bd9e3f0847d6088a4ea4c1ee6f3dcd1e430 gradle/dependency-versions.gradle 44dd42603e93788562fd64c68312570cee71a2aa samza-sql/src/main/java/org/apache/samza/sql/api/data/IncomingMessageTuple.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/api/data/OutgoingMessageTuple.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/api/data/Relation.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/api/data/Tuple.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/api/operators/Operator.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/api/operators/RelationOperator.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/api/operators/SqlOperatorFactory.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/api/operators/TupleOperator.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/api/operators/routing/OperatorRoutingContext.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/api/operators/spec/OperatorSpec.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/api/task/InitSystemContext.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/api/task/RuntimeSystemContext.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/operators/factory/SimpleOperator.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/operators/factory/SimpleOperatorFactoryImpl.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/operators/partition/PartitionOp.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/operators/partition/PartitionSpec.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/operators/relation/Join.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/operators/relation/JoinSpec.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/operators/stream/InsertStream.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/operators/stream/InsertStreamSpec.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/operators/window/BoundedTimeWindow.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/operators/window/WindowSpec.java PRE-CREATION samza-sql/src/main/java/org/apache/samza/sql/operators/window/WindowState.java PRE-CREATION samza-sql/src/test/java/org/apache/samza/sql/data/SystemInputTuple.java PRE-CREATION samza-sql/src/test/java/org/apache/samza/sql/operators/routing/SimpleRoutingContext.java PRE-CREATION samza-sql/src/test/java/org/apache/samza/sql/store/SqlContextManager.java PRE-CREATION samza-sql/src/test/java/org/apache/samza/sql/task/RandomOperatorTask.java PRE-CREATION samza-sql/src/test/java/org/apache/samza/sql/task/RoutableRuntimeContext.java PRE-CREATION samza-sql/src/test/java/org/apache/samza/sql/task/StoredRuntimeContext.java PRE-CREATION samza-sql/src/test/java/org/apache/samza/sql/task/StreamSqlTask.java PRE-CREATION settings.gradle 3a01fd66359b8c79954ae8f34eeaf4b2e3fdc0b4 Diff: https://reviews.apache.org/r/29754/diff/ Testing ------- Thanks, Yi Pan (Data Infrastructure)
