This is an automated email from the ASF dual-hosted git repository. jbonofre pushed a change to branch dsl-euphoria in repository https://gitbox.apache.org/repos/asf/beam.git.
from e7a3578 Merge pull request #4264: [BEAM-4061] Introduced SpannerWriteResult add cc35563 Migrate the `portable` subpackage to Portability add 7848764 Merge pull request #5270: Migrate the `portable` subpackage to use Portable representations add 60f90c8 Make experiments as set attr of RuntimeValueProvider add 389760d #! Init Euphoria 0.5.0 add 0d952c9 #! minor code cleanup add 28b3a00 #! Fix dead lock when executing many tasks add cd56b70 #! Split partition description from its reader add 65c7e05 #! Call Reader#close upon end-of-stream add 52e6f93 #! Initial draft of KafkaStreamSource add 49e4127 #! Correct typo in classname add 7fb031a #! Upgrade PrintStreamSink to a general purpose utility add 2c28ce6 #! Revise comments in example code add 31c8247 #! Allow kafka configuration through properties resource add 88a05c8 #! Fix compilation error in IDEA add f2c2c59 #! Propose readable variable/parameter name add 311561d #! Hadoop input formats adapter add 38dfc38 #! Hadoop input format - clone Writable instances between RecordReader#nextKeyValue calls add ca3fba0 #! Unify input/output creation add ebe78c3 #! Provide easy access to nested configuration settings add 036952b #! Make dataset aware of its consumers add a7028d4 #! added basic test for retrieving dataset's consumers add 1d1f891 #! fix typo in comment add 8352af5 #! Make kafka source configurable through settings add 76edfd5 #! Make StdoutSink#dump-partition-id parameter optional again add 986aa72 #! DataSink API polishing add d267db5 #! Do not close stdout through StdoutSink add 9ca98d7 #! Log swallowed exceptions add e2183f7 #! InMemExecutor - fix potential concurrency issue add 86b030b #! InMemExecutor - rollback all sinks when any of the tasks fails add 3843d2f #! Add inmemory filesystem skeleton add 78f71ae #! Apply InMemFileSystem as SoR in test add 99cb406 #! Drop obsolete/unused method add a905140 #! Rework iteration towards java8 streams add 4172b2b #! Remove unused imports add 29fa239 #! Working join operator add fc86e23 #! git pull --rebase origin master add e4aaba8 #! minor polishing and removing of warnings add b5b6df1 #! polishing after code review add 7a3b152 #! correct calling of constructor of ReduceStateByKey from GroupReduceByKey add 869e412 #! pair moved package add 76aef84 #! Hadoop output format adapter add 6eae64f #! clone datasets to all consumers in inmem executor add bafc866 #! KafkaStreamSource -> KafkaSource add 5e85703 #! Initial draft of a non-tx-aware kafka-sink add be6cdad #! Correct Pair class reference add a199ae8 #! comment typo add 2d40e4f #! first part of code review changes add 8d383f3 #! core of realtime stats add 4b3c126 #! Ensure writing out EOS token add bde6258 #! DRY on computing sum add d726828 #! implemented remarks from code review add 97995e5 #! Get reasonable logging output during tests add 0f93f96 #! InMemFileSystem.Factory -> InMemFileSystem.SourceFactory add 788bbab #! Sink into the InMemFileSystem for unit testing purposes add aed6144 #! Drop CompositeKey#equals implementation add 6c684b4 #! Avoid eye-bleeding add 741e0f2 #! Avoid doubled output add 38b5278 #! added tests for flatmap, repartition and union, slightly cleaned code in inmem add eec07df #! more correct commit of ListDataSink's Writer add 4341c88 #! get rid of batch code in client API add 330f67d #! changes after review add aca5db9 #! Staless Windowing (Windowing.Count working; others commented out) add 422bbb9 #! Attempt at merging add edac6a9 #! Fix state merging add 415b948 #! Drop Window#add/getState add cfdb327 #! Shorten test code add 46fd194 #! Aligned count window add 5d3182b #! Add Join implementation add bceb02f #! Finish up join implementation add 8b64f45 #! fixed test for sort in reducestatebykey add 78e81d6 #! Various styling issue; thanks to review feedback add 8977d66 #! Add more debugging support through stdout-sink add 2cca7ca #! Correct output format add f431fa2 #! added tests for reducestatebykey - non aggregating and unaligned windows add 2a3e083 #! changes after review add 852fb8f #! Provide more debugging info through stdout-sink add e4b3dad #! Add (failing) proof-of-concept test add 724d1bb #! Allowing windowing by item specific event-item add 39aa4ab #! Add VoidSink for debugging purposes add 66bd32a #! Prefer UnaryFunction over EventTimeFn add 08d9ce3 #! Prevent timer thread to die add 3ab9f6e #! Prepare window storage add 7a0cd88 #! Faster retrieval of active windows add cb8f789 #! added tests for inmem, added sliding window add 21d19d6 #! fixed copying inputs in multi consumer pipeline add 27ff345 #! SlidingWindow constructor made private add 9f65126 #! Fix import add c5976e7 #! Fix type reference add 389d0df #! changed triggering to allow event time add b218538 #! added watermark triggering with basic test add b8f1a16 #! fixed tests, code polishing add 176ee2d #! simplified tests, added element discarding on closed windows add 1a537f2 #! better handling of bounded inputs with triggering add 540aa9a #! API - refactor operator builders + unit tests add 2e4f4a3 #! Propage window labels to operator output add 52f051e #! Drop needles consistency methods add ad27ebb #! Correct variable name add 469879a #! Attached/DefaultWindowing emission add 9e37759 #! Add test add e67aa39 #! EndOfPane -> EndOfWindow add d6ef78c #! Put State#collector behind a getter add 73be33e #! Move EndOfWindow skiping directly into InMemExecutor add 0eb3496 #! Drop DatumCleanupSink add 6e7eb4b #! Move InMemExecutor into a dedicated package add 366d26f #! Drop obsolete PersistableDataset add 0670181 #! Tighten test condition; provide explanation add 7b8f125 #! Drop prepared logging in test add 50dfcfa #! Tune test add 57d7511 #! Forward end-of-window only when arriving on all input partitions add 78df397 #! Broadcast EoW to every output partition add b17e95e #! Drop forgotten debug message add 245f63d #! Fix emitting EoW too frequently add 487a0f1 #! Do not synchronize when invoking Windowing#assignWindows/#updateTriggering add e9c440c #! Prepare for EoW tracking add 99e2c9c #! Avoid broadcasting too many times add 5fbab2b #! Drop debugging log messages add a28fbcd #! Fix trigger rescheduling in WatermarkTriggering add 342ebb2 #! Style changes add 24cf581 #! Resolve merging of obsolete windows add 2ec57bf #! added tests applicable on all executors add be37f1b #! removed operator Mapwindow add 7555cc9 #! added simple wordcloud application add f46af63 #! Use attached windowing in Stats add 5b96646 #! Enable watermarking in Stats again add 547c0eb #! compilability after rebase add f1eb44f #! Attempt at nailing down random test failure add c7349e6 #! Allow unified access to .output() add e534fce #! Fluent flow builder (proof-of-concept) add 84ede06 #! Fluent example add 0237ec8 #! Move fluent api to a submodule add aa8eeb1 #! Rename OutputProvider to OutputBuilder add fdf9590 #! Another attempt at nailing down random test failure add ad159b4 #! Attempt at fixing flipping test add 250b2c6 #! polishing after review add 6ede73e #! Update maven repo pointers add 9d5fa93 #! Fix maven-project-info-reports-plugin version add d7730eb #! early triggering of window (replaces aggregating windows) add 4c82b66 #! Thread-safe access to #activeTasks add 1a410f1 #! Javadoc improvement and minor bug fixes after review add e060c62 #! Windowing API requires fixed order of builder methods add 7e1220f #! Allow reading kafka a whole topic as one partition (for easier debugging purposes) add dbe9511 #! Utilize eventTime and earlyTriggering in Stats (WatermarkWindowing disabled) add d247301 #! Revert back to time-sliding add dcb930e #! Allowing limiting the RSBK key space add b8a3722 #! Drop verbose debug message add 8e40c79 #! Hide implementation details and make public input based on Triples add fe02d36 #! Fix evaluating optional setting add 3262d5f #! Introduce session windowing add 0a9a9d6 #! Rename span -> createSpanned add e2a238e #! Fix merging fully enclosed windows add 0348504 #! Speed up ordering add e19beef #! Test for session window labels add cc74d9e #! Fix time-sliding and session-windowing in combination with watermark-triggering add b03e809 #! Allow consuming kafka topics from any earlier offset add 80bec26 #! Print debug to log instead of stderr add 47cdde9 #! Add failing proof-of-bug test add e323aa5 #! Fix DAG traversal add 0a18a12 #! Prefer duration over millis in time based APIs add 07f075e #! Required TimeSliding step to be a duration in favor of millis add d855484 #! Make up session across searches and clicks add 1743ebe #! Resuse Either#lift add a2bb16b #! Make TopPerKey a proper operator add bcacfc5 #! Suppress unchecked warnings; Fix "grouped" flag in RBK add dad1f64 #! Fix indentation add b6f192c #! Fix typo add ef35645 #! Make CompositeKey public and reuse inside inmem executor add 1f97d50 #! Fix inmem executing R(S)BK on a grouped dataset add f103940 #! Flink executor skeleton add f0879cc #! fix compilation error add dad503a #! refactoring after review add f65d37b #! DataSource adapter for Flink executor add ece7f1e #! DataSink adapter for Flink executor add 5bbe2f3 #! Support logging during flink tests add ce32086 #! DataSink#rollback throws IOException add dcf3733 #! fix test add 8e38273 #! ListDataSink stores data in static context add 2663789 #! Favor cz.seznam.euphoria:guava-shaded over com.google.guava:guava add 8a1fcf9 #! Rebase on FlinkIO add f495655 #! ListDataSink review add 4cdc759 #! Flink implementation of ReduceByKey (no windowing) add abd8e77 #! ReduceByKey has isCombinable() method add 38bf82e #! ReduceByKey uses custom partitioner just in case it's different from HashPartitioner add f22685e #! testapps - WordCount implementation add 38bb897 #! Remove explicit parallelism from OperatorTranslator interface add 1fff444 #! Comment add a2a0bbe #! Avoid casts for readability reasons add 7d668a9 #! [euphoria-flink] Dump execution plan prio to flow execution add ed27d0c #! Type-safe HadoopInputFormatAdapter. add d9c57d6 #! Type-safe HadoopOutputFormatAdapter. add ad40095 #! Refactoring. add 9564d7f #! Make HadoopDataSource public. add 2d24071 #! Add SequenceFile factories. add 4af300d #! Add proof-of-concept test add b1cb780 #! [euphoria-flink] Fix operator-input-dataset-mapping add 4ba8031 #! Add printing element type for debugging purposes add 150a543 #! Avoid non-implemented windowing in proof-of-concept test add 2bde2dc #! [euphoria-flink] Separation of streaming and batch executors add 3e94eed #! Rename items for clarity reasons add e50b9aa #! Tighten method signature to expected operator type add ed55262 #! Javadoc add 9f113d3 #! Move #getExecutionEnvironment to parent class add e58f9ad #! Remove garbage add 3294573 #! [euphoria-flink] batch input format adapter (without data locality) add 956870c #! [euphoria-flink] batch output format adapter add 6177525 #! [euphoria-flink] batch ReduceByKey implementation add 5b9d5d2 #! [euphoria-hadoop] Make HadoopDataSource serializable add cb90dad #! [euphoria-flink] Make batch-word-count work (on local-flink-environment) add ec9b504 #! [euphoria-flink] Add an upper bound to parallelism on operators add d4d17fe #! [euphoria-core] Conditional partitioning in fluent style add 7ab7dc0 #! refactored window to windowcontext and windowid add 00cea51 #! fixed test for time sliding window add d2624c8 #! moved Datum to public API and changed its name add 7619d80 #! likvidace unchecked warningu add 557b752 #! refactored windowing stuff to separate package add 7f7ddf5 #! refactored windowing types to separate classes add 814b500 #! unified AttachedWindowing with all other windowings add 4c087bf #! unified ElementWindowing and Windowing add 4f19b14 #! refactored data passing inside inmem pipelines, failing tests related to attached windowing add 96e4a2e #! rebased on master add 44eaeb4 #! inmem working on watermarks and regular attached windowing add 708d567 #! incorporated changes after review add fefd2a1 #! [euphoria-inmem] Emit watermarks with every input item add 73b36af #! Extract diff of jenda/16255-add-watermarking-to-inmem and master add da9d9ab #! Make euphoria-flink compile (temporary work-around) add 8316dba #! Increase read-timeout way over watermarking triggering in the inmem executor to stabilize test add 2b5216c #! [euphoria-core] Drop obsolete field add e193838 #! fix watermark triggering and associated tests add a4ef6f8 #! code polishing add d77fd6d #! removed unneeded synchronization add 6fbca43 #! [euphoria-flink] Partial progress on window-element envelopes add 001fc04 #! [euphoria-flink] Handle window-element envelopes in Repartition operator add 904d3b3 #! tuned generic windowing for use with sliding windows add 5b6c66a #! code formatting add 108081e #! [euphoria-flink] Handle window-element envelopes in batch mode add 038fa60 #! [euphoria-flink] Perform conversion to/from window-elements in sink/sources just as in streaming mode add 17e6c54 #! [euphoria-flink] Attempt fixing window leak add 6301d23 #! [euphoria-flink] Fix emiting label to windowed-pairs. add 2797df8 #! Split operator add 7d8fe1e #! commit kafka consumer offsets add 6911d5d #! Split operator add 6806616 #! post-review cleanup add 8eafa84 #! refactoring add bcfd42b #! [euphoria-flink] Add context to error message add 5a74b20 #! [euphoria-testapps] WordCloud Server/Client/Sink add 2a8eab0 #! [euphoria-flink] Initial sketch of JoinTranslator add c70789d #! [euphoria-flink] Correctly emit Pair instances out of join add ac1b01f #! add support for state backend to flink add 20cee41 #! [euphoria-flink] Handle windowed-element in join operator add ae20fb0 #! tuned stats for inmem and new windowing add 9af587e #! stats tuned on inmem for event time, latecomers and correct distinct calculation add 452ebcb #! fixed ReduceWindow operator add c372b42 #! simplified stats flow, fixed some bugs and minor refactored code and some coding style add 2c1daaf #! [euphoria-flink] implementation of ReduceStateByKey for streaming API add bb493cc #! [euphoria-flink] avoid "Invalid lambda deserialization" in ReduceByKey add 9187372 #! [euphoria-flink] RSBK closes state after flush() add 02f5071 #! [euphoria-flink] implementation of ReduceStateByKey for batch API add b527168 #! codestyle after review add 566ec66 #! [euphoria-flink] Fix NPE due to ReduceWindow add 424d9a6 #! validate that no two operators use the same sink add 021a778 #! [euphoria-flink] Fix class-cast-exception add ebadd9b #! [euphoria-flink] Have StreamingWindowedElement flow through the streaming executor add 7e4618b #! [euphoria-flink] Drop support for processing time add 74c18b2 #! [euphoria-flink] Add support for transfering window emission watermark add 9730954 #! [euphoria-flink] Add support for attached windowing to ReduceByKey add 47fe35c #! [euphoria-flink] Suppress unchecked warnings add 330cedb #! [euphoria-flink] Fix attached window emission (was too early) add 42fc757 #! [euphoria-flink] Stabilize test add 9c27bb2 #! [euphoria-flink] Fix label for time-sliding windows on flink add bf3bb19 #! [euphoria-flink] Add TODO add 05c8b8f #! [euphoria-flink] Allow tuning window emission parameters add f124c45 #! [euphoria-flink] Align flink and euphoria-core time sliding labeling add ff49355 #! [euphoria-flink] Fix streaming MapElements add e3de278 #! [euphoria-flink] Tune windowing parameters for test add 8b6cdaf #! [euphoria-flink] Descrease presure for jenkins add dddc2c4 #! [euphoria-flink] Descrease presure for jenkins add b45a436 #! [euphoria-flink] Correct test setting add 583efeb #! [euphoria-flink] Correct auto-watermark-interval setting add 0e87761 #! [euphoria-flink] Have StreamingWindowedElement flow through RSBK impl add abdc3d6 #! [euphoria-flink] Integrate attached-windowing into RSBK impl add 6371c19 #! [euphoria-flink] Handle negative watermarks add 8ed6a80 #! Move TimeInterval out of Time add 1341f56 #! Make TimeSliding using TimeInterval as a window label add 3481482 #! [euphoria-flink] WindowedElement to StreamingWindowedElement in join-translator add 0b4fccb #! [euphoria-flink] Drop native join translator (rely on RBSK) add a3e2012 #! Drop dead comments add 0a1316c #! Centralize flink version add 6dc6470 #! review add 156384a #! moved flink operator testkit to the euphoria-flink package add 718dc2e #! implemented state storage for states in inmem executor add 1f4abc9 #! implemented state storage in flink, not well tested add c28ae08 #! small polishing add b03204b #! code polishing after review add c76ca9b #! State is not required to be Serializable add d3a6853 #! [euphoria-flink] implementation of non-combining ReduceByKey for streaming API #! #! [euphoria-flink] fix failing tests #! #! [euphoria-flink] use singletonIterator add debf437 #! small formatting changes add 1d7ff50 #! refactored statestorage to work on storage descriptors add 45e4bbb #! changes after review add 6252311 #! [euphoria-flink] Upgrade flink to 1.1.2 add 0de8679 #! [euphoria-flink] Switch time and time-sliding to euphoria implementations add 8d54282 #! [euphoria-flink] Correct forwarding operator parallelism add bff1e07 #! [euphoria-testapps] Emit only top-200 words from word-count add 0fe9c46 #! [euphoria-flink] Fix memory leak on window triggers add 4a4007b #! [euphoria-flink] Attempt to fix clear-window-state leak in backend database add 5673499 #! [euphoria-core, euphoria-flink] Align trigger behavior in inmem and flink add 354d464 #! [euphoria-flink] Testify early triggering add 4d859c9 #! [euphoria-flink] Schedule window only once add 5909326 #! [euphoria-flink] Rename FlinkTrigger to FlinkWindowTrigger add 501ea01 #! [euphoria-flink] Fully integrate generic windowing add d7954f0 #! [euphoria-flink] Fix type annotation add a90b136 #! [euphoria-flink] Fix after rebase add 39d4ce2 #! [euphoria-flink] Reduce noise on unchecked warnings add 0aeb0c7 #! [euphoria-flink] Small refactoring add f6daad1 #! Stabilize flipping test add 5a6e581 #! distinct operator test from testkit moved on event time add 0519a6d #! countByKey tested by operator test in flink add 15fc9cb #! sumbykey and reducebykey on event time windows add 7ce3f6d #! tuned operator testkit for flink, passes on batch inputs add a5fe437 #! flink keys have to be comparable or exception is thrown add 8a66073 #! TimeInterval is Comparable add b356b83 #! functional all operator tests on flink add bbc299a #! changes after review add 3aed834 #! WIP: #16426 Remove GROUP from Windowing add 904312b #! [euphoria-core] Avoid needless allocation during WindowID#hashCode computation add 0d69a7f #! [euphoria-core] Make inmem RSBK handle groupless windows add 270405d #! [euphoria-operator-testkit] Remove GROUP from windowing add a684c0e #! [euphoria-core] Drop global count window test (feature discontinued) add cc06550 #! [euphoria-flink] Remove GROUP from windowing add 8d6283e #! [euphoria-flink] code style add 501ca39 #! [euphoria-core] Rename Collector -> Context add 3ef9fd2 #! [euphoria-core] Provide Context#getWindow add 8d75d32 #! [euphoria-flink] Provide Context#getWindow add bec53ba #! [euphoria-*] Drop WindowedPair add 848d7972 #! [euphoria-*] Avoid using the term "windowed pair" add 703c468 #! [euphoria-flink] Fix windowing for batched based R(S)BK translators add ca9058e #! forward stamp with each element in inmem executor add 2576b05 #! [eurphoria-core] Added tests for earlytriggered session windowing, fixed functionality add f047612 #! [euphoria-core] FIXME: overridden time windowing for element-time add 9eca220 #! Passing element time within pipelines in inmem executor add ca090b1 #! [euphoria-ios] added IOS application module add 4e91d49 #! [euphoria-ios] refactored module structure, separated server from flows add 233747b #! [euphoria-ios] added core for demonstration of lambda architecture add cebf6a5 #! [euphoria-ios review] removed several FIXMEs added test for TimeSliding windowing, correct passing of watermarks between operators add cef5913 #! Trigger API redesigned add b90cdaa #! [euphoria-inmem] ReduceStateByKey against new trigger api (merging-windows not yet supported). add 13c696a #! [euphoria-inmem] Implement MergingWindowing support add 1003302 #! [euphoria-inmem] Enable sort-state test add 833dd1e #! [euphoria-inmem] Attempt to fix fliping test add df9a219 #! [euphoria-inmem] Make Windowing#trigger not return null add 6f62b46 #! [euphoria-flink] Executor uses new Trigger API add 4f9fb87 #! [euphoria-flink] Minor cleanup add 360059f #! [euphoria-ios] Get compilation right add 01a0d1c #! [euphoria-flink] Forward element timestamp add 2e46b80 #! [euphoria-inmem] Fix trigger state merging add da4480d #! [euphoria-inmem] Create a new instance of trigger state during merge add 62a0881 #! [euphoria-core] PeriodicTimeTrigger is aligned with window start timestamp add a31bc11 #! [euphoria-core] Fixed timer registration in PeriodicTimeTrigger add c7aac8a #! [euphoria-core] Drop logging in periodic-time-triggering add 5c47b88 #! [euphoria-inmem] Ensure calling onElement on merged windows add 89dc77f #! [euphoria-core] added serializable Supplier #! [euphoria-hadoop] added DataSourceInputFormat #! [euphoria-kafka] tuned KafkaSource to be able to read whole partition add eee34a7 #! [euphoria-kafka], [euphoria-core], [euphoria-hadoop] changed life cycle of writer object, added flush method, some code polishing add 2b7ead6 #! [euphoria-ios] review and tuning add 43f60e6 #! [euphoria-kafka] renamed all euphoria kafka artifact references to euphoria-kafka_0.10 add 26ffb3b #! Upgrade to Flink 1.1.3 add fc618ce #! [euphodia-ios] remove the module from parent pom add cb635d4 #! [euphoria-flink] RBK: Support for merging windows (streaming) add c0d0381 #! [euphoria-flink] RSBK: Verify correct behaviour during merging-windowing (streaming) add d984b5a #! [euphoria-core] Require MergingWindowing#W being Comparable add d89d3e6 #! [euphoria-hadoop] Fix TaskID retrieval from Hadoop context add e874a3e #! [euphoria-core] correct discarding of latecomers add 07321fd #! [euphoria-flink] Code style; apply diamond operator add 2a5fb7e #! [euphoria-flink] Fix non-combining RBK on bounded input add 5f35abe #! [euphoria-core] fixed latecomers - review add 87b3f48 #! small fixes add 99ede44 #! [euphoria-hadoop] DataSourceInputFormat/DataSinkOutputFormat don't operate with Pair anymore add a4c29b9 #! [euphoria-spark] Spark executor implementation for bounded datasets add 87341d0 #! [euphoria-core] Add operator type annotations add 0f08270 #! [euphoria-core] state complexity and number of repartitions in operator annotations add c3f221e #! [euphoria-ios] added module for command line tools add 6438437 #! [euphoria-ios] added description of lambda and kappa architecture, tuned applications add cdcac6d #! [euphoria-ios] added support for spark, finished presentation add 71304b5 #! [euphoria-ios] performance tuning of Trends application add b137d93 #! [euphoria-ios] slightly optimized spark RSBK, IOS presentation add cd5c5f2 #! [euphoria-ios] rebased on master add ae2b8aa #! [euphoria-ios] review and removed duplicate code add 5b2ea40 #! [euphoria-flink] Support window merging in batch mode add a97dfe8 #! [euphoria-core/flink] Align element timestamp with window emission add fa9fef8 #! flink batch repartition + repartition batch tests add 205e452 #! partitioning with default partitioner add b7c09b8 #! Executor API add 10fab3a #! inmem and flink executor implementation add 85c8ab3 #! spark executor add 0734ea8 #! cleaning add 964852c #! DefaultPartitioner as its own type add d9905e7 #! [euphoria-core] Required explicit windowing if not joining batches add 7fb9f59 #! [euphoria-flink] Fix logic in evaluating RBK translation add 1ca7299 #! [euphoria-core] Make WindowingRequiredException a top-level class for re-use purposes. add ce923ba #! [euphoria-core] Javadoc; Remove reference to seznam internal ticketing system add a3fced1 #! [euphoria-core] Javadoc; Make promise about failing upon #preTranslateValidation add b9bf292 #! Event time extractor function at operator level add aaff007 #! minor refactoring after review add 49b7d5d #! [euphoria-testkit] Demo testkit junit integration add 66d0525 #! [euphoria-testkit] Processing annotation add 75d07ab #! [euphoria-testkit] Add more tests to demo testkit add babd2c0 #! [euphoria-flink] ModuloSplitAssigner for testkit add 5699b1b #! [euphoria-testkit] Use NG jUnit runner add 6c0c138 #! Spark executor - full support of ReduceByKey/ReduceStateByKey including merging windows add f24c6b0 #! Remove GroupBy operator add d39a4d7 #! Avoid flink stream hanging upon cancellation add 6e7e4c7 #! [euphoria-spark] Fix partitioner when partitionId is negative add c9aa6fc #! TimeInterval windows are right-open intervals (not overlapping anymore) add 9a3ff8d #! [euphoria-hadoop] Remove MultiReader from HadoopDataSource add ad71209 #! [euphoria-hadoop] Remove SerializableWritable from public constructor add 08bdd5f #! [euphoria-flink] Use LocatableInputSplitAssigner for batch inputs add 7fa20ef #! README.md proposal add 1f2baeb #! Prevent windowing with zero duration add d03bdac #! Drop KafkaSource#batchSize #! #! The same effect is achievable through KafkaConsumer's paremeter 'fetch.max.wait.ms'. add 5a43174 #! Provide easy-to-use hadoop based data-source/-sinks add 9ffc893 #! Update README add 1333607 #! Fix few TODOs add c57d430 #! Add convenience hadoop data sink around text files add e7f6ca4 #! Provide simple-hadoop-text-file-data-source add 972253f #! Javadoc add cc44142 #! Drop "Data" from the name of hadoop data-sources/-sinks add 79a276f #! Imperative to functional style add 901f647 #! Extract inmem executor into a dedicated module add 5900d82 #! Drop unneccessary dependency on commons-io add 166303f #! Upgrade to guava 21.0 add dcdade7 #! [euphoria-testapps] Resolve conflict on kryo add 773e47e #! [euphoria-flink] Use key type Tuple2 instead of ComparablePair (performance tuning) add db62613 #! benchmarks unification add c748cd4 #! Add LICENSE (APLv2.0) add ba95de7 #! Ensure LICENSE/NOTICE files in produced artifacts/jars add 60b8cf9 #! Drop guava shading add ee587c6 #! Move euphoria-testapps to a dedicated, top-level repo add 27f5cf9 #! Remove obsolete dependency definitions add dfd9fff #! Upgrade maven jar plugin; Cleanup debian package dependencies #! #! Conflicts: #! debian/control add e7da8f6 #! Polish README add 2f6e81d #! Get rid of szn specific stuff add f3ed5e3 #! Integrate licensing headers mechanism add 10893e6 #! Apply license headers add adfc94c #! Update new SCM information; Drop obsolete SZN specifics add 40ba2a1 #! Support custom artifact deployments add 2d90aee #! Correct spelling add 0c7154b Merge pull request #1 from seznam/pete/readme-fixes add cb0740e #! [euphoria-kafka] Properly quit read loop when interrupted add 227403c Merge pull request #2 from seznam/pete/clean-flink-source-exit add e651689 #! Correct name of copyright owner add 33a4867 Merge pull request #4 from seznam/pete/correct-copyright-owner add 9736015 #! Temporarily remove documentation section add b064a21 [WIP] Prepare maven central deploy (#3) add 4999dbb #! Link documentation from within README add cc71fc1 #! Add self-contained euphoria-examples module for demoing purposes add c4be84b #! Add link to examples add 6688d0b Merge pull request #5 from seznam/pete/examples add 8b62e64 WIP: Integration with travis-ci.org (#6) add 0fc7298 #! [euphoria-spark] Upgrade to Spark 2.1.0 add 978660b Merge pull request #7 from seznam/vanekjar/UpgradeSpark add d67c411 #! Add Travis CI badge into README add 780af68 #! Drop obsolete "hudson" profiles add cab4b55 #! Cleanup obsolete gitignore patterns add 3e6fc93 #! Drop obsolete class add de0e610 #! [euphoria-core] Cleanup inmem specific classes add 86b188d #! Sanitze javadocs add 6d58a63 #! Drop obsolete class add e9d7a16 Merge pull request #15 from seznam/pete/small-cleanups add ec92993 #16 Replace Dataset#getPartitioning() with Dataset#getNumPartitions() add f133030 #16 Move Partitioning related classes to a dedicated package add f32ba6f Merge pull request #17 from seznam/pete/16/dataset-getpartitioning add b90d0db #! Attempt automatic deployments add 907a5f2 #! Exclude continuous-deliver folder from being license validated add 5511dc3 #! Set execution flag on deploy scripts add 30c88c4 #! Add missing <name/> <description/> add 766ed99 [maven-release-plugin] prepare release v0.5.0 add aff7e91 [maven-release-plugin] prepare for next development iteration add 5c465dc #! Avoid running tests twice add 14e664d #! Mention maven dependencies in README.md add 0c6b4e5 Merge pull request #22 from seznam/vanekjar/ReadmeMaven add 8a93f65 #8 Suppress safe unchecked warnings add 75ecc18 #! Rename StorageDescriptorBase to StorageDescriptor add 73795eb #18 Fix a few minor bugs after static code analysis add 0a2a2bc #18 Fail build when troubling error is found by FindBugs analysis add b490329 #18 Use @Nullable annotation add 45c4ad1 Merge pull request #26 from seznam/vanekjar/18/FindBugs add 35e03e7 #10 Improve documentation around URI based data-sources/-sinks add c6d6e9c #10 Fix typos add f7ffbdb Merge pull request #28 from seznam/pete/10/uri-docs add 779250b #! Add contribution section to README add ca7a0ef #! [euphoria-flink] Allow enabling object reuse add 0677e3c #48 Move most maven plugins under the "regular-build" profile (active by default) add 6928cfc #! Document regular-build profile add efa9b54 #27 [euphoria-flink] Rewrite windowing to native implementation of StreamOperator add bbd4d21 #! [euphoria-flink] Avoid extra shuffle when windowing on streaming add 79aaef3 #47 [euphoria-flink] Alternatively execute windowing/valueOf fully after shuffle add 84b87cb #! [euphoria-flink] Allow specifying latency tracking interval add 4ffdcfc #! Make WindowedElement an interface add de4a17c #! Drop WindowedElementImpl from euphoria-core add 5f6db17 #! Make window-element-factory use-case specific add 676e3b5 Merge pull request #56 from seznam/vanekjar/WindowedElement add 4d70cf7 #! [euphoria-kafka] No sync commit add 1ccfc47 Merge pull request #58 from seznam/pete/no-sync-commit add f16c9ea #! Add link to gitter chat add cef6f50 #14 [euphoria-flink] Don't send timestamp along with each element. Use rather internal Flink record's timestamp. add 640cf5e #14 review cleanup add 6817bfa #14 [euphoria-flink] Allow WindowAssigner operator chaining add 10132dd Merge pull request #59 from seznam/vanekjar/FlinkRemoveTimestamp add c66bb97 #60 Prefer ValueStorage instead of ListStorage for combining RSBK operations add 297f803 #! Register Either for serialization add 93760b6 #! Suppress safe casts add 4f5adee #! Add a dedicated interface for event-time extraction to reduce auto(-un)-boxing add fa21417 #! Register Either for serialization add eff1d55 #! Register Triple and clean up in TopByKey add ed0ccfe #47 Windowing#assignWindowsToElement returns Iterable instead of Set add 75f0aa0 #47 [euphoria-core] TimeSliding window assigner generates custom SlidingWindowSet (smaller serialized size) add 5e6373a Merge pull request #66 from seznam/vanekjar/SlidingWindowSet add e029705 #! Drop Supplier from public API add fdfe937 #! Make storage descriptors static add 17af93b #! [euphoria-flink] Do not cache states add 2dd9b87 #67 [euphoria-flink] Avoid descriptors cache infinitely growing add bd40432 #67 [euphoria-flink] Avoid flushing empty states due to "localMode" add d307ab8 #67 [euphoria-flink] Fix window merging add 6828c12 #67 [euphoria-flink] Avoid inlining processTriggerResult add 4eac579 Merge pull request #69 from seznam/pete/experimental-state-descriptors add 2ffc124 #! Include link to FAQ wiki page add 8a73616 #! Add shaded-guava for internal use within euphoria add 43787e1 #! Add javadoc generation add 81a35f5 Merge pull request #75 from seznam/pete/guava-shaded add 4778592 #! Switch over to shaded guava add 5b164dc Merge pull request #76 from seznam/pete/use-shaded-guava add ecd595f #51 Do _not_ store storage-provider in states by default add 435f08d #51 Move StateFactory to the state package add 0a4f48d #51 StateFactory interface revised add 2220654 #51 Replace StateCombiner with StateMerger add e65cb53 #51 Drop obsolete TODO add 60ca092 #51 [euphoria-core] Skip processing empty window merge sets add 0139963 Merge pull request #71 from seznam/pete/state-combiner add ffd9c23 #19 [euphoria-flink] Avoid extra shuffle (on the batch executor) add 00a2ffa # [euphoria-flink] Fix trigger state clean-up of merged windows add 426dae0 #! [euphoria-examples] Example of web server log aggregation add 53459ab #! [euphoria-examples] Fix license header add 1293823 Merge pull request #80 from seznam/vanekjar/ExampleAccessLog add 542f3c6 #61 [euphoria-flink] Unit test covering out-of-order stream with allowed lateness add 59b0679 Merge pull request #81 from seznam/vanekjar/61/AllowedLateness add 527e77a #79 [euphoria-core] Trigger#onMerge does not return TriggerResult add 1b106fa Merge pull request #82 from seznam/79/MergingWindowingBug add 6d98a1f #! [euphoria-flink] Warn about failing execution scenario add 17ed906 #! InputSplit#toString - especially useful on spark add 9749e88 #! Add convenience hadoop sink add 511bc56 #! Generalize HadoopStringSink to accept any type of object add 02cd5d2 Merge pull request #83 from seznam/pete/hadoop-string-sink add 67ff5bb #! Update copyright add a6a2a93 #85 Move findbugs plugin execution to the process-classes phase add ce8b2f0 Merge pull request #87 from seznam/pete/findbugs-stabilization add 8b89901 #77 Import trends benchmarks add 98c267f #77 Drop obsolete shell script add 3295733 #77 - parsing fix add 0fddf45 Merge pull request #88 from seznam/pete/import-benmarks add 8c5ac04 #! Variable year in license header add 774b38f Merge pull request #94 from seznam/pete/90/license-headers add 87eaeff #! [euphoria-core] Avoid clearing count state twice add 5d05588 #! Fix typo add 0eebf25 #95 Rename Batch to GlobalWindowing add fbb6106 #! Drop Map.Entry from Pair add 39100e7 #! Add @Experimental for easier API evolution add 8344061 Merge pull request #102 from seznam/pete/experimental-annotation add 2d75c5f #21 [euphoria-core] Code/Javadoc style add 9de663c #21 [euphoria-core] Javadocs for FlatMap add 8c851f1 #21 [euphoria-core] Javadocs for Union add 204bf6c Merge pull request #103 from seznam/pete/javadocs add 3d5fd30 #99 Sort operator support add 6c38260 #21 [euphoria-core] Javadocs for Repartition add 6d1a531 #21 [euphoria-core] Javadocs for ReduceStateByKey add 99b54bf Merge pull request #107 from seznam/pete/javadocs add 10ba50f #! Add contact information to README.md add 1299b31a Update README.md add e84570d Update README.md add 69fd623 Merge pull request #104 from seznam/vanekjar/contacts add 6097d238 #! Remove obsolete class add 605ecd7 #! Do not allow derivations from Pair/Triple add e1bf106 Merge pull request #108 from seznam/pete/cleanup add ea88f76 #98 [euphoria-flink] Do not allow object re-use add dc80db9 Merge pull request #110 from seznam/pete/98/force-object-reuse add e09f9ec #! - javadoc refactoring add eb078b0 #! some corrections/formatting add 2fdffd3 Merge pull request #109 from seznam/adam/doc add 7f0da3e #13 [euphoria-flink] Batch executor uses hash code as a key in shuffles (IntComparator performs much better) add 2097155 #13 [euphoria-flink] Fix bug in batch ReduceByKeyTranslator and add unit test add afab7f1 #13 Fix race condition in batch ReduceStateByKeyTranslator add 1d256b7 #13 [euphoria-flink] Copy input instance in ReduceByKeyTranslator because of Flink's object reuse add 26bc1ff #13 [euphoria-flink] Avoid hash code collisions in batch ReduceByKeyTranslator add 0d8a615 Merge pull request #112 from seznam/vanekjar/13/FlinkBatchTuning add 6c12d03 #! [benchmarks/native-flink] Filter out invalid entries add 6cb3bc3 #! Prevent deleting wrong timers add 809a8ad Merge pull request #116 from seznam/pete/trigger-deletion add a611399 #! Upgrade to flink 1.2.1 add e76b8e9 Merge pull request #115 from seznam/pete/flink-1.2.1 add 762cb18 #! polish: removed unnecessary null check, variable reuse add 791a6ea Merge pull request #117 from seznam/minor/code-cleanup add 56a1c90 #105 Add (failing) proof-of-concept test add b18b9f4 #105 Rework StateFactory API; Stabilize JoinState implementation add 6ade761 #43 Annotate experimental Session#earlyTriggering add 1447b02 #105 Do not read entire disk storage into memory add 22e8042 #105 Provide an experimental "early emitting" join state implementation add aaa00af #105 Simplify closing spilling file add e8f3d3b #105 Document some more experiment dangers add b78c1a5 #105 Add reference to future solution add 13ee79d Merge pull request #114 from seznam/pete/105/state-early-emitting add 09c7e86 #! Prepare for 0.6.0 release add 9f9d9b6 [maven-release-plugin] prepare release v0.6.0 add 30c8174 [maven-release-plugin] prepare for next development iteration add 03cdd80 #! Prepare for next dev iteration on master add b5ba62c #! Update README regarding new release add c2a5046 #! Fix loading configuration add a430b5a #! [euphoria-examples] Explain in details the word-count-example add 6604ba4 #! [euphoria-examples] Explain in details the access-log-count add 83c3bfc #! [euphoria-examples] Correct typos add 8f3fa87 Merge pull request #123 from seznam/pete/explain-examples add 9815212 #! [euphoria-flink] Stabilize test add 6fcbad8 #! Stabilize sort-test add 8f578d6 #! Stabilize count-by-key-test add 11c9e17 Merge pull request #125 from seznam/pete/stabilize-sort-test add 79e67dd #119 [euphoria-core/-inmem] Rework event time assignment add f3ae227 #119 [euphoria-flink] Rework event time assignment add 2ca6a04 #119 [euphoria-spark] Rework event time assignment add 0a252bb #119 Add missing license headers add be96f4d #119 [euphoria-examples] Rework event time assignment add a38914d #119 [euphoria-benchmarks] Rework event time assignment add 82bb6bf #! Stabilize inmem-executor join test add 35a07e9 #121 Allow multiple elements to be emitter from ReduceByKey add 0c331f2 #121 changes requested by review add 7f75067 #121 fixed comment add bb11dd7 Merge pull request #126 from seznam/je-ik/121/multiple-elements-from-reduce-by-key add c219da3 #113 [euphoria-spark] Implement disk splitting list-storage implementation add e6adc6e #113 [euphoria-flink] Unify disk spilling implementation for list-storage add 5cb62b1 #113 Add missing license headers add 340aa13 #113 [euphoria-spark] Drop obsolete warning suppression add 3c496e5 #113 [euphoria-testkit] Enable accidently disabled RBK tests add 8d93c87 #113 [euphoria-core] Support try-with-resources for Serializer.Output/InputStream add 4cdbc97 #113 [euphoria-testkit] Allow different local spill file allocation strategies add 276227f #113 [euphoria-flink] Support a wider area of types during (de-)serialization in list-storage add 5eda49a #113 [euphoria-core] Testify FsSpillingListStorage add d4040ed #113 Add missing license header add 0d4edf0 Merge pull request #130 from seznam/pete/113/list-storage add 0effeed #31 [euphoria-core] Implementation of accumulator API + integration with Flink executor add a5c3433 #31 Refactored according to review feedback add 0289e01 Merge pull request #132 from seznam/vanekjar/31/Accumulators add 9c7fb22 #133 [euphoria-spark] Accumulator API supported in Spark executor add 87597c6 #133 [euphoria-inmem] Accumulator API supported in in-mem executor add a936057 #133 [euphoria-spark] Collector should be transient in UnaryFunctorWrapper add 6c9b9ad #135 Add SingleJvmAccumulatorFactory add 548d55f #135 Demostrates usage of accumulators validation in operator testkit add 0b6c313 #135 Fix histogram accumulation add 90ef146 #135 GetSnapshot -> Snapshotable add 0ee4fea #135 Add tests covering accumulator usage add c9a9a86 #135 Fix failing tests on the spark executor add 85553f2 Merge pull request #138 from seznam/pete/135/unit-testing-accs add f953103 #134 [euphoria-spark] Implemented support for Spark native accumulators add b1936c8 #134 [euphoria-core] Fix misleading log warning in VoidAccumulatorProvider add 33b6f64 #134 [euphoria-spark] Clone accumulator factory before flow execution add 0049bb3 #134 [euphoria-spark] Make SparkAccumulatorHolder thread-safe add fd1984a Merge pull request #139 from seznam/vanekjar/134/SparkAccumulators add c9ae38b [maven-release-plugin] prepare release v0.7.0 add 1685e1d [maven-release-plugin] prepare for next development iteration add aadf60a #! Version up add 71a1263 #! Fix Javadoc warnings add 212193c #! Fix Findbugs warnings add 8ad7530 #! [euphoria-spark] Correctly transfer global state to executed UDFs add 76521b8 Merge pull request #142 from seznam/pete/spark-task-context add 2d08b0f #! Pete dropping out add d68cbe1 [maven-release-plugin] prepare release v0.7.1 add e54ba2f [maven-release-plugin] prepare for next development iteration add 836cc39 [euphoria-spark] Propagate exception in SparkFlowTranslator add f961533 Merge pull request #145 from seznam/spark_translator add 4e64fb7 [euphoria-hadoop] fix SequenceFileSource add debdb05 Merge pull request #146 from seznam/sequence_file_source add 1c4f438 [euphoria-hadoop] wrap hadoop config in SequenceFileSource, so it cannot be changed by user later on. add 29b7685 Merge pull request #149 from seznam/sequence_wrap_config add 9072662 [euphoria-core] Remove IORegistry. add 33c259b Merge pull request #148 from seznam/io_registry_removal add 1052109 [euphoria] add links to license-header.txt from subprojects add 9305d85 [euphoria] exclude license-header.txt itself from the license header check add 0fbac5a Merge pull request #166 from seznam/format-licenses add c2cefb4 [euphoria-flink] #159 fix default parallelism in local flink runner to 4 add d5048ab Merge pull request #163 from seznam/159-fix-parallelism-in-local-flink add 69554f0 add support for Join operator hints add 8bee533 Merge pull request #154 from seznam/hint_support add 9ba6e72 [euphoria-core] #160 remove partitioning from stateful operators, bump version to 0.8-SNAPSHOT add 3850a04 [euphoria-core] #160 drop explicit partitions from ListDataSink add cea1306 [euphoria-operator-testkit] #160 compilable testkit after partitioning removal add b381372 [euphoria-kafka] #160 module compilable after changes add 6348813 [euphoria-hadoop] #160 module compilable after changes add 2c6bbd4 [euphoria-examples] #160 module compilable after changes add ab796b3 [euphoria-flink] #160 module compilable after changes add 7b8e28a [euphoria-fluent] #160 module compilable after change add a19b500 [euphoria-core] #160 removed partitioning and repartition operator add c81dada [euphoria-inmem] #160 compilable, but with failing tests add 992254d [euphoria-inmem] #160 more tests working after code change add f94b1ae [euphoria-inmem] #160 build passing tests after changes add 15b653f [euphoria-spark], [euphoria-flink] #160 modules compilable after partitioning removal, still some tests failing add b4b18a4 [euphoria] #160 build passing including tests add 18b45bb [euphoria] #160 remove mentions of partitions where no longer makes sense add e53e7f2 Merge pull request #164 from seznam/160-drop-explicit-partitioning add 043632c [euphoria-hadoop] remove sneakythrows add d08a157 Merge pull request #168 from seznam/remove-sneaky-throws add 089d930 [euphoria-kafka] remove groupid from kafkasource add 5fe9bbc Merge pull request #169 from seznam/remove-groupid-from-kafka-source add fb1896e [euphoria-benchmarks] make benchmarks part of the build add 717b6ba [euphoria-operator-testkit] activate mistakenly ignored test add 93a76d5 Merge pull request #172 from seznam/active-mistakenly-removed-test add 30afe52 [euphoria-core] add Audience annotation add bcfad9f Merge pull request #176 from seznam/add-interface-audience-annotations add 48d621e [euphoria-core] remove checkpointing from datasets - unusable feature add 232382e Merge pull request #179 from seznam/remove-checkpoints-from-api add c62d893 added IOUtils to help iterate over methods throwing IOException add 603c524 added license add 03e058f Merge pull request #183 from seznam/simunek/IOUtils add cfa0508 [euphoria-core] #158 add `withSortedValues` to `ReduceByKey` operator add e50fe0c [euphoria-core] #158 basic non configurable implementation of value sorting add d1e5d58 [euphoria-core] #158 add StateContext and validate on inmem executor add 07428f9 [euphoria] #158 implemented external sorter for flink and spark add 16daaee Merge pull request #171 from seznam/158-extend-reduce-by-key-with-value-sorting add 417207e [euphoria-core] #157 implement possibility for DataSink to modify output flow before persisting it add d0e6763 [euphoria-core] #157 review add b850039 Merge pull request #180 from seznam/157-enable-outputs-to-modify-flow add c1a6202 [euphoria-local] #173 changed InMemExecutor to LocalExecutor add 1828811 Merge pull request #182 from seznam/173-rename-inmem-executor-to-local-executor add b926e82 [euphoria-core] #177 added MultiDataSink add c25462b [euphoria-core] #177 MultiDataSink renamed vars add e7b99ec Merge pull request #184 from seznam/177-MultiDataSink add b48ef69 Move to gradle. add 2c8707d Merge pull request #178 from seznam/move_to_gradle add 707ce57 Add euphoria-examples module to gradle add 9514cfe Merge pull request #185 from seznam/gradle_add_examples add 40c1fb2 [euphoria] add maxTimestamp to generic Window add e083802 Merge pull request #187 from seznam/add-max-timestamp-to-window add f91ccfc Do not ignore spotbugs failures. add d8a2033 [euphoria-local] fix findbug warning regarding random reuse add db942f4 Merge pull request #189 from seznam/fix-findbugs-random-issue add 2982b1f Merge pull request #186 from seznam/findbugs_ignore_failure_false add 41a68ab [euphoria] #156 distinguish batch and stream sources add 4467169 [euphoria-core] #156 Add split to boundedsource add edc4400 Merge pull request #174 from seznam/156-distinguish-batch-and-stream-inputs add fd7a1f6 [euphoria-core] #161 replace Iterable with Stream in reducing operations add 482c5af Merge pull request #188 from seznam/161-change-iterable-to-stream-in-reducing-operations add d94bfb8 [euphoria-local] fix non deterministic test add 0f07d9a Merge pull request #193 from seznam/fix-non-determinstic-test-in-local-executor add 4917835 Fix javadoc. add f1ce5c8 Shade guava add 32c5317 Merge pull request #197 from seznam/dejv/guava add af1b452 [euphoria-core] DataSinkWrapper is now Serializable add d6c3e36 Merge pull request #196 from seznam/MultiDataSinkFix add df4e3d2 Fix shadow jar publishing. add 358aa6e Merge pull request #198 from seznam/fix_guava_publish add 22c3929 Fix guava add 3688ae0 Merge pull request #199 from seznam/guava_fix add 432afba [euphoria-build] remove unused protobuf plugin add c526a64 Merge pull request #200 from seznam/remove-protobuf-plugin add 4b87f2b [euphoria-core] bugfix building of RBK with no windowing add 0d7f6fa Merge pull request #202 from seznam/fix-value-sorting-builder add d1b0cc6 [euphoria-hbase] #181 add HBase module add e2f025e #181 Code review. add d04890e [euphoria] add compileOnly to testCompile add 16d4a88 Merge pull request #203 from seznam/181-add-hbase-module add 0c06e1a Update readme. add ae9af15 Merge pull request #208 from seznam/update_readme add ab11d8f [euphoria-operator-testkit] Reduce by key bounded parallel test. add ab4b713 [euphoria-operator-testkit] Code review. add c3fa0f7 Merge pull request #209 from seznam/reduce_by_key_test add 3d12e34 [euphoria-core] Union can accept more than two data sets add a5b3bfe Merge pull request #207 from seznam/multi_union add 2514c82 [euphoria-core] Join operator API improvements. add 3a7ff9e [euphoria-core] Join operator hint tests. add b887414 [euphoria-core] Join operator hint tests - equals, hash code. add 1e543df [euphoria-core] Join operator. Cleanup. add 95bded3 [euphoria-core] Code review. add 09bc144 Merge pull request #206 from seznam/join_api add 95c59da [euphoria-hbase] #181 add bulk loading to hbase sink add 5e1fca2 Merge pull request #205 from seznam/181-add-bulk-loading-to-sink add 5844a94 [euphoria-spark] broadcast join. add 5cdda2a [euphoria-spark] broadcast join code review. add 97d8881 Merge pull request #151 from seznam/spark_join add eecc976 [euphoria-hadoop] wrapping hadoopConfig in SequenceFileSink add c3632b5 Merge pull request #215 from seznam/simunek/fixSequenceFileSink add 20c66b6 [euphoria-core] Publish test jar. add 31de6e4 Merge pull request #217 from seznam/core_test_publish add 660aaaa Added outputValues() to operators producing pairs add 8c1f2c5 Updated tests for outputValues add 898ba7e [euphoria-core] Test ouputValues on all executors. add 024bc67 Merge pull request #218 from seznam/tnovak/output-values add 06e85ae [euphoria-core] make sure that windowBy() can be appliedIf() add d22155e Merge pull request #211 from seznam/ensure-window-by-can-be-applied-if add f7e76e8 [euphoria-hbase] HFileSink uses raw types add af0f7e4 Merge pull request #212 from seznam/hfiles-sink-uses-raw-cells add 1ebf2a6 Fix javadoc. add 14208bd [euphoria-hbase] add windowing to hfilesink add 47eca16 Merge pull request #223 from seznam/add-windowing-to-hfilesink add d229d80 [euphoria-flink] move to flink 1.4 add fc593a7 Merge pull request #221 from seznam/move-to-flink-1.4 add 9b1114b [euphoria-core] Optimize ReduceWindow operator for attached windowing add c760612 Merge pull request #224 from seznam/reduce-window-optimization add ac5a3e2 [euphoria-hadoop] add failing test case add 317304c [euphoria-hadoop] Refactoring, tests and fixes. add ff99f52 [euphoria-hadoop] Check output specs during HadoopSink initialization. add 69bbe2c [euphoria-hadoop] Update exception and hadoop utils. add cf3572a [euphoria-sink] Fix test. add ea4a7cb [euphoria-hadoop] Test DataSinkOutputFormat. add 4a3f081 [euphoria-hadoop] Make sure initialize is called only once. add 97335c0 [euphoria-hadoop] Make sure initialize is called exactly once. add 4ae2943 [euphoria-hadoop] Code review. add 2ad1d5d [euphoria-hadoop] Code review. add 69cb870 Merge pull request #219 from seznam/hadoop_tuning add bbdaa53 Bump gradle version add f22ba90 Merge pull request #227 from seznam/update_gradle add 998fa76 [euphoria-core] remove getDefaultParallelism from BoundedDataSource add a3a5567 Merge pull request #229 from seznam/remove-default-parallelism-from-bounded-source add f465a95 [euphoria-testing] Init. add 1761692 [euphoria-testing] Add comments. add 9c3c267 [euphoria-testing] Code review. add c7e8811 Merge pull request #225 from seznam/testing add 6f1ecef [euphoria-core] performance tuning add f984791 [euphoria-core] add test for applyIfNot add 7a7d277 Merge pull request #230 from seznam/core-performance-tuning add a615f21 [euphoria-hadoop] small fixes add 8de6852 Merge pull request #231 from seznam/hadoop-tuning add ef6c7de [euphoria-hbase] fix bulkloading add d5dba9b Merge pull request #235 from seznam/fix-bulkloading add df6586a [euphoria-flink] register common classes by default add ba1c93f Merge pull request #233 from seznam/flink-tuning add 3579423 [euphoria-spark] register default classes add 5052eae [euphoria-spark] Introduce executor builder. add d89652e [euphoria-spark] Simplify. add 963ffeb [euphoria-spark] fix build add 5641086 Merge pull request #234 from seznam/register-spark-classes add a4bdf4f Update README.md add 2cd4bc9 Merge pull request #236 from seznam/Remove-maven-as-dependency-for-building add 5355195 [euphoria-spark] Add default parallelism to local mode. add 579af93 Merge pull request #239 from seznam/spark_executor_local_default add 4461aa0 [euphoria-spark] Add hash map to default classes for kryo. add 5a6c4d8 Merge pull request #238 from seznam/spark_default_classes add 898dc34 [euphoria-core] #21 add builder javadocs to operators add c3521e0 Merge pull request #237 from seznam/add-docs add 76c4b9e [euphoria-core] Fix javadoc. add 4646e89 [euphoria-hadoop] InputSplit doesn't have to be Writable add 7bc421b Merge pull request #240 from seznam/fix-hadoop-split add 5751348 [euphoria-examples] add hfileloader add 3bc9071 [euphoria-examples] Code review add b90ea30 Merge pull request #232 from seznam/add-hfile-loading-example add ed0d1c5 Happy new year!! add c40db81 Merge pull request #241 from seznam/new_year add 31cef95 [euphoria-hadoop] SequenceFileSink builder add 60eb158 [euphoria-hadoop] SequenceFileSink builder refactor add 760f872 [euphoria-hadoop] sequencefilesink builder consistent with other builders" add 2108985 Merge pull request #248 from seznam/SeqBuilder2 add e76cb70 added api example add 3ed0efa Merge pull request #244 from seznam/SeqBuilder add 9018db0 [euphoria] fix javadoc and unchecked warnings add 1fbb5d3 Merge pull request #250 from seznam/fix-warnings add a35c2f8 [thirdparty-guava] use shaded jar with shadow classifier add 58fc9af Merge pull request #249 from seznam/use-unshaded-classifier-for-guava add 737967f [euphoria-build] add maven build for releasing add a05ff29 Merge pull request #253 from seznam/release add 632cac6 [euphoria-hadoop] fix build add c552c30 Merge pull request #254 from seznam/fix-build add 83eaf7b [euphoria-hbase] make sure hfiles have correct permissions before bulkloading. add f668133 Hbase bulk load add ALL permissions for Hbase user add 5d2f371 Merge pull request #251 from seznam/hfilesink_permissions add 258fdc6 [euphoria-flink] flink register classes with serializers add fd674d8 Merge pull request #257 from seznam/simunek/flinkSerializer add 515ec91 [euphoria-examples] better exception handling in SimpleWordCount and README.md add 7fd1eac check kafka partitions availability add 4dd6488 Check if leader is available in KafkaSource add ec6005b Correct indentation add 7b4e766 Test KafkaSource reaction to no consumer partitions add 895e8ba add licence to KafkaSourceTest add a02dd0d Add tests in KafkaSourceTest add fb675a0 Add tests in KafkaSourceTest 2 add 57eb296 Fix KafkaSourceTest add f543c83 Merge pull request #265 from seznam/slechta/issue-262 add 48d9b6a [euphoria-flink] #260 Flink - broadcast hash join add f84b9b8 [euphoria-flink] #260 reformatting and corrections add 2ef9f50 [euphoria-flink] #260 small changes add bb9e81f Merge pull request #264 from seznam/simunek/260/flinkBroadcastHashJoin add 3d82b37 Upgrade kafka to 1.0.0 add 6771298 Merge pull request #267 from seznam/upgrade_kafka add 56f1cfa javadoc fixes add eceb803 Merge pull request #271 from seznam/simunek/corrections add 9d60ce8 [euphoria-spark] #243 RDD are cached when used more than once in flow add 5e132c0 Merge pull request #272 from seznam/simunek/spark-caching-result add 817a4ab [euphoria-core] #259 Hints are not runtime specific. Hints describe OutputDataset add e4f0df5 [euphoria-core] #259 Hints are now in operator, not Dataset add 5a67abc Merge pull request #268 from seznam/simunek/259/hintsUnified add aaa2ff9 broadcastHashJoin fix add 7ef7fe1 broadcastHashJoin fix - util class renamed add 78d037b Merge pull request #274 from seznam/simunek/broadcastHashJoinFix add a59d0ae AVRO read example add 8bc5abd sq add 61d604b Merge pull request #269 from seznam/babu/avro-read-example add 038d4cb Fix code in README.md add 2b85f94 Merge pull request #276 from seznam/275-fix-readme.md add c299b08 Merge branch 'master' into tune-readme add 0556336 Merge pull request #277 from seznam/tune-readme add 487779f [euphoria-spark] Optimize kryo serialization. add 61c0eac [euphoria-spark] Singleton serializer test. add 06bff6d [euphoria-spark] Synchronize singleton serializer. add 6779a5d Merge pull request #279 from seznam/dejv/kryo_serialization add 1374328 Add support for expensive computation hint. add e3cffc6 [euphoria-spark] Fix RDDCaching test. add 94f4949 Merge branch 'dejv/computation_hint' add d3b1df4 [euphoria-spark] Improved RBK translation. add 2c14733 [euphoria-spark] Fix cache RDD test. add 4482c6c [euphoria-spark] Remove timestamped element. add af0646b Merge pull request #283 from seznam/dejv/spark_rbk add c0fc0ce Core changes. add 1185d5f beam wip add 03e3c02 Rebase on master add 75acf54 wip add eaa83e9 wip add 38dae85 wip add cf59be3 WIP: RBK non deterministic, need tuning of FlowUnfolder add c9290bf [euphoria-beam] PoC of beam integration add abd00f9 [euphoria-beam] add Dataset#persist() listener add dc73dfd [euphoria-beam] cleanup add 566d4a1 [euphoria-beam] correctly pass coders from inputs add e54f241 sq add 68ac140 [euphoria-beam] BeamFlow is forced to be backed up by Pipeline add 47a68dd [euphoria-beam] add trigger to window in RBK (missing correct trigger wrapper) add 35b7ecb [euphoria-beam] bump beam to 2.4.0 add 3fee468 [euphoria-beam] annotations are provided add c4b6da6 Missing test dependencies added. Beam version updated to last release '2.4.0'. add 8c84732 Small change to fix error InteliJ Idea is wrongly reporting. add b5383c6 Wrong merge during rebasing fix. add 18d8719 [euphoria-beam] wip add cbb1f4f First attempts to run ReduceByKey tests in BeamOperatorsTestSuite. Some of them are not running due to missing triggers translations. Others use unsupported ReduceStateByKey. add d117c49 Small typo fix. ReduceByKeyTest in BeamOperatorsSuite disabled again. add e057119 [euphoria-beam] beamphoria corrections add 059b976 [euphoria-beam] Avoid unneccessary lamda allocation with each element in DoFnCollector. add 7cc8cec [euphoria-beam] Add tranformation names. add b759bf2 [euphoria-spark] Fix windowing signature in RBK translator. add 7a11ac3 Merge pull request #287 from seznam/dejv/do_fn_collector_tuning add b02dabb Merge pull request #281 from seznam/vasek/beam-rt-rebase add 6d38233 beamphoria integration part 1 add 5cdbb10 Merge remote-tracking branch 'euphoria/simunek/beamphoriaIntegration' into dsl-euphoria add e60c77f [BEAM-3900] removed old licenses add 7872d12 [BEAM-3900] integrating to gradle build system add 7a5b10e [BEAM-3901] code reformat to comply beam code standard add 8033bea [BEAM-3901] findbugs fixes add 863915e [BEAM-3902] euphoria-core checkstyle corrections add 79fed06 BEAM-3900 Code in euphoria-local package modified to comply with checkstyle. add 0f244c3 BEAM-3900 Code in euphoria-testing package modified to comply with checkstyle. add 60e2fa2 [BEAM-3902] euphoria-core checkstyle corrections 2 add d16e388 [BEAM-3902] euphoria-fluent checkstyle corrections add 9cd7162 [BEAM-3900] Code in euphoria-operator-testkit package modified to comply with checkstyle. add 23ceb31 [BEAM-3900] Code in euphoria-operator-testkit package modified to comply with checkstyle. add 8d70a5d [BEAM-3900] Code in euphoria-beam package modified to comply with checkstyle. new e7913a9 Merge pull request #5315 from mareksimunek/dsl-euphoria The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../core/construction/PTransformTranslation.java | 6 + .../java/org/apache/beam/runners/direct/Clock.java | 5 +- .../beam/runners/direct/WatermarkManager.java | 17 +- .../runners/direct/portable/BundleFactory.java | 9 +- .../runners/direct/portable/CommittedBundle.java | 5 +- .../runners/direct/portable/CommittedResult.java | 7 +- .../direct/portable/CompletionCallback.java | 4 +- .../direct/portable/DirectExecutionContext.java | 5 +- ...DirectGBKIntoKeyedWorkItemsOverrideFactory.java | 45 - .../portable/DirectGroupByKeyOverrideFactory.java | 50 - .../direct/portable/DirectTimerInternals.java | 7 +- .../direct/portable/DirectTransformExecutor.java | 10 +- .../runners/direct/portable/EvaluationContext.java | 71 +- .../portable/ExecutorServiceParallelExecutor.java | 19 +- .../direct/portable/FlattenEvaluatorFactory.java | 22 +- .../GroupAlsoByWindowEvaluatorFactory.java | 48 +- .../portable/GroupByKeyOnlyEvaluatorFactory.java | 41 +- .../portable/ImmutableListBundleFactory.java | 15 +- .../direct/portable/ImpulseEvaluatorFactory.java | 25 +- .../portable/PassthroughTransformEvaluator.java | 8 +- .../runners/direct/portable/PipelineExecutor.java | 12 +- .../direct/{ => portable}/PortableGraph.java | 3 +- .../runners/direct/portable/QuiescenceDriver.java | 49 +- .../runners/direct/portable/RootInputProvider.java | 19 +- .../direct/portable/RootProviderRegistry.java | 17 +- .../beam/runners/direct/portable/StepAndKey.java | 10 +- .../direct/portable/StepTransformResult.java | 14 +- .../direct/portable/TransformEvaluatorFactory.java | 6 +- .../portable/TransformEvaluatorRegistry.java | 6 +- .../direct/portable/TransformExecutorFactory.java | 4 +- .../runners/direct/portable/TransformResult.java | 10 +- .../runners/direct/portable/UncommittedBundle.java | 3 +- .../direct/portable/WatermarkCallbackExecutor.java | 26 +- .../runners/direct/portable/WatermarkManager.java | 1568 ------------------ .../direct/portable/WindowEvaluatorFactory.java | 35 +- .../runners/direct/DirectRunnerApiSurfaceTest.java | 4 + .../direct/portable/CommittedResultTest.java | 69 +- .../direct/portable/DirectTimerInternalsTest.java | 6 +- .../portable/DirectTransformExecutorTest.java | 53 +- .../direct/portable/EvaluationContextTest.java | 68 +- .../direct/portable/ExecutableGraphBuilder.java | 82 + .../portable/FlattenEvaluatorFactoryTest.java | 92 +- .../portable/GroupByKeyEvaluatorFactoryTest.java | 177 -- .../GroupByKeyOnlyEvaluatorFactoryTest.java | 57 +- .../portable/ImmutableListBundleFactoryTest.java | 24 +- .../portable/ImpulseEvaluatorFactoryTest.java | 42 +- .../beam/runners/direct/portable/MockClock.java | 1 + .../direct/{ => portable}/PortableGraphTest.java | 2 +- .../direct/portable/StepTransformResultTest.java | 23 +- .../portable/WatermarkCallbackExecutorTest.java | 40 +- .../direct/portable/WatermarkManagerTest.java | 1688 -------------------- .../portable/WindowEvaluatorFactoryTest.java | 61 +- sdks/java/extensions/euphoria/README.md | 142 ++ .../extensions/euphoria/euphoria-beam/build.gradle | 22 + .../java/extensions/euphoria/euphoria-beam/pom.xml | 117 ++ .../java/cz/seznam/euphoria/beam/BeamExecutor.java | 78 + .../seznam/euphoria/beam/BeamExecutorContext.java | 209 +++ .../java/cz/seznam/euphoria/beam/BeamFlow.java | 245 +++ .../cz/seznam/euphoria/beam/DoFnCollector.java | 95 ++ .../cz/seznam/euphoria/beam/FlatMapTranslator.java | 86 + .../cz/seznam/euphoria/beam/FlowTranslator.java | 120 ++ .../cz/seznam/euphoria/beam/InputTranslator.java | 55 + .../euphoria/beam/LazyAccumulatorProvider.java | 62 + .../seznam/euphoria/beam/OperatorTranslator.java | 37 + .../euphoria/beam/ReduceByKeyTranslator.java | 164 ++ .../euphoria/beam/ReduceStateByKeyTranslator.java | 68 + .../seznam/euphoria/beam/SingleValueCollector.java | 71 + .../java/cz/seznam/euphoria/beam/TypeUtils.java | 38 + .../cz/seznam/euphoria/beam/UnionTranslator.java | 35 + .../euphoria/beam/WrappedPCollectionOperator.java | 59 + .../cz/seznam/euphoria/beam/coder/PairCoder.java | 111 ++ .../seznam/euphoria/beam/coder/package-info.java | 12 +- .../seznam/euphoria/beam/io/BeamBoundedSource.java | 116 ++ .../euphoria/beam/io/BeamUnboundedSource.java | 181 +++ .../cz/seznam/euphoria/beam/io/BeamWriteSink.java | 85 + .../java/cz/seznam/euphoria/beam/io/KryoCoder.java | 104 ++ .../cz/seznam/euphoria/beam/io/package-info.java | 27 +- .../java/cz/seznam/euphoria/beam/package-info.java | 12 +- .../cz/seznam/euphoria/beam/window/BeamWindow.java | 64 + .../seznam/euphoria/beam/window/BeamWindowFn.java | 108 ++ .../euphoria/beam/window/BeamWindowedElement.java | 55 + .../seznam/euphoria/beam/window/package-info.java | 12 +- .../java/cz/seznam/euphoria/beam/BeamFlowTest.java | 196 +++ .../java/cz/seznam/euphoria/beam/FlatMapTest.java | 53 + .../cz/seznam/euphoria/beam/ReduceByKeyTest.java | 271 ++++ .../beam/testkit/BeamExecutorProvider.java | 48 + .../euphoria/beam/testkit/BeamOperatorsSuite.java | 50 + .../euphoria/beam/testkit/BeamOperatorsTest.java | 23 + .../src/test/resources/log4j.properties | 7 + .../extensions/euphoria/euphoria-core/build.gradle | 12 + .../java/extensions/euphoria/euphoria-core/pom.xml | 76 + .../core/annotation/audience/Audience.java | 43 + .../core/annotation/audience/package-info.java | 14 +- .../euphoria/core/annotation/operator/Basic.java | 35 + .../euphoria/core/annotation/operator/Derived.java | 35 + .../core/annotation/operator/Recommended.java | 41 + .../core/annotation/operator/StateComplexity.java | 38 + .../core/annotation/operator/package-info.java | 15 +- .../core/annotation/stability/Experimental.java | 42 + .../core/annotation/stability/package-info.java | 15 +- .../core/client/accumulators/Accumulator.java | 27 + .../client/accumulators/AccumulatorProvider.java | 62 + .../euphoria/core/client/accumulators/Counter.java | 33 + .../core/client/accumulators/Histogram.java | 38 + .../euphoria/core/client/accumulators/Timer.java | 45 + .../accumulators/VoidAccumulatorProvider.java | 131 ++ .../core/client/accumulators/package-info.java | 15 +- .../euphoria/core/client/dataset/Dataset.java | 80 + .../euphoria/core/client/dataset/Datasets.java | 53 + .../euphoria/core/client/dataset/InputDataset.java | 71 + .../core/client/dataset/OutputDataset.java | 80 + .../euphoria/core/client/dataset/package-info.java | 15 +- .../core/client/dataset/windowing/Count.java | 60 + .../client/dataset/windowing/GlobalWindowing.java | 93 ++ .../client/dataset/windowing/MergingWindowing.java | 38 + .../core/client/dataset/windowing/Session.java | 158 ++ .../core/client/dataset/windowing/Time.java | 103 ++ .../client/dataset/windowing/TimeInterval.java | 98 ++ .../core/client/dataset/windowing/TimeSliding.java | 134 ++ .../core/client/dataset/windowing/Window.java | 45 + .../client/dataset/windowing/WindowedElement.java | 38 + .../core/client/dataset/windowing/Windowing.java | 38 + .../client/dataset/windowing/package-info.java | 15 +- .../cz/seznam/euphoria/core/client/flow/Flow.java | 297 ++++ .../cz/seznam/euphoria/core/client/flow/Util.java | 41 + .../euphoria/core/client/flow/package-info.java | 15 +- .../core/client/functional/BinaryFunction.java | 40 + .../core/client/functional/BinaryFunctor.java | 28 + .../functional/CombinableBinaryFunction.java | 23 + .../functional/CombinableReduceFunction.java | 26 + .../client/functional/CompositeUnaryFunction.java | 42 + .../euphoria/core/client/functional/Consumer.java | 32 + .../core/client/functional/ExtractEventTime.java | 33 + .../core/client/functional/ReduceFunction.java | 26 + .../core/client/functional/ReduceFunctor.java | 38 + .../client/functional/SameArgsBinaryFunction.java | 24 + .../core/client/functional/TernaryFunction.java | 27 + .../core/client/functional/TypeHintAware.java | 33 + .../core/client/functional/UnaryFunction.java | 38 + .../core/client/functional/UnaryFunctionEnv.java | 40 + .../core/client/functional/UnaryFunctor.java | 37 + .../core/client/functional/UnaryPredicate.java | 23 + .../core/client/functional/VoidFunction.java | 27 + .../core/client/functional/package-info.java | 15 +- .../euphoria/core/client/io/BoundedDataSource.java | 74 + .../euphoria/core/client/io/BoundedReader.java | 27 + .../euphoria/core/client/io/CloseableIterator.java | 24 + .../seznam/euphoria/core/client/io/Collector.java | 42 + .../cz/seznam/euphoria/core/client/io/Context.java | 22 + .../seznam/euphoria/core/client/io/DataSink.java | 74 + .../seznam/euphoria/core/client/io/DataSinks.java | 69 + .../seznam/euphoria/core/client/io/DataSource.java | 55 + .../euphoria/core/client/io/Environment.java | 61 + .../euphoria/core/client/io/ExternalIterable.java | 28 + .../euphoria/core/client/io/ListDataSink.java | 150 ++ .../euphoria/core/client/io/ListDataSource.java | 279 ++++ .../euphoria/core/client/io/MultiDataSink.java | 172 ++ .../seznam/euphoria/core/client/io/SpillTools.java | 87 + .../seznam/euphoria/core/client/io/StdoutSink.java | 131 ++ .../core/client/io/UnboundedDataSource.java | 49 + .../core/client/io/UnboundedPartition.java | 38 + .../euphoria/core/client/io/UnboundedReader.java | 57 + .../core/client/io/UnsplittableBoundedSource.java | 36 + .../seznam/euphoria/core/client/io/VoidSink.java | 54 + .../cz/seznam/euphoria/core/client/io/Writer.java | 68 + .../euphoria/core/client/io/package-info.java | 15 +- .../cz/seznam/euphoria/core/client/lib/Split.java | 119 ++ .../euphoria/core/client/lib/package-info.java | 15 +- .../core/client/operator/AssignEventTime.java | 153 ++ .../euphoria/core/client/operator/Builders.java | 115 ++ .../euphoria/core/client/operator/CountByKey.java | 179 +++ .../euphoria/core/client/operator/Distinct.java | 216 +++ .../core/client/operator/ElementWiseOperator.java | 44 + .../euphoria/core/client/operator/Filter.java | 163 ++ .../euphoria/core/client/operator/FlatMap.java | 240 +++ .../euphoria/core/client/operator/FullJoin.java | 128 ++ .../seznam/euphoria/core/client/operator/Join.java | 572 +++++++ .../euphoria/core/client/operator/LeftJoin.java | 139 ++ .../euphoria/core/client/operator/MapElements.java | 194 +++ .../euphoria/core/client/operator/Operator.java | 88 + .../client/operator/OptionalMethodBuilder.java | 62 + .../euphoria/core/client/operator/ReduceByKey.java | 634 ++++++++ .../core/client/operator/ReduceStateByKey.java | 400 +++++ .../core/client/operator/ReduceWindow.java | 338 ++++ .../euphoria/core/client/operator/RightJoin.java | 129 ++ .../core/client/operator/SingleInputOperator.java | 45 + .../euphoria/core/client/operator/StateAware.java | 33 + .../operator/StateAwareWindowWiseOperator.java | 54 + .../StateAwareWindowWiseSingleInputOperator.java | 73 + .../core/client/operator/StateSupport.java | 41 + .../euphoria/core/client/operator/SumByKey.java | 260 +++ .../euphoria/core/client/operator/TopPerKey.java | 347 ++++ .../euphoria/core/client/operator/Union.java | 200 +++ .../euphoria/core/client/operator/WindowAware.java | 32 + .../core/client/operator/WindowWiseOperator.java | 41 + .../operator/WindowingRequiredException.java | 29 + .../core/client/operator/hint/ComputationHint.java | 26 + .../core/client/operator/hint/OutputHint.java | 23 + .../core/client/operator/hint/SizeHint.java | 28 + .../core/client/operator/hint/package-info.java | 15 +- .../core/client/operator/package-info.java | 15 +- .../core/client/operator/state/ListStorage.java | 52 + .../operator/state/ListStorageDescriptor.java | 38 + .../operator/state/MergingStorageDescriptor.java | 31 + .../euphoria/core/client/operator/state/State.java | 44 + .../core/client/operator/state/StateContext.java | 31 + .../core/client/operator/state/StateFactory.java | 42 + .../core/client/operator/state/StateMerger.java | 44 + .../core/client/operator/state/Storage.java | 26 + .../client/operator/state/StorageDescriptor.java | 35 + .../client/operator/state/StorageProvider.java | 42 + .../core/client/operator/state/ValueStorage.java | 37 + .../operator/state/ValueStorageDescriptor.java | 101 ++ .../core/client/operator/state/package-info.java | 15 +- .../triggers/AfterFirstCompositeTrigger.java | 82 + .../core/client/triggers/CountTrigger.java | 62 + .../euphoria/core/client/triggers/NoopTrigger.java | 54 + .../core/client/triggers/PeriodicTimeTrigger.java | 92 ++ .../euphoria/core/client/triggers/TimeTrigger.java | 66 + .../euphoria/core/client/triggers/Trigger.java | 158 ++ .../core/client/triggers/TriggerContext.java | 55 + .../core/client/triggers/package-info.java | 15 +- .../core/client/type/AbstractTypeAware.java | 40 + .../core/client/type/TypeAwareReduceFunctor.java | 39 + .../core/client/type/TypeAwareUnaryFunction.java | 39 + .../core/client/type/TypeAwareUnaryFunctor.java | 38 + .../seznam/euphoria/core/client/type/TypeHint.java | 83 + .../euphoria/core/client/type/package-info.java | 15 +- .../seznam/euphoria/core/client/util/Either.java | 65 + .../cz/seznam/euphoria/core/client/util/Fold.java | 111 ++ .../cz/seznam/euphoria/core/client/util/Max.java | 45 + .../cz/seznam/euphoria/core/client/util/Pair.java | 142 ++ .../cz/seznam/euphoria/core/client/util/Sums.java | 40 + .../seznam/euphoria/core/client/util/Triple.java | 70 + .../euphoria/core/client/util/package-info.java | 15 +- .../euphoria/core/executor/AbstractExecutor.java | 45 + .../seznam/euphoria/core/executor/Constants.java | 44 + .../cz/seznam/euphoria/core/executor/Executor.java | 81 + .../euphoria/core/executor/FlowUnfolder.java | 275 ++++ .../euphoria/core/executor/FlowValidator.java | 143 ++ .../seznam/euphoria/core/executor/VectorClock.java | 69 + .../seznam/euphoria/core/executor/graph/DAG.java | 252 +++ .../seznam/euphoria/core/executor/graph/Node.java | 123 ++ .../euphoria/core/executor/graph/package-info.java | 15 +- .../core/executor/greduce/GroupReducer.java | 385 +++++ .../core/executor/greduce/TimerSupport.java | 121 ++ .../core/executor/greduce/TriggerStorage.java | 150 ++ .../core/executor/greduce/package-info.java | 15 +- .../core/executor/io/FsSpillingListStorage.java | 189 +++ .../core/executor/io/GenericSpillTools.java | 140 ++ .../core/executor/io/SerializerFactory.java | 55 + .../core/executor/io/SpillFileFactory.java | 59 + .../euphoria/core/executor/io/package-info.java | 15 +- .../euphoria/core/executor/package-info.java | 15 +- .../core/executor/util/InMemExternalIterable.java | 44 + .../core/executor/util/MultiValueContext.java | 112 ++ .../core/executor/util/OperatorTranslator.java | 49 + .../core/executor/util/SingleValueContext.java | 113 ++ .../euphoria/core/executor/util/package-info.java | 15 +- .../cz/seznam/euphoria/core/time/Scheduler.java | 35 + .../cz/seznam/euphoria/core/time/TimeProvider.java | 52 + .../euphoria/core/time/TimeProviderAware.java | 25 + .../seznam/euphoria/core/time/TimeProviders.java | 144 ++ .../seznam/euphoria/core/time/TimerScheduler.java | 54 + .../cz/seznam/euphoria/core/time/package-info.java | 15 +- .../seznam/euphoria/core/util/ExceptionUtils.java | 113 ++ .../java/cz/seznam/euphoria/core/util/IOUtils.java | 60 + .../seznam/euphoria/core/util/InstanceUtils.java | 55 + .../cz/seznam/euphoria/core/util/Settings.java | 195 +++ .../cz/seznam/euphoria/core/util/package-info.java | 15 +- .../core/client/dataset/windowing/SessionTest.java | 55 + .../client/dataset/windowing/TimeSlidingTest.java | 53 + .../core/client/dataset/windowing/TimeTest.java | 45 + .../dataset/windowing/TimestampedElement.java | 41 + .../client/dataset/windowing/WindowingTest.java | 169 ++ .../seznam/euphoria/core/client/flow/TestFlow.java | 68 + .../euphoria/core/client/io/EmptyReader.java | 51 + .../euphoria/core/client/io/ListDataSinkTest.java | 50 + .../core/client/io/MockStreamDataSource.java | 47 + .../euphoria/core/client/io/MultiDataSinkTest.java | 110 ++ .../seznam/euphoria/core/client/lib/SplitTest.java | 90 ++ .../core/client/operator/CountByKeyTest.java | 93 ++ .../core/client/operator/DistinctTest.java | 81 + .../euphoria/core/client/operator/FilterTest.java | 55 + .../euphoria/core/client/operator/FlatMapTest.java | 111 ++ .../euphoria/core/client/operator/HintTest.java | 109 ++ .../euphoria/core/client/operator/JoinTest.java | 297 ++++ .../core/client/operator/MapElementsTest.java | 99 ++ .../core/client/operator/ReduceByKeyTest.java | 200 +++ .../core/client/operator/ReduceStateByKeyTest.java | 151 ++ .../core/client/operator/ReduceWindowTest.java | 111 ++ .../core/client/operator/SumByKeyTest.java | 91 ++ .../core/client/operator/TopPerKeyTest.java | 102 ++ .../euphoria/core/client/operator/UnionTest.java | 93 ++ .../seznam/euphoria/core/client/operator/Util.java | 65 + .../euphoria/core/client/util/IOUtilsTest.java | 67 + .../euphoria/core/executor/FlowUnfolderTest.java | 235 +++ .../euphoria/core/executor/graph/DAGTest.java | 169 ++ .../executor/io/FsSpillingListStorageTest.java | 135 ++ .../core/executor/io/GenericSpillToolsTest.java | 89 ++ .../core/executor/io/JavaSerializationFactory.java | 139 ++ .../executor/io/TmpFolderSpillFileFactory.java | 48 + .../euphoria/core/testing/DatasetAssert.java | 53 + .../euphoria/core/time/TimeProvidersTest.java | 91 ++ .../cz/seznam/euphoria/core/util/SettingsTest.java | 47 + .../src/test/resources/logback-test.xml | 21 + .../euphoria/euphoria-examples/build.gradle | 32 + .../extensions/euphoria/euphoria-examples/pom.xml | 140 ++ .../cz/seznam/euphoria/examples/Executors.java | 127 ++ .../cz/seznam/euphoria/examples/HBaseStreamer.java | 106 ++ .../cz/seznam/euphoria/examples/HFileLoader.java | 157 ++ .../java/cz/seznam/euphoria/examples/Utils.java | 164 ++ .../examples/wordcount/AccessLogCount.java | 266 +++ .../examples/wordcount/SimpleWordCount.java | 213 +++ .../src/main/resources/log4j.properties | 7 + .../examples/wordcount/SimpleWordCountTest.java | 84 + .../src/test/resources/avro/data.avro | Bin 0 -> 272 bytes .../euphoria/euphoria-fluent/build.gradle | 8 + .../extensions/euphoria/euphoria-fluent/pom.xml | 62 + .../java/cz/seznam/euphoria/fluent/Dataset.java | 72 + .../main/java/cz/seznam/euphoria/fluent/Flow.java | 42 + .../java/cz/seznam/euphoria/fluent/Fluent.java | 34 + .../cz/seznam/euphoria/fluent/package-info.java | 14 +- .../java/cz/seznam/euphoria/fluent/FluentTest.java | 70 + .../euphoria/euphoria-local/build.gradle | 10 + .../extensions/euphoria/euphoria-local/pom.xml | 70 + .../executor/local/AbstractTriggerScheduler.java | 171 ++ .../euphoria/executor/local/AttachedWindowing.java | 51 + .../seznam/euphoria/executor/local/Collector.java | 21 + .../cz/seznam/euphoria/executor/local/Datum.java | 151 ++ .../seznam/euphoria/executor/local/ExecPath.java | 39 + .../seznam/euphoria/executor/local/ExecUnit.java | 84 + .../euphoria/executor/local/KeyedWindow.java | 63 + .../euphoria/executor/local/LocalExecutor.java | 893 +++++++++++ .../euphoria/executor/local/LocalSpillTools.java | 46 + .../euphoria/executor/local/LocalStateContext.java | 38 + .../executor/local/LocalStorageProvider.java | 86 + .../executor/local/NoopTriggerScheduler.java | 50 + .../local/ProcessingTimeTriggerScheduler.java | 25 + .../executor/local/ReduceStateByKeyReducer.java | 846 ++++++++++ .../euphoria/executor/local/TriggerScheduler.java | 69 + .../euphoria/executor/local/Triggerable.java | 39 + .../executor/local/WatermarkEmitStrategy.java | 45 + .../executor/local/WatermarkTriggerScheduler.java | 160 ++ .../executor/local/WindowedElementCollector.java | 91 ++ .../euphoria/executor/local/package-info.java | 12 +- .../euphoria/executor/local/BasicOperatorTest.java | 484 ++++++ .../euphoria/executor/local/JoinOperatorTest.java | 241 +++ .../euphoria/executor/local/LocalExecutorTest.java | 600 +++++++ .../cz/seznam/euphoria/executor/local/Util.java | 40 + .../euphoria/executor/local/VectorClockTest.java | 49 + .../euphoria/executor/local/WindowingTest.java | 319 ++++ .../local/testkit/LocalExecutorProvider.java | 45 + .../executor/local/testkit/LocalOperatorTest.java | 23 + .../src/test/resources/log4j.properties | 22 + .../euphoria-operator-testkit/build.gradle | 9 + .../euphoria/euphoria-operator-testkit/pom.xml | 96 ++ .../euphoria/operator/test/AllOperatorsSuite.java | 42 + .../operator/test/BroadcastHashJoinTest.java | 164 ++ .../euphoria/operator/test/CountByKeyTest.java | 127 ++ .../euphoria/operator/test/DistinctTest.java | 129 ++ .../seznam/euphoria/operator/test/FilterTest.java | 51 + .../seznam/euphoria/operator/test/FlatMapTest.java | 101 ++ .../seznam/euphoria/operator/test/IntWindow.java | 53 + .../cz/seznam/euphoria/operator/test/JoinTest.java | 563 +++++++ .../operator/test/JoinWindowEnforcementTest.java | 179 +++ .../euphoria/operator/test/MapElementsTest.java | 99 ++ .../euphoria/operator/test/ReduceByKeyTest.java | 935 +++++++++++ .../operator/test/ReduceStateByKeyTest.java | 772 +++++++++ .../euphoria/operator/test/ReduceWindowTest.java | 90 ++ .../cz/seznam/euphoria/operator/test/SinkTest.java | 97 ++ .../euphoria/operator/test/SumByKeyTest.java | 57 + .../euphoria/operator/test/TopPerKeyTest.java | 111 ++ .../seznam/euphoria/operator/test/UnionTest.java | 150 ++ .../cz/seznam/euphoria/operator/test/Util.java | 43 + .../euphoria/operator/test/WatermarkTest.java | 91 ++ .../euphoria/operator/test/WindowingTest.java | 484 ++++++ .../operator/test/accumulators/LongCounter.java | 47 + .../operator/test/accumulators/LongHistogram.java | 44 + .../test/accumulators/NanosecondTimer.java | 47 + .../accumulators/SingleJvmAccumulatorProvider.java | 140 ++ .../test/accumulators/SnapshotProvider.java | 31 + .../operator/test/accumulators/Snapshotable.java | 20 + .../operator/test/accumulators/package-info.java | 12 +- .../operator/test/junit/AbstractOperatorTest.java | 252 +++ .../operator/test/junit/ExecutorEnvironment.java | 28 + .../operator/test/junit/ExecutorProvider.java | 24 + .../test/junit/ExecutorProviderRunner.java | 292 ++++ .../euphoria/operator/test/junit/Processing.java | 61 + .../euphoria/operator/test/junit/package-info.java | 12 +- .../euphoria/operator/test/package-info.java | 13 +- .../euphoria/euphoria-testing/build.gradle | 7 + .../extensions/euphoria/euphoria-testing/pom.xml | 64 + .../seznam/euphoria/testing/AbstractFlowTest.java | 53 + .../cz/seznam/euphoria/testing/DatasetAssert.java | 55 + .../cz/seznam/euphoria/testing/package-info.java | 12 +- sdks/python/apache_beam/options/value_provider.py | 3 + .../apache_beam/options/value_provider_test.py | 11 + settings.gradle | 15 + 399 files changed, 33814 insertions(+), 4506 deletions(-) delete mode 100644 runners/direct-java/src/main/java/org/apache/beam/runners/direct/portable/DirectGBKIntoKeyedWorkItemsOverrideFactory.java delete mode 100644 runners/direct-java/src/main/java/org/apache/beam/runners/direct/portable/DirectGroupByKeyOverrideFactory.java rename runners/direct-java/src/main/java/org/apache/beam/runners/direct/{ => portable}/PortableGraph.java (96%) delete mode 100644 runners/direct-java/src/main/java/org/apache/beam/runners/direct/portable/WatermarkManager.java create mode 100644 runners/direct-java/src/test/java/org/apache/beam/runners/direct/portable/ExecutableGraphBuilder.java delete mode 100644 runners/direct-java/src/test/java/org/apache/beam/runners/direct/portable/GroupByKeyEvaluatorFactoryTest.java rename runners/direct-java/src/test/java/org/apache/beam/runners/direct/{ => portable}/PortableGraphTest.java (99%) delete mode 100644 runners/direct-java/src/test/java/org/apache/beam/runners/direct/portable/WatermarkManagerTest.java create mode 100644 sdks/java/extensions/euphoria/README.md create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/build.gradle create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/pom.xml create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/BeamExecutor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/BeamExecutorContext.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/BeamFlow.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/DoFnCollector.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/FlatMapTranslator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/FlowTranslator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/InputTranslator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/LazyAccumulatorProvider.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/OperatorTranslator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/ReduceByKeyTranslator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/ReduceStateByKeyTranslator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/SingleValueCollector.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/TypeUtils.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/UnionTranslator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/WrappedPCollectionOperator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/coder/PairCoder.java rename runners/direct-java/src/main/java/org/apache/beam/runners/direct/portable/Clock.java => sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/coder/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/io/BeamBoundedSource.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/io/BeamUnboundedSource.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/io/BeamWriteSink.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/io/KryoCoder.java rename runners/direct-java/src/main/java/org/apache/beam/runners/direct/portable/NanosOffsetClock.java => sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/io/package-info.java (52%) copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/window/BeamWindow.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/window/BeamWindowFn.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/window/BeamWindowedElement.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-beam/src/main/java/cz/seznam/euphoria/beam/window/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/test/java/cz/seznam/euphoria/beam/BeamFlowTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/test/java/cz/seznam/euphoria/beam/FlatMapTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/test/java/cz/seznam/euphoria/beam/ReduceByKeyTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/test/java/cz/seznam/euphoria/beam/testkit/BeamExecutorProvider.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/test/java/cz/seznam/euphoria/beam/testkit/BeamOperatorsSuite.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/test/java/cz/seznam/euphoria/beam/testkit/BeamOperatorsTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/test/resources/log4j.properties create mode 100644 sdks/java/extensions/euphoria/euphoria-core/build.gradle create mode 100644 sdks/java/extensions/euphoria/euphoria-core/pom.xml create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/annotation/audience/Audience.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/annotation/audience/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/annotation/operator/Basic.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/annotation/operator/Derived.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/annotation/operator/Recommended.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/annotation/operator/StateComplexity.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/annotation/operator/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/annotation/stability/Experimental.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/annotation/stability/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/accumulators/Accumulator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/accumulators/AccumulatorProvider.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/accumulators/Counter.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/accumulators/Histogram.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/accumulators/Timer.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/accumulators/VoidAccumulatorProvider.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/accumulators/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/Dataset.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/Datasets.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/InputDataset.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/OutputDataset.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/windowing/Count.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/windowing/GlobalWindowing.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/windowing/MergingWindowing.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/windowing/Session.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/windowing/Time.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/windowing/TimeInterval.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/windowing/TimeSliding.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/windowing/Window.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/windowing/WindowedElement.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/windowing/Windowing.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/dataset/windowing/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/flow/Flow.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/flow/Util.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/flow/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/BinaryFunction.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/BinaryFunctor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/CombinableBinaryFunction.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/CombinableReduceFunction.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/CompositeUnaryFunction.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/Consumer.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/ExtractEventTime.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/ReduceFunction.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/ReduceFunctor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/SameArgsBinaryFunction.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/TernaryFunction.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/TypeHintAware.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/UnaryFunction.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/UnaryFunctionEnv.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/UnaryFunctor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/UnaryPredicate.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/VoidFunction.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/functional/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/BoundedDataSource.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/BoundedReader.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/CloseableIterator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/Collector.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/Context.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/DataSink.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/DataSinks.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/DataSource.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/Environment.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/ExternalIterable.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/ListDataSink.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/ListDataSource.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/MultiDataSink.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/SpillTools.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/StdoutSink.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/UnboundedDataSource.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/UnboundedPartition.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/UnboundedReader.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/UnsplittableBoundedSource.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/VoidSink.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/Writer.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/io/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/lib/Split.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/lib/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/AssignEventTime.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/Builders.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/CountByKey.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/Distinct.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/ElementWiseOperator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/Filter.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/FlatMap.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/FullJoin.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/Join.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/LeftJoin.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/MapElements.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/Operator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/OptionalMethodBuilder.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/ReduceByKey.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/ReduceStateByKey.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/ReduceWindow.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/RightJoin.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/SingleInputOperator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/StateAware.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/StateAwareWindowWiseOperator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/StateAwareWindowWiseSingleInputOperator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/StateSupport.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/SumByKey.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/TopPerKey.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/Union.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/WindowAware.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/WindowWiseOperator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/WindowingRequiredException.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/hint/ComputationHint.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/hint/OutputHint.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/hint/SizeHint.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/hint/package-info.java (79%) copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/ListStorage.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/ListStorageDescriptor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/MergingStorageDescriptor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/State.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/StateContext.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/StateFactory.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/StateMerger.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/Storage.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/StorageDescriptor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/StorageProvider.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/ValueStorage.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/ValueStorageDescriptor.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/operator/state/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/triggers/AfterFirstCompositeTrigger.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/triggers/CountTrigger.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/triggers/NoopTrigger.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/triggers/PeriodicTimeTrigger.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/triggers/TimeTrigger.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/triggers/Trigger.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/triggers/TriggerContext.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/triggers/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/type/AbstractTypeAware.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/type/TypeAwareReduceFunctor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/type/TypeAwareUnaryFunction.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/type/TypeAwareUnaryFunctor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/type/TypeHint.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/type/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/util/Either.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/util/Fold.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/util/Max.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/util/Pair.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/util/Sums.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/util/Triple.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/client/util/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/AbstractExecutor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/Constants.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/Executor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/FlowUnfolder.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/FlowValidator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/VectorClock.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/graph/DAG.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/graph/Node.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/graph/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/greduce/GroupReducer.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/greduce/TimerSupport.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/greduce/TriggerStorage.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/greduce/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/io/FsSpillingListStorage.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/io/GenericSpillTools.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/io/SerializerFactory.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/io/SpillFileFactory.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/io/package-info.java (79%) copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/util/InMemExternalIterable.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/util/MultiValueContext.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/util/OperatorTranslator.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/util/SingleValueContext.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/executor/util/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/time/Scheduler.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/time/TimeProvider.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/time/TimeProviderAware.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/time/TimeProviders.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/time/TimerScheduler.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/time/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/util/ExceptionUtils.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/util/IOUtils.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/util/InstanceUtils.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/util/Settings.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-core/src/main/java/cz/seznam/euphoria/core/util/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/dataset/windowing/SessionTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/dataset/windowing/TimeSlidingTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/dataset/windowing/TimeTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/dataset/windowing/TimestampedElement.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/dataset/windowing/WindowingTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/flow/TestFlow.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/io/EmptyReader.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/io/ListDataSinkTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/io/MockStreamDataSource.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/io/MultiDataSinkTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/lib/SplitTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/CountByKeyTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/DistinctTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/FilterTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/FlatMapTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/HintTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/JoinTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/MapElementsTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/ReduceByKeyTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/ReduceStateByKeyTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/ReduceWindowTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/SumByKeyTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/TopPerKeyTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/UnionTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/operator/Util.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/client/util/IOUtilsTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/executor/FlowUnfolderTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/executor/graph/DAGTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/executor/io/FsSpillingListStorageTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/executor/io/GenericSpillToolsTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/executor/io/JavaSerializationFactory.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/executor/io/TmpFolderSpillFileFactory.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/testing/DatasetAssert.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/time/TimeProvidersTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/java/cz/seznam/euphoria/core/util/SettingsTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-core/src/test/resources/logback-test.xml create mode 100644 sdks/java/extensions/euphoria/euphoria-examples/build.gradle create mode 100644 sdks/java/extensions/euphoria/euphoria-examples/pom.xml create mode 100644 sdks/java/extensions/euphoria/euphoria-examples/src/main/java/cz/seznam/euphoria/examples/Executors.java create mode 100644 sdks/java/extensions/euphoria/euphoria-examples/src/main/java/cz/seznam/euphoria/examples/HBaseStreamer.java create mode 100644 sdks/java/extensions/euphoria/euphoria-examples/src/main/java/cz/seznam/euphoria/examples/HFileLoader.java create mode 100644 sdks/java/extensions/euphoria/euphoria-examples/src/main/java/cz/seznam/euphoria/examples/Utils.java create mode 100644 sdks/java/extensions/euphoria/euphoria-examples/src/main/java/cz/seznam/euphoria/examples/wordcount/AccessLogCount.java create mode 100644 sdks/java/extensions/euphoria/euphoria-examples/src/main/java/cz/seznam/euphoria/examples/wordcount/SimpleWordCount.java create mode 100644 sdks/java/extensions/euphoria/euphoria-examples/src/main/resources/log4j.properties create mode 100644 sdks/java/extensions/euphoria/euphoria-examples/src/test/java/cz/seznam/euphoria/examples/wordcount/SimpleWordCountTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-examples/src/test/resources/avro/data.avro create mode 100644 sdks/java/extensions/euphoria/euphoria-fluent/build.gradle create mode 100644 sdks/java/extensions/euphoria/euphoria-fluent/pom.xml create mode 100644 sdks/java/extensions/euphoria/euphoria-fluent/src/main/java/cz/seznam/euphoria/fluent/Dataset.java create mode 100644 sdks/java/extensions/euphoria/euphoria-fluent/src/main/java/cz/seznam/euphoria/fluent/Flow.java create mode 100644 sdks/java/extensions/euphoria/euphoria-fluent/src/main/java/cz/seznam/euphoria/fluent/Fluent.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-fluent/src/main/java/cz/seznam/euphoria/fluent/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-fluent/src/test/java/cz/seznam/euphoria/fluent/FluentTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/build.gradle create mode 100644 sdks/java/extensions/euphoria/euphoria-local/pom.xml create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/AbstractTriggerScheduler.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/AttachedWindowing.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/Collector.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/Datum.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/ExecPath.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/ExecUnit.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/KeyedWindow.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/LocalExecutor.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/LocalSpillTools.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/LocalStateContext.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/LocalStorageProvider.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/NoopTriggerScheduler.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/ProcessingTimeTriggerScheduler.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/ReduceStateByKeyReducer.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/TriggerScheduler.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/Triggerable.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/WatermarkEmitStrategy.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/WatermarkTriggerScheduler.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/WindowedElementCollector.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-local/src/main/java/cz/seznam/euphoria/executor/local/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/test/java/cz/seznam/euphoria/executor/local/BasicOperatorTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/test/java/cz/seznam/euphoria/executor/local/JoinOperatorTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/test/java/cz/seznam/euphoria/executor/local/LocalExecutorTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/test/java/cz/seznam/euphoria/executor/local/Util.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/test/java/cz/seznam/euphoria/executor/local/VectorClockTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/test/java/cz/seznam/euphoria/executor/local/WindowingTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/test/java/cz/seznam/euphoria/executor/local/testkit/LocalExecutorProvider.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/test/java/cz/seznam/euphoria/executor/local/testkit/LocalOperatorTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-local/src/test/resources/log4j.properties create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/build.gradle create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/pom.xml create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/AllOperatorsSuite.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/BroadcastHashJoinTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/CountByKeyTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/DistinctTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/FilterTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/FlatMapTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/IntWindow.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/JoinTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/JoinWindowEnforcementTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/MapElementsTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/ReduceByKeyTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/ReduceStateByKeyTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/ReduceWindowTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/SinkTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/SumByKeyTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/TopPerKeyTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/UnionTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/Util.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/WatermarkTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/WindowingTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/accumulators/LongCounter.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/accumulators/LongHistogram.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/accumulators/NanosecondTimer.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/accumulators/SingleJvmAccumulatorProvider.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/accumulators/SnapshotProvider.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/accumulators/Snapshotable.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/accumulators/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/junit/AbstractOperatorTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/junit/ExecutorEnvironment.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/junit/ExecutorProvider.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/junit/ExecutorProviderRunner.java create mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/junit/Processing.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/junit/package-info.java (79%) copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/cz/seznam/euphoria/operator/test/package-info.java (79%) create mode 100644 sdks/java/extensions/euphoria/euphoria-testing/build.gradle create mode 100644 sdks/java/extensions/euphoria/euphoria-testing/pom.xml create mode 100644 sdks/java/extensions/euphoria/euphoria-testing/src/main/java/cz/seznam/euphoria/testing/AbstractFlowTest.java create mode 100644 sdks/java/extensions/euphoria/euphoria-testing/src/main/java/cz/seznam/euphoria/testing/DatasetAssert.java copy runners/direct-java/src/main/java/org/apache/beam/runners/direct/Clock.java => sdks/java/extensions/euphoria/euphoria-testing/src/main/java/cz/seznam/euphoria/testing/package-info.java (79%) -- To stop receiving notification emails like this one, please contact jbono...@apache.org.