[GitHub] flink issue #6388: [FLINK-6222] Allow passing env variables to start scripts...

2018-07-24 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6388 LGTM, except the one remaining indentation problem mentioned by @zentol . ---

[GitHub] flink pull request #6351: [FLINK-9862] [test] Extend general puropose DataSt...

2018-07-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6351#discussion_r204345031 --- Diff: flink-end-to-end-tests/flink-datastream-allround-test/src/main/java/org/apache/flink/streaming/tests/SequenceGeneratorSource.java

[GitHub] flink issue #6351: [FLINK-9862] [test] Extend general puropose DataStream te...

2018-07-23 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6351 Had one question. Otherwise LGTM 👍 ---

[GitHub] flink pull request #6351: [FLINK-9862] [test] Extend general puropose DataSt...

2018-07-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6351#discussion_r204336316 --- Diff: flink-end-to-end-tests/flink-datastream-allround-test/src/main/java/org/apache/flink/streaming/tests/SequenceGeneratorSource.java

[GitHub] flink pull request #6351: [FLINK-9862] [test] Extend general puropose DataSt...

2018-07-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6351#discussion_r204336026 --- Diff: flink-end-to-end-tests/flink-datastream-allround-test/src/main/java/org/apache/flink/streaming/tests/SequenceGeneratorSource.java

[GitHub] flink issue #6376: [FLINK-9902][tests] Improve and refactor window checkpoin...

2018-07-20 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6376 Thanks for the fast review @aljoscha . Addressed the comment about the `while`-loop and will merge now. ---

[GitHub] flink pull request #6376: [FLINK-9902][tests] Improve and refactor window ch...

2018-07-20 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6376#discussion_r203982061 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/FailingSource.java --- @@ -0,0 +1,155 @@ +/* + * Licensed to

[GitHub] flink pull request #6376: [FLINK-9902][tests] Improve and refactor window ch...

2018-07-20 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6376#discussion_r203981882 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/ValidatingSink.java --- @@ -0,0 +1,128 @@ +/* + * Licensed to

[GitHub] flink pull request #6376: [FLINK-9902][tests] Improve and refactor window ch...

2018-07-20 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6376#discussion_r203978845 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/WindowCheckpointingITCase.java --- @@ -92,19 +89,21 @@ private static

[GitHub] flink pull request #6376: [FLINK-9902][tests] Improve and refactor window ch...

2018-07-20 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6376#discussion_r203978691 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/FailingSource.java --- @@ -0,0 +1,155 @@ +/* + * Licensed to

[GitHub] flink pull request #6376: [FLINK-9902][tests] Improve and refactor window ch...

2018-07-20 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6376#discussion_r203978368 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/EventTimeAllWindowCheckpointingITCase.java --- @@ -88,20 +80,17 @@ public

[GitHub] flink pull request #6376: [FLINK-9902][tests] Improve and refactor window ch...

2018-07-20 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6376#discussion_r203978136 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/EventTimeAllWindowCheckpointingITCase.java --- @@ -133,9 +122,12 @@ public

[GitHub] flink pull request #6376: [FLINK-9902][tests] Improve and refactor window ch...

2018-07-20 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6376#discussion_r203978068 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/EventTimeWindowCheckpointingITCase.java --- @@ -299,12 +288,17 @@ public

[GitHub] flink issue #6361: [FLINK-9858] [tests] State TTL End-to-End Test

2018-07-20 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6361 Very good work, LGTM 👍 Merging. ---

[GitHub] flink pull request #6351: [FLINK-9862] [test] Extend general puropose DataSt...

2018-07-18 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6351#discussion_r203382388 --- Diff: flink-end-to-end-tests/flink-datastream-allround-test/src/main/java/org/apache/flink/streaming/tests/SemanticsCheckMapper.java

[GitHub] flink pull request #6351: [FLINK-9862] [test] Extend general puropose DataSt...

2018-07-18 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6351#discussion_r203380952 --- Diff: flink-end-to-end-tests/flink-datastream-allround-test/src/main/java/org/apache/flink/streaming/tests/DataStreamAllroundTestJobFactory.java

[GitHub] flink pull request #6361: [FLINK-9858] [tests] State TTL End-to-End Test

2018-07-18 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6361#discussion_r203377098 --- Diff: flink-end-to-end-tests/test-scripts/common.sh --- @@ -240,6 +240,15 @@ function start_cluster { done } +function

[GitHub] flink pull request #6361: [FLINK-9858] [tests] State TTL End-to-End Test

2018-07-18 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6361#discussion_r203372004 --- Diff: flink-end-to-end-tests/flink-stream-state-ttl-test/src/main/java/org/apache/flink/streaming/tests/verify/TtlUpdateContext.java --- @@ -0,0

[GitHub] flink pull request #6361: [FLINK-9858] [tests] State TTL End-to-End Test

2018-07-18 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6361#discussion_r203363708 --- Diff: flink-end-to-end-tests/flink-stream-state-ttl-test/src/main/java/org/apache/flink/streaming/tests/DataStreamStateTTLTestProgram.java

[GitHub] flink pull request #6361: [FLINK-9858] [tests] State TTL End-to-End Test

2018-07-18 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6361#discussion_r203362731 --- Diff: flink-end-to-end-tests/flink-stream-state-ttl-test/src/main/java/org/apache/flink/streaming/tests/DataStreamStateTTLTestProgram.java

[GitHub] flink pull request #6361: [FLINK-9858] [tests] State TTL End-to-End Test

2018-07-18 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6361#discussion_r203361200 --- Diff: flink-end-to-end-tests/flink-stream-state-ttl-test/src/main/java/org/apache/flink/streaming/tests/verify/AbstractTtlStateVerifier.java

[GitHub] flink pull request #6361: [FLINK-9858] [tests] State TTL End-to-End Test

2018-07-18 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6361#discussion_r203355448 --- Diff: flink-end-to-end-tests/flink-stream-state-ttl-test/src/main/java/org/apache/flink/streaming/tests/verify/AbstractTtlStateVerifier.java

[GitHub] flink pull request #6361: [FLINK-9858] [tests] State TTL End-to-End Test

2018-07-18 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6361#discussion_r203353112 --- Diff: flink-end-to-end-tests/flink-stream-state-ttl-test/src/main/java/org/apache/flink/streaming/tests/verify/AbstractTtlStateVerifier.java

[GitHub] flink issue #6302: [FLINK-9061][checkpointing] add entropy to s3 path for be...

2018-07-16 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6302 @indrc I think there is no contradiction between Stephan's comment and my suggestion about 1. I stand by my point that this is a very common task and there is no very special requireme

[GitHub] flink pull request #6333: [FLINK-9489] Checkpoint timers as part of managed ...

2018-07-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6333#discussion_r202556109 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/CachingInternalPriorityQueueSet.java --- @@ -80,13 +82,57 @@ public E peek

[GitHub] flink pull request #6333: [FLINK-9489] Checkpoint timers as part of managed ...

2018-07-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6333#discussion_r202556091 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/HeapKeyedStateBackend.java --- @@ -446,8 +485,10 @@ public String toString

[GitHub] flink issue #6333: [FLINK-9489] Checkpoint timers as part of managed keyed s...

2018-07-13 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6333 CC @tillrohrmann ---

[GitHub] flink pull request #6333: [FLINK-9489] Checkpoint timers as part of managed ...

2018-07-13 Thread StefanRRichter
GitHub user StefanRRichter opened a pull request: https://github.com/apache/flink/pull/6333 [FLINK-9489] Checkpoint timers as part of managed keyed state instead of raw keyed state ## What is the purpose of the change This PR integrates priority queue state (timers) with

[GitHub] flink pull request #6325: [FLINK-9376] Allow upgrading to incompatible state...

2018-07-13 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6325#discussion_r202295131 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java

[GitHub] flink pull request #6325: [FLINK-9376] Allow upgrading to incompatible state...

2018-07-13 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6325#discussion_r202285840 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/TypeSerializerConfigSnapshot.java --- @@ -99,7 +99,8

[GitHub] flink pull request #6325: [FLINK-9376] Allow upgrading to incompatible state...

2018-07-13 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6325#discussion_r202293686 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java

[GitHub] flink pull request #6325: [FLINK-9376] Allow upgrading to incompatible state...

2018-07-13 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6325#discussion_r202293217 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java

[GitHub] flink pull request #6325: [FLINK-9376] Allow upgrading to incompatible state...

2018-07-13 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6325#discussion_r202293477 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java

[GitHub] flink pull request #6325: [FLINK-9376] Allow upgrading to incompatible state...

2018-07-13 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6325#discussion_r202289229 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java

[GitHub] flink issue #6313: [FLINK-9701] Add TTL in state descriptors

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6313 LGTM, nice work! 👍 Besides one comment about closing the backends after tests, the PR is ready. This is no big thing so I will just fix it myself before merging now. ---

[GitHub] flink pull request #6313: [FLINK-9701] Add TTL in state descriptors

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6313#discussion_r202130806 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/ttl/StateBackendTestContext.java --- @@ -0,0 +1,120 @@ +/* + * Licensed

[GitHub] flink pull request #6313: [FLINK-9701] Add TTL in state descriptors

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6313#discussion_r202103083 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/HeapKeyedStateBackend.java --- @@ -240,7 +243,7 @@ private boolean

[GitHub] flink pull request #6313: [FLINK-9701] Add TTL in state descriptors

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6313#discussion_r202058484 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/HeapKeyedStateBackend.java --- @@ -240,7 +243,7 @@ private boolean

[GitHub] flink pull request #6313: [FLINK-9701] Add TTL in state descriptors

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6313#discussion_r202057089 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FsStateBackend.java --- @@ -93,7 +94,7 @@ private static

[GitHub] flink pull request #6313: [FLINK-9701] Add TTL in state descriptors

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6313#discussion_r202056626 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FsStateBackend.java --- @@ -93,7 +94,7 @@ private static

[GitHub] flink pull request #6308: [FLINK-9799] Generalize and unify state meta info ...

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6308#discussion_r202047581 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/KeyedBackendSerializationProxy.java --- @@ -98,8 +103,7 @@ public int

[GitHub] flink pull request #6308: [FLINK-9799] Generalize and unify state meta info ...

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6308#discussion_r202047403 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/SerializationProxiesTest.java --- @@ -126,11 +131,11 @@ public void

[GitHub] flink pull request #6313: [FLINK-9701] Add TTL in state descriptors

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6313#discussion_r202042548 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/ttl/TtlMapState.java --- @@ -84,52 +86,89 @@ public boolean contains(UK key

[GitHub] flink issue #6308: [FLINK-9799] Generalize and unify state meta info snapsho...

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6308 @sihuazhou @azagrebin thanks guys for the fast reviews! Will address the comments and merge. ---

[GitHub] flink pull request #6308: [FLINK-9799] Generalize and unify state meta info ...

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6308#discussion_r202041046 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/metainfo/StateMetaInfoSnapshotReadersWriters.java --- @@ -0,0 +1,412

[GitHub] flink pull request #6313: [FLINK-9701] Add TTL in state descriptors

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6313#discussion_r202036711 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/ttl/TtlMapState.java --- @@ -84,52 +86,89 @@ public boolean contains(UK key

[GitHub] flink pull request #6313: [FLINK-9701] Add TTL in state descriptors

2018-07-12 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6313#discussion_r202032512 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/state/StateDescriptor.java --- @@ -92,6 +93,10 @@ @Nullable private

[GitHub] flink issue #6277: [FLINK-9511] Implement TTL config

2018-07-11 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6277 LGTM 👍 merging. ---

[GitHub] flink issue #6308: [FLINK-9799] Generalize and unify state meta info snapsho...

2018-07-11 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6308 CC @azagrebin ---

[GitHub] flink pull request #6308: [FLINK-9799] Generalize and unify state meta info ...

2018-07-11 Thread StefanRRichter
GitHub user StefanRRichter opened a pull request: https://github.com/apache/flink/pull/6308 [FLINK-9799] Generalize and unify state meta info snapshot ## What is the purpose of the change This PR generalizes and unifies the de/serialization of state meta information in

[GitHub] flink issue #6276: [FLINK-9486] Introduce TimerState in keyed state backend

2018-07-09 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6276 @tillrohrmann Thanks for the fast review. Merging. ---

[GitHub] flink pull request #6276: [FLINK-9486] Introduce TimerState in keyed state b...

2018-07-09 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6276#discussion_r201013659 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/KeyGroupedInternalPriorityQueue.java --- @@ -0,0 +1,31

[GitHub] flink issue #6275: [FLINK-9776] [runtime] Stop sending periodic interrupts o...

2018-07-09 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6275 LGTM 👍 ---

[GitHub] flink pull request #6275: [FLINK-9776] [runtime] Stop sending periodic inter...

2018-07-09 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6275#discussion_r200911028 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/taskmanager/Task.java --- @@ -1563,7 +1573,7 @@ public void run

[GitHub] flink pull request #6275: [FLINK-9776] [runtime] Stop sending periodic inter...

2018-07-06 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6275#discussion_r200737014 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/taskmanager/Task.java --- @@ -1563,7 +1573,7 @@ public void run

[GitHub] flink issue #6276: [FLINK-9486] Introduce TimerState in keyed state backend

2018-07-06 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6276 CC @tillrohrmann ---

[GitHub] flink pull request #6276: [FLINK-9486] Introduce TimerState in keyed state b...

2018-07-06 Thread StefanRRichter
GitHub user StefanRRichter opened a pull request: https://github.com/apache/flink/pull/6276 [FLINK-9486] Introduce TimerState in keyed state backend ## What is the purpose of the change This PR integrates `InternalTimerQueue` with keyed state backends (Heap and RocksDB

[GitHub] flink issue #6251: [FLINK-9693] Set Execution#taskRestore to null after depl...

2018-07-04 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6251 LGTM 👍 ---

[GitHub] flink issue #6196: [FLINK-9513] Implement TTL state wrappers factory and ser...

2018-07-04 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6196 I found there is still a small issue with the equals/hashCode but will just fix it before merging. ---

[GitHub] flink issue #6196: [FLINK-9513] Implement TTL state wrappers factory and ser...

2018-07-04 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6196 LGTM 👍 merging. ---

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199894398 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompositeSerializer.java --- @@ -272,4 +254,60 @@ public int getVersion

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199894217 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompositeSerializer.java --- @@ -272,4 +254,60 @@ public int getVersion

[GitHub] flink issue #6228: [FLINK-9491] Implement timer data structure based on Rock...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6228 @sihuazhou @azagrebin thanks for the reviews! I will merge this once my travis is green. ---

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199841799 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/InternalPriorityQueueTestBase.java --- @@ -0,0 +1,452

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199817513 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/InternalPriorityQueueTestBase.java --- @@ -0,0 +1,452

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199817285 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/InternalPriorityQueueTestBase.java --- @@ -0,0 +1,452

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199817158 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/InternalPriorityQueueTestBase.java --- @@ -0,0 +1,452

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199816750 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/InternalPriorityQueueTestBase.java --- @@ -0,0 +1,452

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199816552 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/InternalPriorityQueueTestBase.java --- @@ -0,0 +1,452

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199816139 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/KeyGroupPartitionedPriorityQueue.java --- @@ -0,0 +1,280

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199816118 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBOrderedSetStore.java

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199815863 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/KeyGroupPartitionedPriorityQueue.java --- @@ -0,0 +1,280

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199814790 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/HeapPriorityQueueSet.java --- @@ -0,0 +1,186 @@ +/* + * Licensed

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199814578 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/HeapPriorityQueue.java --- @@ -0,0 +1,341 @@ +/* + * Licensed to

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199813559 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/HeapPriorityQueue.java --- @@ -0,0 +1,341 @@ +/* + * Licensed to

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199813529 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/HeapPriorityQueue.java --- @@ -0,0 +1,341 @@ +/* + * Licensed to

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199812541 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/KeyExtractorFunction.java --- @@ -0,0 +1,36 @@ +/* + * Licensed to the

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199812074 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/InternalPriorityQueue.java --- @@ -0,0 +1,99 @@ +/* + * Licensed to the

[GitHub] flink issue #6196: [FLINK-9513] Implement TTL state wrappers factory and ser...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6196 Had a few more comments, but they all are basically optimizations. I leave it up to you if you still want to address all or some of them. Please let me know. Otherwise, we can merge this. 👍 ---

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199783587 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompositeSerializer.java --- @@ -0,0 +1,275 @@ +/* + * Licensed to

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199782860 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompositeSerializer.java --- @@ -0,0 +1,275 @@ +/* + * Licensed to

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199782303 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompositeSerializer.java --- @@ -0,0 +1,275 @@ +/* + * Licensed to

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199485075 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompositeSerializer.java --- @@ -0,0 +1,258 @@ +/* + * Licensed to

[GitHub] flink issue #6196: [FLINK-9513] Implement TTL state wrappers factory and ser...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6196 I had a few more comments, in particular some improvements for the new serializer. I think when those are addressed this is good to merge. ---

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199477483 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/ttl/TtlStateFactory.java --- @@ -0,0 +1,210 @@ +/* + * Licensed to the

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199476870 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/ttl/TtlStateFactory.java --- @@ -0,0 +1,210 @@ +/* + * Licensed to the

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199474873 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompositeSerializer.java --- @@ -0,0 +1,258 @@ +/* + * Licensed to

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199474421 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompositeSerializer.java --- @@ -0,0 +1,258 @@ +/* + * Licensed to

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199474494 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompositeSerializer.java --- @@ -0,0 +1,258 @@ +/* + * Licensed to

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199474258 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompositeSerializer.java --- @@ -0,0 +1,258 @@ +/* + * Licensed to

[GitHub] flink pull request #6196: [FLINK-9513] Implement TTL state wrappers factory ...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6196#discussion_r199474152 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompositeSerializer.java --- @@ -0,0 +1,258 @@ +/* + * Licensed to

[GitHub] flink issue #6228: [FLINK-9491] Implement timer data structure based on Rock...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6228 @sihuazhou thanks for the fast review. I addressed all your comments. ---

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199442186 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBOrderedStore.java

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199427083 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBOrderedStore.java

[GitHub] flink pull request #6228: [FLINK-9491] Implement timer data structure based ...

2018-07-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6228#discussion_r199426052 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBOrderedStore.java

[GitHub] flink issue #5799: [FLINK-7775] Remove unreferenced method PermanentBlobCach...

2018-06-29 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/5799 LGTM 👍 Merging. ---

[GitHub] flink issue #6186: [FLINK-9514,FLINK-9515,FLINK-9516] State ttl wrappers

2018-06-29 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6186 Merging this. ---

[GitHub] flink issue #6186: [FLINK-9514,FLINK-9515,FLINK-9516] State ttl wrappers

2018-06-29 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6186 Had one more minor comment. Besides, this looks good 👍 Nice job! ---

[GitHub] flink pull request #6186: [FLINK-9514,FLINK-9515,FLINK-9516] State ttl wrapp...

2018-06-29 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/6186#discussion_r199109435 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/ttl/TtlMapState.java --- @@ -0,0 +1,134 @@ +/* + * Licensed to the

[GitHub] flink issue #6228: [FLINK-9491] Implement timer data structure based on Rock...

2018-06-29 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6228 CC @azagrebin @sihuazhou ---

  1   2   3   4   5   6   7   8   9   10   >