[8/9] flink git commit: [hotfix][tests] replace InputChannelTestUtils#createMockBuffer() with TestBufferFactory#createBuffer()

2018-01-18 Thread srichter
[hotfix][tests] replace InputChannelTestUtils#createMockBuffer() with TestBufferFactory#createBuffer() This eliminates one more unnecessary buffer mock. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/1a5a355a Tree:

[3/9] flink git commit: [hotfix][tests] do not use a mocked BufferRecycler for unpooled memory segments

2018-01-18 Thread srichter
[hotfix][tests] do not use a mocked BufferRecycler for unpooled memory segments The mock will actually keep references to the segments instead of freeing them. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/997fab62 Tree:

[7/9] flink git commit: [hotfix][tests] make SpillableSubpartitionTest use TestBufferFactory.createBuffer

2018-01-18 Thread srichter
[hotfix][tests] make SpillableSubpartitionTest use TestBufferFactory.createBuffer (this simplifies the test setups) Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b3fc7939 Tree:

[4/9] flink git commit: [FLINK-7520][network] let our Buffer class extend from netty's buffer class

2018-01-18 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/85bea23a/flink-runtime/src/test/java/org/apache/flink/runtime/io/network/buffer/BufferBuilderTest.java -- diff --git

[1/9] flink git commit: [hotfix][tests] replace DiscardingRecycler with FreeingBufferRecycler

2018-01-18 Thread srichter
Repository: flink Updated Branches: refs/heads/master 76abcaa55 -> 9d0dfcba6 [hotfix][tests] replace DiscardingRecycler with FreeingBufferRecycler Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/705ba2e8 Tree:

[5/9] flink git commit: [FLINK-7520][network] let our Buffer class extend from netty's buffer class

2018-01-18 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/85bea23a/flink-runtime/src/test/java/org/apache/flink/runtime/io/network/buffer/AbstractByteBufTest.java -- diff --git

[9/9] flink git commit: [hotfix][network] clarify BufferResponse#size() uses (by removing it)

2018-01-18 Thread srichter
[hotfix][network] clarify BufferResponse#size() uses (by removing it) This field was only used by the code paths on the receiver and was inconsistent with what was added on the sending side. We should use the contained buffer's readableBytes() instead, depending on the actual use case. This

[2/9] flink git commit: [hotfix][io] remove duplicate code between SynchronousBufferFileReader and BufferReadRequest

2018-01-18 Thread srichter
[hotfix][io] remove duplicate code between SynchronousBufferFileReader and BufferReadRequest Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/43593016 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/43593016 Diff:

[4/4] flink git commit: [FLINK-8371][network] always recycle Buffers when releasing SpillableSubpartition

2018-01-11 Thread srichter
[FLINK-8371][network] always recycle Buffers when releasing SpillableSubpartition There were places where Buffer instances were not released upon SpillableSubpartition#release() with a view attached to a non-spilled subpartition: 1) SpillableSubpartition#buffer:

[2/4] flink git commit: [hotfix] add some more buffer recycling checks in SpillableSubpartitionTest

2018-01-11 Thread srichter
[hotfix] add some more buffer recycling checks in SpillableSubpartitionTest Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/9398dafa Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/9398dafa Diff:

[3/4] flink git commit: [FLINK-7499][io] also let AsynchronousBufferFileWriter#writeBlock() recycle the buffer in case of failures

2018-01-11 Thread srichter
[FLINK-7499][io] also let AsynchronousBufferFileWriter#writeBlock() recycle the buffer in case of failures This fixes a double-recycle in SpillableSubpartitionView and also makes sure that even if adding the (asynchronous) write operation fails, the buffer is properly freed in code that did not

[1/4] flink git commit: [hotfix] only update buffer statistics in SpillableSubpartition#add() if successful

2018-01-11 Thread srichter
Repository: flink Updated Branches: refs/heads/release-1.4 6f50ed256 -> 71ede3992 [hotfix] only update buffer statistics in SpillableSubpartition#add() if successful Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [FLINK-7475] [state] Introduce ListState#update()

2018-01-10 Thread srichter
Repository: flink Updated Branches: refs/heads/master b7f3497d3 -> 438e4e374 [FLINK-7475] [state] Introduce ListState#update() This closes #4963. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/438e4e37 Tree:

[3/6] flink git commit: [FLINK-7468][network] Implement sender backlog logic for credit-based

2018-01-09 Thread srichter
[FLINK-7468][network] Implement sender backlog logic for credit-based THis closes #4559. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/718a2ba0 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/718a2ba0 Diff:

[4/6] flink git commit: [FLINK-8375][network] Remove unnecessary synchronization

2018-01-09 Thread srichter
[FLINK-8375][network] Remove unnecessary synchronization Synchronized blocks in ResultPartition could affect only: 1. totalNumberOfBuffers and totalNumberOfBytes counters 2. subpartition add(), finish() and release() calls. However: 1. counters were not used anywhere - they are removed by this

[1/6] flink git commit: [hotfix][checkstyle] only ignore checkstyle in existing packages under runtime.io.network

2018-01-09 Thread srichter
Repository: flink Updated Branches: refs/heads/master b32b8359e -> 4c3f6075b [hotfix][checkstyle] only ignore checkstyle in existing packages under runtime.io.network - ignore runtime.io.(async|disk) - ignore runtime.io.network.(api|buffer|netty|partition|serialization|util) -> everything

[6/6] flink git commit: [FLINK-8371][network] always recycle Buffers when releasing SpillableSubpartition

2018-01-09 Thread srichter
[FLINK-8371][network] always recycle Buffers when releasing SpillableSubpartition There were places where Buffer instances were not released upon SpillableSubpartition#release() with a view attached to a non-spilled subpartition: 1) SpillableSubpartition#buffer:

[5/6] flink git commit: [hotfix][tests] move assertions out of the finally block

2018-01-09 Thread srichter
[hotfix][tests] move assertions out of the finally block There was a potential for them to mask exceptions. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/50f09ad3 Tree:

[2/6] flink git commit: [FLINK-8252][benchmarks] convert network benchmarks to streaming benchmarks

2018-01-09 Thread srichter
[FLINK-8252][benchmarks] convert network benchmarks to streaming benchmarks This allows us to use the output flushing interval as a parameter to evaluate, too. This closes #5259. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

[2/2] flink git commit: [FLINK-8385] [checkpointing] Suppress logging of expected exception during snapshot cancellation.

2018-01-09 Thread srichter
[FLINK-8385] [checkpointing] Suppress logging of expected exception during snapshot cancellation. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b5de38ce Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/b5de38ce

[1/2] flink git commit: [FLINK-8385] [checkpointing] Avoid RejectedExecutionException in SharedStateRegistry during disposal from async Zookeeper calls.

2018-01-09 Thread srichter
Repository: flink Updated Branches: refs/heads/master 40ba6261b -> b32b8359e [FLINK-8385] [checkpointing] Avoid RejectedExecutionException in SharedStateRegistry during disposal from async Zookeeper calls. This closes #5256. Project: http://git-wip-us.apache.org/repos/asf/flink/repo

[03/15] flink git commit: [FLINK-8210][network-tests] Collect results into proper mock in MockEnvironment

2018-01-08 Thread srichter
[FLINK-8210][network-tests] Collect results into proper mock in MockEnvironment Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/af6bdb60 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/af6bdb60 Diff:

[14/15] flink git commit: [FLINK-8220][network-benchmarks] Define network benchmarks in Flink project

2018-01-08 Thread srichter
[FLINK-8220][network-benchmarks] Define network benchmarks in Flink project Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/c8161911 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/c8161911 Diff:

[04/15] flink git commit: [FLINK-7416][network] Implement Netty receiver outgoing pipeline for credit-based

2018-01-08 Thread srichter
[FLINK-7416][network] Implement Netty receiver outgoing pipeline for credit-based Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/1752fdb3 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/1752fdb3 Diff:

[05/15] flink git commit: [FLINK-7406][network] Implement Netty receiver incoming pipeline for credit-based

2018-01-08 Thread srichter
[FLINK-7406][network] Implement Netty receiver incoming pipeline for credit-based Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/268867ce Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/268867ce Diff:

[06/15] flink git commit: [hotfix][network] Drop redundant this reference usages

2018-01-08 Thread srichter
[hotfix][network] Drop redundant this reference usages Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/1f60a1de Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/1f60a1de Diff:

[13/15] flink git commit: [hotfix][util] Added suppressExceptions for lambda functions

2018-01-08 Thread srichter
[hotfix][util] Added suppressExceptions for lambda functions Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/81d3e72e Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/81d3e72e Diff:

[09/15] flink git commit: [FLINK-8209][network-tests] Make LocalBufferPoolDestroyTest less implementation dependent

2018-01-08 Thread srichter
[FLINK-8209][network-tests] Make LocalBufferPoolDestroyTest less implementation dependent Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/5cf37782 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/5cf37782 Diff:

[10/15] flink git commit: [FLINK-8178][network] Introduce not threadsafe write only BufferBuilder

2018-01-08 Thread srichter
[FLINK-8178][network] Introduce not threadsafe write only BufferBuilder While Buffer class is used in multithreaded context it requires synchronisation. Previously it was miss-leading and unclear, suggesting that RecordSerializer should take into account synchronisation of the Buffer that's

[12/15] flink git commit: [hotfix][runtime] Remove unused methods

2018-01-08 Thread srichter
[hotfix][runtime] Remove unused methods Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/d5d4da1b Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/d5d4da1b Diff:

[07/15] flink git commit: [FLINK-8207][network-tests] Unify TestInfiniteBufferProvider and TestPooledBufferProvider

2018-01-08 Thread srichter
[FLINK-8207][network-tests] Unify TestInfiniteBufferProvider and TestPooledBufferProvider Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/91c72b9d Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/91c72b9d Diff:

[11/15] flink git commit: [FLINK-8208][network-tests] Reduce mockito usage in RecordWriterTest

2018-01-08 Thread srichter
[FLINK-8208][network-tests] Reduce mockito usage in RecordWriterTest Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/97db0bf9 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/97db0bf9 Diff:

[15/15] flink git commit: [FLINK-8221][network-benchmarks] Define latency network benchmarks in Flink project

2018-01-08 Thread srichter
[FLINK-8221][network-benchmarks] Define latency network benchmarks in Flink project This closes #5255. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/2558ae51 Tree:

[01/15] flink git commit: [hotfix][test] Add timeout for joining with CheckedThread

2018-01-08 Thread srichter
Repository: flink Updated Branches: refs/heads/master 542419ba0 -> 2558ae511 [hotfix][test] Add timeout for joining with CheckedThread Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/435d9d32 Tree:

[08/15] flink git commit: [hotfix][network-tests] Simplify TestPooledBufferProvider

2018-01-08 Thread srichter
[hotfix][network-tests] Simplify TestPooledBufferProvider Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/409ea231 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/409ea231 Diff:

[4/5] flink git commit: [FLINK-7499][io] also let AsynchronousBufferFileWriter#writeBlock() recycle the buffer in case of failures

2018-01-05 Thread srichter
[FLINK-7499][io] also let AsynchronousBufferFileWriter#writeBlock() recycle the buffer in case of failures This fixes a double-recycle in SpillableSubpartitionView and also makes sure that even if adding the (asynchronous) write operation fails, the buffer is properly freed in code that did not

[1/5] flink git commit: [FLINK-7427][network] integrate PartitionRequestProtocol into NettyProtocol

2018-01-05 Thread srichter
Repository: flink Updated Branches: refs/heads/master f399b3fbb -> fcdd56e54 [FLINK-7427][network] integrate PartitionRequestProtocol into NettyProtocol - removes one level of (unneeded) abstraction for clarity This closes #4528. Project: http://git-wip-us.apache.org/repos/asf/flink/repo

[2/5] flink git commit: [hotfix] add some more buffer recycling checks in SpillableSubpartitionTest

2018-01-05 Thread srichter
[hotfix] add some more buffer recycling checks in SpillableSubpartitionTest Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/7fa3b55e Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/7fa3b55e Diff:

[3/5] flink git commit: [hotfix] only update buffer statistics in SpillableSubpartition#add() if successful

2018-01-05 Thread srichter
[hotfix] only update buffer statistics in SpillableSubpartition#add() if successful Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/79bcdffc Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/79bcdffc Diff:

[5/5] flink git commit: [FLINK-7517][network] let NettyBufferPool extend PooledByteBufAllocator

2018-01-05 Thread srichter
[FLINK-7517][network] let NettyBufferPool extend PooledByteBufAllocator Previously, NettyBufferPool only wrapped PooledByteBufAllocator but then, any allocated buffer's alloc() method was returning the wrapped PooledByteBufAllocator which allowed heap buffers again. By extending the

flink git commit: [FLINK-7316][network] Always use off-heap network buffers.

2017-11-24 Thread srichter
Repository: flink Updated Branches: refs/heads/master 54dd91603 -> 1854a3de1 [FLINK-7316][network] Always use off-heap network buffers. This is another step at using or own (off-heap) buffers for network communication that we pass through netty in order to avoid unnecessary buffer copies.

flink git commit: [FLINK-5465] [streaming] Wait for pending timer threads to finish or to exceed a time limit in exceptional stream task shutdown.

2017-11-23 Thread srichter
Repository: flink Updated Branches: refs/heads/release-1.4 e100861f8 -> 828ef09b0 [FLINK-5465] [streaming] Wait for pending timer threads to finish or to exceed a time limit in exceptional stream task shutdown. This closes #5058. (cherry picked from commit d86c6b6) Project:

flink git commit: [FLINK-5465] [streaming] Wait for pending timer threads to finish or to exceed a time limit in exceptional stream task shutdown.

2017-11-23 Thread srichter
Repository: flink Updated Branches: refs/heads/master fda2c9ff6 -> d86c6b6bb [FLINK-5465] [streaming] Wait for pending timer threads to finish or to exceed a time limit in exceptional stream task shutdown. This closes #5058. Project: http://git-wip-us.apache.org/repos/asf/flink/repo

flink git commit: [FLINK-6505] Proactively cleanup local FS for RocksDBKeyedStateBackend on startup

2017-11-23 Thread srichter
Repository: flink Updated Branches: refs/heads/release-1.4 35517f129 -> 8a052bf09 [FLINK-6505] Proactively cleanup local FS for RocksDBKeyedStateBackend on startup Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/8a052bf0

flink git commit: [FLIN-6505] Proactively cleanup local FS for RocksDBKeyedStateBackend on startup

2017-11-23 Thread srichter
Repository: flink Updated Branches: refs/heads/master 200612ee0 -> ccf917de2 [FLIN-6505] Proactively cleanup local FS for RocksDBKeyedStateBackend on startup Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/ccf917de Tree:

flink git commit: [FLINK-4809] [checkpoints] Operators should tolerate checkpoint failures.

2017-11-20 Thread srichter
Repository: flink Updated Branches: refs/heads/master 0a22acef4 -> 7c63526ad [FLINK-4809] [checkpoints] Operators should tolerate checkpoint failures. This closes #4883. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [FLINK-8053] [checkpoints] Default to asynchronous snapshots for FsStateBackend and MemoryStateBackend.

2017-11-14 Thread srichter
Repository: flink Updated Branches: refs/heads/release-1.4 8f2d0fa8c -> 8b7698dbc [FLINK-8053] [checkpoints] Default to asynchronous snapshots for FsStateBackend and MemoryStateBackend. (cherry picked from commit 2906698) Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [FLINK-8053] [checkpoints] Default to asynchronous snapshots for FsStateBackend and MemoryStateBackend.

2017-11-14 Thread srichter
Repository: flink Updated Branches: refs/heads/master d139e6340 -> 2906698b4 [FLINK-8053] [checkpoints] Default to asynchronous snapshots for FsStateBackend and MemoryStateBackend. This closes #5005. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [FLINK-8040] [tests] Fix test instability in ResourceGuardTest (cherry picked from commit ad8ef6d)

2017-11-13 Thread srichter
Repository: flink Updated Branches: refs/heads/release-1.4 431ae36f7 -> e2b92f22c [FLINK-8040] [tests] Fix test instability in ResourceGuardTest (cherry picked from commit ad8ef6d) Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [FLINK-8040] [tests] Fix test instability in ResourceGuardTest

2017-11-13 Thread srichter
Repository: flink Updated Branches: refs/heads/master 2929eda7e -> ad8ef6d01 [FLINK-8040] [tests] Fix test instability in ResourceGuardTest This closes #5004. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/ad8ef6d0

flink git commit: [FLINK-5372] [tests] Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2017-10-19 Thread srichter
Repository: flink Updated Branches: refs/heads/master 479be9d88 -> dbf4c865f [FLINK-5372] [tests] Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints() Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/dbf4c865

flink git commit: [FLINK-7757] [checkpointing] Introduce resource guard for RocksDBKeyedStateBackend to reduce locking and avoid blocking behavior.

2017-10-18 Thread srichter
Repository: flink Updated Branches: refs/heads/master abc3e1c88 -> 7d026aa72 [FLINK-7757] [checkpointing] Introduce resource guard for RocksDBKeyedStateBackend to reduce locking and avoid blocking behavior. This closes #4764. Project: http://git-wip-us.apache.org/repos/asf/flink/repo

flink git commit: [FLINK-7683][state backends] Introduce iterator for keys in KeyedStateBackend. This closes #4722.

2017-09-28 Thread srichter
Repository: flink Updated Branches: refs/heads/master 685ca8af8 -> 3ff059299 [FLINK-7683][state backends] Introduce iterator for keys in KeyedStateBackend. This closes #4722. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [FLINK-7541][runtime] Refactor StateAssignmentOperation and use OperatorID

2017-09-28 Thread srichter
Repository: flink Updated Branches: refs/heads/master 819fe2083 -> 685ca8af8 [FLINK-7541][runtime] Refactor StateAssignmentOperation and use OperatorID This is not complete refactor, some methods still relay on the order of the new and old operators. This closes #4609. Project:

[2/2] flink git commit: [FLINK-7541][runtime] Refactor StateAssignmentOperation and use OperatorID

2017-09-25 Thread srichter
[FLINK-7541][runtime] Refactor StateAssignmentOperation and use OperatorID This is not complete refactor, some methods still relay on the order of the new and old operators. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

[1/2] flink git commit: [hotfix][runtime] Checkstyle changes in TaskStateSnapshot

2017-09-25 Thread srichter
Repository: flink Updated Branches: refs/heads/master 5af463a9c -> f1b2b83d6 [hotfix][runtime] Checkstyle changes in TaskStateSnapshot Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/79b916c7 Tree:

[2/2] flink git commit: [FLINK-7619] Improved abstraction of AbstractAsyncIOCallable to better fit the current usage pattern.

2017-09-25 Thread srichter
[FLINK-7619] Improved abstraction of AbstractAsyncIOCallable to better fit the current usage pattern. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/5af463a9 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/5af463a9

[1/2] flink git commit: [FLINK-7524] Remove potentially blocking behaviour from AbstractCloseableRegistry.

2017-09-25 Thread srichter
Repository: flink Updated Branches: refs/heads/master 1ebd44a63 -> 5af463a9c [FLINK-7524] Remove potentially blocking behaviour from AbstractCloseableRegistry. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/0073204b

[08/11] flink git commit: [FLINK-7461] Remove Backwards compatibility with <= Flink 1.1

2017-08-24 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/6642768a/flink-runtime/src/main/java/org/apache/flink/migration/runtime/state/memory/SerializedStateHandle.java -- diff --git

[09/11] flink git commit: [FLINK-7461] Remove Backwards compatibility with <= Flink 1.1

2017-08-24 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/6642768a/flink-runtime/src/main/java/org/apache/flink/migration/runtime/checkpoint/savepoint/SavepointV0Serializer.java -- diff --git

[04/11] flink git commit: [FLINK-7461] Remove Backwards compatibility with <= Flink 1.1

2017-08-24 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/6642768a/flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperatorMigrationTest.java -- diff --git

[03/11] flink git commit: [FLINK-7461] Remove Backwards compatibility with <= Flink 1.1

2017-08-24 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/6642768a/flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/StatefulJobSavepointFrom11MigrationITCase.java -- diff --git

[02/11] flink git commit: [FLINK-7505] Use lambdas in suppressed exception idiom

2017-08-24 Thread srichter
[FLINK-7505] Use lambdas in suppressed exception idiom Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/5456cf9f Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/5456cf9f Diff:

[05/11] flink git commit: [FLINK-7461] Remove Backwards compatibility with <= Flink 1.1

2017-08-24 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/6642768a/flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/operators/windowing/AccumulatingAlignedProcessingTimeWindowOperatorTest.java -- diff --git

[10/11] flink git commit: [FLINK-7461] Remove Backwards compatibility with <= Flink 1.1

2017-08-24 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/6642768a/flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFA.java -- diff --git a/flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFA.java

[06/11] flink git commit: [FLINK-7461] Remove Backwards compatibility with <= Flink 1.1

2017-08-24 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/6642768a/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/AbstractUdfStreamOperator.java -- diff --git

[07/11] flink git commit: [FLINK-7461] Remove Backwards compatibility with <= Flink 1.1

2017-08-24 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/6642768a/flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/savepoint/MigrationV0ToV1Test.java -- diff --git

[01/11] flink git commit: [FLINK-7460] [state backends] Close all ColumnFamilyHandles when restoring from rescaled incremental checkpoints

2017-08-24 Thread srichter
Repository: flink Updated Branches: refs/heads/master 3f4de57b1 -> 6642768ad [FLINK-7460] [state backends] Close all ColumnFamilyHandles when restoring from rescaled incremental checkpoints Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

[11/11] flink git commit: [FLINK-7461] Remove Backwards compatibility with <= Flink 1.1

2017-08-24 Thread srichter
[FLINK-7461] Remove Backwards compatibility with <= Flink 1.1 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/6642768a Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/6642768a Diff:

flink git commit: [FLINK-7362] [checkpoints] Savepoint property is lost after de/serialization of CheckpointProperties

2017-08-15 Thread srichter
Repository: flink Updated Branches: refs/heads/master d29bed383 -> 843f0cbc1 [FLINK-7362] [checkpoints] Savepoint property is lost after de/serialization of CheckpointProperties Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

[4/7] flink git commit: [FLINK-7213] Introduce state management by OperatorID in TaskManager

2017-08-15 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/b71154a7/flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/tasks/StreamTaskTest.java -- diff --git

[1/7] flink git commit: [FLINK-7268] Add delaying executor in *EventTimeWindowCheckpointingITCase

2017-08-15 Thread srichter
Repository: flink Updated Branches: refs/heads/master 3b0321aee -> d29bed383 [FLINK-7268] Add delaying executor in *EventTimeWindowCheckpointingITCase This helps tease out races, for example the recently discovered one in cleanup of incremental state handles at the SharedStateRegistry.

[5/7] flink git commit: [FLINK-7213] Introduce state management by OperatorID in TaskManager

2017-08-15 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/b71154a7/flink-runtime/src/test/java/org/apache/flink/runtime/taskmanager/TaskStopTest.java -- diff --git

[7/7] flink git commit: [FLINK-7213] Introduce state management by OperatorID in TaskManager

2017-08-15 Thread srichter
[FLINK-7213] Introduce state management by OperatorID in TaskManager Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b71154a7 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/b71154a7 Diff:

[2/7] flink git commit: [FLINK-7268] [checkpoints] Scope SharedStateRegistry objects per (re)start

2017-08-15 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/91a4b276/flink-tests/src/test/java/org/apache/flink/test/checkpointing/HAIncrementalRocksDbBackendEventTimeWindowCheckpointingITCase.java -- diff --git

[3/7] flink git commit: [FLINK-7268] [checkpoints] Scope SharedStateRegistry objects per (re)start

2017-08-15 Thread srichter
[FLINK-7268] [checkpoints] Scope SharedStateRegistry objects per (re)start Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/91a4b276 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/91a4b276 Diff:

[6/7] flink git commit: [FLINK-7213] Introduce state management by OperatorID in TaskManager

2017-08-15 Thread srichter
http://git-wip-us.apache.org/repos/asf/flink/blob/b71154a7/flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/CheckpointCoordinatorFailureTest.java -- diff --git

[2/4] flink git commit: [hotfix][Kafka] Refactor properties for KafkaTestEnvironment setup

2017-08-08 Thread srichter
[hotfix][Kafka] Refactor properties for KafkaTestEnvironment setup Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/e11a5919 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/e11a5919 Diff:

[4/4] flink git commit: [FLINK-7343][utils] Add network proxy utility to simulate network failures

2017-08-08 Thread srichter
[FLINK-7343][utils] Add network proxy utility to simulate network failures Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b7f96f79 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/b7f96f79 Diff:

[1/4] flink git commit: [hotfix][Kafka] Clean up getKafkaServer method

2017-08-08 Thread srichter
Repository: flink Updated Branches: refs/heads/master e2d3e1f86 -> 14bcac7b9 [hotfix][Kafka] Clean up getKafkaServer method Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/14bcac7b Tree:

[3/4] flink git commit: [FLINK-7343][Kafka] Use NetworkFailureProxy in kafka tests

2017-08-08 Thread srichter
[FLINK-7343][Kafka] Use NetworkFailureProxy in kafka tests We shouldn't fail KafkaServers directly, because they might not be able to flush the data. Since we don't want to test how well Kafka implements at-least-once/exactly-once semantic, we just simulate network failure between Flink and Kafka

flink git commit: [FLINK-7369] [backend] Add more information for 'Key group index out of range of key group range' exception

2017-08-04 Thread srichter
Repository: flink Updated Branches: refs/heads/release-1.3 856d44cdb -> f6b1f422a [FLINK-7369] [backend] Add more information for 'Key group index out of range of key group range' exception (cherry picked from commit 0477753) Project: http://git-wip-us.apache.org/repos/asf/flink/repo

flink git commit: [FLINK-7369] [backend] Add more information for 'Key group index out of range of key group range' exception

2017-08-04 Thread srichter
Repository: flink Updated Branches: refs/heads/master 875a1369c -> 04777538c [FLINK-7369] [backend] Add more information for 'Key group index out of range of key group range' exception Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

[2/2] flink git commit: [FLINK-7268] [checkpoints] Scope SharedStateRegistry objects per (re)start

2017-07-28 Thread srichter
[FLINK-7268] [checkpoints] Scope SharedStateRegistry objects per (re)start Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/09caa9ff Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/09caa9ff Diff:

[1/2] flink git commit: [FLINK-7268] [checkpoints] Scope SharedStateRegistry objects per (re)start

2017-07-28 Thread srichter
Repository: flink Updated Branches: refs/heads/release-1.3 0225db288 -> 09caa9ffd http://git-wip-us.apache.org/repos/asf/flink/blob/09caa9ff/flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/ZooKeeperCompletedCheckpointStoreITCase.java

[2/3] flink git commit: Bump to 5.6.1

2017-07-28 Thread srichter
Bump to 5.6.1 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/d7b0661c Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/d7b0661c Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/d7b0661c Branch:

[1/3] flink git commit: Stephan's feedback

2017-07-28 Thread srichter
Repository: flink Updated Branches: refs/heads/master e97514090 -> 219ae33d3 Stephan's feedback Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/219ae33d Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/219ae33d

[3/3] flink git commit: [FLINK-7220] [checkpoints] Update RocksDB dependency to 5.5.5

2017-07-28 Thread srichter
[FLINK-7220] [checkpoints] Update RocksDB dependency to 5.5.5 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/d818fc48 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/d818fc48 Diff:

flink git commit: [hotfix] Backwards compatible deserialization of RocksDB backend UUIDs

2017-07-20 Thread srichter
Repository: flink Updated Branches: refs/heads/master 4341c8a35 -> 2ba5f8733 [hotfix] Backwards compatible deserialization of RocksDB backend UUIDs Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/2ba5f873 Tree:

flink git commit: [hotfix] [tests] Workaround for WaitForAllVerticesToBeRunning not working in TestingCluster

2017-07-18 Thread srichter
Repository: flink Updated Branches: refs/heads/release-1.3 3c0f38369 -> 9643af2b3 [hotfix] [tests] Workaround for WaitForAllVerticesToBeRunning not working in TestingCluster (cherry picked from commit d7f9f9e) Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [hotfix] [tests] Workaround for WaitForAllVerticesToBeRunning not working in TestingCluster

2017-07-18 Thread srichter
Repository: flink Updated Branches: refs/heads/master b8d6778f7 -> d7f9f9e3e [hotfix] [tests] Workaround for WaitForAllVerticesToBeRunning not working in TestingCluster Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [FLINK-6964] [checkpoint] Fix externalized incremental checkpoints for StandaloneCompletedCheckpointStore

2017-07-17 Thread srichter
Repository: flink Updated Branches: refs/heads/release-1.3 1ed2ef438 -> 4b003eafd [FLINK-6964] [checkpoint] Fix externalized incremental checkpoints for StandaloneCompletedCheckpointStore (cherry picked from commit 8cff17f) Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [FLINK-6964] [checkpoint] Fix externalized incremental checkpoints for StandaloneCompletedCheckpointStore

2017-07-14 Thread srichter
Repository: flink Updated Branches: refs/heads/master 94d3166b4 -> 8cff17fcc [FLINK-6964] [checkpoint] Fix externalized incremental checkpoints for StandaloneCompletedCheckpointStore Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [FLINK-6773] [checkpoint] Introduce compression (snappy) for keyed state in full checkpoints and savepoints

2017-07-04 Thread srichter
Repository: flink Updated Branches: refs/heads/master d17a4b9d0 -> 5171513a3 [FLINK-6773] [checkpoint] Introduce compression (snappy) for keyed state in full checkpoints and savepoints Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [hotfix] Additional tests for HadoopDataInputStream#skip vs #seek

2017-06-15 Thread srichter
Repository: flink Updated Branches: refs/heads/master d8756553c -> f27cb2ac9 [hotfix] Additional tests for HadoopDataInputStream#skip vs #seek Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/f27cb2ac Tree:

flink git commit: [FLINK-6776] [runtime] Use skip instead of seek for small forward repositioning in DFS streams

2017-06-15 Thread srichter
Repository: flink Updated Branches: refs/heads/master 59bd8bec1 -> 9141379f6 [FLINK-6776] [runtime] Use skip instead of seek for small forward repositioning in DFS streams Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

[2/2] flink git commit: [FLINK-6690] Fix meta-data restore in RocksDBKeyedStateBackend under rescaling

2017-05-24 Thread srichter
[FLINK-6690] Fix meta-data restore in RocksDBKeyedStateBackend under rescaling Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/353d6004 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/353d6004 Diff:

[1/2] flink git commit: [FLINK-6685] Prevent that SafetyNetCloseableRegistry is closed prematurely in Task::triggerCheckpointBarrier

2017-05-24 Thread srichter
Repository: flink Updated Branches: refs/heads/release-1.3 d552b3447 -> 353d60045 [FLINK-6685] Prevent that SafetyNetCloseableRegistry is closed prematurely in Task::triggerCheckpointBarrier Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [FLINK-6651] Add synchronization to SharedStateRegistry::clear

2017-05-22 Thread srichter
Repository: flink Updated Branches: refs/heads/release-1.3 fcf8466a5 -> 6e40223b5 [FLINK-6651] Add synchronization to SharedStateRegistry::clear (cherry picked from commit 392bc71) Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit:

flink git commit: [FLINK-6651] Add synchronization to SharedStateRegistry::clear

2017-05-22 Thread srichter
Repository: flink Updated Branches: refs/heads/master 654d0ede9 -> 392bc7130 [FLINK-6651] Add synchronization to SharedStateRegistry::clear Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/392bc713 Tree:

<    1   2   3   4   5   6   7   >