buildbot failure in on flink-docs-release-0.10

2016-09-21 Thread buildbot
The Buildbot has detected a new failure on builder flink-docs-release-0.10 while building . Full details are available at: https://ci.apache.org/builders/flink-docs-release-0.10/builds/338 Buildbot URL: https://ci.apache.org/ Buildslave for this Build: bb_slave2_ubuntu Build Reason: The Nig

[2/4] flink git commit: [FLINK-4537] rebase and refine

2016-09-21 Thread mxm
[FLINK-4537] rebase and refine Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b905fdbf Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/b905fdbf Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/b905fdbf Branch:

[3/4] flink git commit: [FLINK-4535] [cluster management] resourceManager process the registration from TaskExecutor

2016-09-21 Thread mxm
[FLINK-4535] [cluster management] resourceManager process the registration from TaskExecutor Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/a31cf004 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/a31cf004 Diff: http

[4/4] flink git commit: [FLINK-4535] rebase and refine

2016-09-21 Thread mxm
[FLINK-4535] rebase and refine Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/4076bd74 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/4076bd74 Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/4076bd74 Branch:

[1/4] flink git commit: [FLINK-4537] [cluster management] ResourceManager registration with JobManager

2016-09-21 Thread mxm
Repository: flink Updated Branches: refs/heads/flip-6 b5f6a06b0 -> 4076bd748 [FLINK-4537] [cluster management] ResourceManager registration with JobManager Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/8b2271bd Tree: htt

flink git commit: [FLINK-4658] [rpc] Allow RpcService to execute Runnables and Callables in its executor

2016-09-21 Thread trohrmann
Repository: flink Updated Branches: refs/heads/flip-6 31a091b93 -> b5f6a06b0 [FLINK-4658] [rpc] Allow RpcService to execute Runnables and Callables in its executor This closes #2531. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/fl

[1/2] flink git commit: [FLINK-4656] [rpc] Port the existing code to Flink's own future abstraction

2016-09-21 Thread trohrmann
Repository: flink Updated Branches: refs/heads/flip-6 04fbdb3c5 -> 31a091b93 http://git-wip-us.apache.org/repos/asf/flink/blob/31a091b9/flink-runtime/src/test/java/org/apache/flink/runtime/rpc/TestingSerialRpcService.java -- di

[2/2] flink git commit: [FLINK-4656] [rpc] Port the existing code to Flink's own future abstraction

2016-09-21 Thread trohrmann
[FLINK-4656] [rpc] Port the existing code to Flink's own future abstraction This closes #2530. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/31a091b9 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/31a091b9 Diff: ht

[1/6] flink git commit: [FLINK-4645] [core] Adjust signatures of 'registerTypeWithKryoSerializer(...)' methods to allow simpler passing of classes without generic casting.

2016-09-21 Thread sewen
Repository: flink Updated Branches: refs/heads/master 721220203 -> b51605686 [FLINK-4645] [core] Adjust signatures of 'registerTypeWithKryoSerializer(...)' methods to allow simpler passing of classes without generic casting. This is not API breaking due to generic type erasure in Java. The ch

[5/6] flink git commit: [hotfix] [tests] Fix race condition in RescalingITCase that could make the test stuck in a blocking call until timeout

2016-09-21 Thread sewen
[hotfix] [tests] Fix race condition in RescalingITCase that could make the test stuck in a blocking call until timeout This closes #2513 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/5f67b54b Tree: http://git-wip-us.apache

[3/6] flink git commit: [hotfix] [streaming api] Add proper deprecation JavaDocs

2016-09-21 Thread sewen
[hotfix] [streaming api] Add proper deprecation JavaDocs Also includes minor style cleanup of a test. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/349d06d6 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/349d06d6 D

[2/6] flink git commit: [hotfix] [docs] Parametrized version of quickstart script and artifacts in the quickstart docs

2016-09-21 Thread sewen
[hotfix] [docs] Parametrized version of quickstart script and artifacts in the quickstart docs This closes #2522 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/db45da7d Tree: http://git-wip-us.apache.org/repos/asf/flink/tre

[6/6] flink git commit: [docs] Update docs on data types and serialization, to include type hints, type registration, and serializer registration.

2016-09-21 Thread sewen
[docs] Update docs on data types and serialization, to include type hints, type registration, and serializer registration. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b5160568 Tree: http://git-wip-us.apache.org/repos/asf/

[4/6] flink git commit: [FLINK-4640] [streaming api] Ensure that the state descriptors properly initialize the serializers.

2016-09-21 Thread sewen
[FLINK-4640] [streaming api] Ensure that the state descriptors properly initialize the serializers. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/4d4eb64b Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/4d4eb64b Dif

flink git commit: [FLINK-4654] [docs] Small improvements to the docs.

2016-09-21 Thread greg
Repository: flink Updated Branches: refs/heads/master 4cc38fd36 -> 721220203 [FLINK-4654] [docs] Small improvements to the docs. This closes #2525 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/72122020 Tree: http://git-

flink git commit: [FLINK-4640] [streaming api] Ensure that the state descriptors properly initialize the serializers.

2016-09-21 Thread sewen
Repository: flink Updated Branches: refs/heads/release-1.1 a7f6594b6 -> 52a4440d9 [FLINK-4640] [streaming api] Ensure that the state descriptors properly initialize the serializers. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flin

flink git commit: [hotfix] Add methods defined in the gateway to the ResourceManager and TaskExecutor

2016-09-21 Thread trohrmann
Repository: flink Updated Branches: refs/heads/flip-6 a04c11c87 -> 04fbdb3c5 [hotfix] Add methods defined in the gateway to the ResourceManager and TaskExecutor Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/04fbdb3c Tre

flink git commit: [FLINK-3042] [FLINK-3060] [types] Define a way to let types create their own TypeInformation

2016-09-21 Thread twalthr
Repository: flink Updated Branches: refs/heads/master 68709b087 -> 4cc38fd36 [FLINK-3042] [FLINK-3060] [types] Define a way to let types create their own TypeInformation This closes #2337. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/

[09/50] [abbrv] flink git commit: [FLINK-3929] conditionally skip RollingSinkSecuredITCase

2016-09-21 Thread trohrmann
[FLINK-3929] conditionally skip RollingSinkSecuredITCase - for now, we skip this test class until Hadoop version 3.x.x. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/285b6f74 Tree: http://git-wip-us.apache.org/repos/asf/fli

[10/50] [abbrv] flink git commit: [FLINK-3929] additional fixes for keytab security

2016-09-21 Thread trohrmann
[FLINK-3929] additional fixes for keytab security - load flink-jaas.conf from classpath - avoid using undocumented flink base dir config entry - enable test cases to run on MacOS - unify suffix of secure test cases - fix error logging and reporting This closes #2275 Project: http://git-wip-us.a

[04/50] [abbrv] flink git commit: [FLINK-4594] [core] Validate lower bound in MathUtils.checkedDownCast

2016-09-21 Thread trohrmann
[FLINK-4594] [core] Validate lower bound in MathUtils.checkedDownCast This closes #2481 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/4f84a02f Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/4f84a02f Diff: http://gi

[31/50] [abbrv] flink git commit: [FLINK-4355] [cluster management] Add tests for the TaskManager -> ResourceManager registration.

2016-09-21 Thread trohrmann
[FLINK-4355] [cluster management] Add tests for the TaskManager -> ResourceManager registration. This closes #2395. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/5ea97a18 Tree: http://git-wip-us.apache.org/repos/asf/flink/

[37/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-09-21 Thread trohrmann
http://git-wip-us.apache.org/repos/asf/flink/blob/2f12ba3e/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/SlotRequest.java -- diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/

[15/50] [abbrv] flink git commit: [FLINK-4362] [rpc] Auto generate rpc gateways via Java proxies

2016-09-21 Thread trohrmann
[FLINK-4362] [rpc] Auto generate rpc gateways via Java proxies This PR introduces a generic AkkaRpcActor which receives rpc calls as a RpcInvocation message. The RpcInvocation message is generated by the AkkaInvocationHandler which gets them from automatically generated Java Proxies. Add document

[45/50] [abbrv] flink git commit: [FLINK-4451] [rpc] Throw RpcConnectionException when rpc endpoint is not reachable

2016-09-21 Thread trohrmann
[FLINK-4451] [rpc] Throw RpcConnectionException when rpc endpoint is not reachable This PR introduces a RpcConnectionException which is thrown if the rpc endpoint is not reachable when calling RpcService.connect. This closes #2405. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Com

[18/50] [abbrv] flink git commit: [FLINK-4346] [rpc] Add new RPC abstraction

2016-09-21 Thread trohrmann
[FLINK-4346] [rpc] Add new RPC abstraction Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/04bcb715 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/04bcb715 Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/04bcb

[40/50] [abbrv] flink git commit: [FLINK-4363] Implement TaskManager basic startup of all components in java

2016-09-21 Thread trohrmann
[FLINK-4363] Implement TaskManager basic startup of all components in java This closes #2400 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/35e80103 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/35e80103 Diff: http

[28/50] [abbrv] flink git commit: [FLINK-4400] [cluster mngmt] Implement leadership election among JobMasters

2016-09-21 Thread trohrmann
[FLINK-4400] [cluster mngmt] Implement leadership election among JobMasters Adapt related components to the changes in HighAvailabilityServices Add comments for getJobMasterElectionService in HighAvailabilityServices This closes #2377. Project: http://git-wip-us.apache.org/repos/asf/flink/repo

[23/50] [abbrv] flink git commit: [FLINK-4373] [cluster management] Introduce SlotID, AllocationID, ResourceProfile

2016-09-21 Thread trohrmann
[FLINK-4373] [cluster management] Introduce SlotID, AllocationID, ResourceProfile [FLINK-4373] [cluster management] address comments This closes #2370. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/9159ad6e Tree: http://g

[34/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-09-21 Thread trohrmann
http://git-wip-us.apache.org/repos/asf/flink/blob/2f12ba3e/flink-runtime/src/test/java/org/apache/flink/runtime/clusterframework/SlotManagerTest.java -- diff --git a/flink-runtime/src/test/java/org/apache/flink/runtime/clusterfram

[30/50] [abbrv] flink git commit: [FLINK-4434] [rpc] Add a testing RPC service.

2016-09-21 Thread trohrmann
[FLINK-4434] [rpc] Add a testing RPC service. This closes #2394. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/e6b0f12c Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/e6b0f12c Diff: http://git-wip-us.apache.org/rep

[16/50] [abbrv] flink git commit: [FLINK-4368] [distributed runtime] Eagerly initialize the RPC endpoint members

2016-09-21 Thread trohrmann
[FLINK-4368] [distributed runtime] Eagerly initialize the RPC endpoint members This closes #2351 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/94e00927 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/94e00927 Diff:

[02/50] [abbrv] flink git commit: [FLINK-4247] [table] CsvTableSource.getDataSet() expects Java ExecutionEnvironment

2016-09-21 Thread trohrmann
[FLINK-4247] [table] CsvTableSource.getDataSet() expects Java ExecutionEnvironment This closes #2298. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/0975d9f1 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/0975d9f1

[20/50] [abbrv] flink git commit: [FLINK-4392] [rpc] Make RPC Service thread-safe

2016-09-21 Thread trohrmann
[FLINK-4392] [rpc] Make RPC Service thread-safe Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/86f21bf9 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/86f21bf9 Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/

[06/50] [abbrv] flink git commit: [FLINK-4638] [core] Fix exception message for MemorySegment

2016-09-21 Thread trohrmann
[FLINK-4638] [core] Fix exception message for MemorySegment This closes #2515 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/7a25bf5c Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/7a25bf5c Diff: http://git-wip-us.a

[43/50] [abbrv] flink git commit: [FLINK-4528] [rpc] Marks main thread execution methods in RpcEndpoint as protected

2016-09-21 Thread trohrmann
[FLINK-4528] [rpc] Marks main thread execution methods in RpcEndpoint as protected Give main thread execution context into the TaskExecutorToResourceManagerConnection Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b779d19d

[41/50] [abbrv] flink git commit: [FLINK-4347][cluster management] Implement SlotManager core

2016-09-21 Thread trohrmann
[FLINK-4347][cluster management] Implement SlotManager core This closes #2388 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/ba78de80 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/ba78de80 Diff: http://git-wip-us.a

[49/50] [abbrv] flink git commit: [FLINK-4361] Introduce Flink's own future abstraction

2016-09-21 Thread trohrmann
[FLINK-4361] Introduce Flink's own future abstraction Flink's future abstraction whose API is similar to Java 8's CompletableFuture. That's in order to ease a future transition to this class once we ditch Java 7. The current set of operations comprises: - isDone to check the completion of the fut

[29/50] [abbrv] flink git commit: [FLINK-4443] [rpc] Add support for rpc gateway and rpc endpoint inheritance

2016-09-21 Thread trohrmann
[FLINK-4443] [rpc] Add support for rpc gateway and rpc endpoint inheritance This commit extends the RpcCompletenessTest such that it can now check for inherited remote procedure calls. All methods defined at the RpcGateway are considered native. This means that they need no RpcEndpoint counterpa

[22/50] [abbrv] flink git commit: [FLINK-4386] [rpc] Add a utility to verify calls happen in the Rpc Endpoint's main thread

2016-09-21 Thread trohrmann
[FLINK-4386] [rpc] Add a utility to verify calls happen in the Rpc Endpoint's main thread Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/4ca049b5 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/4ca049b5 Diff: http://

[50/50] [abbrv] flink git commit: [hotfix] Remove unused imports from SlotRequestRegistered/Rejected and ResourceSlot

2016-09-21 Thread trohrmann
[hotfix] Remove unused imports from SlotRequestRegistered/Rejected and ResourceSlot Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/a04c11c8 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/a04c11c8 Diff: http://git-wi

[11/50] [abbrv] flink git commit: [FLINK-3929] Added Keytab based Kerberos support to enable secure Flink cluster deployment(addresses HDHS, Kafka and ZK services)

2016-09-21 Thread trohrmann
http://git-wip-us.apache.org/repos/asf/flink/blob/25a622fd/flink-yarn/src/main/java/org/apache/flink/yarn/AbstractYarnClusterDescriptor.java -- diff --git a/flink-yarn/src/main/java/org/apache/flink/yarn/AbstractYarnClusterDescrip

[39/50] [abbrv] flink git commit: [hotfix] [clustermgnt] Set pending registration properly in TaskExecutorToResourceManagerConnection

2016-09-21 Thread trohrmann
[hotfix] [clustermgnt] Set pending registration properly in TaskExecutorToResourceManagerConnection Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/ffd20e98 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/ffd20e98 Dif

[25/50] [abbrv] flink git commit: [FLINK-4403] [rpc] Use relative classloader for proxies, rather than system class loader.

2016-09-21 Thread trohrmann
[FLINK-4403] [rpc] Use relative classloader for proxies, rather than system class loader. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/68998378 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/68998378 Diff: http://

[21/50] [abbrv] flink git commit: [FLINK-4384] [rpc] Add "scheduleRunAsync()" to the RpcEndpoint

2016-09-21 Thread trohrmann
[FLINK-4384] [rpc] Add "scheduleRunAsync()" to the RpcEndpoint This closes #2360 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/f5614a4c Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/f5614a4c Diff: http://git-wip-u

[26/50] [abbrv] flink git commit: [FLINK-4382] [rpc] Buffer rpc calls until the RpcEndpoint has been started

2016-09-21 Thread trohrmann
[FLINK-4382] [rpc] Buffer rpc calls until the RpcEndpoint has been started This PR allows the AkkaRpcActor to stash messages until the corresponding RcpEndpoint has been started. When receiving a Processing.START message, the AkkaRpcActor unstashes all messages and starts processing rpcs. When re

[46/50] [abbrv] flink git commit: [hotfix] [taskmanager] Fixes TaskManager component creation at startup

2016-09-21 Thread trohrmann
[hotfix] [taskmanager] Fixes TaskManager component creation at startup Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/26305430 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/26305430 Diff: http://git-wip-us.apache.or

[17/50] [abbrv] flink git commit: [FLINK-4346] [rpc] Add new RPC abstraction

2016-09-21 Thread trohrmann
http://git-wip-us.apache.org/repos/asf/flink/blob/04bcb715/flink-runtime/src/main/java/org/apache/flink/runtime/rpc/resourcemanager/ResourceManagerGateway.java -- diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/r

[36/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-09-21 Thread trohrmann
http://git-wip-us.apache.org/repos/asf/flink/blob/2f12ba3e/flink-runtime/src/main/java/org/apache/flink/runtime/rpc/taskexecutor/TaskExecutor.java -- diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/rpc/taskexecut

[24/50] [abbrv] flink git commit: [FLINK-4355] [cluster management] Implement TaskManager side of registration at ResourceManager.

2016-09-21 Thread trohrmann
[FLINK-4355] [cluster management] Implement TaskManager side of registration at ResourceManager. This closes #2353 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/fe90811a Tree: http://git-wip-us.apache.org/repos/asf/flink/t

[38/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-09-21 Thread trohrmann
[FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package The TaskExecutor, the JobMaster and the ResourceManager were still contained in the rpc package. With this commit, they will be moved out of this package. Now they are contained in dedicated packages o

[19/50] [abbrv] flink git commit: [FLINK-4383] [rpc] Eagerly serialize remote rpc invocation messages

2016-09-21 Thread trohrmann
[FLINK-4383] [rpc] Eagerly serialize remote rpc invocation messages This PR introduces an eager serialization for remote rpc invocation messages. That way it is possible to check whether the message is serializable and whether it exceeds the maximum allowed akka frame size. If either of these cons

[48/50] [abbrv] flink git commit: [FLINK-4538][FLINK-4348] ResourceManager slot allocation protcol

2016-09-21 Thread trohrmann
[FLINK-4538][FLINK-4348] ResourceManager slot allocation protcol - associates JobMasters with JobID instead of InstanceID - adds TaskExecutorGateway to slot - adds SlotManager as RM constructor parameter - adds LeaderRetrievalListener to SlotManager to keep track of the leader id - tests the inte

[44/50] [abbrv] flink git commit: [hotfix] Add self rpc gateway registration to TestingSerialRpcService

2016-09-21 Thread trohrmann
[hotfix] Add self rpc gateway registration to TestingSerialRpcService Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/12af3b13 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/12af3b13 Diff: http://git-wip-us.apache.org

[33/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-09-21 Thread trohrmann
http://git-wip-us.apache.org/repos/asf/flink/blob/2f12ba3e/flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/SlotManagerTest.java -- diff --git a/flink-runtime/src/test/java/org/apache/flink/runtime/resourcemana

[08/50] [abbrv] flink git commit: [FLINK-2662] [dataSet] [optimizer] Fix merging of unions with multiple outputs.

2016-09-21 Thread trohrmann
[FLINK-2662] [dataSet] [optimizer] Fix merging of unions with multiple outputs. Translate union with N outputs into N unions with single output. This closes #2508. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/303f6fee Tre

[07/50] [abbrv] flink git commit: [FLINK-4268] [core] Add a parsers for BigDecimal/BigInteger

2016-09-21 Thread trohrmann
[FLINK-4268] [core] Add a parsers for BigDecimal/BigInteger This closes #2304. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/5c02988b Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/5c02988b Diff: http://git-wip-us.

[27/50] [abbrv] flink git commit: [FLINK-4414] [cluster] Add getAddress method to RpcGateway

2016-09-21 Thread trohrmann
[FLINK-4414] [cluster] Add getAddress method to RpcGateway The RpcGateway.getAddress method allows to retrieve the fully qualified address of the associated RpcEndpoint. This closes #2392. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf

[47/50] [abbrv] flink git commit: [FLINK-4538][FLINK-4348] ResourceManager slot allocation protcol

2016-09-21 Thread trohrmann
http://git-wip-us.apache.org/repos/asf/flink/blob/0a134a32/flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/SlotManagerTest.java -- diff --git a/flink-runtime/src/test/java/org/apache/flink/runtime/resourcemana

[05/50] [abbrv] flink git commit: [FLINK-4609] [java-api] Remove redundant check for null in CrossOperator

2016-09-21 Thread trohrmann
[FLINK-4609] [java-api] Remove redundant check for null in CrossOperator This closes #2490 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/470b752e Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/470b752e Diff: http:/

[12/50] [abbrv] flink git commit: [FLINK-3929] Added Keytab based Kerberos support to enable secure Flink cluster deployment(addresses HDHS, Kafka and ZK services)

2016-09-21 Thread trohrmann
http://git-wip-us.apache.org/repos/asf/flink/blob/25a622fd/flink-streaming-connectors/flink-connector-kafka-0.9/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaTestEnvironmentImpl.java -- diff --git a/flink-streamin

[01/50] [abbrv] flink git commit: [FLINK-4610] [core] Replace keySet/getValue with entrySet in UdfAnalyzerUtils [Forced Update!]

2016-09-21 Thread trohrmann
Repository: flink Updated Branches: refs/heads/flip-6 11cc6b95b -> a04c11c87 (forced update) [FLINK-4610] [core] Replace keySet/getValue with entrySet in UdfAnalyzerUtils This closes #2491 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/a

[35/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-09-21 Thread trohrmann
http://git-wip-us.apache.org/repos/asf/flink/blob/2f12ba3e/flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskExecutor.java -- diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskE

[03/50] [abbrv] flink git commit: [FLINK-4572] [gelly] Convert to negative in LongValueToIntValue

2016-09-21 Thread trohrmann
[FLINK-4572] [gelly] Convert to negative in LongValueToIntValue The Gelly drivers expect that scale 32 edges, represented by the lower 32 bits of long values, can be converted to int values. Values between 2^31 and 2^32 - 1 should be converted to negative integers. Creates separate signed and uns

[32/50] [abbrv] flink git commit: [hotfix] Remove RecoveryMode from JobMaster

2016-09-21 Thread trohrmann
[hotfix] Remove RecoveryMode from JobMaster The recovery mode is not used any more by the latest CheckpointCoordinator. All difference in recovery logic between high-availability and non-high-availability is encapsulated in the HighAvailabilityServices. Project: http://git-wip-us.apache.org/re

[42/50] [abbrv] flink git commit: [FLINK-4516] leader election of resourcemanager

2016-09-21 Thread trohrmann
[FLINK-4516] leader election of resourcemanager - add serial rpc service - add a special rpcService implementation which directly executes the asynchronous calls serially one by one, it is just for testcase - Change ResourceManagerLeaderContender code and TestingSerialRpcService code - override s

[14/50] [abbrv] flink git commit: [FLINK-4362] [rpc] Auto generate rpc gateways via Java proxies

2016-09-21 Thread trohrmann
http://git-wip-us.apache.org/repos/asf/flink/blob/f5cf6b56/flink-runtime/src/test/java/org/apache/flink/runtime/rpc/akka/AkkaRpcServiceTest.java -- diff --git a/flink-runtime/src/test/java/org/apache/flink/runtime/rpc/akka/AkkaRpc

[13/50] [abbrv] flink git commit: [FLINK-3929] Added Keytab based Kerberos support to enable secure Flink cluster deployment(addresses HDHS, Kafka and ZK services)

2016-09-21 Thread trohrmann
[FLINK-3929] Added Keytab based Kerberos support to enable secure Flink cluster deployment(addresses HDHS, Kafka and ZK services) FLINK-3929 Added MiniKDC support for Kafka, Zookeeper, RollingFS and Yarn integration test modules Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit

flink git commit: [FLINK-4361] Introduce Flink's own future abstraction

2016-09-21 Thread trohrmann
Repository: flink Updated Branches: refs/heads/flip-6 d159de62f -> 11cc6b95b [FLINK-4361] Introduce Flink's own future abstraction Flink's future abstraction whose API is similar to Java 8's CompletableFuture. That's in order to ease a future transition to this class once we ditch Java 7. The