[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2015-12-01 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1426#issuecomment-161056518 Okay, I'll reopen two new PRs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2015-12-01 Thread rmetzger
Github user rmetzger closed the pull request at: https://github.com/apache/flink/pull/1426 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2015-12-01 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1427 [FLINK-3093] Introduce annotations for interface stability in flink-core Please see https://github.com/apache/flink/pull/1426 You can merge this pull request into a Git repository by running

[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2015-12-01 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1428 [FLINK-3093] Introduce annotations for interface stability in remaining modules Please see https://github.com/apache/flink/pull/1426 This pull request depends on https://github.com/apache

[GitHub] flink pull request: FLINK-2949 [WIP]: Add method 'writeSequencefil...

2015-12-01 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1311#issuecomment-161058586 Thank you for the contribution. To me it seems that the pull request so far consists only of unrelated changes. Did you make any progress on resolving the issue

[GitHub] flink pull request: [FLINK-3102] Allow reading from multiple topic...

2015-12-04 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1437 [FLINK-3102] Allow reading from multiple topics with one FlinkKafkaConsumer * I added a new constructor to the Kafka source, accepting a List of topics. * the deserialization schema will get

[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2015-12-05 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1427#discussion_r46756747 --- Diff: flink-core/src/main/java/org/apache/flink/types/Pair.java --- @@ -33,6 +34,7 @@ * @param Type of the pair's first element. * @

[GitHub] flink pull request: [FLINK-2976] Allow to trigger checkpoints manu...

2015-12-05 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1434#issuecomment-162168898 Awesome change! I think its a feature many users are asking for because its crucial for production use! I'll try to review it soon. --- If your project is s

[GitHub] flink pull request: [FLINK-2954] Add config parameter for passing ...

2015-12-05 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1409#issuecomment-162174050 Thanks for the review. I'll merge it soon --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] flink pull request: [FLINK-3023][web-dashboard] Display version an...

2015-12-06 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1422#issuecomment-162333939 Tested the change on a cluster ![image](https://cloud.githubusercontent.com/assets/89049/11614772/3c8c2ec4-9c4d-11e5-870e-0d75586d53ae.png) --- If your project

[GitHub] flink pull request: [FLINK-3023][web-dashboard] Display version an...

2015-12-06 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1422#discussion_r46773662 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/handlers/ClusterOverviewHandler.java --- @@ -63,6 +67,10 @@ public String

[GitHub] flink pull request: [FLINK-2978][web-dashboard][webclient] Integra...

2015-12-06 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1338#issuecomment-162334327 I've tested the change again on a cluster, works nicely! ![image](https://cloud.githubusercontent.com/assets/89049/11614821/5f2f4ca8-9c4e-11e5

[GitHub] flink pull request: [FLINK-3073] Replace Streaming Mode by Memory ...

2015-12-06 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1433#issuecomment-162334401 Tested the change on a cluster with a job reading some 100GBs of data ... looks good .. ``` 19:07:19,537 INFO

[GitHub] flink pull request: [FLINK-3102] Allow reading from multiple topic...

2015-12-07 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1437#issuecomment-162465233 The `KeyedDeserializationSchema` is a new interface introduced in 1.0. I don't want to break the existing `DeserializationSchema` with the change. Even befor

[GitHub] flink pull request: Bumped the docker container to the latest vers...

2015-12-07 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1366#issuecomment-162468460 +1 to merge. I've verified the change locally. I'll merge it. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] flink pull request: [FLINK-3102] Allow reading from multiple topic...

2015-12-07 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1437#discussion_r46836686 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer.java --- @@ -25,6

[GitHub] flink pull request: [FLINK-3102] Allow reading from multiple topic...

2015-12-07 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1437#discussion_r46837656 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/Fetcher.java --- @@ -61,15

[GitHub] flink pull request: [FLINK-3102] Allow reading from multiple topic...

2015-12-07 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1437#discussion_r46840520 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer.java --- @@ -640,30

[GitHub] flink pull request: [FLINK-3102] Allow reading from multiple topic...

2015-12-07 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1437#discussion_r46840339 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/KafkaTopicPartition.java

[GitHub] flink pull request: [FLINK-3102] Allow reading from multiple topic...

2015-12-07 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1437#issuecomment-162634935 Thank you for the good reviews! I've addressed all comments. The entire kafka connector is now using a space after `if` and `for`. --- If your project i

[GitHub] flink pull request: [FLINK-3074] Add config option to start YARN A...

2015-12-08 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1416#issuecomment-162943866 Thank you for the good review I've addressed all your concerns. I've also changed the method which parses the configuration string to return an iterator

[GitHub] flink pull request: [FLINK-3150] Make the YARN container start inv...

2015-12-09 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1446 [FLINK-3150] Make the YARN container start invocation configurable You can merge this pull request into a Git repository by running: $ git pull https://github.com/rmetzger/flink flink3150

[GitHub] flink pull request: [FLINK-3074] Add config option to start YARN A...

2015-12-10 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1416#issuecomment-163554565 Thank you for the review! I've merged it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] flink pull request: [FLINK-3121] Emit Final Watermark in Kafka Sou...

2015-12-10 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1447#issuecomment-16382 +1 for the Kafka part. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink pull request: [FLINK-2769] [runtime-web] Add configurable jo...

2015-12-10 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1449#discussion_r47281222 --- Diff: flink-runtime-web/web-dashboard/app/scripts/modules/overview/overview.svc.coffee --- @@ -24,7 +24,7 @@ angular.module('fli

[GitHub] flink pull request: [FLINK-2769] [runtime-web] Add configurable jo...

2015-12-11 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1449#issuecomment-163953942 I think its good to merge, +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] flink pull request: [FLINK-3067] Use curator for committing offset...

2015-12-12 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1451 [FLINK-3067] Use curator for committing offsets to ZK from Kafka @aljoscha reported issues with our latest FlinkKafkaConnector: It was still throwing NPE. Therefore, I decided to abandon the

[GitHub] flink pull request: [FLINK-3023][web-dashboard] Display version an...

2015-12-12 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1422#issuecomment-164177222 Merging ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request: [FLINK-3077][cli] Add version option to Cli.

2015-12-12 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1418#issuecomment-164177365 I'll merge this change ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] flink pull request: [FLINK-3067] Use curator for committing offset...

2015-12-14 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1451#discussion_r47531635 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer.java --- @@ -632,6

[GitHub] flink pull request: [FLINK-3067] Use curator for committing offset...

2015-12-14 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1451#discussion_r47536647 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/ZookeeperOffsetHandler.java

[GitHub] flink pull request: [FLINK-3067] Use curator for committing offset...

2015-12-14 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1451#discussion_r47536514 --- Diff: flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/ZookeeperOffsetHandler.java

[GitHub] flink pull request: [FLINK-3134][yarn] asynchronous YarnJobManager...

2015-12-15 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1450#discussion_r47611363 --- Diff: flink-yarn/src/main/scala/org/apache/flink/yarn/YarnJobManager.scala --- @@ -754,6 +538,243 @@ class YarnJobManager( memoryLimit

[GitHub] flink pull request: [FLINK-3134][yarn] asynchronous YarnJobManager...

2015-12-15 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1450#discussion_r47611847 --- Diff: flink-yarn/src/main/scala/org/apache/flink/yarn/ApplicationClient.scala --- @@ -29,6 +31,7 @@ import org.apache.flink.runtime.akka.AkkaUtils

[GitHub] flink pull request: [FLINK-3134][yarn] asynchronous YarnJobManager...

2015-12-15 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1450#discussion_r47612509 --- Diff: flink-yarn/src/main/scala/org/apache/flink/yarn/YarnJobManager.scala --- @@ -754,6 +538,243 @@ class YarnJobManager( memoryLimit

[GitHub] flink pull request: [FLINK-3134][yarn] asynchronous YarnJobManager...

2015-12-15 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1450#issuecomment-164696473 I've tested the change on a cluster and everything is working fine. I had some minor comments. --- If your project is set up for it, you can reply to this

[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2015-12-15 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1427#issuecomment-164762014 Thank you all for the comments. I'll rename the interfaces to `@Public` and `@Experimental`. I'll keep the annotation on the `ConfigConstants

[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2015-12-15 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1427#issuecomment-164764484 I didn't make `MemorySegment` a public API. Lets declare it in the pull request as stable. I decided to mark `XORShiftRandom` and `NumberSequenceIterator` as s

[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2015-12-15 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1427#issuecomment-164768159 > Are inner classes of a class tagged as PublicInterface also marked as public/stable? Yes! --- If your project is set up for it, you can reply to this em

[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2015-12-15 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1427#issuecomment-164777618 I addressed all issues you've mentioned and rebased the code to the current master. I would like to merge this soon! --- If your project is set up for it, yo

[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2015-12-15 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1428#issuecomment-164781638 Thank you for your patch. I've added it to the PR. Regarding your question: I would keep name changes separate from this PR. Once this one is merged, w

[GitHub] flink pull request: [FLINK-3134][yarn] asynchronous YarnJobManager...

2015-12-15 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1450#discussion_r47651966 --- Diff: flink-yarn/src/main/scala/org/apache/flink/yarn/YarnJobManager.scala --- @@ -155,12 +156,14 @@ class YarnJobManager

[GitHub] flink pull request: [FLINK-3134][yarn] asynchronous YarnJobManager...

2015-12-15 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1450#discussion_r47656932 --- Diff: flink-yarn/src/main/scala/org/apache/flink/yarn/YarnJobManager.scala --- @@ -155,12 +156,14 @@ class YarnJobManager

[GitHub] flink pull request: [FLINK-3147] HadoopOutputFormatBase should exp...

2015-12-15 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1442#issuecomment-164828376 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request: [FLINK-3194] Remove standalone web client

2016-01-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1481#issuecomment-168620845 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request: [FLINK-3188] Pass deletes to KeyedDeserializat...

2016-01-04 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1484 [FLINK-3188] Pass deletes to KeyedDeserializationSchema I've converted the two patches from https://issues.apache.org/jira/browse/FLINK-3188 into this pull request. I removed the m

[GitHub] flink pull request: [FLINK-3188] Pass deletes to KeyedDeserializat...

2016-01-04 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1484#issuecomment-168766653 I'd like to merge this change in the next 12 hours: its a rather small fix with a test and travis passed. --- If your project is set up for it, you can reply to

[GitHub] flink pull request: [FLINK-3188] Pass deletes to KeyedDeserializat...

2016-01-05 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1484#issuecomment-168938339 Merging ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request: [FLINK-3058] Add support for Kafka 0.9.0.0

2016-01-06 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1489 [FLINK-3058] Add support for Kafka 0.9.0.0 For adding Kafka 0.9.0.0 support, this commit changes the following: - Split up of the kafka connector into a flink-connector-kafka-(base|0.9|0.8

[GitHub] flink pull request: [FLINK-3057][py] Bidirectional Connection

2016-01-06 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1432#issuecomment-169329884 I've quickly scrolled through the change. I'm wondering whether we should change the development process for the Python API a bit. It seems that you are

[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2016-01-06 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1427#issuecomment-169335005 Thanks a lot for looking into this! In the `ExecutionConfig` I've made the following methods experimental: - setAutoWatermarkInterval - enableTimes

[GitHub] flink pull request: [FLINK-3195] [examples] Consolidate Java/Scala...

2016-01-06 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1482#issuecomment-169362242 I'd like to finish the project restructure and I'll use this PR as a base. I'll also address Fabian's comments. --- If your project is set up for

[GitHub] flink pull request: Added, to the DataStream API guide, an example...

2016-01-07 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1487#discussion_r49070463 --- Diff: docs/apis/streaming_guide.md --- @@ -1830,6 +1840,17 @@ val myTuples = env.fromCollection(data) val longIt: Iterator[Long] = ... val

[GitHub] flink pull request: [FLINK-3187] Introduce RestartStrategy to deco...

2016-01-07 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1470#issuecomment-169668035 I like this change because the current restart behavior is not flexible enough. Resolving this issue should be really easy with your change in: https

[GitHub] flink pull request: Update PoissonSampler.java

2016-01-07 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1476#issuecomment-169671136 This change needs to be merged by a Flink committer. I've just put the "good to merge" comment so that the other committers know the code has been

[GitHub] flink pull request: [FLINK-3174] Add merging WindowAssigner

2016-01-07 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1460#discussion_r49074918 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperatorTest.java --- @@ -438,7 +617,7 @@ public

[GitHub] flink pull request: [FLINK-3058] Add support for Kafka 0.9.0.0

2016-01-08 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1489#issuecomment-170103132 There are some build instabilities with the new Kafka 0.9 code. I'll look into it soon. --- If your project is set up for it, you can reply to this email and

[GitHub] flink pull request: [FLINK-1712] Remove "flink-staging" module

2016-01-12 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1492#issuecomment-170840541 I moved the following modules out of "flink-staging": flink-tez (to flink-contrib) flink-ml (to flink-libraries) flink-table (to flink-libraries)

[GitHub] flink pull request: [FLINK-3057][py] Bidirectional Connection

2016-01-12 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1432#issuecomment-170849507 Well, in practice, even with PR's, there is not much QA going on for Python. --- If your project is set up for it, you can reply to this email and have your

[GitHub] flink pull request: [FLINK-3132] [docs] Initial docs restructure

2016-01-12 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1499#issuecomment-170926819 Thank you for improving the documentation. I think we can entirely remove the "Docker Connector" section (which is, in the current documentati

[GitHub] flink pull request: [FLINK-1712] Remove "flink-staging" module

2016-01-14 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1492#issuecomment-171596184 Thank you for the reviews ... I'll merge the PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[GitHub] flink pull request: [FLINK-3058] Add support for Kafka 0.9.0.0

2016-01-15 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1489#issuecomment-171903718 Okay, I'll rename the consumers and producers to include the version. (FlinkKafkaConsumer08 and so on.) --- If your project is set up for it, you can reply to

[GitHub] flink pull request: [FLINK-3209] Remove Unused ProcessingTime, Eve...

2016-01-15 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1512#discussion_r49876047 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/api/operators/FoldWindowFunctionTest.java --- @@ -66,10 +72,27 @@ public Integer

[GitHub] flink pull request: [FLINK-3246] Remove unnecessary '-parent' suff...

2016-01-18 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1515#issuecomment-172527568 -1 breaks build. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] flink pull request: [FLINK-3243] Fix Interplay of TimeCharacterist...

2016-01-18 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1513#issuecomment-172533529 I think the documentation hasn't been adopted to the changes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] flink pull request:

2016-01-19 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/commit/1bc48e0855df803c65344d836092dcf6393ad3f2#commitcomment-15535103 In flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java: In flink-core/src/main/java/org/apache

[GitHub] flink pull request:

2016-01-19 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/commit/1bc48e0855df803c65344d836092dcf6393ad3f2#commitcomment-15535215 Did you IDE autoformat the code? That's something which makes reviewing the PRs much harder. You didn't update

[GitHub] flink pull request: [FLINK-3058] Add support for Kafka 0.9.0.0

2016-01-19 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1489#issuecomment-172932775 Thank you all for the comments. I renamed the Consumers again to include the version, I added deprecated 081 and 092 consumers. Do you think we should also add a

[GitHub] flink pull request: [FLINK-3246] Remove unnecessary '-parent' suff...

2016-01-20 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1515#issuecomment-173214575 +1 looks good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] flink pull request: [FLINK-3161][dist] Externalize cluster start-u...

2016-01-20 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1523#issuecomment-173217454 Seems that `pdsh` is available in all Ubuntu versions. So I guess the tool is popular enough to be present for some of our users. I think some tests on a

[GitHub] flink pull request: [FLINK-3161][dist] Externalize cluster start-u...

2016-01-20 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1523#issuecomment-173215668 I filed a JIRA for the failed test case: https://issues.apache.org/jira/browse/FLINK-3265 --- If your project is set up for it, you can reply to this email and have

[GitHub] flink pull request: [FLINK-3058] Add support for Kafka 0.9.0.0

2016-01-20 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1489#issuecomment-173243638 I addressed all concerns and rebased to master. Once the tests have passed, I'll merge the change. --- If your project is set up for it, you can reply to

[GitHub] flink pull request: [FLINK-3093] Introduce annotations for interfa...

2016-01-21 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1428#issuecomment-173511286 Cool, thank you. I'll rebase the PR, and go over the APIs again as well --- If your project is set up for it, you can reply to this email and have your

[GitHub] flink pull request: [FLINK-3270] Add Kafka example

2016-01-21 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1533 [FLINK-3270] Add Kafka example You can merge this pull request into a Git repository by running: $ git pull https://github.com/rmetzger/flink flink3270 Alternatively you can review and

[GitHub] flink pull request: [FLINK-3265] Make RabbitMQ source threadsafe

2016-01-21 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1534 [FLINK-3265] Make RabbitMQ source threadsafe You can merge this pull request into a Git repository by running: $ git pull https://github.com/rmetzger/flink flink3265 Alternatively you can

[GitHub] flink pull request: [FLINK-2021] Rework examples to use ParameterT...

2016-01-21 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1536#discussion_r50401269 --- Diff: flink-examples/flink-examples-batch/src/main/java/org/apache/flink/examples/java/clustering/KMeans.java --- @@ -291,31 +297,54 @@ public Centroid

[GitHub] flink pull request: [FLINK-2021] Rework examples to use ParameterT...

2016-01-21 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1536#discussion_r50401470 --- Diff: flink-examples/flink-examples-batch/src/main/java/org/apache/flink/examples/java/clustering/KMeans.java --- @@ -291,31 +297,54 @@ public Centroid

[GitHub] flink pull request: [FLINK-2021] Rework examples to use ParameterT...

2016-01-21 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1536#issuecomment-173607167 I have quickly checked out your branch and came up with another variant for reworking the KMeans example with the `ParameterTool`: https://github.com/rmetzger/flink

[GitHub] flink pull request: [FLINK-3274] Make accumulator names of Kafka c...

2016-01-22 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1541 [FLINK-3274] Make accumulator names of Kafka connector unique You can merge this pull request into a Git repository by running: $ git pull https://github.com/rmetzger/flink flink3274

[GitHub] flink pull request: [FLINK-2021] Rework examples to use ParameterT...

2016-01-22 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1536#issuecomment-173874750 mh, I understand that you are motivated to move on with this task. I think most likely other Flink committers agree to the change, but it might also happen that the

[GitHub] flink pull request: [FLINK-3261] Allow Task to decline checkpoint ...

2016-01-25 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1537#issuecomment-174446152 I tested this as well. A Kafka test was previously failing, now its passing. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] flink pull request: [FLINK-3187] Introduce RestartStrategy to deco...

2016-01-25 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1470#issuecomment-174450252 Whats the status of this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] flink pull request: [hotfix] [docs] Add missing licenses to progra...

2016-01-25 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1545#issuecomment-174510830 awesome, thank you. I'll merge it --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] flink pull request: FLINK-2523: making the task cancellation inter...

2016-01-25 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1546#discussion_r50694061 --- Diff: flink-examples/flink-examples-batch/src/main/java/org/apache/flink/examples/java/wordcount/WordCount.java --- @@ -60,6 +60,7 @@ public static

[GitHub] flink pull request: [FLINK-3274] Make accumulator names of Kafka c...

2016-01-25 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1541#issuecomment-174539785 This PR also addresses https://issues.apache.org/jira/browse/FLINK-3280 --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] flink pull request: [FLINK-2021] Rework examples to use ParameterT...

2016-01-26 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1536#issuecomment-174946246 Okay, since nobody objected on the mailing list, we can start changing all examples. --- If your project is set up for it, you can reply to this email and have your

[GitHub] flink pull request: [FLINK-2933] Flink scala libraries exposed wit...

2016-01-26 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1529#issuecomment-174948935 I think we should also update the documentation along with the change! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] flink pull request: [FLINK-2021] Rework examples to use ParameterT...

2016-01-26 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1536#issuecomment-174950736 I think its important that users also see how to read data from sources. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] flink pull request: [FLINK-2021] Rework examples to use ParameterT...

2016-01-26 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1536#issuecomment-174953115 I don't really see the points of encapsulating parts of the examples into methods: Usually, methods are used when functionality is used in different places. In

[GitHub] flink pull request: [FLINK-3270] Add Kafka example

2016-01-27 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1533#issuecomment-175544829 I understand that argument, and I would be strongly against adding examples for each connector. The pull request is moving the example away from the Kafka

[GitHub] flink pull request: [FLINK-2428] Clean up unused properties in Str...

2016-01-28 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1554#issuecomment-176079663 To squash commits, you have to call "git rebase -i HEAD~10" (its called interactive rebase). Then, put "fixup" or "squash" instead of &quo

[GitHub] flink pull request: [FLINK-3295][Kafka 0.8] Improve ZK error behav...

2016-01-28 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1555 [FLINK-3295][Kafka 0.8] Improve ZK error behavior This PR changes the behavior of the Kafka 0.8 source if there is an error while getting the initial offsets from ZK. Instead of failing, the

[GitHub] flink pull request: [FLINK-3295][Kafka 0.8] Improve ZK error behav...

2016-01-28 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1555#issuecomment-176230855 Yes, curator is retrying using an exponential backoff retry. I've addressed your comments. --- If your project is set up for it, you can reply to this

[GitHub] flink pull request: [FLINK-3296] Remove 'flushing' behavior of the...

2016-01-29 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1563 [FLINK-3296] Remove 'flushing' behavior of the OutputFormat in DataStream API I removed the `FileSinkFunctionByMillis` and removed all the `millis` arguments on the writing

[GitHub] flink pull request: [FLINK-3265][tests] adapt RabbitMQ checkpointi...

2016-02-01 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1569#discussion_r51432473 --- Diff: flink-streaming-connectors/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSourceTest.java --- @@ -219,7

[GitHub] flink pull request: [FLINK-3287] [FLINK-3247] Fix curator shading ...

2016-02-02 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1573 [FLINK-3287][FLINK-3247] Fix curator shading for Kafka connector Some maven versions are not properly evaluating star * excludes. Therefore, I've manually listed our shaded artifac

[GitHub] flink pull request: [FLINK-3287] [FLINK-3247] Fix curator shading ...

2016-02-02 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1573#issuecomment-178527480 There is one issue I need to figure out, then, I'll merge it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] flink pull request: [hotfix][yarn] Shutdown JVM when Flink-on-yarn...

2016-02-02 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1576 [hotfix][yarn] Shutdown JVM when Flink-on-yarn is shutting down With this change, we call System.exit() when the YARN session is shutting down. On some Linux distributions, YARN is not

[GitHub] flink pull request: [FLINK-3313] [kafka] Fix concurrent TypeInform...

2016-02-02 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1577#issuecomment-178683735 Good catch & fix! +1 to merge asap (too many tests are failing on this one right now) --- If your project is set up for it, you can reply to this email and

[GitHub] flink pull request: [hotfix, yarn] Exit JVM after YARN actor syste...

2016-02-03 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1582#issuecomment-179365564 I think the change is good to merge when travis has passed. I tried it on GCE: ``` 17:36:55,084 INFO org.apache.flink.yarn.YarnTaskManager

<    5   6   7   8   9   10   11   12   13   14   >