[GitHub] flink issue #3006: [FLINK-5323] CheckpointNotifier should be removed from do...

2016-12-14 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3006 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] flink issue #3008: [FLINK-4973] Let LatencyMarksEmitter use StreamTask's Pro...

2016-12-15 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3008 +1 to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 I checked the elasticsearch documentation and some user forum from ES, and indeed it seems that they do not include any retry logic into their clients. --- If your project is set up for it, you

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93043759 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93045771 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 @fpompermaier Why is throwing exceptions in close causing document losses? As far as I can see ES is flushing all outstanding batches on close(). --- If your project is set up for it, you can

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93048695 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93049169 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 @fpompermaier I guess logstash is just a client to ES that implement its own retry logic (similar to Flink). I'll check out the JIRA. --- If your project is set up for it, you can rep

[GitHub] flink pull request #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2767#discussion_r93052912 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch5/pom.xml --- @@ -0,0 +1,93 @@ + + +http://maven.apache.org/POM/4.0.0

[GitHub] flink pull request #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2767#discussion_r93053073 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch5/pom.xml --- @@ -0,0 +1,93 @@ + + +http://maven.apache.org/POM/4.0.0

[GitHub] flink issue #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2767 @StephanEwen I'll start a discussion on the mailing list to decide how we want to proceed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] flink pull request #3029: [FLINK-5369] [build] Rework jsr305 and logging dep...

2016-12-20 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/3029#discussion_r93206487 --- Diff: pom.xml --- @@ -91,7 +91,6 @@ under the License. 1C true log4j-test.properties

[GitHub] flink issue #3029: [FLINK-5369] [build] Rework jsr305 and logging dependenci...

2016-12-20 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3029 I've tested the change on a YARN cluster (I know there are tests for that). I'm currently trying out the quickstarts as well. --- If your project is set up for it, you can reply to this

[GitHub] flink issue #3029: [FLINK-5369] [build] Rework jsr305 and logging dependenci...

2016-12-20 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3029 (quickstart worked as well!) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] flink issue #3030: Updated version of #3014

2016-12-20 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3030 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] flink pull request #2142: [FLINK-3752] Add Per-Kafka-Partition Watermark Gen...

2016-06-22 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2142#discussion_r68060615 --- Diff: docs/apis/streaming/connectors/kafka.md --- @@ -198,6 +198,63 @@ Flink on YARN supports automatic restart of lost YARN containers. If

[GitHub] flink pull request #2142: [FLINK-3752] Add Per-Kafka-Partition Watermark Gen...

2016-06-22 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2142#discussion_r68061306 --- Diff: docs/apis/streaming/connectors/kafka.md --- @@ -198,6 +198,63 @@ Flink on YARN supports automatic restart of lost YARN containers. If

[GitHub] flink issue #2142: [FLINK-3752] Add Per-Kafka-Partition Watermark Generation...

2016-06-22 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2142 Thank you for opening the pull request. There's one issue that needs addressing, once that's done, we can merge it. --- If your project is set up for it, you can reply to this emai

[GitHub] flink pull request #2148: [FLINK-3995] [build] Make test utils properly avai...

2016-06-22 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2148 [FLINK-3995] [build] Make test utils properly available and fix Maven dependencies This pull request subsumes https://github.com/apache/flink/pull/2092. I added a commit to Stephan's

[GitHub] flink pull request #2108: [FLINK-4027] Flush FlinkKafkaProducer on checkpoin...

2016-06-22 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2108#discussion_r68082639 --- Diff: flink-streaming-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducerBase.java

[GitHub] flink issue #2142: [FLINK-3752] Add Per-Kafka-Partition Watermark Generation...

2016-06-22 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2142 Okay, merging ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink pull request #2151: [hotfix][docs] Add warning to Cassandra documentat...

2016-06-23 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2151 [hotfix][docs] Add warning to Cassandra documentation You can merge this pull request into a Git repository by running: $ git pull https://github.com/rmetzger/flink cassandra_doc_hotfix

[GitHub] flink pull request #2153: [FLINK-4110] Add testing skeleton to quickstart

2016-06-23 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2153 [FLINK-4110] Add testing skeleton to quickstart With this change, our quickstart archetypes will also contain some sample code for bringing up an embedded server for testing purposes. You can

[GitHub] flink issue #2131: [FLINK-3231][streaming-connectors] FlinkKinesisConsumer r...

2016-06-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2131 I'll review your change now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] flink pull request #2071: [FLINK-4018][streaming-connectors] Configurable id...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2071#discussion_r68386857 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardConsumerThread.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68397478 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/KinesisDataFetcher.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68399389 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/IKinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68399467 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68399431 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68399454 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68400596 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/IKinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68400657 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68402254 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68403594 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68403918 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68404148 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68406625 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/model/KinesisStreamShard.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68410216 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/model/KinesisStreamShard.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68413466 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink issue #2071: [FLINK-4018][streaming-connectors] Configurable idle time...

2016-06-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2071 Yes, I would suggest to do this PR after the big one. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink issue #2131: [FLINK-3231][streaming-connectors] FlinkKinesisConsumer r...

2016-06-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2131 I'm not done with the review yet. I hope I find some time over the weekend to continue with it. --- If your project is set up for it, you can reply to this email and have your reply appe

[GitHub] flink issue #2131: [FLINK-3231][streaming-connectors] FlinkKinesisConsumer r...

2016-06-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2131 Okay, sounds good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink pull request #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1813#discussion_r68453630 --- Diff: flink-streaming-connectors/flink-connector-redis/pom.xml --- @@ -0,0 +1,92 @@ + + +http://maven.apache.org/POM/4.0.0

[GitHub] flink pull request #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1813#discussion_r68453882 --- Diff: flink-streaming-connectors/flink-connector-redis/pom.xml --- @@ -0,0 +1,92 @@ + + +http://maven.apache.org/POM/4.0.0

[GitHub] flink pull request #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1813#discussion_r68454370 --- Diff: flink-streaming-connectors/flink-connector-redis/src/main/java/org/apache/flink/streaming/connectors/redis/RedisSink.java --- @@ -0,0 +1,232

[GitHub] flink pull request #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1813#discussion_r68454559 --- Diff: flink-streaming-connectors/flink-connector-redis/src/main/java/org/apache/flink/streaming/connectors/redis/common/container/RedisClusterContainer.java

[GitHub] flink pull request #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1813#discussion_r68454693 --- Diff: flink-streaming-connectors/flink-connector-redis/src/main/java/org/apache/flink/streaming/connectors/redis/common/container/RedisContainer.java

[GitHub] flink pull request #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1813#discussion_r68455103 --- Diff: flink-streaming-connectors/flink-connector-redis/src/main/java/org/apache/flink/streaming/connectors/redis/common/container/RedisContainer.java

[GitHub] flink pull request #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1813#discussion_r68455334 --- Diff: flink-streaming-connectors/flink-connector-redis/src/test/java/org/apache/flink/streaming/connectors/redis/RedisSentinelClusterTest.java

[GitHub] flink pull request #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/1813#discussion_r68455277 --- Diff: flink-streaming-connectors/flink-connector-redis/src/test/java/org/apache/flink/streaming/connectors/redis/RedisSentinelClusterTest.java

[GitHub] flink issue #1813: [FLINK-3034] Redis Sink Connector

2016-06-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/1813 @mjsax, did you test the code with a redis installation / on a cluster? (I'm not expecting those tests from a PR review, but I would not do it again if you already did ... and I'm no

[GitHub] flink issue #2163: [FLINK-4119] Null checks in close() for Cassandra Input/O...

2016-06-27 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2163 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] flink pull request #2166: [FLINK-4099] Fix CliFrontendYarnAddressConfigurati...

2016-06-27 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2166 [FLINK-4099] Fix CliFrontendYarnAddressConfigurationTest failures You can merge this pull request into a Git repository by running: $ git pull https://github.com/rmetzger/flink flink4099

[GitHub] flink pull request #2151: [hotfix][docs] Add warning to Cassandra documentat...

2016-06-27 Thread rmetzger
Github user rmetzger closed the pull request at: https://github.com/apache/flink/pull/2151 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #2151: [hotfix][docs] Add warning to Cassandra documentation

2016-06-27 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2151 Sure. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-27 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68558779 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxyInterface.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-27 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68560835 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardDiscoverer.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-27 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68562955 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/KinesisDataFetcher.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-27 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68564082 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/KinesisDataFetcher.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-27 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68564678 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardDiscoverer.java

[GitHub] flink issue #2166: [FLINK-4099] Fix CliFrontendYarnAddressConfigurationTest ...

2016-06-27 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2166 Thank you for the review. I'll wait until travis is passing and then merge it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-27 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68582306 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardDiscoverer.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-27 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68583275 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/KinesisDataFetcher.java

[GitHub] flink issue #2131: [FLINK-3231][streaming-connectors] FlinkKinesisConsumer r...

2016-06-27 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2131 @tzulitai: I'm still not done with the review. I hope I can get it done in the next two hours. --- If your project is set up for it, you can reply to this email and have your reply appe

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-27 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68594061 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-28 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68722233 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/KinesisDataFetcher.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-28 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68726797 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardDiscoverer.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-28 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68727843 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-28 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68729145 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink issue #2131: [FLINK-3231][streaming-connectors] FlinkKinesisConsumer r...

2016-06-28 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2131 I'm done with my first full review. I'll test the code tomorrow. Let me know if you need help addressing my comments. --- If your project is set up for it, you can reply to this emai

[GitHub] flink pull request #2175: [FLINK-4085][Kinesis] Set Flink-specific user agen...

2016-06-28 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2175 [FLINK-4085][Kinesis] Set Flink-specific user agent I was asked by Amazon to set a Flink specific user agent when accessing the AWS APIs. I've set an agent for the consumer, for the produ

[GitHub] flink pull request #2175: [FLINK-4085][Kinesis] Set Flink-specific user agen...

2016-06-28 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2175#discussion_r68757009 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink pull request #2175: [FLINK-4085][Kinesis] Set Flink-specific user agen...

2016-06-28 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2175#discussion_r68757090 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/proxy/KinesisProxy.java

[GitHub] flink issue #2175: [FLINK-4085][Kinesis] Set Flink-specific user agent

2016-06-28 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2175 Thank you for the review. It seems that I'm not that focused today ;) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] flink pull request #2177: [FLINK-4127] Check API compatbility for 1.1 in fli...

2016-06-28 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2177 [FLINK-4127] Check API compatbility for 1.1 in flink-core I checked all the newly introduced methods in public APIs by going through the reports generated from japicmp. I've also pu

[GitHub] flink issue #2180: [FLINK-4080][kinesis-connector] Guarantee exactly-once fo...

2016-06-29 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2180 Thanks a lot for fixing this. I'll try to review it in the next few hours. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] flink pull request #2158: [FLINK-4116] Metrics documentation

2016-06-29 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2158#discussion_r68904562 --- Diff: docs/apis/common/index.md --- @@ -1350,3 +1350,211 @@ You may specify program arguments before the job is executed. The plan visualiza the

[GitHub] flink pull request #2158: [FLINK-4116] Metrics documentation

2016-06-29 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2158#discussion_r68904915 --- Diff: docs/apis/common/index.md --- @@ -1350,3 +1350,211 @@ You may specify program arguments before the job is executed. The plan visualiza the

[GitHub] flink pull request #2180: [FLINK-4080][kinesis-connector] Guarantee exactly-...

2016-06-29 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2180#discussion_r68905535 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/model/SequenceNumber.java

[GitHub] flink pull request #2177: [FLINK-4127] Check API compatbility for 1.1 in fli...

2016-06-29 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2177#discussion_r68906518 --- Diff: docs/setup/config.md --- @@ -85,6 +85,8 @@ The default fraction for managed memory can be adjusted using the `taskmanager.m

[GitHub] flink pull request #2180: [FLINK-4080][kinesis-connector] Guarantee exactly-...

2016-06-29 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2180#discussion_r68906667 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/model/SequenceNumber.java

[GitHub] flink issue #2180: [FLINK-4080][kinesis-connector] Guarantee exactly-once fo...

2016-06-29 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2180 +1 the change is good to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] flink pull request #2177: [FLINK-4127] Check API compatbility for 1.1 in fli...

2016-06-29 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2177#discussion_r68918991 --- Diff: docs/setup/config.md --- @@ -85,6 +85,8 @@ The default fraction for managed memory can be adjusted using the `taskmanager.m

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-06-29 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r68930725 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardDiscoverer.java

[GitHub] flink issue #2131: [FLINK-3231][streaming-connectors] FlinkKinesisConsumer r...

2016-06-29 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2131 Okay, I'll merge the exactly once fix now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] flink issue #2181: [FLINK-4033][docs, kinesis-connector] Polish up Kinesis c...

2016-06-29 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2181 Thank you for opening a PR. I'll merge it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] flink pull request #2177: [FLINK-4127] Check API compatbility for 1.1 in fli...

2016-06-29 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2177#discussion_r68933286 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java --- @@ -269,26 +269,26 @@ * Percentage of heap space to

[GitHub] flink pull request #2177: [FLINK-4127] Check API compatbility for 1.1 in fli...

2016-06-29 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2177#discussion_r68933327 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java --- @@ -269,26 +269,26 @@ * Percentage of heap space to

[GitHub] flink pull request #2177: [FLINK-4127] Check API compatbility for 1.1 in fli...

2016-06-29 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2177#discussion_r68933356 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java --- @@ -269,26 +269,26 @@ * Percentage of heap space to

[GitHub] flink pull request #2174: [FLINK-4075] ContinuousFileProcessingCheckpointITC...

2016-06-30 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2174#discussion_r69100533 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/ContinuousFileReaderOperator.java --- @@ -334,9 +342,11

[GitHub] flink pull request #2174: [FLINK-4075] ContinuousFileProcessingCheckpointITC...

2016-06-30 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2174#discussion_r69102339 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/ContinuousFileReaderOperator.java --- @@ -334,9 +342,11

[GitHub] flink issue #2187: [FLINK-3675][yarn] improvements to library shipping

2016-06-30 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2187 Change looks good! +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] flink issue #2108: [FLINK-4027] Flush FlinkKafkaProducer on checkpoints

2016-06-30 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2108 Thank you for your review @tillrohrmann and @zentol . I tried addressing all your concerns. Please let me know what you think about it. --- If your project is set up for it, you can reply to

[GitHub] flink pull request #2177: [FLINK-4127] Check API compatbility for 1.1 in fli...

2016-07-01 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2177#discussion_r69267193 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java --- @@ -269,26 +269,26 @@ * Percentage of heap space to

[GitHub] flink issue #2177: [FLINK-4127] Check API compatbility for 1.1 in flink-core

2016-07-01 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2177 I addressed all comments. It seems to me that the configuration parameters for YARN are overly complicated now because they are separated in resource manager and YARN now. --- If your project is

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-07-01 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r69274234 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/config/KinesisConfigConstants.java

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-07-01 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r69274851 --- Diff: docs/apis/streaming/connectors/kinesis.md --- @@ -60,10 +60,10 @@ to setup Kinesis streams. Make sure to create the appropriate IAM policy and use

[GitHub] flink pull request #2131: [FLINK-3231][streaming-connectors] FlinkKinesisCon...

2016-07-01 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2131#discussion_r69285572 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/KinesisDataFetcher.java

[GitHub] flink issue #2167: [FLINK-4122] Disable root shading in Cassandra jar

2016-07-01 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2167 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

<    1   2   3   4   5   6   7   8   9   10   >