[jira] [Commented] (FLINK-4410) Report more information about operator checkpoints

2016-10-12 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569405#comment-15569405 ] Stephan Ewen commented on FLINK-4410: - Code that gathers additional metrics is integrated. What is

[jira] [Resolved] (FLINK-2624) RabbitMQ source / sink should participate in checkpointing

2016-10-12 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2624. - Resolution: Fixed Fixed in 9215b72422d3e638fe950b61fa01f2e4e04981a0 > RabbitMQ source / sink

[jira] [Closed] (FLINK-2624) RabbitMQ source / sink should participate in checkpointing

2016-10-12 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2624. --- > RabbitMQ source / sink should participate in checkpointing >

[jira] [Commented] (FLINK-2221) Checkpoints to "file://" are not cleaned up

2016-10-12 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569386#comment-15569386 ] Stephan Ewen commented on FLINK-2221: - I would like to close this as "won't fix", because it is

[jira] [Resolved] (FLINK-3594) StreamTask may fail when checkpoint is concurrent to regular termination

2016-10-12 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-3594. - Resolution: Fixed Fix Version/s: 1.1.0 Fixed via 34110fefc6e49bcbe1ae8de090fa43a5f6ef5fec

[jira] [Updated] (FLINK-4410) Report more information about operator checkpoints

2016-10-12 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-4410: Assignee: (was: Stephan Ewen) > Report more information about operator checkpoints >

[jira] [Commented] (FLINK-4102) Test failure with checkpoint barriers

2016-10-12 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569440#comment-15569440 ] Stephan Ewen commented on FLINK-4102: - Can we close that as "could not reproduce" and reopen it once

[jira] [Resolved] (FLINK-3354) RocksDB should compute checkpoint size based on backup file size

2016-10-12 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-3354. - Resolution: Fixed Fixed in b17632ddbbb58f8b3e3d1a31d6658e59258918c7 > RocksDB should compute

[jira] [Closed] (FLINK-3354) RocksDB should compute checkpoint size based on backup file size

2016-10-12 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-3354. --- > RocksDB should compute checkpoint size based on backup file size >

[GitHub] flink issue #2627: Kafka 0.10 follow-up fixes

2016-10-12 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2627 +1, looks good to me 👍 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] flink pull request #2628: [FLINK-3722] [runtime] Don't / and % when sorting

2016-10-12 Thread greghogan
GitHub user greghogan opened a pull request: https://github.com/apache/flink/pull/2628 [FLINK-3722] [runtime] Don't / and % when sorting Replace division and modulus with addition and subtraction. The timing chart below has three columns for two Gelly algorithms with

[jira] [Commented] (FLINK-3722) The divisions in the InMemorySorters' swap/compare methods hurt performance

2016-10-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570510#comment-15570510 ] ASF GitHub Bot commented on FLINK-3722: --- GitHub user greghogan opened a pull request:

[jira] [Commented] (FLINK-4727) Kafka 0.9 Consumer should also checkpoint auto retrieved offsets even when no data is read

2016-10-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570678#comment-15570678 ] ASF GitHub Bot commented on FLINK-4727: --- Github user tzulitai commented on a diff in the pull

[GitHub] flink pull request #2585: [FLINK-4727] [kafka-connector] Set missing initial...

2016-10-12 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2585#discussion_r83138654 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java ---

[jira] [Commented] (FLINK-4723) Unify behaviour of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570730#comment-15570730 ] ASF GitHub Bot commented on FLINK-4723: --- Github user tzulitai commented on the issue:

[GitHub] flink issue #2580: [FLINK-4723] [kafka-connector] Unify committed offsets to...

2016-10-12 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2580 Thanks for the review @rmetzger. I've created several local branches to test out the new IT tests stability as @StephanEwen suggested, and they seem to be fine. I'll rebase this, address

[jira] [Commented] (FLINK-3037) Make the behavior of the Kafka consumer configurable if the offsets to restore from are not available

2016-10-12 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570751#comment-15570751 ] Tzu-Li (Gordon) Tai commented on FLINK-3037: I'm a little bit confused here. On checkpoints /

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-10-12 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r83141867 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer08.java --- @@

[jira] [Commented] (FLINK-4280) New Flink-specific option to set starting position of Kafka consumer without respecting external offsets in ZK / Broker

2016-10-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570766#comment-15570766 ] ASF GitHub Bot commented on FLINK-4280: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-4280) New Flink-specific option to set starting position of Kafka consumer without respecting external offsets in ZK / Broker

2016-10-12 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570763#comment-15570763 ] Tzu-Li (Gordon) Tai commented on FLINK-4280: I think using the {{KafkaTopicPartition}} is a

[GitHub] flink issue #2509: [FLINK-4280][kafka-connector] Explicit start position con...

2016-10-12 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2509 Rebasing + adding tests for the new functions now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[jira] [Comment Edited] (FLINK-4627) Use Flink's PropertiesUtil in Kinesis connector to extract typed values from config properties

2016-10-12 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570772#comment-15570772 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4627 at 10/13/16 4:13 AM: --

[jira] [Commented] (FLINK-4280) New Flink-specific option to set starting position of Kafka consumer without respecting external offsets in ZK / Broker

2016-10-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570769#comment-15570769 ] ASF GitHub Bot commented on FLINK-4280: --- Github user tzulitai commented on the issue:

[jira] [Commented] (FLINK-4627) Use Flink's PropertiesUtil in Kinesis connector to extract typed values from config properties

2016-10-12 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570772#comment-15570772 ] Tzu-Li (Gordon) Tai commented on FLINK-4627: Hi Neelesh, I'm not aware of anyone working on

<    1   2   3