[jira] [Commented] (FLINK-7930) Support periodic jobs with state that gets restored and persisted in a savepoint

2018-11-13 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685313#comment-16685313 ] Till Rohrmann commented on FLINK-7930: -- Not sure what you mean with periodic job but

[jira] [Updated] (FLINK-10863) Assign uids to all operators

2018-11-13 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-10863: -- Fix Version/s: 1.7.0 1.6.3 1.5.6 > Assign uids to all op

[jira] [Updated] (FLINK-10863) Assign uids to all operators

2018-11-13 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-10863: -- Affects Version/s: 1.5.5 1.6.2 > Assign uids to all operators > ---

[jira] [Updated] (FLINK-10866) Queryable state can prevent cluster from starting

2018-11-13 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-10866: -- Fix Version/s: 1.8.0 > Queryable state can prevent cluster from starting > ---

[GitHub] StefanRRichter commented on issue #7085: [FLINK-10863][tests] Assign UIDs to all operators in DataStreamAllrou…

2018-11-13 Thread GitBox
StefanRRichter commented on issue #7085: [FLINK-10863][tests] Assign UIDs to all operators in DataStreamAllrou… URL: https://github.com/apache/flink/pull/7085#issuecomment-438292849 Thanks for the review @tillrohrmann! Merging. --

[jira] [Commented] (FLINK-10863) Assign uids to all operators

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685322#comment-16685322 ] ASF GitHub Bot commented on FLINK-10863: StefanRRichter commented on issue #7085

[GitHub] pnowojski closed pull request #7084: [FLINK-10861][e2e] Do not fail stop_kafka_cluster if a process terminates before we kill it

2018-11-13 Thread GitBox
pnowojski closed pull request #7084: [FLINK-10861][e2e] Do not fail stop_kafka_cluster if a process terminates before we kill it URL: https://github.com/apache/flink/pull/7084 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below f

[jira] [Commented] (FLINK-10861) Kafka e2e test fails during tearing down

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685370#comment-16685370 ] ASF GitHub Bot commented on FLINK-10861: pnowojski closed pull request #7084: [F

[jira] [Commented] (FLINK-7930) Support periodic jobs with state that gets restored and persisted in a savepoint

2018-11-13 Thread Flavio Pompermaier (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685388#comment-16685388 ] Flavio Pompermaier commented on FLINK-7930: --- What I really like to do with Flin

[jira] [Closed] (FLINK-10861) Kafka e2e test fails during tearing down

2018-11-13 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-10861. -- Resolution: Fixed Fix Version/s: 1.8.0 merged commit 9f8df97 into apache:master > Kaf

[GitHub] suez1224 opened a new pull request #7078: [FLINK-10848][YARN] properly remove YARN ContainerRequest upon container allocation success

2018-11-13 Thread GitBox
suez1224 opened a new pull request #7078: [FLINK-10848][YARN] properly remove YARN ContainerRequest upon container allocation success URL: https://github.com/apache/flink/pull/7078 ## What is the purpose of the change Properly remove YARN ContainerRequest upon container allocation su

[GitHub] suez1224 closed pull request #7078: [FLINK-10848][YARN] properly remove YARN ContainerRequest upon container allocation success

2018-11-13 Thread GitBox
suez1224 closed pull request #7078: [FLINK-10848][YARN] properly remove YARN ContainerRequest upon container allocation success URL: https://github.com/apache/flink/pull/7078 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below fo

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685391#comment-16685391 ] ASF GitHub Bot commented on FLINK-10848: suez1224 closed pull request #7078: [FL

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685392#comment-16685392 ] ASF GitHub Bot commented on FLINK-10848: suez1224 opened a new pull request #707

[GitHub] asfgit closed pull request #7085: [FLINK-10863][tests] Assign UIDs to all operators in DataStreamAllrou…

2018-11-13 Thread GitBox
asfgit closed pull request #7085: [FLINK-10863][tests] Assign UIDs to all operators in DataStreamAllrou… URL: https://github.com/apache/flink/pull/7085 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenanc

[jira] [Commented] (FLINK-10863) Assign uids to all operators

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685395#comment-16685395 ] ASF GitHub Bot commented on FLINK-10863: asfgit closed pull request #7085: [FLIN

[jira] [Closed] (FLINK-10863) Assign uids to all operators

2018-11-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-10863. -- Resolution: Fixed Merged in: master: 31176d5 release-1.7: 44777b6 release-1.6: 76d7fb1 release

[GitHub] pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible

2018-11-13 Thread GitBox
pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible URL: https://github.com/apache/flink/pull/7087#discussion_r233101708 ## File path: docs/dev/table/connect.md ## @@ -583,7 +586,9 @@ connector

[GitHub] pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible

2018-11-13 Thread GitBox
pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible URL: https://github.com/apache/flink/pull/7087#discussion_r233097356 ## File path: flink-connectors/flink-connector-kafka-base/src/main/java/org/apach

[GitHub] pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible

2018-11-13 Thread GitBox
pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible URL: https://github.com/apache/flink/pull/7087#discussion_r233103572 ## File path: docs/dev/table/connect.md ## @@ -524,7 +525,8 @@ The Kafka

[jira] [Commented] (FLINK-10843) Make Kafka version definition more flexible for new Kafka table factory

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685412#comment-16685412 ] ASF GitHub Bot commented on FLINK-10843: pnowojski commented on a change in pull

[GitHub] pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible

2018-11-13 Thread GitBox
pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible URL: https://github.com/apache/flink/pull/7087#discussion_r233098151 ## File path: flink-connectors/flink-connector-kafka-base/src/main/java/org/apach

[GitHub] pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible

2018-11-13 Thread GitBox
pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible URL: https://github.com/apache/flink/pull/7087#discussion_r233090756 ## File path: flink-connectors/flink-connector-kafka-base/src/main/java/org/apach

[GitHub] pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible

2018-11-13 Thread GitBox
pnowojski commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible URL: https://github.com/apache/flink/pull/7087#discussion_r233089061 ## File path: flink-connectors/flink-connector-kafka-base/src/main/java/org/apach

[jira] [Commented] (FLINK-10843) Make Kafka version definition more flexible for new Kafka table factory

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685416#comment-16685416 ] ASF GitHub Bot commented on FLINK-10843: pnowojski commented on a change in pull

[jira] [Commented] (FLINK-10843) Make Kafka version definition more flexible for new Kafka table factory

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685415#comment-16685415 ] ASF GitHub Bot commented on FLINK-10843: pnowojski commented on a change in pull

[jira] [Commented] (FLINK-10843) Make Kafka version definition more flexible for new Kafka table factory

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685417#comment-16685417 ] ASF GitHub Bot commented on FLINK-10843: pnowojski commented on a change in pull

[GitHub] pnowojski commented on a change in pull request #6927: [FLINK-10624] Extend SQL client end-to-end to test new KafkaTableSink

2018-11-13 Thread GitBox
pnowojski commented on a change in pull request #6927: [FLINK-10624] Extend SQL client end-to-end to test new KafkaTableSink URL: https://github.com/apache/flink/pull/6927#discussion_r233108785 ## File path: flink-end-to-end-tests/test-scripts/test_sql_client_kafka_common.sh ##

[jira] [Commented] (FLINK-10624) Extend SQL client end-to-end to test new KafkaTableSink

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685428#comment-16685428 ] ASF GitHub Bot commented on FLINK-10624: pnowojski commented on a change in pull

[jira] [Commented] (FLINK-10843) Make Kafka version definition more flexible for new Kafka table factory

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685414#comment-16685414 ] ASF GitHub Bot commented on FLINK-10843: pnowojski commented on a change in pull

[GitHub] twalthr commented on a change in pull request #6927: [FLINK-10624] Extend SQL client end-to-end to test new KafkaTableSink

2018-11-13 Thread GitBox
twalthr commented on a change in pull request #6927: [FLINK-10624] Extend SQL client end-to-end to test new KafkaTableSink URL: https://github.com/apache/flink/pull/6927#discussion_r233110969 ## File path: flink-end-to-end-tests/test-scripts/test_sql_client_kafka_common.sh

[jira] [Commented] (FLINK-10843) Make Kafka version definition more flexible for new Kafka table factory

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685413#comment-16685413 ] ASF GitHub Bot commented on FLINK-10843: pnowojski commented on a change in pull

[jira] [Commented] (FLINK-10624) Extend SQL client end-to-end to test new KafkaTableSink

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685434#comment-16685434 ] ASF GitHub Bot commented on FLINK-10624: twalthr commented on a change in pull r

[GitHub] dawidwys closed pull request #7082: [FLINK-10419] Using DeclineCheckpoint message class when invoking RPC declineCheckpoint

2018-11-13 Thread GitBox
dawidwys closed pull request #7082: [FLINK-10419] Using DeclineCheckpoint message class when invoking RPC declineCheckpoint URL: https://github.com/apache/flink/pull/7082 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for th

[GitHub] twalthr commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible

2018-11-13 Thread GitBox
twalthr commented on a change in pull request #7087: [FLINK-10843] [connectors] Make Kafka table factory versioning more flexible URL: https://github.com/apache/flink/pull/7087#discussion_r233129481 ## File path: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/

[jira] [Commented] (FLINK-10843) Make Kafka version definition more flexible for new Kafka table factory

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685468#comment-16685468 ] ASF GitHub Bot commented on FLINK-10843: twalthr commented on a change in pull r

[jira] [Commented] (FLINK-10419) ClassNotFoundException while deserializing user exceptions from checkpointing

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685463#comment-16685463 ] ASF GitHub Bot commented on FLINK-10419: dawidwys closed pull request #7082: [FL

[jira] [Resolved] (FLINK-10859) Queryable state (rocksdb) end-to-end test fails on Travis

2018-11-13 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-10859. --- Resolution: Fixed Fixed via 39f796320fd5b3374f4d48222677257401e98286 > Queryable state (roc

[GitHub] dawidwys opened a new pull request #7089: [FLINK-10419] Using DeclineCheckpoint message class when invoking RPC declineCheckpoint

2018-11-13 Thread GitBox
dawidwys opened a new pull request #7089: [FLINK-10419] Using DeclineCheckpoint message class when invoking RPC declineCheckpoint URL: https://github.com/apache/flink/pull/7089 ## What is the purpose of the change Invoking `declineCheckpoint` RPC endpoint with `DeclineCheckpoint` me

[jira] [Commented] (FLINK-10419) ClassNotFoundException while deserializing user exceptions from checkpointing

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685474#comment-16685474 ] ASF GitHub Bot commented on FLINK-10419: dawidwys opened a new pull request #708

[GitHub] dawidwys opened a new pull request #7090: [FLINK-10419] Using DeclineCheckpoint message class when invoking RPC declineCheckpoint

2018-11-13 Thread GitBox
dawidwys opened a new pull request #7090: [FLINK-10419] Using DeclineCheckpoint message class when invoking RPC declineCheckpoint URL: https://github.com/apache/flink/pull/7090 ## What is the purpose of the change Invoking `declineCheckpoint` RPC endpoint with `DeclineCheckpoint` me

[jira] [Commented] (FLINK-10419) ClassNotFoundException while deserializing user exceptions from checkpointing

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685475#comment-16685475 ] ASF GitHub Bot commented on FLINK-10419: dawidwys opened a new pull request #709

[jira] [Created] (FLINK-10867) Add a DataSet-based CacheOperator to reuse results between jobs

2018-11-13 Thread Miguel E. Coimbra (JIRA)
Miguel E. Coimbra created FLINK-10867: - Summary: Add a DataSet-based CacheOperator to reuse results between jobs Key: FLINK-10867 URL: https://issues.apache.org/jira/browse/FLINK-10867 Project: Fl

[jira] [Updated] (FLINK-10867) Add a DataSet-based CacheOperator to reuse results between jobs

2018-11-13 Thread Miguel E. Coimbra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miguel E. Coimbra updated FLINK-10867: -- Description: *Motivation.* There are job scenarios where Flink batch processing users

[jira] [Updated] (FLINK-10867) Add a DataSet-based CacheOperator to reuse results between jobs

2018-11-13 Thread Miguel E. Coimbra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miguel E. Coimbra updated FLINK-10867: -- Description: *Motivation.* There are job scenarios where Flink batch processing users

[jira] [Created] (FLINK-10868) Flink's Yarn ResourceManager doesn't use yarn.maximum-failed-containers as limit of resource acquirement

2018-11-13 Thread Zhenqiu Huang (JIRA)
Zhenqiu Huang created FLINK-10868: - Summary: Flink's Yarn ResourceManager doesn't use yarn.maximum-failed-containers as limit of resource acquirement Key: FLINK-10868 URL: https://issues.apache.org/jira/browse/FLI

[jira] [Commented] (FLINK-10860) java.lang.ArrayIndexOutOfBoundsException Error reading state

2018-11-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685493#comment-16685493 ] Stefan Richter commented on FLINK-10860: This could be the result of a serialize

[jira] [Commented] (FLINK-10860) java.lang.ArrayIndexOutOfBoundsException Error reading state

2018-11-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685497#comment-16685497 ] Stefan Richter commented on FLINK-10860: I opened https://issues.apache.org/jira

[jira] [Resolved] (FLINK-10860) java.lang.ArrayIndexOutOfBoundsException Error reading state

2018-11-13 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter resolved FLINK-10860. Resolution: Not A Problem Problem is most likely in the Beam code, where serializers are d

[jira] [Created] (FLINK-10869) Update S3 testing settings

2018-11-13 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-10869: Summary: Update S3 testing settings Key: FLINK-10869 URL: https://issues.apache.org/jira/browse/FLINK-10869 Project: Flink Issue Type: Improvement

[GitHub] stevenzwu commented on issue #7020: [FLINK-10774] [Kafka] connection leak when partition discovery is disabled an…

2018-11-13 Thread GitBox
stevenzwu commented on issue #7020: [FLINK-10774] [Kafka] connection leak when partition discovery is disabled an… URL: https://github.com/apache/flink/pull/7020#issuecomment-438384937 @tillrohrmann > shouldn't we close the partitionDiscoverer in the open method in case of a failur

[GitHub] stevenzwu edited a comment on issue #7020: [FLINK-10774] [Kafka] connection leak when partition discovery is disabled an…

2018-11-13 Thread GitBox
stevenzwu edited a comment on issue #7020: [FLINK-10774] [Kafka] connection leak when partition discovery is disabled an… URL: https://github.com/apache/flink/pull/7020#issuecomment-438384937 @tillrohrmann > shouldn't we close the partitionDiscoverer in the open method in case of a

[jira] [Commented] (FLINK-10774) connection leak when partition discovery is disabled and open throws exception

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685582#comment-16685582 ] ASF GitHub Bot commented on FLINK-10774: stevenzwu edited a comment on issue #70

[jira] [Commented] (FLINK-10774) connection leak when partition discovery is disabled and open throws exception

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685580#comment-16685580 ] ASF GitHub Bot commented on FLINK-10774: stevenzwu commented on issue #7020: [FL

[jira] [Updated] (FLINK-10867) Add a DataSet-based CacheOperator to reuse results between jobs

2018-11-13 Thread Miguel E. Coimbra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miguel E. Coimbra updated FLINK-10867: -- Description: *Motivation.* There are job scenarios where Flink batch processing users

[jira] [Updated] (FLINK-10867) Add a DataSet-based CacheOperator to reuse results between jobs

2018-11-13 Thread Miguel E. Coimbra (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miguel E. Coimbra updated FLINK-10867: -- Description: *Motivation.* There are job scenarios where Flink batch processing users

[jira] [Assigned] (FLINK-9555) Support table api in scala shell

2018-11-13 Thread shuiqiangchen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuiqiangchen reassigned FLINK-9555: Assignee: shuiqiangchen > Support table api in scala shell > -

[GitHub] maqingxiang closed pull request #7083: [hotfix][flink-runtime] modify maxAttempts when find a unique file name for the spilling channel

2018-11-13 Thread GitBox
maqingxiang closed pull request #7083: [hotfix][flink-runtime] modify maxAttempts when find a unique file name for the spilling channel URL: https://github.com/apache/flink/pull/7083 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed

[GitHub] maqingxiang commented on a change in pull request #7083: [hotfix][flink-runtime] modify maxAttempts when find a unique file name for the spilling channel

2018-11-13 Thread GitBox
maqingxiang commented on a change in pull request #7083: [hotfix][flink-runtime] modify maxAttempts when find a unique file name for the spilling channel URL: https://github.com/apache/flink/pull/7083#discussion_r233295206 ## File path: flink-runtime/src/main/java/org/apache/flink

[GitHub] maqingxiang commented on issue #6566: [FLINK-10162][flink-runtime][flink-runtime-web] add host in checkpoint detail

2018-11-13 Thread GitBox
maqingxiang commented on issue #6566: [FLINK-10162][flink-runtime][flink-runtime-web] add host in checkpoint detail URL: https://github.com/apache/flink/pull/6566#issuecomment-438514735 @aljoscha Please help review it, thanks. ---

[jira] [Commented] (FLINK-10162) Add host in checkpoint detail

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686019#comment-16686019 ] ASF GitHub Bot commented on FLINK-10162: maqingxiang commented on issue #6566:

[jira] [Commented] (FLINK-10866) Queryable state can prevent cluster from starting

2018-11-13 Thread Jiayi Liao (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686039#comment-16686039 ] Jiayi Liao commented on FLINK-10866: I think we should also expose the proxy port in

[jira] [Created] (FLINK-10870) Reconstruct Flink Dashboard Overview Module to Angular 7.0

2018-11-13 Thread Yadong Xie (JIRA)
Yadong Xie created FLINK-10870: -- Summary: Reconstruct Flink Dashboard Overview Module to Angular 7.0 Key: FLINK-10870 URL: https://issues.apache.org/jira/browse/FLINK-10870 Project: Flink Issue

[jira] [Assigned] (FLINK-10867) Add a DataSet-based CacheOperator to reuse results between jobs

2018-11-13 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-10867: Assignee: vinoyang > Add a DataSet-based CacheOperator to reuse results between jobs > --

[jira] [Comment Edited] (FLINK-10855) CheckpointCoordinator does not delete checkpoint directory of late/failed checkpoints

2018-11-13 Thread Yun Tang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686065#comment-16686065 ] Yun Tang edited comment on FLINK-10855 at 11/14/18 3:54 AM:

[jira] [Commented] (FLINK-10855) CheckpointCoordinator does not delete checkpoint directory of late/failed checkpoints

2018-11-13 Thread Yun Tang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686065#comment-16686065 ] Yun Tang commented on FLINK-10855: -- [~till.rohrmann], as far as I know, the checkpoint

[jira] [Comment Edited] (FLINK-10705) Rework Flink Web Dashboard

2018-11-13 Thread Yadong Xie (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684904#comment-16684904 ] Yadong Xie edited comment on FLINK-10705 at 11/14/18 3:56 AM:

[jira] [Created] (FLINK-10871) ExecutionEnvironment & TableEnvironment should be singleton

2018-11-13 Thread Jeff Zhang (JIRA)
Jeff Zhang created FLINK-10871: -- Summary: ExecutionEnvironment & TableEnvironment should be singleton Key: FLINK-10871 URL: https://issues.apache.org/jira/browse/FLINK-10871 Project: Flink Issu

[GitHub] wittyameta commented on issue #5929: [FLINK-8497] [connectors] KafkaConsumer throws NPE if topic doesn't exist

2018-11-13 Thread GitBox
wittyameta commented on issue #5929: [FLINK-8497] [connectors] KafkaConsumer throws NPE if topic doesn't exist URL: https://github.com/apache/flink/pull/5929#issuecomment-438538421 Any update on this PR? This is an automated

[jira] [Commented] (FLINK-8497) KafkaConsumer throws NPE if topic doesn't exist

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686097#comment-16686097 ] ASF GitHub Bot commented on FLINK-8497: --- wittyameta commented on issue #5929: [FLIN

[jira] [Updated] (FLINK-8497) KafkaConsumer throws NPE if topic doesn't exist

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-8497: -- Labels: pull-request-available (was: ) > KafkaConsumer throws NPE if topic doesn't exist > ---

[GitHub] stevenzwu commented on issue #7020: [FLINK-10774] [Kafka] connection leak when partition discovery is disabled an…

2018-11-13 Thread GitBox
stevenzwu commented on issue #7020: [FLINK-10774] [Kafka] connection leak when partition discovery is disabled an… URL: https://github.com/apache/flink/pull/7020#issuecomment-438544127 we saw some exception regarding redundant calls to close method. will need to fix it. ``` 2018-

[GitHub] stevenzwu edited a comment on issue #7020: [FLINK-10774] [Kafka] connection leak when partition discovery is disabled an…

2018-11-13 Thread GitBox
stevenzwu edited a comment on issue #7020: [FLINK-10774] [Kafka] connection leak when partition discovery is disabled an… URL: https://github.com/apache/flink/pull/7020#issuecomment-438544127 we saw some exception regarding redundant calls to close method. will need to fix it. ```

[jira] [Commented] (FLINK-10774) connection leak when partition discovery is disabled and open throws exception

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686108#comment-16686108 ] ASF GitHub Bot commented on FLINK-10774: stevenzwu edited a comment on issue #70

[jira] [Commented] (FLINK-10774) connection leak when partition discovery is disabled and open throws exception

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686106#comment-16686106 ] ASF GitHub Bot commented on FLINK-10774: stevenzwu commented on issue #7020: [FL

[GitHub] XuQianJin-Stars closed pull request #6823: [FLINK-10134] UTF-16 support for TextInputFormat bug refixed

2018-11-13 Thread GitBox
XuQianJin-Stars closed pull request #6823: [FLINK-10134] UTF-16 support for TextInputFormat bug refixed URL: https://github.com/apache/flink/pull/6823 This is an automated message from the Apache Git Service. To respond to t

[jira] [Commented] (FLINK-10134) UTF-16 support for TextInputFormat

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686116#comment-16686116 ] ASF GitHub Bot commented on FLINK-10134: XuQianJin-Stars closed pull request #68

[jira] [Assigned] (FLINK-10871) ExecutionEnvironment & TableEnvironment should be singleton

2018-11-13 Thread Hequn Cheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hequn Cheng reassigned FLINK-10871: --- Assignee: Hequn Cheng > ExecutionEnvironment & TableEnvironment should be singleton > -

[GitHub] mai-nakagawa opened a new pull request #7091: Fixed a typo in a Javadoc comment

2018-11-13 Thread GitBox
mai-nakagawa opened a new pull request #7091: Fixed a typo in a Javadoc comment URL: https://github.com/apache/flink/pull/7091 This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Commented] (FLINK-10871) ExecutionEnvironment & TableEnvironment should be singleton

2018-11-13 Thread Hequn Cheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686118#comment-16686118 ] Hequn Cheng commented on FLINK-10871: - A singleton Environment makes sense too. I th

[jira] [Created] (FLINK-10872) Extend SQL client end-to-end to test KafkaTableSink for kafka connector 0.11

2018-11-13 Thread vinoyang (JIRA)
vinoyang created FLINK-10872: Summary: Extend SQL client end-to-end to test KafkaTableSink for kafka connector 0.11 Key: FLINK-10872 URL: https://issues.apache.org/jira/browse/FLINK-10872 Project: Flink

[GitHub] yanghua commented on issue #6927: [FLINK-10624] Extend SQL client end-to-end to test new KafkaTableSink

2018-11-13 Thread GitBox
yanghua commented on issue #6927: [FLINK-10624] Extend SQL client end-to-end to test new KafkaTableSink URL: https://github.com/apache/flink/pull/6927#issuecomment-438553957 I have created a new issue FLINK-10872 to provide end-to-end sql client test for kafka connector 0.11. Once this PR

[jira] [Commented] (FLINK-10624) Extend SQL client end-to-end to test new KafkaTableSink

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686131#comment-16686131 ] ASF GitHub Bot commented on FLINK-10624: yanghua commented on issue #6927: [FLIN

[jira] [Created] (FLINK-10873) Remove tableEnv in DataSetConversions#toTable and DataStreamConversions#toTable

2018-11-13 Thread Jeff Zhang (JIRA)
Jeff Zhang created FLINK-10873: -- Summary: Remove tableEnv in DataSetConversions#toTable and DataStreamConversions#toTable Key: FLINK-10873 URL: https://issues.apache.org/jira/browse/FLINK-10873 Project:

[jira] [Commented] (FLINK-10871) ExecutionEnvironment & TableEnvironment should be singleton

2018-11-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686150#comment-16686150 ] Jeff Zhang commented on FLINK-10871: Thanks [~hequn8128], I link FLINK-10873 which

[jira] [Assigned] (FLINK-9142) Lower the minimum number of buffers for incoming channels to 1

2018-11-13 Thread blues Zheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] blues Zheng reassigned FLINK-9142: -- Assignee: (was: blues Zheng) > Lower the minimum number of buffers for incoming channels t

[GitHub] XuQianJin-Stars opened a new pull request #7092: [FLINK-10134] UTF-16 support for TextInputFormat bug

2018-11-13 Thread GitBox
XuQianJin-Stars opened a new pull request #7092: [FLINK-10134] UTF-16 support for TextInputFormat bug URL: https://github.com/apache/flink/pull/7092 ## What is the purpose of the change *(This PR is designed to solve the problem of `TextInputFormat` using UTF-16 encoding to parse fi

[GitHub] zhijiangW commented on a change in pull request #7083: [hotfix][flink-runtime] modify maxAttempts when find a unique file name for the spilling channel

2018-11-13 Thread GitBox
zhijiangW commented on a change in pull request #7083: [hotfix][flink-runtime] modify maxAttempts when find a unique file name for the spilling channel URL: https://github.com/apache/flink/pull/7083#discussion_r232929174 ## File path: flink-runtime/src/main/java/org/apache/flink/ru

[GitHub] suez1224 opened a new pull request #7078: [FLINK-10848][YARN] properly remove YARN ContainerRequest upon container allocation success

2018-11-13 Thread GitBox
suez1224 opened a new pull request #7078: [FLINK-10848][YARN] properly remove YARN ContainerRequest upon container allocation success URL: https://github.com/apache/flink/pull/7078 ## What is the purpose of the change Properly remove YARN ContainerRequest upon container allocation su

[GitHub] suez1224 closed pull request #7078: [FLINK-10848][YARN] properly remove YARN ContainerRequest upon container allocation success

2018-11-13 Thread GitBox
suez1224 closed pull request #7078: [FLINK-10848][YARN] properly remove YARN ContainerRequest upon container allocation success URL: https://github.com/apache/flink/pull/7078 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below fo

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684859#comment-16684859 ] ASF GitHub Bot commented on FLINK-10848: suez1224 closed pull request #7078: [FL

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684860#comment-16684860 ] ASF GitHub Bot commented on FLINK-10848: suez1224 opened a new pull request #707

[GitHub] kl0u commented on issue #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-11-13 Thread GitBox
kl0u commented on issue #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream URL: https://github.com/apache/flink/pull/6608#issuecomment-438182663 Hi @art4ul ! There is already an open PR for that issue and it is this one: https://git

[jira] [Commented] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684888#comment-16684888 ] ASF GitHub Bot commented on FLINK-10203: kl0u commented on issue #6608: [FLINK-1

[jira] [Commented] (FLINK-10826) Heavy deployment end-to-end test produces no output on Travis

2018-11-13 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684903#comment-16684903 ] Timo Walther commented on FLINK-10826: -- Travis still failed: [https://api.travis-ci

[jira] [Commented] (FLINK-10705) Rework Flink Web Dashboard

2018-11-13 Thread Yadong Xie (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684904#comment-16684904 ] Yadong Xie commented on FLINK-10705: The new dashboard has about 10,000 lines of cod

[jira] [Assigned] (FLINK-10705) Rework Flink Web Dashboard

2018-11-13 Thread Yadong Xie (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Xie reassigned FLINK-10705: -- Assignee: Yadong Xie (was: Fabian Wollert) > Rework Flink Web Dashboard > --

[GitHub] twalthr commented on issue #6927: [FLINK-10624] Extend SQL client end-to-end to test new KafkaTableSink

2018-11-13 Thread GitBox
twalthr commented on issue #6927: [FLINK-10624] Extend SQL client end-to-end to test new KafkaTableSink URL: https://github.com/apache/flink/pull/6927#issuecomment-438189527 @yanghua I agree with @pnowojski. We should test Kafka and Elastic but we don't need to test them together. The `Exe

[jira] [Commented] (FLINK-10624) Extend SQL client end-to-end to test new KafkaTableSink

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684912#comment-16684912 ] ASF GitHub Bot commented on FLINK-10624: twalthr commented on issue #6927: [FLIN

[jira] [Created] (FLINK-10858) Create Angular Scaffold in Flink Dashboard

2018-11-13 Thread Yadong Xie (JIRA)
Yadong Xie created FLINK-10858: -- Summary: Create Angular Scaffold in Flink Dashboard Key: FLINK-10858 URL: https://issues.apache.org/jira/browse/FLINK-10858 Project: Flink Issue Type: Sub-task

  1   2   >