[jira] [Closed] (FLINK-9263) Kafka010ITCase failed on travis because of the concurrency problem in DefaultOperateStateBackend

2018-05-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9263. - Resolution: Fixed Merged in: master: c11f11359b release 1.5: de4f283087 > Kafka010ITCase failed

[jira] [Commented] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460879#comment-16460879 ] Aljoscha Krettek commented on FLINK-8500: - [~tzulitai] I thought about that second

[jira] [Updated] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9269: Fix Version/s: (was: 1.5.0) 1.6.0 > Concurrency problem in HeapKeyedS

[GitHub] flink issue #3359: [FLINK-5544][streaming] Add InternalTimerService implemen...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/3359 @shixiaogang Thank you very much, appreciate your efforts on this feature! There is no need to rush this if you are busy right now, the cycle for the 1.6 release is just beginning. ---

[jira] [Commented] (FLINK-5544) Implement Internal Timer Service in RocksDB

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460884#comment-16460884 ] ASF GitHub Bot commented on FLINK-5544: --- Github user StefanRRichter commented on the

[jira] [Reopened] (FLINK-9043) Flink recover from checkpoint like Spark Streaming

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened FLINK-9043: - > Flink recover from checkpoint like Spark Streaming > --

[jira] [Updated] (FLINK-9101) HAQueryableStateRocksDBBackendITCase failed on travis

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9101: Fix Version/s: 1.5.1 1.6.0 > HAQueryableStateRocksDBBackendITCase failed

[jira] [Commented] (FLINK-9178) Add rate control for kafka source

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460891#comment-16460891 ] Tzu-Li (Gordon) Tai commented on FLINK-9178: [~app-tarush] Sorry for slow late

[jira] [Comment Edited] (FLINK-9178) Add rate control for kafka source

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460891#comment-16460891 ] Tzu-Li (Gordon) Tai edited comment on FLINK-9178 at 5/2/18 11:22 AM: ---

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185464970 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -3594,6 +3599,58 @@ public String fold(String a

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460901#comment-16460901 ] ASF GitHub Bot commented on FLINK-9269: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185465142 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460902#comment-16460902 ] ASF GitHub Bot commented on FLINK-9269: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185465407 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460904#comment-16460904 ] ASF GitHub Bot commented on FLINK-9269: --- Github user StefanRRichter commented on a d

[jira] [Reopened] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened FLINK-5372: - Reopen to change fixVersion > Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

[jira] [Closed] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-5372. --- Resolution: Fixed Fix Version/s: (was: 1.6.0) > Fix RocksDBAsyncSnapshotTest.testCa

[jira] [Commented] (FLINK-7484) CaseClassSerializer.duplicate() does not perform proper deep copy

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460905#comment-16460905 ] Aljoscha Krettek commented on FLINK-7484: - cc [~srichter] > CaseClassSerializer.d

[jira] [Commented] (FLINK-7484) CaseClassSerializer.duplicate() does not perform proper deep copy

2018-05-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460907#comment-16460907 ] Stefan Richter commented on FLINK-7484: --- [~joshlemer] this looks like a different pr

[GitHub] flink issue #5922: [FLINK-8780] [docs] Add Broadcast State documentation.

2018-05-02 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5922 Thanks a lot for the reviews! I pushed a commit that integrates your comments. Let me know if now it looks ok. ---

[jira] [Commented] (FLINK-8780) Add Broadcast State documentation.

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460920#comment-16460920 ] ASF GitHub Bot commented on FLINK-8780: --- Github user kl0u commented on the issue:

[jira] [Created] (FLINK-9288) clarify a few points in the event time / watermark docs

2018-05-02 Thread David Anderson (JIRA)
David Anderson created FLINK-9288: - Summary: clarify a few points in the event time / watermark docs Key: FLINK-9288 URL: https://issues.apache.org/jira/browse/FLINK-9288 Project: Flink Issue

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185470576 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/HeapKeyedStateBackend.java --- @@ -622,20 +622,23 @@ public HeapSnapshotStr

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460924#comment-16460924 ] ASF GitHub Bot commented on FLINK-9269: --- Github user StefanRRichter commented on a d

[GitHub] flink issue #5934: [FLINK-9269][state] fix concurrency problem when performi...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/5934 Thanks for your work! Besides my comments, this looks good 👍 ---

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460925#comment-16460925 ] ASF GitHub Bot commented on FLINK-9269: --- Github user StefanRRichter commented on the

[GitHub] flink pull request #5949: [FLINK-9288][docs] clarify the event time / waterm...

2018-05-02 Thread alpinegizmo
GitHub user alpinegizmo opened a pull request: https://github.com/apache/flink/pull/5949 [FLINK-9288][docs] clarify the event time / watermark docs This PR only affects the documentation (for event time and watermarks). I wanted to make a couple of things clearer, and to provide a c

[jira] [Commented] (FLINK-9288) clarify a few points in the event time / watermark docs

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460927#comment-16460927 ] ASF GitHub Bot commented on FLINK-9288: --- GitHub user alpinegizmo opened a pull reque

[jira] [Commented] (FLINK-9122) NFASerialize deserailze failed and cause other exception

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460930#comment-16460930 ] Aljoscha Krettek commented on FLINK-9122: - You could try applying the PR for FLINK

[jira] [Commented] (FLINK-9271) flink-1.4.2-bin-scala_2.11.tgz is not in gzip format

2018-05-02 Thread Martin Grigorov (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460932#comment-16460932 ] Martin Grigorov commented on FLINK-9271: The downloaded file is not gzipped when I

[jira] [Resolved] (FLINK-9271) flink-1.4.2-bin-scala_2.11.tgz is not in gzip format

2018-05-02 Thread Martin Grigorov (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Grigorov resolved FLINK-9271. Resolution: Not A Problem > flink-1.4.2-bin-scala_2.11.tgz is not in gzip format > -

[GitHub] flink issue #5817: [FLINK-9136][tests] Remove StreamingProgramTestBase

2018-05-02 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5817 Looks very good to merge! 👍 ---

[jira] [Commented] (FLINK-9136) Remove StreamingProgramTestBase

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460933#comment-16460933 ] ASF GitHub Bot commented on FLINK-9136: --- Github user aljoscha commented on the issue

[GitHub] flink pull request #5932: [FLINK-9266][flink-connector-kinesis]Updates Kines...

2018-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5932 ---

[jira] [Commented] (FLINK-9188) Provide a mechanism to configure AmazonKinesisClient in FlinkKinesisConsumer

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460935#comment-16460935 ] ASF GitHub Bot commented on FLINK-9188: --- Github user asfgit closed the pull request

[GitHub] flink pull request #5889: [FLINK-9188] [kinesis] Generic mechanism to set Cl...

2018-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5889 ---

[jira] [Commented] (FLINK-9266) Upgrade AWS Kinesis Client version to 1.9.0 to reduce Kinesis describe streams calls

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460936#comment-16460936 ] ASF GitHub Bot commented on FLINK-9266: --- Github user asfgit closed the pull request

[jira] [Resolved] (FLINK-9188) Provide a mechanism to configure AmazonKinesisClient in FlinkKinesisConsumer

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-9188. Resolution: Fixed Assignee: Thomas Weise Fix Version/s: 1.5.0 Thanks

[jira] [Resolved] (FLINK-9266) Upgrade AWS Kinesis Client version to 1.9.0 to reduce Kinesis describe streams calls

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-9266. Resolution: Fixed Fix Version/s: 1.5.0 Release Note: The default version

[jira] [Updated] (FLINK-9266) Upgrade AWS Kinesis Client version to 1.9.0 to reduce Kinesis describe streams calls

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-9266: --- Release Note: The default versions for AWS SDKs used in the Flink Kinesis connector ha

[jira] [Closed] (FLINK-9148) when deploying flink on kubernetes, the taskmanager report "java.net.UnknownHostException: flink-jobmanager: Temporary failure in name resolution"

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-9148. --- Resolution: Cannot Reproduce Fix Version/s: (was: 1.6.0) Seems to be a configuratio

[jira] [Assigned] (FLINK-9266) Upgrade AWS Kinesis Client version to 1.9.0 to reduce Kinesis describe streams calls

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-9266: -- Assignee: Thomas Moser > Upgrade AWS Kinesis Client version to 1.9.0 to reduce

[jira] [Updated] (FLINK-9201) same merge window will be fired twice if watermark already passed the merge window

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9201: Fix Version/s: 1.6.0 > same merge window will be fired twice if watermark already passed the

[jira] [Closed] (FLINK-9226) Add Bucketing e2e test script to run-nightly-tests.sh

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-9226. --- Resolution: Duplicate > Add Bucketing e2e test script to run-nightly-tests.sh > --

[jira] [Closed] (FLINK-9238) There are some questions about BuckeingSink when sinking data to S3.

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-9238. --- Resolution: Duplicate Fix Version/s: (was: 1.4.2) Unfortunately, the current bucket

[jira] [Commented] (FLINK-9251) Move MemoryStateBackend to flink-state-backends

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460959#comment-16460959 ] Aljoscha Krettek commented on FLINK-9251: - I don't think we have to do this. This

[jira] [Closed] (FLINK-9251) Move MemoryStateBackend to flink-state-backends

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-9251. --- Resolution: Not A Problem Fix Version/s: (was: 1.6.0) Closing for now but please co

[jira] [Updated] (FLINK-9043) Flink recover from checkpoint like Spark Streaming

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9043: Description: I know a flink job can reovery from checkpoint with restart strategy, but can

[jira] [Updated] (FLINK-9043) Introduce a friendly way to resume the job from externalized checkpoints automatically

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9043: Summary: Introduce a friendly way to resume the job from externalized checkpoints automatica

[jira] [Assigned] (FLINK-9043) Introduce a friendly way to resume the job from externalized checkpoints automatically

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned FLINK-9043: --- Assignee: Sihua Zhou > Introduce a friendly way to resume the job from externalized c

[jira] [Closed] (FLINK-9260) Introduce a friendly way to resume the job from externalized checkpoints automatically

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-9260. --- Resolution: Duplicate Fix Version/s: (was: 1.6.0) Please resume any discussion on F

[jira] [Updated] (FLINK-9262) KeyedOneInputStreamOperatorTestHarness throws NPE creating snapshot

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9262: Priority: Blocker (was: Major) > KeyedOneInputStreamOperatorTestHarness throws NPE creating

[jira] [Updated] (FLINK-9245) Can't create a BucketingSink with a provided Configuration if no hadoop defaults

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9245: Fix Version/s: 1.6.0 > Can't create a BucketingSink with a provided Configuration if no hado

[jira] [Updated] (FLINK-9262) KeyedOneInputStreamOperatorTestHarness throws NPE creating snapshot

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9262: Fix Version/s: 1.6.0 > KeyedOneInputStreamOperatorTestHarness throws NPE creating snapshot >

[jira] [Commented] (FLINK-9278) Allow restore savepoint with some SQL queries added/removed

2018-05-02 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460972#comment-16460972 ] Fabian Hueske commented on FLINK-9278: -- Hi [~ahains], This sounds like a very valuab

[jira] [Comment Edited] (FLINK-9278) Allow restore savepoint with some SQL queries added/removed

2018-05-02 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460972#comment-16460972 ] Fabian Hueske edited comment on FLINK-9278 at 5/2/18 12:49 PM: -

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185485401 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -3594,6 +3599,58 @@ public String fold(String acc, I

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185485532 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@ -198

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460982#comment-16460982 ] ASF GitHub Bot commented on FLINK-9269: --- Github user sihuazhou commented on a diff i

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460983#comment-16460983 ] ASF GitHub Bot commented on FLINK-9269: --- Github user sihuazhou commented on a diff i

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185486196 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@ -198

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185486283 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/HeapKeyedStateBackend.java --- @@ -622,20 +622,23 @@ public HeapSnapshotStrategy

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460988#comment-16460988 ] ASF GitHub Bot commented on FLINK-9269: --- Github user sihuazhou commented on a diff i

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460989#comment-16460989 ] ASF GitHub Bot commented on FLINK-9269: --- Github user sihuazhou commented on a diff i

[jira] [Closed] (FLINK-9270) Upgrade RocksDB to 5.11.3, and resolve concurrent test invocation problem of @RetryOnFailure

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-9270. --- Resolution: Won't Fix Fix Version/s: (was: 1.6.0) > Upgrade RocksDB to 5.11.3, and

[jira] [Reopened] (FLINK-9270) Upgrade RocksDB to 5.11.3, and resolve concurrent test invocation problem of @RetryOnFailure

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened FLINK-9270: - Reopen to remove fixVersion > Upgrade RocksDB to 5.11.3, and resolve concurrent test invocati

[jira] [Updated] (FLINK-9278) Allow restore savepoint with some SQL queries added/removed

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9278: Component/s: Table API & SQL > Allow restore savepoint with some SQL queries added/removed >

[jira] [Created] (FLINK-9289) Parallelism of generated operators should have max parallism of input

2018-05-02 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-9289: Summary: Parallelism of generated operators should have max parallism of input Key: FLINK-9289 URL: https://issues.apache.org/jira/browse/FLINK-9289 Project: Flink

[jira] [Updated] (FLINK-9289) Parallelism of generated operators should have max parallism of input

2018-05-02 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske updated FLINK-9289: - Description: The DataSet API aims to chain generated operators such as key extraction mappers to

[GitHub] flink pull request #5906: [FLINK-9213] [REST] [docs] Revert checkpoint detai...

2018-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5906 ---

[GitHub] flink pull request #5904: [FLINK-9249][build] Add convenience profile for sk...

2018-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5904 ---

[GitHub] flink pull request #5912: [FLINK-9041] Refactor StreamTaskTest to not use sc...

2018-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5912 ---

[GitHub] flink pull request #5833: [FLINK-9154][REST][docs] Document WebSubmissionExt...

2018-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5833 ---

[GitHub] flink pull request #5822: [FLINK-8743][docs] Allow overriding documented def...

2018-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5822 ---

[GitHub] flink pull request #5903: [FLINK-9211][REST] JarRunHandler submits job to Di...

2018-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5903 ---

[jira] [Closed] (FLINK-9211) Job submission via REST/dashboard does not work on Kubernetes

2018-05-02 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-9211. --- Resolution: Fixed master: e884a3a4f6ba738fac66846488f931cf85f2e2fc 1.5: f4bef6fc51c297b372b95c

[GitHub] flink pull request #5878: [FLINK-9216][Streaming] Fix comparator violation

2018-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5878 ---

[GitHub] flink pull request #5919: [hotfix][state.md]modify typo in the state.md

2018-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5919 ---

[jira] [Closed] (FLINK-8743) Add annotation to override documented default

2018-05-02 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-8743. --- Resolution: Fixed master: c7d59105c0dfae172db8d70820077d81040b3f6d 1.5: d83e19fbb20e4e04b65260

[jira] [Commented] (FLINK-8743) Add annotation to override documented default

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461014#comment-16461014 ] ASF GitHub Bot commented on FLINK-8743: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-9249) Add convenience profile for skipping non-essential plugins

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461013#comment-16461013 ] ASF GitHub Bot commented on FLINK-9249: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-9216) Fix comparator violation

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461011#comment-16461011 ] ASF GitHub Bot commented on FLINK-9216: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-9041) Refactor StreamTaskTest to not use scala and akka

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461012#comment-16461012 ] ASF GitHub Bot commented on FLINK-9041: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-9213) Revert breaking change in checkpoint detail URL

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461010#comment-16461010 ] ASF GitHub Bot commented on FLINK-9213: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-9154) Include WebSubmissionExtension in REST API docs

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461016#comment-16461016 ] ASF GitHub Bot commented on FLINK-9154: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-9211) Job submission via REST/dashboard does not work on Kubernetes

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461015#comment-16461015 ] ASF GitHub Bot commented on FLINK-9211: --- Github user asfgit closed the pull request

[jira] [Closed] (FLINK-9154) Include WebSubmissionExtension in REST API docs

2018-05-02 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-9154. --- Resolution: Fixed master: fa321ea96bc5a58d53c0cf29dbd8fb04ace3c2a8 1.5: 1c48e32446363e903f5084

[jira] [Closed] (FLINK-9249) Add convenience profile for skipping non-essential plugins

2018-05-02 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-9249. --- Resolution: Fixed master: 678ab6cb2f810a93c9b9599cde56d821d09801af 1.5: 45354899cef40ed6ce8a38

[jira] [Commented] (FLINK-9216) Fix comparator violation

2018-05-02 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461020#comment-16461020 ] Chesnay Schepler commented on FLINK-9216: - master: 3242214bac3719d057aeaeb34259039

[jira] [Closed] (FLINK-9041) Refactor StreamTaskTest to not use scala and akka

2018-05-02 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-9041. --- Resolution: Fixed Fix Version/s: 1.6.0 master: 40e412ae233046a5f6f38cf86288ab5185d9d194

[jira] [Closed] (FLINK-9213) Revert breaking change in checkpoint detail URL

2018-05-02 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-9213. --- Resolution: Fixed master: dee63946904fa7f1c82f4d482cb8a425935e8ef6 1.5: 547152eadd54f2b0d827b9

[jira] [Commented] (FLINK-9273) Class cast exception

2018-05-02 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461060#comment-16461060 ] Fabian Hueske commented on FLINK-9273: -- Hi [~bob365], Flink cannot automatically ext

[GitHub] flink issue #5887: [FLINK-6719] [docs] Add details about fault-tolerance of ...

2018-05-02 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/5887 Thanks for the update @bowenli86. I'll merge the PR later. ---

[jira] [Commented] (FLINK-6719) Add details about fault-tolerance of timers to ProcessFunction docs

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461075#comment-16461075 ] ASF GitHub Bot commented on FLINK-6719: --- Github user fhueske commented on the issue:

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185508430 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -3594,6 +3599,58 @@ public String fold(String a

[GitHub] flink issue #5934: [FLINK-9269][state] fix concurrency problem when performi...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/5934 Thanks! Will merge once my travis run is green. ---

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461076#comment-16461076 ] ASF GitHub Bot commented on FLINK-9269: --- Github user StefanRRichter commented on a d

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461077#comment-16461077 ] ASF GitHub Bot commented on FLINK-9269: --- Github user StefanRRichter commented on the

[jira] [Assigned] (FLINK-9289) Parallelism of generated operators should have max parallism of input

2018-05-02 Thread Xingcan Cui (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingcan Cui reassigned FLINK-9289: -- Assignee: Xingcan Cui > Parallelism of generated operators should have max parallism of input >

[GitHub] flink pull request #5580: [FLINK-8620] Enable shipping custom files to BlobS...

2018-05-02 Thread dawidwys
Github user dawidwys commented on a diff in the pull request: https://github.com/apache/flink/pull/5580#discussion_r185517079 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/filecache/FileCacheDirectoriesTest.java --- @@ -0,0 +1,209 @@ +/* + * Licensed to th

<    1   2   3   >