[jira] [Commented] (FLINK-8802) Concurrent serialization without duplicating serializers in state server.

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405813#comment-16405813 ] ASF GitHub Bot commented on FLINK-8802: --- Github user kl0u commented on the issue:

[GitHub] flink issue #5691: [FLINK-8802] [QS] Fix concurrent access to non-duplicated...

2018-03-19 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5691 That is because cleaning up the cache is happening from another thread, other than the one accessing the serializers, and ThreadLocal does not have a clear() method that you can call from anoth

[jira] [Commented] (FLINK-9018) Unclosed snapshotCloseableRegistry in RocksDBKeyedStateBackend#FullSnapshotStrategy#performSnapshot

2018-03-19 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405781#comment-16405781 ] Sihua Zhou commented on FLINK-9018: --- Since this is a minor change, I covered it in [571

[jira] [Assigned] (FLINK-9018) Unclosed snapshotCloseableRegistry in RocksDBKeyedStateBackend#FullSnapshotStrategy#performSnapshot

2018-03-19 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou reassigned FLINK-9018: - Assignee: Sihua Zhou > Unclosed snapshotCloseableRegistry in > RocksDBKeyedStateBackend#FullSnap

[jira] [Commented] (FLINK-8620) Enable shipping custom artifacts to BlobStore and accessing them through DistributedCache

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405778#comment-16405778 ] ASF GitHub Bot commented on FLINK-8620: --- Github user aljoscha commented on the issue

[GitHub] flink issue #5580: [FLINK-8620] Enable shipping custom files to BlobStore an...

2018-03-19 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5580 So the current state of this PR doesn't work with the Python API because it uploads complete directories? Is that really used/needed by the Python API? I would like to have this feature in 1

[jira] [Commented] (FLINK-8886) Job isolation via scheduling in shared cluster

2018-03-19 Thread Elias Levy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405753#comment-16405753 ] Elias Levy commented on FLINK-8886: --- Thanks.  I am aware of YARN, but we do want to mana

[jira] [Commented] (FLINK-8415) Unprotected access to recordsToSend in LongRecordWriterThread#shutdown()

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405750#comment-16405750 ] ASF GitHub Bot commented on FLINK-8415: --- GitHub user yanghua opened a pull request:

[GitHub] flink pull request #5724: [FLINK-8415] Unprotected access to recordsToSend i...

2018-03-19 Thread yanghua
GitHub user yanghua opened a pull request: https://github.com/apache/flink/pull/5724 [FLINK-8415] Unprotected access to recordsToSend in LongRecordWriterThread#shutdown() ## What is the purpose of the change *This pull request marked a method as `synchronized` keyword.*

[jira] [Commented] (FLINK-9019) Unclosed closeableRegistry in StreamTaskStateInitializerImpl#rawOperatorStateInputs

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405739#comment-16405739 ] ASF GitHub Bot commented on FLINK-9019: --- Github user yanghua commented on the issue:

[GitHub] flink issue #5723: [FLINK-9019] Unclosed closeableRegistry in StreamTaskStat...

2018-03-19 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5723 cc @tillrohrmann ---

[jira] [Assigned] (FLINK-8394) Lack of synchronization accessing expectedRecord in ReceiverThread#shutdown

2018-03-19 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-8394: --- Assignee: vinoyang > Lack of synchronization accessing expectedRecord in ReceiverThread#shutdown > --

[jira] [Commented] (FLINK-8886) Job isolation via scheduling in shared cluster

2018-03-19 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405723#comment-16405723 ] vinoyang commented on FLINK-8886: - [~elevy] YARN has a feature named 'Node Label' since Ap

[jira] [Updated] (FLINK-8394) Lack of synchronization accessing expectedRecord in ReceiverThread#shutdown

2018-03-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-8394: -- Description: {code} public void shutdown() { running = false; interrupt(); expectedRecord.complete

[jira] [Commented] (FLINK-8802) Concurrent serialization without duplicating serializers in state server.

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405713#comment-16405713 ] ASF GitHub Bot commented on FLINK-8802: --- Github user sihuazhou commented on a diff i

[GitHub] flink pull request #5691: [FLINK-8802] [QS] Fix concurrent access to non-dup...

2018-03-19 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5691#discussion_r175640731 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/internal/InternalQueryableKvState.java --- @@ -16,46 +16,42 @@ * limitations un

[jira] [Assigned] (FLINK-8415) Unprotected access to recordsToSend in LongRecordWriterThread#shutdown()

2018-03-19 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-8415: --- Assignee: vinoyang > Unprotected access to recordsToSend in LongRecordWriterThread#shutdown() > -

[jira] [Commented] (FLINK-9019) Unclosed closeableRegistry in StreamTaskStateInitializerImpl#rawOperatorStateInputs

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405696#comment-16405696 ] ASF GitHub Bot commented on FLINK-9019: --- GitHub user yanghua opened a pull request:

[GitHub] flink pull request #5723: [FLINK-9019] Unclosed closeableRegistry in StreamT...

2018-03-19 Thread yanghua
GitHub user yanghua opened a pull request: https://github.com/apache/flink/pull/5723 [FLINK-9019] Unclosed closeableRegistry in StreamTaskStateInitializerImpl#rawOperatorStateInputs ## What is the purpose of the change *This pull request fixed a resource(CloseableRegistry)

[jira] [Commented] (FLINK-8946) TaskManager stop sending metrics after JobManager failover

2018-03-19 Thread Truong Duc Kien (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405692#comment-16405692 ] Truong Duc Kien commented on FLINK-8946: Sorry, we haven't had time to test with F

[jira] [Commented] (FLINK-9019) Unclosed closeableRegistry in StreamTaskStateInitializerImpl#rawOperatorStateInputs

2018-03-19 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405688#comment-16405688 ] vinoyang commented on FLINK-9019: - sorry, I was busy and have not joined the discussion. A

[jira] [Comment Edited] (FLINK-5486) Lack of synchronization in BucketingSink#handleRestoredBucketState()

2018-03-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351986#comment-16351986 ] Ted Yu edited comment on FLINK-5486 at 3/19/18 9:12 PM: Can this g

[jira] [Comment Edited] (FLINK-7795) Utilize error-prone to discover common coding mistakes

2018-03-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345955#comment-16345955 ] Ted Yu edited comment on FLINK-7795 at 3/19/18 9:09 PM: error-pron

[jira] [Updated] (FLINK-8661) Replace Collections.EMPTY_MAP with Collections.emptyMap()

2018-03-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-8661: -- Description: The use of Collections.EMPTY_SET and Collections.EMPTY_MAP often causes unchecked assignment and it

[jira] [Updated] (FLINK-8941) SpanningRecordSerializationTest fails on Travis

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8941: Fix Version/s: (was: 1.6.0) > SpanningRecordSerializationTest fails on Travis >

[jira] [Updated] (FLINK-9013) Document yarn.containers.vcores only being effective when adapting YARN config

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9013: Affects Version/s: (was: 1.6.0) > Document yarn.containers.vcores only being effective w

[jira] [Updated] (FLINK-9010) NoResourceAvailableException with FLIP-6

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9010: Affects Version/s: (was: 1.6.0) > NoResourceAvailableException with FLIP-6 > --

[jira] [Updated] (FLINK-9012) Shaded Hadoop S3A end-to-end test failing with S3 bucket in Ireland

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9012: Affects Version/s: (was: 1.6.0) > Shaded Hadoop S3A end-to-end test failing with S3 buck

[jira] [Updated] (FLINK-8941) SpanningRecordSerializationTest fails on Travis

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8941: Affects Version/s: (was: 1.6.0) > SpanningRecordSerializationTest fails on Travis >

[jira] [Updated] (FLINK-9011) YarnResourceManager spamming log file at INFO level

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9011: Affects Version/s: (was: 1.6.0) > YarnResourceManager spamming log file at INFO level >

[jira] [Updated] (FLINK-9027) Web UI does not cleanup temporary files

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9027: Affects Version/s: (was: 1.6.0) > Web UI does not cleanup temporary files >

[jira] [Updated] (FLINK-9010) NoResourceAvailableException with FLIP-6

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9010: Fix Version/s: (was: 1.6.0) > NoResourceAvailableException with FLIP-6 > --

[jira] [Updated] (FLINK-9014) Adapt BackPressureStatsTracker to work with credit-based flow control

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9014: Affects Version/s: (was: 1.6.0) > Adapt BackPressureStatsTracker to work with credit-bas

[jira] [Updated] (FLINK-9011) YarnResourceManager spamming log file at INFO level

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9011: Fix Version/s: (was: 1.6.0) > YarnResourceManager spamming log file at INFO level >

[jira] [Updated] (FLINK-9014) Adapt BackPressureStatsTracker to work with credit-based flow control

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9014: Fix Version/s: (was: 1.6.0) > Adapt BackPressureStatsTracker to work with credit-based f

[jira] [Updated] (FLINK-9027) Web UI does not cleanup temporary files

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9027: Fix Version/s: (was: 1.6.0) > Web UI does not cleanup temporary files >

[jira] [Updated] (FLINK-9013) Document yarn.containers.vcores only being effective when adapting YARN config

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9013: Fix Version/s: (was: 1.6.0) > Document yarn.containers.vcores only being effective when

[jira] [Updated] (FLINK-9012) Shaded Hadoop S3A end-to-end test failing with S3 bucket in Ireland

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9012: Fix Version/s: (was: 1.6.0) > Shaded Hadoop S3A end-to-end test failing with S3 bucket i

[jira] [Commented] (FLINK-8959) Port AccumulatorLiveITCase to flip6

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405348#comment-16405348 ] ASF GitHub Bot commented on FLINK-8959: --- Github user zentol commented on a diff in t

[GitHub] flink pull request #5719: [FLINK-8959][tests] Port AccumulatorLiveITCase to ...

2018-03-19 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5719#discussion_r175566292 --- Diff: flink-tests/src/test/java/org/apache/flink/test/accumulators/AccumulatorLiveITCase.java --- @@ -18,292 +18,188 @@ package org.apache.fli

[jira] [Commented] (FLINK-8937) Refactor flink end-to-end test skeleton

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405343#comment-16405343 ] Aljoscha Krettek commented on FLINK-8937: - That sounds good. Is that even possible

[jira] [Commented] (FLINK-8073) Test instability FlinkKafkaProducer011ITCase.testScaleDownBeforeFirstCheckpoint()

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405298#comment-16405298 ] ASF GitHub Bot commented on FLINK-8073: --- Github user zentol commented on the issue:

[GitHub] flink issue #5718: [FLINK-8073][kafka-tests] Disable timeout in tests

2018-03-19 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5718 I don't want to make a fuss over a single test, so for the purposes of this test it's fine to just remote the timeout. In general however i think it would be pretty neat if we would add such a

[jira] [Updated] (FLINK-8886) Job isolation via scheduling in shared cluster

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8886: Component/s: Local Runtime Distributed Coordination > Job isolation via sch

[jira] [Updated] (FLINK-8939) Provide better support for saving streaming data to s3

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8939: Component/s: Streaming Connectors > Provide better support for saving streaming data to s3 >

[jira] [Commented] (FLINK-9020) Move test projects of end-to-end tests in separate modules

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405189#comment-16405189 ] Aljoscha Krettek commented on FLINK-9020: - Only seeing this now but it makes a lot

[jira] [Created] (FLINK-9027) Web UI does not cleanup temporary files

2018-03-19 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9027: -- Summary: Web UI does not cleanup temporary files Key: FLINK-9027 URL: https://issues.apache.org/jira/browse/FLINK-9027 Project: Flink Issue Type: Bug C

[jira] [Closed] (FLINK-9025) Problem with convert String to Row

2018-03-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-9025. Resolution: Not A Problem The {{Row}} data type was not designed for flexible schemas. Closing as "

[jira] [Commented] (FLINK-9025) Problem with convert String to Row

2018-03-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405162#comment-16405162 ] Fabian Hueske commented on FLINK-9025: -- Rows have a schema with fixed data types like

[jira] [Commented] (FLINK-9026) Unregister finished tasks from TaskManagerMetricGroup and close it

2018-03-19 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405130#comment-16405130 ] Sihua Zhou commented on FLINK-9026: --- Hi [~till.rohrmann] have you already work on this?

[jira] [Created] (FLINK-9026) Unregister finished tasks from TaskManagerMetricGroup and close it

2018-03-19 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9026: Summary: Unregister finished tasks from TaskManagerMetricGroup and close it Key: FLINK-9026 URL: https://issues.apache.org/jira/browse/FLINK-9026 Project: Flink

[jira] [Commented] (FLINK-8946) TaskManager stop sending metrics after JobManager failover

2018-03-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405101#comment-16405101 ] Till Rohrmann commented on FLINK-8946: -- Is this also a problem for Flip-6 [~kien_truo

[jira] [Commented] (FLINK-8976) End-to-end test: Resume with different parallelism

2018-03-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405096#comment-16405096 ] Till Rohrmann commented on FLINK-8976: -- My oversight. It should also work with increm

[jira] [Updated] (FLINK-8976) End-to-end test: Resume with different parallelism

2018-03-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-8976: - Description: Similar to FLINK-8975, we should have an end-to-end test which resumes a job with a

[jira] [Created] (FLINK-9025) Problem with convert String to Row

2018-03-19 Thread ChenDonghe (JIRA)
ChenDonghe created FLINK-9025: - Summary: Problem with convert String to Row Key: FLINK-9025 URL: https://issues.apache.org/jira/browse/FLINK-9025 Project: Flink Issue Type: Bug Componen

[jira] [Closed] (FLINK-9021) org.apache.flink.table.codegen.CodeGenException: Unsupported call: TUMBLE

2018-03-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-9021. Resolution: Not A Problem You can implement this functionality with a user-defined aggregate functio

[jira] [Commented] (FLINK-9019) Unclosed closeableRegistry in StreamTaskStateInitializerImpl#rawOperatorStateInputs

2018-03-19 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405049#comment-16405049 ] Sihua Zhou commented on FLINK-9019: --- I think we can't use try-with-resources here, cause

[jira] [Resolved] (FLINK-8906) Flip6DefaultCLI is not tested in org.apache.flink.client.cli tests

2018-03-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-8906. -- Resolution: Fixed Fixed via master: 463b922abebc77420d0ec990ba18ad83ea33c0e4 1.5.0: 0ba8ed6ba8b2

[jira] [Resolved] (FLINK-8905) RestClusterClient#getMaxSlots returns 0

2018-03-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-8905. -- Resolution: Fixed Fixed via master: 52475b3478e78f12d5e2a9ecb10e2bf3d5133687 1.5.0: 76b0eb670921

[GitHub] flink pull request #5671: [FLINK-8906][flip6][tests] also test Flip6DefaultC...

2018-03-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5671 ---

[jira] [Commented] (FLINK-8906) Flip6DefaultCLI is not tested in org.apache.flink.client.cli tests

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405014#comment-16405014 ] ASF GitHub Bot commented on FLINK-8906: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-8988) End-to-end test: Cassandra connector

2018-03-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405004#comment-16405004 ] Till Rohrmann commented on FLINK-8988: -- {{CassandraConnectorITCase}} is indeed alread

[jira] [Commented] (FLINK-9019) Unclosed closeableRegistry in StreamTaskStateInitializerImpl#rawOperatorStateInputs

2018-03-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405003#comment-16405003 ] Ted Yu commented on FLINK-9019: --- Since CloseableRegistry implements Closeable, try-with-reso

[jira] [Commented] (FLINK-8562) Fix YARNSessionFIFOSecuredITCase

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405002#comment-16405002 ] ASF GitHub Bot commented on FLINK-8562: --- Github user tillrohrmann commented on the i

[GitHub] flink issue #5416: [FLINK-8562] [Security] Fix YARNSessionFIFOSecuredITCase

2018-03-19 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5416 The problem is @suez1224 that in Flip-6 mode we won't allocate 2 containers if there is no job submitted. Thus, we would have to wait for a different signal in Flip-6 mode. ---

[jira] [Commented] (FLINK-8562) Fix YARNSessionFIFOSecuredITCase

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405000#comment-16405000 ] ASF GitHub Bot commented on FLINK-8562: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request #5416: [FLINK-8562] [Security] Fix YARNSessionFIFOSecured...

2018-03-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5416#discussion_r175483617 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java --- @@ -206,7 +209,7 @@ public void checkClusterEmpty() throws IOExcept

[jira] [Commented] (FLINK-8562) Fix YARNSessionFIFOSecuredITCase

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404988#comment-16404988 ] ASF GitHub Bot commented on FLINK-8562: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request #5416: [FLINK-8562] [Security] Fix YARNSessionFIFOSecured...

2018-03-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5416#discussion_r175480428 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java --- @@ -97,6 +98,15 @@ public static void teardownSecu

[jira] [Commented] (FLINK-8562) Fix YARNSessionFIFOSecuredITCase

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404987#comment-16404987 ] ASF GitHub Bot commented on FLINK-8562: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request #5416: [FLINK-8562] [Security] Fix YARNSessionFIFOSecured...

2018-03-19 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5416#discussion_r175480192 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOITCase.java --- @@ -105,7 +105,7 @@ public void testDetachedMode() throws

[jira] [Commented] (FLINK-7270) Add support for dynamic properties to cluster entry point

2018-03-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404984#comment-16404984 ] Till Rohrmann commented on FLINK-7270: -- {{env.java.opts}} is a configuration option w

[jira] [Updated] (FLINK-7897) Consider using nio.Files for file deletion in TransientBlobCleanupTask

2018-03-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-7897: -- Description: nio.Files#delete() provides better clue as to why the deletion may fail: https://docs.oracle.com/j

[jira] [Updated] (FLINK-8415) Unprotected access to recordsToSend in LongRecordWriterThread#shutdown()

2018-03-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-8415: -- Description: {code} public void shutdown() { running = false; recordsToSend.complete(0L); {code} In o

[jira] [Commented] (FLINK-8073) Test instability FlinkKafkaProducer011ITCase.testScaleDownBeforeFirstCheckpoint()

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404972#comment-16404972 ] ASF GitHub Bot commented on FLINK-8073: --- Github user tillrohrmann commented on the i

[GitHub] flink issue #5718: [FLINK-8073][kafka-tests] Disable timeout in tests

2018-03-19 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5718 I agree with @pnowojski. The watchdog and Travis itself should time out the test for us if things take too long. ---

[jira] [Commented] (FLINK-8984) Disabling credit based flow control deadlocks Flink on checkpoint

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404966#comment-16404966 ] ASF GitHub Bot commented on FLINK-8984: --- Github user pnowojski commented on the issu

[GitHub] flink issue #5708: [FLINK-8984][network] Drop taskmanager.exactly-once.block...

2018-03-19 Thread pnowojski
Github user pnowojski commented on the issue: https://github.com/apache/flink/pull/5708 Yes, it's a valid setting, but has worse performance and whole credit based flow control looses it's sense. `taskmanager.exactly-once.blocking.data.enabled` setting was thought as a fallback optio

[jira] [Commented] (FLINK-8948) RescalingITCase fails on Travis

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404948#comment-16404948 ] ASF GitHub Bot commented on FLINK-8948: --- Github user pnowojski commented on the issu

[GitHub] flink issue #5710: [FLINK-8948][runtime] Fix IllegalStateException when clos...

2018-03-19 Thread pnowojski
Github user pnowojski commented on the issue: https://github.com/apache/flink/pull/5710 thanks! ---

[jira] [Commented] (FLINK-8073) Test instability FlinkKafkaProducer011ITCase.testScaleDownBeforeFirstCheckpoint()

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404944#comment-16404944 ] ASF GitHub Bot commented on FLINK-8073: --- Github user pnowojski commented on the issu

[GitHub] flink issue #5718: [FLINK-8073][kafka-tests] Disable timeout in tests

2018-03-19 Thread pnowojski
Github user pnowojski commented on the issue: https://github.com/apache/flink/pull/5718 I think that timeouts in IDE are only making things worse: 1. you can not debug, since longer debugging session will fail 2. in case of deadlocks, locally you can always manually dump/view s

[jira] [Updated] (FLINK-9024) IntelliJ IDEA support run and debug Flink code

2018-03-19 Thread chillon.m (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chillon.m updated FLINK-9024: - Issue Type: Improvement (was: Wish) > IntelliJ IDEA support run and debug Flink code > --

[jira] [Updated] (FLINK-9024) IntelliJ IDEA support run and debug Flink code

2018-03-19 Thread chillon.m (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chillon.m updated FLINK-9024: - Issue Type: Wish (was: Bug) > IntelliJ IDEA support run and debug Flink code > --

[jira] [Commented] (FLINK-8959) Port AccumulatorLiveITCase to flip6

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404932#comment-16404932 ] ASF GitHub Bot commented on FLINK-8959: --- Github user aljoscha commented on a diff in

[GitHub] flink pull request #5719: [FLINK-8959][tests] Port AccumulatorLiveITCase to ...

2018-03-19 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/5719#discussion_r175462181 --- Diff: flink-tests/src/test/java/org/apache/flink/test/accumulators/AccumulatorLiveITCase.java --- @@ -18,292 +18,188 @@ package org.apache.f

[jira] [Comment Edited] (FLINK-4714) Set task state to RUNNING after state has been restored

2018-03-19 Thread Wei-Che Wei (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404461#comment-16404461 ] Wei-Che Wei edited comment on FLINK-4714 at 3/19/18 2:46 PM: -

[jira] [Closed] (FLINK-8947) Timeout handler issue

2018-03-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-8947. --- Resolution: Not A Problem This is working as intended. The bounded extractor will only emit a

[jira] [Comment Edited] (FLINK-9024) IntelliJ IDEA support run and debug Flink code

2018-03-19 Thread chillon.m (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404893#comment-16404893 ] chillon.m edited comment on FLINK-9024 at 3/19/18 2:42 PM: --- [~Ze

[jira] [Comment Edited] (FLINK-9024) IntelliJ IDEA support run and debug Flink code

2018-03-19 Thread chillon.m (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404893#comment-16404893 ] chillon.m edited comment on FLINK-9024 at 3/19/18 2:39 PM: --- [~Ze

[jira] [Comment Edited] (FLINK-9024) IntelliJ IDEA support run and debug Flink code

2018-03-19 Thread chillon.m (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404893#comment-16404893 ] chillon.m edited comment on FLINK-9024 at 3/19/18 2:23 PM: --- [~Ze

[jira] [Commented] (FLINK-9024) IntelliJ IDEA support run and debug Flink code

2018-03-19 Thread chillon.m (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404893#comment-16404893 ] chillon.m commented on FLINK-9024: -- [~Zentol] add doc on https://ci.apache.org/projects/

[jira] [Commented] (FLINK-8935) Implement remaining methods in MiniClusterClient

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404891#comment-16404891 ] ASF GitHub Bot commented on FLINK-8935: --- Github user zentol commented on the issue:

[GitHub] flink issue #5690: [FLINK-8935][tests] Extend MiniClusterClient

2018-03-19 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5690 merging... ---

[jira] [Commented] (FLINK-8948) RescalingITCase fails on Travis

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404884#comment-16404884 ] ASF GitHub Bot commented on FLINK-8948: --- Github user zentol commented on the issue:

[jira] [Commented] (FLINK-8958) Port TaskCancelAsyncProducerConsumerITCase to flip6

2018-03-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404887#comment-16404887 ] ASF GitHub Bot commented on FLINK-8958: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request #5722: [FLINK-8958][tests] Port TaskCancelAsyncProducerCo...

2018-03-19 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5722 [FLINK-8958][tests] Port TaskCancelAsyncProducerConsumerITCase to flip6 ## What is the purpose of the change This PR ports the `TaskCancelAsyncProducerConsumerITCase` to flip6. The existing

[GitHub] flink issue #5710: [FLINK-8948][runtime] Fix IllegalStateException when clos...

2018-03-19 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5710 merging. ---

[jira] [Assigned] (FLINK-8958) Port TaskCancelAsyncProducerConsumerITCase to flip6

2018-03-19 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-8958: --- Assignee: Chesnay Schepler > Port TaskCancelAsyncProducerConsumerITCase to flip6 > --

[jira] [Comment Edited] (FLINK-9024) IntelliJ IDEA support run and debug Flink code

2018-03-19 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404882#comment-16404882 ] Chesnay Schepler edited comment on FLINK-9024 at 3/19/18 2:15 PM: --

  1   2   >