[jira] [Created] (FLINK-10662) Refactor the ChannelSelector interface for single selected channel

2018-10-24 Thread zhijiang (JIRA)
zhijiang created FLINK-10662: Summary: Refactor the ChannelSelector interface for single selected channel Key: FLINK-10662 URL: https://issues.apache.org/jira/browse/FLINK-10662 Project: Flink

[jira] [Created] (FLINK-10661) Initial credit should be configured in a separate parameter

2018-10-24 Thread zhijiang (JIRA)
zhijiang created FLINK-10661: Summary: Initial credit should be configured in a separate parameter Key: FLINK-10661 URL: https://issues.apache.org/jira/browse/FLINK-10661 Project: Flink Issue

[jira] [Updated] (FLINK-10653) Propose of external shuffle service for batch jobs

2018-10-23 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10653: - Description: The network shuffle behavior for batch jobs in Flink can be improved in two dimensions:  

[jira] [Created] (FLINK-10653) Propose of external shuffle service for batch jobs

2018-10-23 Thread zhijiang (JIRA)
zhijiang created FLINK-10653: Summary: Propose of external shuffle service for batch jobs Key: FLINK-10653 URL: https://issues.apache.org/jira/browse/FLINK-10653 Project: Flink Issue Type: New

[jira] [Commented] (FLINK-10573) Support task revocation

2018-10-22 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660123#comment-16660123 ] zhijiang commented on FLINK-10573: -- I have not focused on this implement yet. If your Jira would be

[jira] [Commented] (FLINK-10607) Unify to remove duplicated NoOpResultPartitionConsumableNotifier

2018-10-22 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658745#comment-16658745 ] zhijiang commented on FLINK-10607: -- [~pnowojski], this is the issue from the review of 

[jira] [Comment Edited] (FLINK-10606) Construct NetworkEnvironment simple for tests

2018-10-22 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658744#comment-16658744 ] zhijiang edited comment on FLINK-10606 at 10/22/18 8:41 AM: [~pnowojski],

[jira] [Commented] (FLINK-10606) Construct NetworkEnvironment simple for tests

2018-10-22 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658744#comment-16658744 ] zhijiang commented on FLINK-10606: -- [~pnowojski], this is the issue from the review of 

[jira] [Commented] (FLINK-9761) Potential buffer leak in PartitionRequestClientHandler during job failures

2018-10-21 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658543#comment-16658543 ] zhijiang commented on FLINK-9761: - I just quickly reviewed the related codes and think this is still a

[jira] [Comment Edited] (FLINK-9761) Potential buffer leak in PartitionRequestClientHandler during job failures

2018-10-21 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658543#comment-16658543 ] zhijiang edited comment on FLINK-9761 at 10/22/18 3:56 AM: --- I just quickly

[jira] [Commented] (FLINK-10491) Deadlock during spilling data in SpillableSubpartition

2018-10-21 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658496#comment-16658496 ] zhijiang commented on FLINK-10491: -- [~till.rohrmann], I think it should be covered in FLINK-1.7 if can

[jira] [Updated] (FLINK-10607) Unify to remove duplicated NoOpResultPartitionConsumableNotifier

2018-10-19 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10607: - Affects Version/s: (was: 1.5.6) (was: 1.6.3)

[jira] [Updated] (FLINK-10606) Construct NetworkEnvironment simple for tests

2018-10-19 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10606: - Affects Version/s: (was: 1.5.6) (was: 1.6.3)

[jira] [Created] (FLINK-10607) Unify to remove duplicated NoOpResultPartitionConsumableNotifier

2018-10-19 Thread zhijiang (JIRA)
zhijiang created FLINK-10607: Summary: Unify to remove duplicated NoOpResultPartitionConsumableNotifier Key: FLINK-10607 URL: https://issues.apache.org/jira/browse/FLINK-10607 Project: Flink

[jira] [Created] (FLINK-10606) Construct NetworkEnvironment simple for tests

2018-10-19 Thread zhijiang (JIRA)
zhijiang created FLINK-10606: Summary: Construct NetworkEnvironment simple for tests Key: FLINK-10606 URL: https://issues.apache.org/jira/browse/FLINK-10606 Project: Flink Issue Type: Test

[jira] [Commented] (FLINK-10573) Support task revocation

2018-10-18 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654833#comment-16654833 ] zhijiang commented on FLINK-10573: -- I think my previous Jira 

[jira] [Commented] (FLINK-10367) Avoid recursion stack overflow during releasing SingleInputGate

2018-10-10 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644580#comment-16644580 ] zhijiang commented on FLINK-10367: -- Good point! I have not thought of returning this

[jira] [Assigned] (FLINK-10491) Deadlock during spilling data in SpillableSubpartition

2018-10-09 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-10491: Assignee: zhijiang > Deadlock during spilling data in SpillableSubpartition >

[jira] [Commented] (FLINK-10491) Deadlock during spilling data in SpillableSubpartition

2018-10-09 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643077#comment-16643077 ] zhijiang commented on FLINK-10491: -- For {{SpillableSubpartition#releaseMemory}}, actually it has been

[jira] [Commented] (FLINK-10491) Deadlock during spilling data in SpillableSubpartition

2018-10-08 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641481#comment-16641481 ] zhijiang commented on FLINK-10491: -- I think we can set the {{BufferPoolOwner}} in the construction of

[jira] [Commented] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2018-10-07 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641324#comment-16641324 ] zhijiang commented on FLINK-10462: -- [~NicoK], thanks for your feedback! In our special cases, if many

[jira] [Commented] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2018-09-28 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632808#comment-16632808 ] zhijiang commented on FLINK-10462: -- [~pnowojski] [~NicoK] Do you have other concerns or is it necessary

[jira] [Updated] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2018-09-28 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10462: - Description: Every {{IntermediateResult}} generates a random {{ConnectionIndex}} which will be

[jira] [Updated] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2018-09-28 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10462: - Description: Every {{IntermediateResult}} generates a random {{ConnectionIndex}} which will be

[jira] [Updated] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2018-09-28 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10462: - Description: Every {{IntermediateResult}} generates a random {{ConnectionIndex}} which will be

[jira] [Updated] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2018-09-28 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10462: - Description: Every {{IntermediateResult}} generates a random {{ConnectionIndex}} which will be

[jira] [Updated] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2018-09-28 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10462: - Description: Every {{IntermediateResult}} generates a random {{ConnectionIndex}} which will be

[jira] [Updated] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2018-09-28 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10462: - Description: Every {{IntermediateResult}} generates a random {{ConnectionIndex}} which will be

[jira] [Updated] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2018-09-28 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10462: - Description: Every {{IntermediateResult}} generates a random {{ConnectionIndex}} which will be

[jira] [Updated] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2018-09-28 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10462: - Description: Every {{IntermediateResult}} generates a random {{ConnectionIndex}} which will be

[jira] [Created] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2018-09-28 Thread zhijiang (JIRA)
zhijiang created FLINK-10462: Summary: Remove ConnectionIndex for further sharing tcp connection in credit-based mode Key: FLINK-10462 URL: https://issues.apache.org/jira/browse/FLINK-10462 Project:

[jira] [Commented] (FLINK-10367) Avoid recursion stack overflow during releasing SingleInputGate

2018-09-25 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627155#comment-16627155 ] zhijiang commented on FLINK-10367: -- Thanks for your feedback, [~NicoK]. For the option 2, if the

[jira] [Commented] (FLINK-10339) SpillReadBufferPool cannot use off-heap memory

2018-09-21 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623153#comment-16623153 ] zhijiang commented on FLINK-10339: -- Hey [~NicoK]  [~pnowojski], do you think we should make

[jira] [Updated] (FLINK-9913) Improve output serialization only once in RecordWriter

2018-09-20 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-9913: Affects Version/s: 1.5.0 1.5.1 1.5.2

[jira] [Updated] (FLINK-10367) Avoid recursion stack overflow during releasing SingleInputGate

2018-09-19 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10367: - Description: For task failure or canceling, the {{SingleInputGate#releaseAllResources}} will be 

***UNCHECKED*** [jira] [Updated] (FLINK-10367) Avoid recursion stack overflow during releasing SingleInputGate

2018-09-19 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10367: - Description: For task failure or canceling, the {{SingleInputGate#releaseAllResources}} will be 

***UNCHECKED*** [jira] [Updated] (FLINK-10367) Avoid recursion stack overflow during releasing SingleInputGate

2018-09-19 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10367: - Description: For task failure or canceling, the {{SingleInputGate#releaseAllResources}} will be 

[jira] [Updated] (FLINK-10367) Avoid recursion stack overflow during releasing SingleInputGate

2018-09-19 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10367: - Description: For task failure or canceling, the {{SingleInputGate#releaseAllResources}} will be 

***UNCHECKED*** [jira] [Created] (FLINK-10367) Avoid recursion stack overflow during releasing SingleInputGate

2018-09-19 Thread zhijiang (JIRA)
zhijiang created FLINK-10367: Summary: Avoid recursion stack overflow during releasing SingleInputGate Key: FLINK-10367 URL: https://issues.apache.org/jira/browse/FLINK-10367 Project: Flink

[jira] [Created] (FLINK-10339) SpillReadBufferPool cannot use off-heap memory

2018-09-13 Thread zhijiang (JIRA)
zhijiang created FLINK-10339: Summary: SpillReadBufferPool cannot use off-heap memory Key: FLINK-10339 URL: https://issues.apache.org/jira/browse/FLINK-10339 Project: Flink Issue Type:

[jira] [Created] (FLINK-10321) Make the condition of broadcast partitioner simple

2018-09-12 Thread zhijiang (JIRA)
zhijiang created FLINK-10321: Summary: Make the condition of broadcast partitioner simple Key: FLINK-10321 URL: https://issues.apache.org/jira/browse/FLINK-10321 Project: Flink Issue Type:

[jira] [Commented] (FLINK-4175) Broadcast data sent increases with # slots per TM

2018-09-04 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602806#comment-16602806 ] zhijiang commented on FLINK-4175: - I am interested in this improvement and want to know what is the

[jira] [Commented] (FLINK-10158) The DataOutputSerializer may consume excessive memory

2018-08-16 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582241#comment-16582241 ] zhijiang commented on FLINK-10158: -- I already improved it in 

[jira] [Commented] (FLINK-10047) Checkpointing takes much longer with credit base flow control.

2018-08-05 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569669#comment-16569669 ] zhijiang commented on FLINK-10047: -- let's trace it together. :) > Checkpointing takes much longer with

[jira] [Issue Comment Deleted] (FLINK-8523) Stop assigning floating buffers for blocked input channels in exactly-once mode

2018-07-29 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-8523: Comment: was deleted (was: Hey [~pnowojski], [~NicoK]  Glad to see we come back to this issue again. I

[jira] [Commented] (FLINK-8523) Stop assigning floating buffers for blocked input channels in exactly-once mode

2018-07-29 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561200#comment-16561200 ] zhijiang commented on FLINK-8523: - Hey [~pnowojski], [~NicoK]  Glad to see we come back to this issue

[jira] [Commented] (FLINK-8523) Stop assigning floating buffers for blocked input channels in exactly-once mode

2018-07-29 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561199#comment-16561199 ] zhijiang commented on FLINK-8523: - Hey [~pnowojski], [~NicoK]  Glad to see we come back to this issue

[jira] [Created] (FLINK-9913) Improve output serialization only once in RecordWriter

2018-07-22 Thread zhijiang (JIRA)
zhijiang created FLINK-9913: --- Summary: Improve output serialization only once in RecordWriter Key: FLINK-9913 URL: https://issues.apache.org/jira/browse/FLINK-9913 Project: Flink Issue Type:

[jira] [Commented] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-06-27 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524873#comment-16524873 ] zhijiang commented on FLINK-9676: - [~NicoK], I think this is a bug in credit-based mode. > Deadlock

[jira] [Updated] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-06-27 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-9676: Description: It may cause deadlock between task canceler thread and task thread. The detail is as

[jira] [Updated] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-06-27 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-9676: Description: It may cause deadlock between task canceler thread and task thread. The detail is as

[jira] [Updated] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-06-27 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-9676: Description: It may cause deadlock between task canceler thread and task thread. The detail is as

[jira] [Updated] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-06-27 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-9676: Description: It may cause deadlock between task canceler thread and task thread. The detail is as

[jira] [Updated] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-06-27 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-9676: Description: It may cause deadlock between task canceler thread and task thread. The detail is as

[jira] [Updated] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-06-27 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-9676: Description: It may cause deadlock between task canceler thread and task thread. The detail is as

[jira] [Updated] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-06-27 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-9676: Description: It may cause deadlock between task canceler thread and task thread. The detail is as

[jira] [Updated] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-06-27 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-9676: Description: It may cause deadlock between task canceler thread and task thread. The detail is as

[jira] [Created] (FLINK-9676) Deadlock during canceling task and recycling exclusive buffer

2018-06-27 Thread zhijiang (JIRA)
zhijiang created FLINK-9676: --- Summary: Deadlock during canceling task and recycling exclusive buffer Key: FLINK-9676 URL: https://issues.apache.org/jira/browse/FLINK-9676 Project: Flink Issue

[jira] [Commented] (FLINK-9636) Network buffer leaks in requesting a batch of segments during canceling

2018-06-21 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519204#comment-16519204 ] zhijiang commented on FLINK-9636: - [~NicoK], I think this is a bug during implementing credit-based flow

[jira] [Created] (FLINK-9636) Network buffer leaks in requesting a batch of segments during canceling

2018-06-21 Thread zhijiang (JIRA)
zhijiang created FLINK-9636: --- Summary: Network buffer leaks in requesting a batch of segments during canceling Key: FLINK-9636 URL: https://issues.apache.org/jira/browse/FLINK-9636 Project: Flink

[jira] [Closed] (FLINK-8747) The tag of waiting for floating buffers in RemoteInputChannel should be updated properly

2018-04-09 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-8747. --- > The tag of waiting for floating buffers in RemoteInputChannel should be > updated properly >

[jira] [Updated] (FLINK-8523) Stop assigning floating buffers for blocked input channels in exactly-once mode

2018-04-09 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-8523: Affects Version/s: 1.6.0 > Stop assigning floating buffers for blocked input channels in exactly-once >

[jira] [Commented] (FLINK-9142) Lower the minimum number of buffers for incoming channels to 1

2018-04-07 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429589#comment-16429589 ] zhijiang commented on FLINK-9142: - Yeah, this change seems more reasonable as we discussed before.(y) >

[jira] [Assigned] (FLINK-7282) Credit-based Network Flow Control

2018-03-02 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-7282: --- Assignee: zhijiang > Credit-based Network Flow Control > - > >

[jira] [Updated] (FLINK-8747) The tag of waiting for floating buffers in RemoteInputChannel should be updated properly

2018-02-22 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-8747: Description: In credit-based flow control mode, when the number of available buffers is less than required

[jira] [Updated] (FLINK-8747) The tag of waiting for floating buffers in RemoteInputChannel should be updated properly

2018-02-22 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-8747: Description: In credit-based flow control mode, when the number of available buffers is less than required

[jira] [Updated] (FLINK-8747) The tag of waiting for floating buffers in RemoteInputChannel should be updated properly

2018-02-22 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-8747: Description: In credit-based flow control mode, when the number of available buffers is less than required

[jira] [Created] (FLINK-8747) The tag of waiting for floating buffers in RemoteInputChannel should be updated properly

2018-02-22 Thread zhijiang (JIRA)
zhijiang created FLINK-8747: --- Summary: The tag of waiting for floating buffers in RemoteInputChannel should be updated properly Key: FLINK-8747 URL: https://issues.apache.org/jira/browse/FLINK-8747

[jira] [Updated] (FLINK-8547) Implement CheckpointBarrierHandler not to spill data for exactly-once based on credit-based flow control

2018-02-01 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-8547: Description: Currently in exactly-once mode, the {{BarrierBuffer}} would block inputs with barriers until

[jira] [Created] (FLINK-8547) Implement CheckpointBarrierHandler not to spill data for exactly-once based on credit-based flow control

2018-02-01 Thread zhijiang (JIRA)
zhijiang created FLINK-8547: --- Summary: Implement CheckpointBarrierHandler not to spill data for exactly-once based on credit-based flow control Key: FLINK-8547 URL: https://issues.apache.org/jira/browse/FLINK-8547

[jira] [Created] (FLINK-8523) Stop assigning floating buffers for blocked input channels in exactly-once mode

2018-01-29 Thread zhijiang (JIRA)
zhijiang created FLINK-8523: --- Summary: Stop assigning floating buffers for blocked input channels in exactly-once mode Key: FLINK-8523 URL: https://issues.apache.org/jira/browse/FLINK-8523 Project: Flink

[jira] [Updated] (FLINK-8458) Add the switch for keeping both the old mode and the new credit-based mode

2018-01-19 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-8458: Issue Type: Sub-task (was: Task) Parent: FLINK-7282 > Add the switch for keeping both the old mode

[jira] [Updated] (FLINK-8458) Add the switch for keeping both the old mode and the new credit-based mode

2018-01-19 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-8458: Description: After the whole feature of credit-based flow control is done, we should add a config

[jira] [Updated] (FLINK-8458) Add the switch for keeping both the old mode and the new credit-based mode

2018-01-19 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-8458: Fix Version/s: 1.5.0 > Add the switch for keeping both the old mode and the new credit-based mode >

[jira] [Updated] (FLINK-8458) Add the switch for keeping both the old mode and the new credit-based mode

2018-01-19 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-8458: Description: After the whole feature of credit-based flow control is done, we should add a config

[jira] [Created] (FLINK-8458) Add the switch for keeping both the old mode and the new credit-based mode

2018-01-19 Thread zhijiang (JIRA)
zhijiang created FLINK-8458: --- Summary: Add the switch for keeping both the old mode and the new credit-based mode Key: FLINK-8458 URL: https://issues.apache.org/jira/browse/FLINK-8458 Project: Flink

[jira] [Closed] (FLINK-7468) Implement sender backlog logic for credit-based

2018-01-16 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-7468. --- Resolution: Fixed > Implement sender backlog logic for credit-based >

[jira] [Reopened] (FLINK-7456) Implement Netty sender incoming pipeline for credit-based

2018-01-16 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reopened FLINK-7456: - > Implement Netty sender incoming pipeline for credit-based >

[jira] [Closed] (FLINK-7456) Implement Netty sender incoming pipeline for credit-based

2018-01-16 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-7456. --- Resolution: Fixed > Implement Netty sender incoming pipeline for credit-based >

[jira] [Updated] (FLINK-7468) Implement sender backlog logic for credit-based

2017-10-11 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7468: Summary: Implement sender backlog logic for credit-based (was: Implement Netty sender backlog logic for

[jira] [Commented] (FLINK-7394) Manage exclusive buffers in RemoteInputChannel

2017-10-10 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199702#comment-16199702 ] zhijiang commented on FLINK-7394: - [~Zentol], thank you for merging and let me know the rule. > Manage

[jira] [Closed] (FLINK-7699) Define the BufferListener interface to replace EventListener in BufferProvider

2017-10-10 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-7699. --- Resolution: Fixed > Define the BufferListener interface to replace EventListener in BufferProvider >

[jira] [Closed] (FLINK-7394) Manage exclusive buffers in RemoteInputChannel

2017-10-10 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-7394. --- Resolution: Fixed > Manage exclusive buffers in RemoteInputChannel >

[jira] [Closed] (FLINK-7378) Create a fix size (non rebalancing) buffer pool type for the floating buffers

2017-10-10 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-7378. --- Resolution: Fixed > Create a fix size (non rebalancing) buffer pool type for the floating buffers >

[jira] [Updated] (FLINK-7416) Implement Netty receiver outgoing pipeline for credit-based

2017-09-28 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7416: Description: This is a part of work for credit-based network flow control. The related works are : * We

[jira] [Created] (FLINK-7699) Define the BufferListener interface to replace EventlListener in BufferProvider

2017-09-27 Thread zhijiang (JIRA)
zhijiang created FLINK-7699: --- Summary: Define the BufferListener interface to replace EventlListener in BufferProvider Key: FLINK-7699 URL: https://issues.apache.org/jira/browse/FLINK-7699 Project: Flink

[jira] [Updated] (FLINK-7394) Manage exclusive buffers in RemoteInputChannel

2017-09-24 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7394: Summary: Manage exclusive buffers in RemoteInputChannel (was: Implement basic InputChannel for

[jira] [Updated] (FLINK-7394) Implement basic InputChannel for credit-based logic

2017-09-24 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7394: Description: This is a part of work for credit-based network flow control. The basic works are: *

[jira] [Updated] (FLINK-7661) Add credit field in PartitionRequest message

2017-09-21 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7661: Description: Currently the {{PartitionRequest}} message contains {{ResultPartitionID}} | {{queueIndex}} |

[jira] [Updated] (FLINK-7661) Add credit field in PartitionRequest message

2017-09-21 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7661: Description: Currently the {{PartitionRequest}} message contains

[jira] [Created] (FLINK-7661) Add credit field in PartitionRequest message

2017-09-21 Thread zhijiang (JIRA)
zhijiang created FLINK-7661: --- Summary: Add credit field in PartitionRequest message Key: FLINK-7661 URL: https://issues.apache.org/jira/browse/FLINK-7661 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-7378) Create a fix size (non rebalancing) buffer pool type for the floating buffers

2017-09-21 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7378: Description: Currently the number of network buffers in {{LocalBufferPool}} for {{SingleInputGate}} is

[jira] [Updated] (FLINK-7378) Create a fix size (non rebalancing) buffer pool type for the floating buffers

2017-09-21 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7378: Description: Currently the number of network buffers in {{LocalBufferPool}} for {{SingleInputGate}} is

[jira] [Created] (FLINK-7468) Implement Netty sender backlog logic for credit-based

2017-08-17 Thread zhijiang (JIRA)
zhijiang created FLINK-7468: --- Summary: Implement Netty sender backlog logic for credit-based Key: FLINK-7468 URL: https://issues.apache.org/jira/browse/FLINK-7468 Project: Flink Issue Type:

[jira] [Assigned] (FLINK-7456) Implement Netty sender incoming pipeline for credit-based

2017-08-16 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-7456: --- Assignee: zhijiang > Implement Netty sender incoming pipeline for credit-based >

[jira] [Updated] (FLINK-7456) Implement Netty sender incoming pipeline for credit-based

2017-08-16 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7456: Description: This is a part of work for credit-based network flow control. On sender side, each

[jira] [Created] (FLINK-7456) Implement Netty sender incoming pipeline for credit-based

2017-08-16 Thread zhijiang (JIRA)
zhijiang created FLINK-7456: --- Summary: Implement Netty sender incoming pipeline for credit-based Key: FLINK-7456 URL: https://issues.apache.org/jira/browse/FLINK-7456 Project: Flink Issue Type:

[jira] [Updated] (FLINK-7394) Implement basic InputChannel for credit-based logic

2017-08-14 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7394: Description: This is a part of work for credit-based network flow control. The basic works are: *

[jira] [Updated] (FLINK-7378) Create a fix size (non rebalancing) buffer pool type for the floating buffers

2017-08-13 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7378: Description: Currently the number of network buffers in {{LocalBufferPool}} for {{SingleInputGate}} is

[jira] [Updated] (FLINK-7378) Create a fix size (non rebalancing) buffer pool type for the floating buffers

2017-08-13 Thread zhijiang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-7378: Summary: Create a fix size (non rebalancing) buffer pool type for the floating buffers (was: Implement the

<    6   7   8   9   10   11   12   >