[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-22 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385644#comment-17385644 ] Zhu Zhu commented on FLINK-23218: - Thanks for confirming! [~trohrmann] And thanks for th

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-22 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385585#comment-17385585 ] Till Rohrmann commented on FLINK-23218: --- Just for my understanding: When will a {{

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-21 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385234#comment-17385234 ] Zhu Zhu commented on FLINK-23218: - Just summarize the investigation and discussion, a co

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-21 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384876#comment-17384876 ] Zhu Zhu commented on FLINK-23218: - I took a look at the code and looks to me that transi

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-21 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384868#comment-17384868 ] Zhu Zhu commented on FLINK-23218: - I think the PR mentioned above should be https://git

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-21 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384827#comment-17384827 ] Zhilong Hong commented on FLINK-23218: -- Thank you for your reply, [~trohrmann].  ?

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-21 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384734#comment-17384734 ] Till Rohrmann commented on FLINK-23218: --- I think I am not fully understanding the

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-20 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17383878#comment-17383878 ] Zhilong Hong commented on FLINK-23218: -- After investigation, we think there are thr

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-19 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17383265#comment-17383265 ] Zhilong Hong commented on FLINK-23218: -- Hi, [~trohrmann]. While we are trying to im

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-11 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17378872#comment-17378872 ] Yang Wang commented on FLINK-23218: --- Just a side input, the Yarn local resource cache

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-09 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377977#comment-17377977 ] Zhilong Hong commented on FLINK-23218: -- Thank you so much for your suggestions, [~t

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377963#comment-17377963 ] Zhu Zhu commented on FLINK-23218: - I took another think and 10GB sounds good to me now.

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377961#comment-17377961 ] Zhu Zhu commented on FLINK-23218: - 10GB looks a bit too large to limit the blob size by

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-09 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377936#comment-17377936 ] Till Rohrmann commented on FLINK-23218: --- Do you think that setting the size limit

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377811#comment-17377811 ] Zhu Zhu commented on FLINK-23218: - 1. To not affect existing users, I prefer limit to no

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-07 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376501#comment-17376501 ] Zhilong Hong commented on FLINK-23218: -- Thank you so much for your suggestion, [~tr

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-07 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376472#comment-17376472 ] Till Rohrmann commented on FLINK-23218: --- I think your proposal for the clean up of

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-06 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375416#comment-17375416 ] Zhilong Hong commented on FLINK-23218: -- Thank you for your reply, [~trohrmann].  #

[jira] [Commented] (FLINK-23218) Distribute the ShuffleDescriptors via blob server

2021-07-05 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17374869#comment-17374869 ] Till Rohrmann commented on FLINK-23218: --- Thanks for creating this proposal [~Thesh