[jira] [Commented] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode

2021-11-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441038#comment-17441038 ] Apache Spark commented on SPARK-37239: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode

2021-11-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440859#comment-17440859 ] Yang Jie commented on SPARK-37239: -- Haha, I give a PR yesterday:)   > Avoid unnecessary

[jira] [Commented] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode

2021-11-08 Thread Victor Wong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440852#comment-17440852 ] Victor Wong commented on SPARK-37239: - HDFS `setReplication` is a time-consuming rpc call, it should

[jira] [Commented] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode

2021-11-08 Thread Victor Wong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440851#comment-17440851 ] Victor Wong commented on SPARK-37239: - [~LuciferYang] It seems the reporter could come up with a PR

[jira] [Commented] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode

2021-11-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440413#comment-17440413 ] Apache Spark commented on SPARK-37239: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode

2021-11-08 Thread wang-zhun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440329#comment-17440329 ] wang-zhun commented on SPARK-37239: --- [~LuciferYang]  Yes, use the default value {code:java}

[jira] [Commented] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode

2021-11-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440252#comment-17440252 ] Yang Jie commented on SPARK-37239: -- I think your description should be to avoid call `setReplication`

[jira] [Commented] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode

2021-11-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440244#comment-17440244 ] Yang Jie commented on SPARK-37239: -- Why `setReplication` is a unnecessary operation? > Avoid