[jira] [Updated] (SPARK-26397) Driver-side only metrics support
[ https://issues.apache.org/jira/browse/SPARK-26397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26397: -- Fix Version/s: (was: 3.0.0) > Driver-side only metrics support > > > Key: SPARK-26397 > URL: https://issues.apache.org/jira/browse/SPARK-26397 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.4.0 >Reporter: Yuanjian Li >Priority: Major > > As the comment in > [https://github.com/apache/spark/pull/23327#discussion_r242646521|https://github.com/apache/spark/pull/23327#discussion_r242646521], > during the work of SPARK-26222 and SPARK-26223, we need the support for > driver-side only metrics, which will mark the metadata relative metrics as > driver-side only and will not send them to executor-side. > This issue needs some changes in SparkPlan and SparkPlanInfo, we should also > check is there any misuse before. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-26397) Driver-side only metrics support
[ https://issues.apache.org/jira/browse/SPARK-26397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-26397: Description: As the comment in [https://github.com/apache/spark/pull/23327#discussion_r242646521|https://github.com/apache/spark/pull/23327#discussion_r242646521], during the work of SPARK-26222 and SPARK-26223, we need the support for driver-side only metrics, which will mark the metadata relative metrics as driver-side only and will not send them to executor-side. This issue needs some changes in SparkPlan and SparkPlanInfo, we should also check is there any misuse before. was: As the comment in [https://github.com/apache/spark/pull/23327#discussion_r242646521|https://github.com/apache/spark/pull/23327#discussion_r242646521,], during the work of SPARK-26222 and SPARK-26223, we need the support for driver-side only metrics, which will mark the metadata relative metrics as driver-side only and will not send them to executor-side. This issue needs some changes in SparkPlan and SparkPlanInfo, we should also check is there any misuse before. > Driver-side only metrics support > > > Key: SPARK-26397 > URL: https://issues.apache.org/jira/browse/SPARK-26397 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.4.0 >Reporter: Yuanjian Li >Priority: Major > Fix For: 3.0.0 > > > As the comment in > [https://github.com/apache/spark/pull/23327#discussion_r242646521|https://github.com/apache/spark/pull/23327#discussion_r242646521], > during the work of SPARK-26222 and SPARK-26223, we need the support for > driver-side only metrics, which will mark the metadata relative metrics as > driver-side only and will not send them to executor-side. > This issue needs some changes in SparkPlan and SparkPlanInfo, we should also > check is there any misuse before. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-26397) Driver-side only metrics support
[ https://issues.apache.org/jira/browse/SPARK-26397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-26397: Description: As the comment in [https://github.com/apache/spark/pull/23327#discussion_r242646521|https://github.com/apache/spark/pull/23327#discussion_r242646521,], during the work of SPARK-26222 and SPARK-26223, we need the support for driver-side only metrics, which will mark the metadata relative metrics as driver-side only and will not send them to executor-side. This issue needs some changes in SparkPlan and SparkPlanInfo, we should also check is there any misuse before. was: As the comment in [https://github.com/apache/spark/pull/23327#discussion_r242646521,] during the work of SPARK-26222 and SPARK-26223, we need the support for driver-side only metrics, which will mark the metadata relative metrics as driver-side only and will not send them to executor-side. This issue needs some changes in SparkPlan and SparkPlanInfo, we should also check is there any misuse before. > Driver-side only metrics support > > > Key: SPARK-26397 > URL: https://issues.apache.org/jira/browse/SPARK-26397 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.4.0 >Reporter: Yuanjian Li >Priority: Major > Fix For: 3.0.0 > > > As the comment in > [https://github.com/apache/spark/pull/23327#discussion_r242646521|https://github.com/apache/spark/pull/23327#discussion_r242646521,], > during the work of SPARK-26222 and SPARK-26223, we need the support for > driver-side only metrics, which will mark the metadata relative metrics as > driver-side only and will not send them to executor-side. > This issue needs some changes in SparkPlan and SparkPlanInfo, we should also > check is there any misuse before. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-26397) Driver-side only metrics support
[ https://issues.apache.org/jira/browse/SPARK-26397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-26397: Description: As the comment in [https://github.com/apache/spark/pull/23327#discussion_r242646521,] during the work of SPARK-26222 and SPARK-26223, we need the support for driver-side only metrics, which will mark the metadata relative metrics as driver-side only and will not send them to executor-side. This issue needs some changes in SparkPlan and SparkPlanInfo, we should also check is there any misuse before. > Driver-side only metrics support > > > Key: SPARK-26397 > URL: https://issues.apache.org/jira/browse/SPARK-26397 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.4.0 >Reporter: Yuanjian Li >Priority: Major > Fix For: 3.0.0 > > > As the comment in > [https://github.com/apache/spark/pull/23327#discussion_r242646521,] during > the work of SPARK-26222 and SPARK-26223, we need the support for driver-side > only metrics, which will mark the metadata relative metrics as driver-side > only and will not send them to executor-side. > This issue needs some changes in SparkPlan and SparkPlanInfo, we should also > check is there any misuse before. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-26397) Driver-side only metrics support
[ https://issues.apache.org/jira/browse/SPARK-26397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-26397: Environment: (was: As the comment in [https://github.com/apache/spark/pull/23327#discussion_r242646521,] during the work of SPARK-26222 and SPARK-26223, we need the support for driver-side only metrics, which will mark the metadata relative metrics as driver-side only and will not send them to executor-side. This issue needs some changes in SparkPlan and SparkPlanInfo, we should also check is there any misuse before.) > Driver-side only metrics support > > > Key: SPARK-26397 > URL: https://issues.apache.org/jira/browse/SPARK-26397 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.4.0 >Reporter: Yuanjian Li >Priority: Major > Fix For: 3.0.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
