[jira] [Updated] (SPARK-47148) Avoid to materialize AQE ExchangeQueryStageExec on the cancellation

2024-03-01 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-47148: --- Description: AQE can materialize both *ShuffleQueryStage* and *BroadcastQueryStage*

[jira] [Updated] (SPARK-47148) Avoid to materialize AQE ExchangeQueryStageExec on the cancellation

2024-02-28 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-47148: --- Summary: Avoid to materialize AQE ExchangeQueryStageExec on the cancellation (was:

[jira] [Updated] (SPARK-47148) Avoid to materialize AQE ShuffleQueryStage on the cancellation

2024-02-23 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-47148: --- Description: AQE can materialize *ShuffleQueryStage* on the cancellation. This

[jira] [Updated] (SPARK-46639) Add WindowExec SQLMetrics

2024-02-23 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-46639: --- Description: Currently, WindowExec Physical Operator has only spillSize SQLMetric.

[jira] [Updated] (SPARK-46639) Add WindowExec SQLMetrics

2024-02-23 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-46639: --- Description: Currently, WindowExec Physical Operator has only spillSize SQLMetric.

[jira] [Updated] (SPARK-46639) Add WindowExec SQLMetrics

2024-02-23 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-46639: --- Attachment: WindowExec SQLMetrics.png > Add WindowExec SQLMetrics >

[jira] [Updated] (SPARK-47148) Avoid to materialize AQE ShuffleQueryStage on the cancellation

2024-02-23 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-47148: --- Summary: Avoid to materialize AQE ShuffleQueryStage on the cancellation (was:

[jira] [Created] (SPARK-47148) [AQE] Avoid to materialize ShuffleQueryStage on the cancellation

2024-02-23 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-47148: -- Summary: [AQE] Avoid to materialize ShuffleQueryStage on the cancellation Key: SPARK-47148 URL: https://issues.apache.org/jira/browse/SPARK-47148

[jira] [Updated] (SPARK-46639) Add WindowExec SQLMetrics

2024-01-15 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-46639: --- Description: Currently, WindowExec Physical Operator has only spillSize SQLMetric.

[jira] [Created] (SPARK-46639) Add WindowExec SQLMetrics

2024-01-09 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-46639: -- Summary: Add WindowExec SQLMetrics Key: SPARK-46639 URL: https://issues.apache.org/jira/browse/SPARK-46639 Project: Spark Issue Type: Task

[jira] [Comment Edited] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-09 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773480#comment-17773480 ] Eren Avsarogullari edited comment on SPARK-45443 at 10/9/23 9:17 PM: -

[jira] [Comment Edited] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-09 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773480#comment-17773480 ] Eren Avsarogullari edited comment on SPARK-45443 at 10/9/23 9:16 PM: -

[jira] [Commented] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-09 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773480#comment-17773480 ] Eren Avsarogullari commented on SPARK-45443: > But this idea only work for one query Could

[jira] [Comment Edited] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-08 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773050#comment-17773050 ] Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:42 PM: -

[jira] [Comment Edited] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-08 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773050#comment-17773050 ] Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:40 PM: -

[jira] [Comment Edited] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-08 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773050#comment-17773050 ] Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:33 PM: -

[jira] [Comment Edited] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-08 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773050#comment-17773050 ] Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:29 PM: -

[jira] [Comment Edited] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-08 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773050#comment-17773050 ] Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:27 PM: -

[jira] [Comment Edited] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-08 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773050#comment-17773050 ] Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:25 PM: -

[jira] [Comment Edited] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-08 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773050#comment-17773050 ] Eren Avsarogullari edited comment on SPARK-45443 at 10/8/23 8:24 PM: -

[jira] [Commented] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-08 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773050#comment-17773050 ] Eren Avsarogullari commented on SPARK-45443: Hi [~ulysses],  Firstly, thanks for reply.

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Description: TableCacheQueryStage is created per InMemoryTableScanExec by

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Description: TableCacheQueryStage is created per InMemoryTableScanExec by

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Description: TableCacheQueryStage is created per InMemoryTableScanExec by

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Description: TableCacheQueryStage is created per InMemoryTableScanExec by

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Description: TableCacheQueryStage is created per InMemoryTableScanExec by

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Description: TableCacheQueryStage is created per InMemoryTableScanExec by

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Description: TableCacheQueryStage is created per InMemoryTableScanExec by

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Description: TableCacheQueryStage is created per InMemoryTableScanExec by

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Description: TableCacheQueryStage is created per InMemoryTableScanExec by

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Attachment: IMR Materialization - Stage 3.png IMR Materialization -

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Description: TableCacheQueryStage is created per InMemoryTableScanExec by

[jira] [Updated] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated InMemoryRelation materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-45443: --- Summary: Revisit TableCacheQueryStage to avoid replicated InMemoryRelation

[jira] [Created] (SPARK-45443) Revisit TableCacheQueryStage to avoid replicated IMR materialization

2023-10-06 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-45443: -- Summary: Revisit TableCacheQueryStage to avoid replicated IMR materialization Key: SPARK-45443 URL: https://issues.apache.org/jira/browse/SPARK-45443

[jira] [Updated] (SPARK-41214) SQL metrics are missing from Spark UI when AQE for Cached DataFrame is enabled

2022-11-21 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-41214: --- Summary: SQL metrics are missing from Spark UI when AQE for Cached DataFrame is

[jira] [Updated] (SPARK-41214) SubPlan metrics are missed when AQE is enabled under InMemoryRelation

2022-11-20 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-41214: --- Summary: SubPlan metrics are missed when AQE is enabled under InMemoryRelation

[jira] [Updated] (SPARK-41214) Sub-plan metrics under InMemoryRelation are missed when AQE Cached DataFrame Support is enabled

2022-11-20 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-41214: --- Description: *spark.sql.optimizer.canChangeCachedPlanOutputPartitioning* enables

[jira] [Created] (SPARK-41214) Sub-plan metrics under InMemoryRelation are missed when AQE Cached DataFrame Support is enabled

2022-11-20 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-41214: -- Summary: Sub-plan metrics under InMemoryRelation are missed when AQE Cached DataFrame Support is enabled Key: SPARK-41214 URL:

[jira] [Updated] (SPARK-41214) Sub-plan metrics under InMemoryRelation are missed when AQE Cached DataFrame Support is enabled

2022-11-20 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-41214: --- Attachment: DAG when AQE=ON and AQECachedDFSupport=ON with fix.png

[jira] [Updated] (SPARK-38222) Expose Node Description attribute in SQL Rest API

2022-02-16 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-38222: --- Attachment: Spark_SQL_REST_Result_with-nodeDesc > Expose Node Description attribute

[jira] [Created] (SPARK-38222) Expose nodeDesc attribute in SQL Rest API

2022-02-15 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-38222: -- Summary: Expose nodeDesc attribute in SQL Rest API Key: SPARK-38222 URL: https://issues.apache.org/jira/browse/SPARK-38222 Project: Spark Issue

[jira] [Updated] (SPARK-38222) Expose Node Description attribute in SQL Rest API

2022-02-15 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-38222: --- Summary: Expose Node Description attribute in SQL Rest API (was: Expose nodeDesc

[jira] [Updated] (SPARK-37710) Add detailed log message for java.io.IOException occurring on Kryo flow

2022-01-06 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-37710: --- Summary: Add detailed log message for java.io.IOException occurring on Kryo flow

[jira] [Updated] (SPARK-37710) Add detailed error message for java.io.IOException occurring on Kryo flow

2022-01-05 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-37710: --- Description: *Input/output error* usually points environmental issues such as disk

[jira] [Updated] (SPARK-37710) Add detailed error message for java.io.IOException occurring on Kryo flow

2022-01-05 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-37710: --- Summary: Add detailed error message for java.io.IOException occurring on Kryo flow

[jira] [Updated] (SPARK-37710) Add clear error message for java.io.IOException: Input/output error

2021-12-21 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-37710: --- Description: *Input/output error* usually points environmental issues such as disk

[jira] [Updated] (SPARK-37710) Add clear error message for java.io.IOException: Input/output error

2021-12-21 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-37710: --- Description: *Input/output error* usually points environmental issues such as disk

[jira] [Updated] (SPARK-37710) Add clear error message for java.io.IOException: Input/output error

2021-12-21 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-37710: --- Summary: Add clear error message for java.io.IOException: Input/output error (was:

[jira] [Updated] (SPARK-37710) Log clear message for Input/output error

2021-12-21 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-37710: --- Description: *Input/output error* usually points environmental issues such as disk

[jira] [Created] (SPARK-37710) Log clear message for Input/output error

2021-12-21 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-37710: -- Summary: Log clear message for Input/output error Key: SPARK-37710 URL: https://issues.apache.org/jira/browse/SPARK-37710 Project: Spark Issue

[jira] [Updated] (SPARK-32548) Add Application attemptId support to SQL Rest API

2020-08-05 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-32548: --- Description: Currently, Spark Public Rest APIs support Application attemptId except

[jira] [Created] (SPARK-32548) Add Application attemptId support to SQL Rest API

2020-08-05 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-32548: -- Summary: Add Application attemptId support to SQL Rest API Key: SPARK-32548 URL: https://issues.apache.org/jira/browse/SPARK-32548 Project: Spark

[jira] [Updated] (SPARK-32026) Add PrometheusServletSuite

2020-06-30 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-32026: --- Description: This Jira aims to be added _PrometheusServletSuite_. *Note:* This

[jira] [Updated] (SPARK-32026) Add PrometheusServletSuite

2020-06-29 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-32026: --- Summary: Add PrometheusServletSuite (was: Add PrometheusServlet Unit Test

[jira] [Commented] (SPARK-32026) Add PrometheusServlet Unit Test coverage

2020-06-29 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148211#comment-17148211 ] Eren Avsarogullari commented on SPARK-32026: Currently, _PrometheusServlet_ follows Spark

[jira] [Updated] (SPARK-32026) Add PrometheusServlet Unit Test coverage

2020-06-29 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-32026: --- Summary: Add PrometheusServlet Unit Test coverage (was: Support consistency on

[jira] [Created] (SPARK-32026) Support consistency on Prometheus driver and executor metrics format

2020-06-18 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-32026: -- Summary: Support consistency on Prometheus driver and executor metrics format Key: SPARK-32026 URL: https://issues.apache.org/jira/browse/SPARK-32026

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

2020-05-01 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Attachment: improved_version_May1th.json > Improve SQL Rest API >

[jira] [Commented] (SPARK-31566) Add SQL Rest API Documentation

2020-04-29 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095948#comment-17095948 ] Eren Avsarogullari commented on SPARK-31566: Hi Pablo, There is ongoing PR on this: 

[jira] [Updated] (SPARK-31566) Add SQL Rest API Documentation

2020-04-26 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31566: --- Description: SQL Rest API exposes query execution metrics as Public API. Its

[jira] [Updated] (SPARK-31566) Add SQL Rest API Documentation

2020-04-26 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31566: --- Description: SQL Rest API exposes query execution metrics as Public API. Its

[jira] [Updated] (SPARK-31566) Add SQL Rest API Documentation

2020-04-26 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31566: --- Description: SQL Rest API exposes query execution metrics as Public API. Its

[jira] [Created] (SPARK-31566) Add SQL Rest API Documentation

2020-04-26 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-31566: -- Summary: Add SQL Rest API Documentation Key: SPARK-31566 URL: https://issues.apache.org/jira/browse/SPARK-31566 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

2020-04-20 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Attachment: (was: improved_version.json) > Improve SQL Rest API >

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

2020-04-20 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Attachment: improved_version.json > Improve SQL Rest API > > >

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

2020-04-20 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Description: SQL Rest API exposes query execution metrics as Public API. This Jira

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

2020-04-13 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Description: SQL Rest API exposes query execution metrics as Public API. This Jira

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

2020-04-13 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Attachment: current_version.json > Improve SQL Rest API > > >

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

2020-04-13 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Attachment: improved_version.json > Improve SQL Rest API > > >

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

2020-04-13 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Description: SQL Rest API exposes query execution metrics as Public API. This Jira

[jira] [Created] (SPARK-31440) Improve SQL Rest API

2020-04-13 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-31440: -- Summary: Improve SQL Rest API Key: SPARK-31440 URL: https://issues.apache.org/jira/browse/SPARK-31440 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-19964) SparkSubmitSuite fails due to Timeout

2017-03-15 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-19964: --- Attachment: SparkSubmitSuite_Stacktrace > SparkSubmitSuite fails due to Timeout >

[jira] [Created] (SPARK-19964) SparkSubmitSuite fails due to Timeout

2017-03-15 Thread Eren Avsarogullari (JIRA)
Eren Avsarogullari created SPARK-19964: -- Summary: SparkSubmitSuite fails due to Timeout Key: SPARK-19964 URL: https://issues.apache.org/jira/browse/SPARK-19964 Project: Spark Issue

[jira] [Updated] (SPARK-19662) Add Fair Scheduler Unit Test coverage for different build cases

2017-02-19 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-19662: --- Description: Fair Scheduler can be built via one of the following options: - By

[jira] [Created] (SPARK-19662) Add Fair Scheduler Unit Test coverage for different build cases

2017-02-19 Thread Eren Avsarogullari (JIRA)
Eren Avsarogullari created SPARK-19662: -- Summary: Add Fair Scheduler Unit Test coverage for different build cases Key: SPARK-19662 URL: https://issues.apache.org/jira/browse/SPARK-19662 Project:

[jira] [Commented] (SPARK-19567) Support some Schedulable variables immutability and access

2017-02-12 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862983#comment-15862983 ] Eren Avsarogullari commented on SPARK-19567: Hi [~srowen], Thanks for quick response. I

[jira] [Created] (SPARK-19567) Support some Schedulable variables immutability and access

2017-02-12 Thread Eren Avsarogullari (JIRA)
Eren Avsarogullari created SPARK-19567: -- Summary: Support some Schedulable variables immutability and access Key: SPARK-19567 URL: https://issues.apache.org/jira/browse/SPARK-19567 Project: Spark

[jira] [Updated] (SPARK-19466) Improve Fair Scheduler Logging

2017-02-05 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-19466: --- Description: Fair Scheduler Logging for the following cases can be useful for the

[jira] [Created] (SPARK-19466) Improve Fair Scheduler Logging

2017-02-05 Thread Eren Avsarogullari (JIRA)
Eren Avsarogullari created SPARK-19466: -- Summary: Improve Fair Scheduler Logging Key: SPARK-19466 URL: https://issues.apache.org/jira/browse/SPARK-19466 Project: Spark Issue Type:

[jira] [Updated] (SPARK-18066) Add Pool usage policies test coverage for FIFO & FAIR Schedulers

2016-10-23 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-18066: --- Summary: Add Pool usage policies test coverage for FIFO & FAIR Schedulers (was: Add

[jira] [Updated] (SPARK-18066) Add Pool usage policies test coverage to FIFO & FAIR Schedulers

2016-10-23 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-18066: --- Description: The following Pool usage cases need to have Unit test coverage : -

[jira] [Updated] (SPARK-18066) Add Pool usage policies test coverage to FIFO & FAIR Schedulers

2016-10-23 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-18066: --- Description: The following Pool usage cases need to have Unit test coverage : -

[jira] [Created] (SPARK-18066) Add Pool usage policies test coverage to FIFO & FAIR Schedulers

2016-10-23 Thread Eren Avsarogullari (JIRA)
Eren Avsarogullari created SPARK-18066: -- Summary: Add Pool usage policies test coverage to FIFO & FAIR Schedulers Key: SPARK-18066 URL: https://issues.apache.org/jira/browse/SPARK-18066 Project:

[jira] [Updated] (SPARK-17759) Avoid adding duplicate schedulables

2016-10-13 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17759: --- Summary: Avoid adding duplicate schedulables (was: FairSchedulableBuilder should

[jira] [Updated] (SPARK-17759) FairSchedulableBuilder should avoid to create duplicate fair scheduler-pools.

2016-10-13 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17759: --- Description: If _spark.scheduler.allocation.file_ has duplicate pools, all of them

[jira] [Updated] (SPARK-17894) Ensure uniqueness of TaskSetManager name

2016-10-13 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17894: --- Description: TaskSetManager should have unique name to avoid adding duplicate ones

[jira] [Updated] (SPARK-17894) Ensure uniqueness of TaskSetManager name

2016-10-13 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17894: --- Summary: Ensure uniqueness of TaskSetManager name (was: Uniqueness of

[jira] [Updated] (SPARK-17894) Uniqueness of TaskSetManager name

2016-10-12 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17894: --- Description: TaskSetManager should have unique name to avoid adding duplicate ones

[jira] [Created] (SPARK-17894) Uniqueness of TaskSetManager name

2016-10-12 Thread Eren Avsarogullari (JIRA)
Eren Avsarogullari created SPARK-17894: -- Summary: Uniqueness of TaskSetManager name Key: SPARK-17894 URL: https://issues.apache.org/jira/browse/SPARK-17894 Project: Spark Issue Type:

[jira] [Updated] (SPARK-17759) FairSchedulableBuilder should avoid to create duplicate fair scheduler-pools.

2016-10-02 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17759: --- Description: If _spark.scheduler.allocation.file_ has duplicate pools, all of them

[jira] [Updated] (SPARK-17759) FairSchedulableBuilder should avoid to create duplicate fair scheduler-pools.

2016-10-02 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17759: --- Summary: FairSchedulableBuilder should avoid to create duplicate fair

[jira] [Updated] (SPARK-17759) SchedulableBuilder should avoid to create duplicate fair scheduler-pools.

2016-10-02 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17759: --- Attachment: duplicate_pools2.png > SchedulableBuilder should avoid to create

[jira] [Updated] (SPARK-17759) SchedulableBuilder should avoid to create duplicate fair scheduler-pools.

2016-10-02 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17759: --- Description: If _spark.scheduler.allocation.file_ has duplicate pools, all of them

[jira] [Updated] (SPARK-17759) SchedulableBuilder should avoid to create duplicate fair scheduler-pools.

2016-10-02 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17759: --- Attachment: duplicate_pools.png > SchedulableBuilder should avoid to create

[jira] [Created] (SPARK-17759) SchedulableBuilder should avoid to create duplicate fair scheduler-pools.

2016-10-02 Thread Eren Avsarogullari (JIRA)
Eren Avsarogullari created SPARK-17759: -- Summary: SchedulableBuilder should avoid to create duplicate fair scheduler-pools. Key: SPARK-17759 URL: https://issues.apache.org/jira/browse/SPARK-17759

[jira] [Updated] (SPARK-17759) SchedulableBuilder should avoid to create duplicate fair scheduler-pools.

2016-10-02 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17759: --- Description: If _spark.scheduler.allocation.file_ has duplicate pools, all of them

[jira] [Updated] (SPARK-17663) SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2016-09-28 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17663: --- Description: If spark.scheduler.allocation.file has invalid minShare or/and weight

[jira] [Updated] (SPARK-17663) SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2016-09-27 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17663: --- Affects Version/s: (was: 2.0.1) 2.1.0 >

[jira] [Updated] (SPARK-17663) SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2016-09-25 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17663: --- Description: If spark.scheduler.allocation.file has invalid *minShare* or/and

[jira] [Updated] (SPARK-17663) SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2016-09-25 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17663: --- Description: If spark.scheduler.allocation.file has invalid minShare or/and weight,

  1   2   >