[jira] [Updated] (SPARK-42068) Implicit conversion is not working with parallelization in scala with java 11 and spark3

[ https://issues.apache.org/jira/browse/SPARK-42068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-42068: -- Summary: Implicit conversion is not working with

[jira] [Updated] (SPARK-42068) Parallelization in Scala is not working with Java 11 and spark3

[ https://issues.apache.org/jira/browse/SPARK-42068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-42068: -- Description: The following code snippet fails with java 11

[jira] [Updated] (SPARK-42068) Parallelization in Scala is not working with Java 11 and spark3

[ https://issues.apache.org/jira/browse/SPARK-42068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-42068: -- Environment: spark version 3.3.1 Using Scala version 2.12.15

[jira] [Created] (SPARK-42068) Parallelization in Scala is not working with Java 11 and spark3

Srinivas Rishindra Pothireddi created SPARK-42068: - Summary: Parallelization in Scala is not working with Java 11 and spark3 Key: SPARK-42068 URL: https://issues.apache.org/jira/browse/SPARK-42068

[jira] [Issue Comment Deleted] (SPARK-34572) Documentation generation check fails in GitHub

[ https://issues.apache.org/jira/browse/SPARK-34572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-34572: -- Comment: was deleted (was: I published a PR to to remove the

[jira] [Commented] (SPARK-34572) Documentation generation check fails in GitHub

[ https://issues.apache.org/jira/browse/SPARK-34572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292509#comment-17292509 ] Srinivas Rishindra Pothireddi commented on SPARK-34572: --- I published a PR to to

[jira] [Created] (SPARK-34572) Documentation generation check fails in GitHub

Srinivas Rishindra Pothireddi created SPARK-34572: - Summary: Documentation generation check fails in GitHub Key: SPARK-34572 URL: https://issues.apache.org/jira/browse/SPARK-34572

[jira] [Updated] (SPARK-34369) Track number of pairs processed out of Join

[ https://issues.apache.org/jira/browse/SPARK-34369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-34369: -- Description: Often users face a scenario where even a modest

[jira] [Commented] (SPARK-34369) Track number of pairs processed out of Join

[ https://issues.apache.org/jira/browse/SPARK-34369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279098#comment-17279098 ] Srinivas Rishindra Pothireddi commented on SPARK-34369: --- I am working on this >

[jira] [Created] (SPARK-34369) Track number of pairs processed out of Join

Srinivas Rishindra Pothireddi created SPARK-34369: - Summary: Track number of pairs processed out of Join Key: SPARK-34369 URL: https://issues.apache.org/jira/browse/SPARK-34369

[jira] [Updated] (SPARK-31377) Add unit tests for "number of output rows" metric for joins in SQLMetricsSuite

[ https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31377: -- Description: For some combinations of join algorithm and join

[jira] [Comment Edited] (SPARK-31380) Peak Execution Memory Quantile is not displayed in Spark History Server UI

[ https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085138#comment-17085138 ] Srinivas Rishindra Pothireddi edited comment on SPARK-31380 at 4/16/20, 6:10 PM:

[jira] [Comment Edited] (SPARK-31380) Peak Execution Memory Quantile is not displayed in Spark History Server UI

[ https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085138#comment-17085138 ] Srinivas Rishindra Pothireddi edited comment on SPARK-31380 at 4/16/20, 6:08 PM:

[jira] [Comment Edited] (SPARK-31380) Peak Execution Memory Quantile is not displayed in Spark History Server UI

[ https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085138#comment-17085138 ] Srinivas Rishindra Pothireddi edited comment on SPARK-31380 at 4/16/20, 6:06 PM:

[jira] [Comment Edited] (SPARK-31380) Peak Execution Memory Quantile is not displayed in Spark History Server UI

[ https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085138#comment-17085138 ] Srinivas Rishindra Pothireddi edited comment on SPARK-31380 at 4/16/20, 6:05 PM:

[jira] [Commented] (SPARK-31380) Peak Execution Memory Quantile is not displayed in Spark History Server UI

[ https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085138#comment-17085138 ] Srinivas Rishindra Pothireddi commented on SPARK-31380: --- I tested this with spark

[jira] [Updated] (SPARK-31377) Add unit tests for "number of output rows" metric for joins in SQLMetricsSuite

[ https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31377: -- Description: For some combinations of join algorithm and join

[jira] [Updated] (SPARK-31377) Add unit tests for "number of output rows" metric for joins in SQLMetricsSuite

[ https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31377: -- Description: For some combinations of join algorithm and join

[jira] [Updated] (SPARK-31377) Add unit tests for "number of output rows" metric for joins in SQLMetricsSuite

[ https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31377: -- Description: For some combinations of join algorithm and join

[jira] [Updated] (SPARK-31389) Ensure all tests in SQLMetricsSuite run with both codegen on and off

[ https://issues.apache.org/jira/browse/SPARK-31389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31389: -- Description: Many tests in SQLMetricsSuite run only with

[jira] [Commented] (SPARK-31389) Ensure all tests in SQLMetricsSuite run with both codegen on and off

[ https://issues.apache.org/jira/browse/SPARK-31389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078803#comment-17078803 ] Srinivas Rishindra Pothireddi commented on SPARK-31389: --- I am working on this. >

[jira] [Updated] (SPARK-31389) Ensure all tests in SQLMetricsSuite run with both codegen on and off

[ https://issues.apache.org/jira/browse/SPARK-31389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31389: -- Description: Many tests in SQLMetricsSuite run only with

[jira] [Created] (SPARK-31389) Ensure all tests in SQLMetricsSuite run with both codegen on and off

Srinivas Rishindra Pothireddi created SPARK-31389: - Summary: Ensure all tests in SQLMetricsSuite run with both codegen on and off Key: SPARK-31389 URL:

[jira] [Commented] (SPARK-31377) Add unit tests for "number of output rows" metric for joins in SQLMetricsSuite

[ https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078524#comment-17078524 ] Srinivas Rishindra Pothireddi commented on SPARK-31377: --- I am working on this >

[jira] [Updated] (SPARK-31377) Add missing unit tests for "number of output rows" metric for joins in SQLMetricsSuite

[ https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31377: -- Description: For some combinations of join algorithm and join

[jira] [Updated] (SPARK-31380) Peak Execution Memory Quantile is not displayed in Spark History Server UI

[ https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31380: -- Description: Peak Execution Memory Quantile is displayed in

[jira] [Updated] (SPARK-31380) Peak Execution Memory Quantile is not displayed in Spark History Server UI

[ https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31380: -- Description: Peak Execution Memory Quantile is displayed in

[jira] [Updated] (SPARK-31380) Peak Execution Memory Quantile is not displayed in Spark History Server UI

[ https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31380: -- Description: Peak Execution Memory Quantile is displayed in

[jira] [Updated] (SPARK-31380) Peak Execution Memory Quantile is not displayed in Spark History Server UI

[ https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31380: -- Description: Peak Execution Memory Quantile is displayed in

[jira] [Updated] (SPARK-31380) Peak Execution Memory Quantile is not displayed in Spark History Server UI

[ https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31380: -- Description: Peak Execution Memory Quantile is displayed in

[jira] [Created] (SPARK-31380) Peak Execution Memory Quantile is not displayed in Spark History Server UI

Srinivas Rishindra Pothireddi created SPARK-31380: - Summary: Peak Execution Memory Quantile is not displayed in Spark History Server UI Key: SPARK-31380 URL:

[jira] [Updated] (SPARK-31377) Add missing unit tests for "number of output rows" metric for joins in SQLMetricsSuite

[ https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-31377: -- Description: For some combinations of join algorithm and join

[jira] [Created] (SPARK-31377) Add missing unit tests for "number of output rows" metric for joins in SQLMetricsSuite

Srinivas Rishindra Pothireddi created SPARK-31377: - Summary: Add missing unit tests for "number of output rows" metric for joins in SQLMetricsSuite Key: SPARK-31377 URL:

[jira] [Commented] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in pyspark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493075#comment-15493075 ] Srinivas Rishindra Pothireddi commented on SPARK-17538: --- Hi [~srowen], I updated

[jira] [Updated] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in pyspark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-17538: -- Description: I have a production job in spark 1.6.2 that

[jira] [Commented] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in pyspark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15492937#comment-15492937 ] Srinivas Rishindra Pothireddi commented on SPARK-17538: --- Hi [~srowen], I will fix

[jira] [Updated] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in pyspark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-17538: -- Labels: pyspark (was: ) > sqlContext.registerDataFrameAsTable

[jira] [Updated] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in pyspark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-17538: -- Description: I have a production job in spark 1.6.2 that

[jira] [Updated] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in pyspark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivas Rishindra Pothireddi updated SPARK-17538: -- Summary: sqlContext.registerDataFrameAsTable is not working

[jira] [Created] (SPARK-17538) sqlContext.registerDataFrameAsTable is not working sometimes in spark 2.0

Srinivas Rishindra Pothireddi created SPARK-17538: - Summary: sqlContext.registerDataFrameAsTable is not working sometimes in spark 2.0 Key: SPARK-17538 URL: