[jira] [Commented] (SPARK-32525) The layout of monitoring.html is broken

[ https://issues.apache.org/jira/browse/SPARK-32525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170572#comment-17170572 ] Apache Spark commented on SPARK-32525: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32525) The layout of monitoring.html is broken

[ https://issues.apache.org/jira/browse/SPARK-32525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32525: Assignee: Kousuke Saruta (was: Apache Spark) > The layout of monitoring.html is broken

[jira] [Assigned] (SPARK-32525) The layout of monitoring.html is broken

[ https://issues.apache.org/jira/browse/SPARK-32525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32525: Assignee: Apache Spark (was: Kousuke Saruta) > The layout of monitoring.html is broken

[jira] [Commented] (SPARK-32519) test of org.apache.spark.sql.kafka010.KafkaSourceStressSuite failed for aarch64

[ https://issues.apache.org/jira/browse/SPARK-32519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170573#comment-17170573 ] Jungtaek Lim commented on SPARK-32519: -- #29343 is merged. Please check the new maven job of

[jira] [Commented] (SPARK-32264) More resources in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170571#comment-17170571 ] Hyukjin Kwon commented on SPARK-32264: -- Looks we can't allocate the locations for one specific repo

[jira] [Resolved] (SPARK-32264) More resources in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32264. -- Resolution: Invalid > More resources in Github Actions > > >

[jira] [Resolved] (SPARK-32520) Flaky Test: KafkaSourceStressSuite.stress test with multiple topics and partitions

[ https://issues.apache.org/jira/browse/SPARK-32520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32520. -- Fix Version/s: 3.1.0 Assignee: Jungtaek Lim Resolution: Fixed This was fixed

[jira] [Created] (SPARK-32525) The layout of monitoring.html is broken

Kousuke Saruta created SPARK-32525: -- Summary: The layout of monitoring.html is broken Key: SPARK-32525 URL: https://issues.apache.org/jira/browse/SPARK-32525 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170558#comment-17170558 ] Jungtaek Lim commented on SPARK-31754: -- I'd really like to help, but without the reproducer it's

[jira] [Commented] (SPARK-32519) test of org.apache.spark.sql.kafka010.KafkaSourceStressSuite failed for aarch64

[ https://issues.apache.org/jira/browse/SPARK-32519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170554#comment-17170554 ] Jungtaek Lim commented on SPARK-32519: -- See https://github.com/apache/spark/pull/29343 - I've found

[jira] [Commented] (SPARK-32524) SharedSparkSession should clean up InMemoryRelation.ser

[ https://issues.apache.org/jira/browse/SPARK-32524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170552#comment-17170552 ] Apache Spark commented on SPARK-32524: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-32524) SharedSparkSession should clean up InMemoryRelation.ser

[ https://issues.apache.org/jira/browse/SPARK-32524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32524: Assignee: Apache Spark > SharedSparkSession should clean up InMemoryRelation.ser >

[jira] [Updated] (SPARK-32399) Support full outer join in shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-32399: - Description: Currently for SQL full outer join, spark always does a sort merge join no matter of how

[jira] [Commented] (SPARK-32524) SharedSparkSession should clean up InMemoryRelation.ser

[ https://issues.apache.org/jira/browse/SPARK-32524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170551#comment-17170551 ] Apache Spark commented on SPARK-32524: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-32524) SharedSparkSession should clean up InMemoryRelation.ser

[ https://issues.apache.org/jira/browse/SPARK-32524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32524: Assignee: (was: Apache Spark) > SharedSparkSession should clean up

[jira] [Updated] (SPARK-32399) Support full outer join in shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-32399: - Summary: Support full outer join in shuffled hash join (was: Support full outer join in shuffled hash

[jira] [Resolved] (SPARK-30276) Support Filter expression allows simultaneous use of DISTINCT

[ https://issues.apache.org/jira/browse/SPARK-30276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30276. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29291

[jira] [Assigned] (SPARK-30276) Support Filter expression allows simultaneous use of DISTINCT

[ https://issues.apache.org/jira/browse/SPARK-30276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30276: --- Assignee: jiaan.geng > Support Filter expression allows simultaneous use of DISTINCT >

[jira] [Created] (SPARK-32524) SharedSparkSession should clean up InMemoryRelation.ser

Dongjoon Hyun created SPARK-32524: - Summary: SharedSparkSession should clean up InMemoryRelation.ser Key: SPARK-32524 URL: https://issues.apache.org/jira/browse/SPARK-32524 Project: Spark

[jira] [Commented] (SPARK-32468) Fix timeout config issue in Kafka connector tests

[ https://issues.apache.org/jira/browse/SPARK-32468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170511#comment-17170511 ] Apache Spark commented on SPARK-32468: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-32468) Fix timeout config issue in Kafka connector tests

[ https://issues.apache.org/jira/browse/SPARK-32468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170514#comment-17170514 ] Apache Spark commented on SPARK-32468: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-32520) Flaky Test: KafkaSourceStressSuite.stress test with multiple topics and partitions

[ https://issues.apache.org/jira/browse/SPARK-32520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170470#comment-17170470 ] Jungtaek Lim commented on SPARK-32520: -- I'll take a look today. Let's revert once I fail to make it

[jira] [Created] (SPARK-32523) Override alter table in JDBC dialects

Huaxin Gao created SPARK-32523: -- Summary: Override alter table in JDBC dialects Key: SPARK-32523 URL: https://issues.apache.org/jira/browse/SPARK-32523 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-32399) Support full outer join in shuffled hash join and broadcast hash join

[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170452#comment-17170452 ] Apache Spark commented on SPARK-32399: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32399) Support full outer join in shuffled hash join and broadcast hash join

[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32399: Assignee: Apache Spark > Support full outer join in shuffled hash join and broadcast

[jira] [Commented] (SPARK-32333) Drop references to Master

[ https://issues.apache.org/jira/browse/SPARK-32333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170451#comment-17170451 ] Thomas Graves commented on SPARK-32333: --- What about renaming Master to be ApplicationManager or

[jira] [Commented] (SPARK-32399) Support full outer join in shuffled hash join and broadcast hash join

[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170450#comment-17170450 ] Apache Spark commented on SPARK-32399: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32399) Support full outer join in shuffled hash join and broadcast hash join

[ https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32399: Assignee: (was: Apache Spark) > Support full outer join in shuffled hash join and

[jira] [Commented] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170442#comment-17170442 ] Apache Spark commented on SPARK-32160: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170441#comment-17170441 ] Apache Spark commented on SPARK-32160: -- User 'ueshin' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170340#comment-17170340 ] Dongjoon Hyun edited comment on SPARK-32160 at 8/3/20, 6:34 PM: This

[jira] [Commented] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170340#comment-17170340 ] Dongjoon Hyun commented on SPARK-32160: --- This seems to exist all old Spark versions. Could you

[jira] [Updated] (SPARK-32160) Executors should not be able to create SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-32160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32160: -- Affects Version/s: 2.4.6 > Executors should not be able to create SparkContext. >

[jira] [Commented] (SPARK-32515) Distinct Function Weird Bug

[ https://issues.apache.org/jira/browse/SPARK-32515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170257#comment-17170257 ] Jayce Jiang commented on SPARK-32515: - Thanks, it is a very weird issue. Not sure if it is

[jira] [Updated] (SPARK-32522) Using pyspark with a MultiLayerPerceptron model given inconsistent outputs if a large amount of data is fed into it and at least one of the model outputs is fed to a Pyt

[ https://issues.apache.org/jira/browse/SPARK-32522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Smith updated SPARK-32522: -- Attachment: pyspark-script.py > Using pyspark with a MultiLayerPerceptron model given inconsistent

[jira] [Created] (SPARK-32522) Using pyspark with a MultiLayerPerceptron model given inconsistent outputs if a large amount of data is fed into it and at least one of the model outputs is fed to a Pyt

Ben Smith created SPARK-32522: - Summary: Using pyspark with a MultiLayerPerceptron model given inconsistent outputs if a large amount of data is fed into it and at least one of the model outputs is fed to a Python UDF. Key:

[jira] [Updated] (SPARK-32522) Using pyspark with a MultiLayerPerceptron model given inconsistent outputs if a large amount of data is fed into it and at least one of the model outputs is fed to a Pyt

[ https://issues.apache.org/jira/browse/SPARK-32522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Smith updated SPARK-32522: -- Attachment: model.zip > Using pyspark with a MultiLayerPerceptron model given inconsistent outputs if

[jira] [Commented] (SPARK-32512) Add basic partition command for datasourcev2

[ https://issues.apache.org/jira/browse/SPARK-32512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170138#comment-17170138 ] Apache Spark commented on SPARK-32512: -- User 'stczwd' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32521) WithFields Expression should not be foldable

[ https://issues.apache.org/jira/browse/SPARK-32521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32521: Assignee: (was: Apache Spark) > WithFields Expression should not be foldable >

[jira] [Commented] (SPARK-32521) WithFields Expression should not be foldable

[ https://issues.apache.org/jira/browse/SPARK-32521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170110#comment-17170110 ] Apache Spark commented on SPARK-32521: -- User 'fqaiser94' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32521) WithFields Expression should not be foldable

[ https://issues.apache.org/jira/browse/SPARK-32521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32521: Assignee: Apache Spark > WithFields Expression should not be foldable >

[jira] [Commented] (SPARK-32521) WithFields Expression should not be foldable

[ https://issues.apache.org/jira/browse/SPARK-32521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170111#comment-17170111 ] Apache Spark commented on SPARK-32521: -- User 'fqaiser94' has created a pull request for this issue:

[jira] [Updated] (SPARK-32521) WithFields Expression should not be foldable

[ https://issues.apache.org/jira/browse/SPARK-32521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fqaiser94 updated SPARK-32521: -- Description: The following query currently fails on master brach:  {code:scala} sql("SELECT

[jira] [Commented] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeachBatch in PySpark

[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170095#comment-17170095 ] JinxinTang commented on SPARK-32500: Thank you for your issue, I have understand and will check this

[jira] [Created] (SPARK-32521) WithFields Expression should not be foldable

fqaiser94 created SPARK-32521: - Summary: WithFields Expression should not be foldable Key: SPARK-32521 URL: https://issues.apache.org/jira/browse/SPARK-32521 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32520) Flaky Test: KafkaSourceStressSuite.stress test with multiple topics and partitions

[ https://issues.apache.org/jira/browse/SPARK-32520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170073#comment-17170073 ] Gabor Somogyi commented on SPARK-32520: --- Commented on

[jira] [Commented] (SPARK-32264) More resources in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170040#comment-17170040 ] Hyukjin Kwon commented on SPARK-32264: -- Okay .. actually I contacted GitHub team. I brought one

[jira] [Assigned] (SPARK-32512) Add basic partition command for datasourcev2

[ https://issues.apache.org/jira/browse/SPARK-32512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32512: Assignee: Apache Spark > Add basic partition command for datasourcev2 >

[jira] [Assigned] (SPARK-32512) Add basic partition command for datasourcev2

[ https://issues.apache.org/jira/browse/SPARK-32512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32512: Assignee: (was: Apache Spark) > Add basic partition command for datasourcev2 >

[jira] [Commented] (SPARK-32512) Add basic partition command for datasourcev2

[ https://issues.apache.org/jira/browse/SPARK-32512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170032#comment-17170032 ] Apache Spark commented on SPARK-32512: -- User 'stczwd' has created a pull request for this issue:

[jira] [Commented] (SPARK-32512) Add basic partition command for datasourcev2

[ https://issues.apache.org/jira/browse/SPARK-32512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170033#comment-17170033 ] Apache Spark commented on SPARK-32512: -- User 'stczwd' has created a pull request for this issue:

[jira] [Commented] (SPARK-32520) Flaky Test: KafkaSourceStressSuite.stress test with multiple topics and partitions

[ https://issues.apache.org/jira/browse/SPARK-32520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170031#comment-17170031 ] Hyukjin Kwon commented on SPARK-32520: -- cc [~kabhwan] and [~gsomogyi] FYI. Would you guys mind

[jira] [Updated] (SPARK-32520) Flaky Test: KafkaSourceStressSuite.stress test with multiple topics and partitions

[ https://issues.apache.org/jira/browse/SPARK-32520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32520: - Description: {{KafkaSourceStressSuite.stress test with multiple topics and partitions}} seems

[jira] [Created] (SPARK-32520) Flaky Test: KafkaSourceStressSuite.stress test with multiple topics and partitions

Hyukjin Kwon created SPARK-32520: Summary: Flaky Test: KafkaSourceStressSuite.stress test with multiple topics and partitions Key: SPARK-32520 URL: https://issues.apache.org/jira/browse/SPARK-32520

[jira] [Assigned] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32257: --- Assignee: Takeshi Yamamuro > [SQL Parser] Report Error for invalid usage of SET command >

[jira] [Resolved] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32257. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29146

[jira] [Assigned] (SPARK-32083) Unnecessary tasks are launched when input is empty with AQE

[ https://issues.apache.org/jira/browse/SPARK-32083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32083: --- Assignee: Wenchen Fan > Unnecessary tasks are launched when input is empty with AQE >

[jira] [Resolved] (SPARK-32083) Unnecessary tasks are launched when input is empty with AQE

[ https://issues.apache.org/jira/browse/SPARK-32083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32083. - Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-32290) NotInSubquery SingleColumn Optimize

[ https://issues.apache.org/jira/browse/SPARK-32290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32290: Target Version/s: (was: 3.0.0) > NotInSubquery SingleColumn Optimize >

[jira] [Resolved] (SPARK-32492) Fulfill missing column meta information for thrift server client tools

[ https://issues.apache.org/jira/browse/SPARK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32492. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29303

[jira] [Assigned] (SPARK-32492) Fulfill missing column meta information for thrift server client tools

[ https://issues.apache.org/jira/browse/SPARK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32492: --- Assignee: Kent Yao > Fulfill missing column meta information for thrift server client

[jira] [Resolved] (SPARK-31709) Proper base path for location when it is a relative path

[ https://issues.apache.org/jira/browse/SPARK-31709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31709. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28527

[jira] [Assigned] (SPARK-31709) Proper base path for location when it is a relative path

[ https://issues.apache.org/jira/browse/SPARK-31709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31709: --- Assignee: Kent Yao > Proper base path for location when it is a relative path >

[jira] [Updated] (SPARK-32319) Disallow the use of unused imports

[ https://issues.apache.org/jira/browse/SPARK-32319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-32319: - Summary: Disallow the use of unused imports (was: Remove unused imports) > Disallow

[jira] [Commented] (SPARK-32293) Inconsistent default unit between Spark memory configs and JVM option

[ https://issues.apache.org/jira/browse/SPARK-32293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169946#comment-17169946 ] Takeshi Yamamuro commented on SPARK-32293: -- Hi, [~attilapiros]. You don't need to set the

[jira] [Updated] (SPARK-32293) Inconsistent default unit between Spark memory configs and JVM option

[ https://issues.apache.org/jira/browse/SPARK-32293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32293: - Target Version/s: (was: 3.1.0) > Inconsistent default unit between Spark memory

[jira] [Commented] (SPARK-32290) NotInSubquery SingleColumn Optimize

[ https://issues.apache.org/jira/browse/SPARK-32290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169928#comment-17169928 ] Apache Spark commented on SPARK-32290: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-32290) NotInSubquery SingleColumn Optimize

[ https://issues.apache.org/jira/browse/SPARK-32290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169927#comment-17169927 ] Apache Spark commented on SPARK-32290: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-32293) Inconsistent default unit between Spark memory configs and JVM option

[ https://issues.apache.org/jira/browse/SPARK-32293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-32293: --- Target Version/s: 3.1.0 > Inconsistent default unit between Spark memory configs

[jira] [Commented] (SPARK-32519) test of org.apache.spark.sql.kafka010.KafkaSourceStressSuite failed for aarch64

[ https://issues.apache.org/jira/browse/SPARK-32519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169850#comment-17169850 ] Gabor Somogyi commented on SPARK-32519: --- I'm on 3 weeks vacation but had a slight look at it. This

[jira] [Assigned] (SPARK-32495) Update jackson-databind versions to fix various vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32495: Assignee: Apache Spark > Update jackson-databind versions to fix various

[jira] [Commented] (SPARK-32495) Update jackson-databind versions to fix various vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169822#comment-17169822 ] Apache Spark commented on SPARK-32495: -- User 'ScrapCodes' has created a pull request for this

[jira] [Assigned] (SPARK-32495) Update jackson-databind versions to fix various vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32495: Assignee: (was: Apache Spark) > Update jackson-databind versions to fix various

[jira] [Resolved] (SPARK-32513) Rename classes/files with the Jdbc prefix to JDBC

[ https://issues.apache.org/jira/browse/SPARK-32513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32513. -- Resolution: Won't Fix > Rename classes/files with the Jdbc prefix to JDBC >

[jira] [Resolved] (SPARK-32253) Make readability better in the test result logs

[ https://issues.apache.org/jira/browse/SPARK-32253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32253. -- Resolution: Duplicate This was reverted in https://github.com/apache/spark/pull/29219. It

[jira] [Reopened] (SPARK-32253) Make readability better in the test result logs

[ https://issues.apache.org/jira/browse/SPARK-32253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-32253: -- > Make readability better in the test result logs >

[jira] [Commented] (SPARK-32357) Investigate test result reporter integration

[ https://issues.apache.org/jira/browse/SPARK-32357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169801#comment-17169801 ] Apache Spark commented on SPARK-32357: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32357) Investigate test result reporter integration

[ https://issues.apache.org/jira/browse/SPARK-32357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169802#comment-17169802 ] Apache Spark commented on SPARK-32357: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32495) Update jackson-databind versions to fix various vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169800#comment-17169800 ] Prashant Sharma commented on SPARK-32495: - In general, upgrading the version of a dependency can

[jira] [Commented] (SPARK-32519) test of org.apache.spark.sql.kafka010.KafkaSourceStressSuite failed for aarch64

[ https://issues.apache.org/jira/browse/SPARK-32519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169797#comment-17169797 ] huangtianhua commented on SPARK-32519: -- [~gsomogyi] I am not sure why the commit affects the test

[jira] [Comment Edited] (SPARK-32495) Update jackson-databind versions to fix various vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169756#comment-17169756 ] Prashant Sharma edited comment on SPARK-32495 at 8/3/20, 7:54 AM: -- As

[jira] [Created] (SPARK-32519) test of org.apache.spark.sql.kafka010.KafkaSourceStressSuite failed for aarch64

huangtianhua created SPARK-32519: Summary: test of org.apache.spark.sql.kafka010.KafkaSourceStressSuite failed for aarch64 Key: SPARK-32519 URL: https://issues.apache.org/jira/browse/SPARK-32519

[jira] [Commented] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeachBatch in PySpark

[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169786#comment-17169786 ] Abhishek Dixit commented on SPARK-32500: [~JinxinTang] [~rohitmishr1484] _epoch_id_ may be

[jira] [Updated] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeachBatch in PySpark

[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Dixit updated SPARK-32500: --- Attachment: Screen Shot 2020-07-26 at 6.50.39 PM.png > Query and Batch Id not set for

[jira] [Commented] (SPARK-32486) Issue with deserialization and persist api in latest spark java versions

[ https://issues.apache.org/jira/browse/SPARK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169781#comment-17169781 ] Prashant Sharma commented on SPARK-32486: - This issue needs discussion, before we can mark it as

[jira] [Updated] (SPARK-32486) Issue with deserialization and persist api in latest spark java versions

[ https://issues.apache.org/jira/browse/SPARK-32486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32486: Priority: Major (was: Blocker) > Issue with deserialization and persist api in latest

[jira] [Commented] (SPARK-29965) Race in executor shutdown handling can lead to executor never fully unregistering

[ https://issues.apache.org/jira/browse/SPARK-29965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169774#comment-17169774 ] lushilun commented on SPARK-29965: -- I have the same issue on Spark 2.4.4 when i run the Spark SQL:

[jira] [Commented] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169766#comment-17169766 ] fritz commented on SPARK-31754: --- Hi [~puviarasu], In our case, re-run it not throwing the NPE since the

[jira] [Commented] (SPARK-32495) Update jackson-databind versions to fix various vulnerabilities.

[ https://issues.apache.org/jira/browse/SPARK-32495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169756#comment-17169756 ] Prashant Sharma commented on SPARK-32495: - As per the issues and commit:

[jira] [Commented] (SPARK-32518) CoarseGrainedSchedulerBackend.maxNumConcurrentTasks should consider all kinds of resources

[ https://issues.apache.org/jira/browse/SPARK-32518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169753#comment-17169753 ] Apache Spark commented on SPARK-32518: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32518) CoarseGrainedSchedulerBackend.maxNumConcurrentTasks should consider all kinds of resources

[ https://issues.apache.org/jira/browse/SPARK-32518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32518: Assignee: Apache Spark > CoarseGrainedSchedulerBackend.maxNumConcurrentTasks should

[jira] [Commented] (SPARK-32518) CoarseGrainedSchedulerBackend.maxNumConcurrentTasks should consider all kinds of resources

[ https://issues.apache.org/jira/browse/SPARK-32518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169752#comment-17169752 ] Apache Spark commented on SPARK-32518: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32518) CoarseGrainedSchedulerBackend.maxNumConcurrentTasks should consider all kinds of resources

[ https://issues.apache.org/jira/browse/SPARK-32518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32518: Assignee: (was: Apache Spark) > CoarseGrainedSchedulerBackend.maxNumConcurrentTasks

[jira] [Commented] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169746#comment-17169746 ] Puviarasu commented on SPARK-31754: --- Hello [~fritzwijaya],  Restarting[after clearing the checkpoint

[jira] [Resolved] (SPARK-24884) Implement regexp_extract_all

[ https://issues.apache.org/jira/browse/SPARK-24884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24884. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27507

[jira] [Assigned] (SPARK-24884) Implement regexp_extract_all

[ https://issues.apache.org/jira/browse/SPARK-24884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24884: --- Assignee: jiaan.geng > Implement regexp_extract_all > > >