[jira] [Resolved] (SPARK-40033) Nested schema pruning support through element_at

2022-09-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-40033. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37463 [https://gith

[jira] [Assigned] (SPARK-40033) Nested schema pruning support through element_at

2022-09-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-40033: --- Assignee: XiDuo You > Nested schema pruning support through element_at > --

[jira] [Resolved] (SPARK-40312) Add missing configuration documentation in Spark History Server

2022-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40312. - Fix Version/s: 3.4.0 Assignee: dzcxzl Resolution: Fixed > Add missing configurat

[jira] [Commented] (SPARK-39414) Upgrade Scala to 2.12.16

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599807#comment-17599807 ] Apache Spark commented on SPARK-39414: -- User 'wangyum' has created a pull request f

[jira] [Resolved] (SPARK-40319) Remove duplicated query execution error method for PARSE_DATETIME_BY_NEW_PARSER

2022-09-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40319. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37776 [https://github.com

[jira] [Commented] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599764#comment-17599764 ] Apache Spark commented on SPARK-40320: -- User 'yabola' has created a pull request fo

[jira] [Assigned] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40320: Assignee: Apache Spark > When the Executor plugin fails to initialize, the Executor shows

[jira] [Assigned] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40320: Assignee: (was: Apache Spark) > When the Executor plugin fails to initialize, the Exe

[jira] [Commented] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599763#comment-17599763 ] Apache Spark commented on SPARK-40320: -- User 'yabola' has created a pull request fo

[jira] [Updated] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-02 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-40320: - Description: Reproduce step: set `spark.plugins=ErrorSparkPlugin` `ErrorSparkPlugin` && `ErrorExecutorPlugin` cl

[jira] [Updated] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-02 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-40320: - Description: *Reproduce step:* set `spark.plugins=ErrorSparkPlugin` `ErrorSparkPlugin` && `ErrorExecutorPlugin`

[jira] [Updated] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-02 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-40320: - Description: *Reproduce step:* set `spark.plugins=ErrorSparkPlugin` `ErrorSparkPlugin` && `ErrorExecutorPlugin`

[jira] [Updated] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-02 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-40320: - Description: Reproduce step: set `spark.plugins=ErrorSparkPlugin` `ErrorSparkPlugin` && `ErrorExecutorPlugin` cl

[jira] [Created] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-02 Thread Mars (Jira)
Mars created SPARK-40320: Summary: When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung Key: SPARK-40320 URL: https://issues.apache.org/jira/brows

[jira] [Resolved] (SPARK-40283) Update mima's previousSparkVersion to 3.3.0

2022-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40283. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37741 [https://

[jira] [Assigned] (SPARK-40283) Update mima's previousSparkVersion to 3.3.0

2022-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40283: - Assignee: Yang Jie (was: Yuming Wang) > Update mima's previousSparkVersion to 3.3.0 >

[jira] [Assigned] (SPARK-40283) Update mima's previousSparkVersion to 3.3.0

2022-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40283: - Assignee: Yuming Wang > Update mima's previousSparkVersion to 3.3.0 > -

[jira] [Updated] (SPARK-38542) UnsafeHashedRelation should serialize numKeys out

2022-09-02 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-38542: --- Labels: correctness (was: ) > UnsafeHashedRelation should serialize numKeys out > -

[jira] [Assigned] (SPARK-40309) Introduce sql_conf context manager for pyspark.sql

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40309: Assignee: Apache Spark > Introduce sql_conf context manager for pyspark.sql > ---

[jira] [Assigned] (SPARK-40309) Introduce sql_conf context manager for pyspark.sql

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40309: Assignee: (was: Apache Spark) > Introduce sql_conf context manager for pyspark.sql >

[jira] [Commented] (SPARK-40309) Introduce sql_conf context manager for pyspark.sql

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599718#comment-17599718 ] Apache Spark commented on SPARK-40309: -- User 'xinrong-meng' has created a pull requ

[jira] [Updated] (SPARK-40309) Introduce sql_conf context manager for pyspark.sql

2022-09-02 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40309: - Description: That would simplify the control of Spark SQL configuration as below from {code:jav

[jira] [Commented] (SPARK-40319) Remove duplicated query execution error method for PARSE_DATETIME_BY_NEW_PARSER

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599717#comment-17599717 ] Apache Spark commented on SPARK-40319: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-40319) Remove duplicated query execution error method for PARSE_DATETIME_BY_NEW_PARSER

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599716#comment-17599716 ] Apache Spark commented on SPARK-40319: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-40319) Remove duplicated query execution error method for PARSE_DATETIME_BY_NEW_PARSER

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40319: Assignee: Gengliang Wang (was: Apache Spark) > Remove duplicated query execution error m

[jira] [Assigned] (SPARK-40319) Remove duplicated query execution error method for PARSE_DATETIME_BY_NEW_PARSER

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40319: Assignee: Apache Spark (was: Gengliang Wang) > Remove duplicated query execution error m

[jira] [Created] (SPARK-40319) Remove duplicated query execution error method for PARSE_DATETIME_BY_NEW_PARSER

2022-09-02 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40319: -- Summary: Remove duplicated query execution error method for PARSE_DATETIME_BY_NEW_PARSER Key: SPARK-40319 URL: https://issues.apache.org/jira/browse/SPARK-40319 P

[jira] [Updated] (SPARK-40309) Introduce sql_conf context manager for pyspark.sql

2022-09-02 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40309: - Description: [Here|https://github.com/apache/spark/blob/master/python/pyspark/pandas/utils.py#L4

[jira] [Commented] (SPARK-40318) try_avg() should throw the exceptions from its child

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599703#comment-17599703 ] Apache Spark commented on SPARK-40318: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-40318) try_avg() should throw the exceptions from its child

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599702#comment-17599702 ] Apache Spark commented on SPARK-40318: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-40318) try_avg() should throw the exceptions from its child

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40318: Assignee: Apache Spark (was: Gengliang Wang) > try_avg() should throw the exceptions fro

[jira] [Assigned] (SPARK-40318) try_avg() should throw the exceptions from its child

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40318: Assignee: Gengliang Wang (was: Apache Spark) > try_avg() should throw the exceptions fro

[jira] [Created] (SPARK-40318) try_avg() should throw the exceptions from its child

2022-09-02 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40318: -- Summary: try_avg() should throw the exceptions from its child Key: SPARK-40318 URL: https://issues.apache.org/jira/browse/SPARK-40318 Project: Spark Issu

[jira] [Commented] (SPARK-40210) Fix math atan2, hypot, pow and pmod float argument call

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599672#comment-17599672 ] Apache Spark commented on SPARK-40210: -- User 'khalidmammadov' has created a pull re

[jira] [Created] (SPARK-40317) Improvement to JDBC predicate for queries involving joins

2022-09-02 Thread David Ahern (Jira)
David Ahern created SPARK-40317: --- Summary: Improvement to JDBC predicate for queries involving joins Key: SPARK-40317 URL: https://issues.apache.org/jira/browse/SPARK-40317 Project: Spark Issue

[jira] [Comment Edited] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-02 Thread Sachit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599644#comment-17599644 ] Sachit edited comment on SPARK-40316 at 9/2/22 5:30 PM: Hi [~sro

[jira] [Commented] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-02 Thread Sachit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599644#comment-17599644 ] Sachit commented on SPARK-40316: I am using UDF in scala which is causing this. To debug

[jira] [Commented] (SPARK-40299) java api calls the count() method to appear: java.lang.ArithmeticException: BigInteger would overflow supported range

2022-09-02 Thread Bhavya Jain (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599634#comment-17599634 ] Bhavya Jain commented on SPARK-40299: - [~code1v5] Can you please elaborate more on t

[jira] [Commented] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599629#comment-17599629 ] Sean R. Owen commented on SPARK-40316: -- There's no info about what you're doing tha

[jira] [Commented] (SPARK-40303) The performance will be worse after codegen

2022-09-02 Thread Kris Mok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599616#comment-17599616 ] Kris Mok commented on SPARK-40303: -- Nice findings [~LuciferYang]! {quote} After some e

[jira] [Commented] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-02 Thread Sachit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599614#comment-17599614 ] Sachit commented on SPARK-40316: Hi [~hyukjin.kwon] / [~srowen]  , Can you please help 

[jira] [Created] (SPARK-40316) Upgrading to Spark 3 is giving NullPointerException

2022-09-02 Thread Sachit (Jira)
Sachit created SPARK-40316: -- Summary: Upgrading to Spark 3 is giving NullPointerException Key: SPARK-40316 URL: https://issues.apache.org/jira/browse/SPARK-40316 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-40251) Upgrade dev.ludovic.netlib from 2.2.1 to 3.0.2

2022-09-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40251. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37700 [https://gi

[jira] [Assigned] (SPARK-40251) Upgrade dev.ludovic.netlib from 2.2.1 to 3.0.2

2022-09-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40251: Assignee: BingKun Pan > Upgrade dev.ludovic.netlib from 2.2.1 to 3.0.2 >

[jira] [Resolved] (SPARK-40310) try_sum() should throw the exceptions from its child

2022-09-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40310. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37764 [https:

[jira] [Assigned] (SPARK-40228) Don't simplify multiLike if child is not attribute

2022-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-40228: --- Assignee: Yuming Wang > Don't simplify multiLike if child is not attribute > --

[jira] [Resolved] (SPARK-40228) Don't simplify multiLike if child is not attribute

2022-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40228. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37672 [https://gith

[jira] [Commented] (SPARK-40098) Format error messages in the Thrift Server

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599503#comment-17599503 ] Apache Spark commented on SPARK-40098: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-40098) Format error messages in the Thrift Server

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599504#comment-17599504 ] Apache Spark commented on SPARK-40098: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-40163) [SPARK][SQL] feat: SparkSession.confing(Map)

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599501#comment-17599501 ] Apache Spark commented on SPARK-40163: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-40163) [SPARK][SQL] feat: SparkSession.confing(Map)

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599500#comment-17599500 ] Apache Spark commented on SPARK-40163: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-40315) Non-deterministic hashCode() calculations for ArrayBasedMapData on equal objects

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599475#comment-17599475 ] Apache Spark commented on SPARK-40315: -- User 'c27kwan' has created a pull request f

[jira] [Assigned] (SPARK-40315) Non-deterministic hashCode() calculations for ArrayBasedMapData on equal objects

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40315: Assignee: (was: Apache Spark) > Non-deterministic hashCode() calculations for ArrayBa

[jira] [Assigned] (SPARK-40315) Non-deterministic hashCode() calculations for ArrayBasedMapData on equal objects

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40315: Assignee: Apache Spark > Non-deterministic hashCode() calculations for ArrayBasedMapData

[jira] [Commented] (SPARK-40315) Non-deterministic hashCode() calculations for ArrayBasedMapData on equal objects

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599474#comment-17599474 ] Apache Spark commented on SPARK-40315: -- User 'c27kwan' has created a pull request f

[jira] [Created] (SPARK-40315) Non-deterministic hashCode() calculations for ArrayBasedMapData on equal objects

2022-09-02 Thread Carmen Kwan (Jira)
Carmen Kwan created SPARK-40315: --- Summary: Non-deterministic hashCode() calculations for ArrayBasedMapData on equal objects Key: SPARK-40315 URL: https://issues.apache.org/jira/browse/SPARK-40315 Projec

[jira] [Commented] (SPARK-40314) Add inline Scala and Python bindings

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599438#comment-17599438 ] Apache Spark commented on SPARK-40314: -- User 'Kimahriman' has created a pull reques

[jira] [Assigned] (SPARK-40314) Add inline Scala and Python bindings

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40314: Assignee: Apache Spark > Add inline Scala and Python bindings > -

[jira] [Commented] (SPARK-40314) Add inline Scala and Python bindings

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599434#comment-17599434 ] Apache Spark commented on SPARK-40314: -- User 'Kimahriman' has created a pull reques

[jira] [Assigned] (SPARK-40314) Add inline Scala and Python bindings

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40314: Assignee: (was: Apache Spark) > Add inline Scala and Python bindings > --

[jira] [Created] (SPARK-40314) Add inline Scala and Python bindings

2022-09-02 Thread Adam Binford (Jira)
Adam Binford created SPARK-40314: Summary: Add inline Scala and Python bindings Key: SPARK-40314 URL: https://issues.apache.org/jira/browse/SPARK-40314 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-40210) Fix math atan2, hypot, pow and pmod float argument call

2022-09-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40210. --- Target Version/s: 3.4.0 Resolution: Resolved > Fix math atan2, hypot, pow and pmod

[jira] [Assigned] (SPARK-40210) Fix math atan2, hypot, pow and pmod float argument call

2022-09-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40210: - Assignee: Khalid Mammadov > Fix math atan2, hypot, pow and pmod float argument call > -

[jira] [Commented] (SPARK-40313) ps.DataFrame(data, index) should support the same anchor

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599359#comment-17599359 ] Apache Spark commented on SPARK-40313: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-40313) ps.DataFrame(data, index) should support the same anchor

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40313: Assignee: (was: Apache Spark) > ps.DataFrame(data, index) should support the same anc

[jira] [Commented] (SPARK-40312) Add missing configuration documentation in Spark History Server

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599360#comment-17599360 ] Apache Spark commented on SPARK-40312: -- User 'cxzl25' has created a pull request fo

[jira] [Commented] (SPARK-40313) ps.DataFrame(data, index) should support the same anchor

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599358#comment-17599358 ] Apache Spark commented on SPARK-40313: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-40312) Add missing configuration documentation in Spark History Server

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40312: Assignee: (was: Apache Spark) > Add missing configuration documentation in Spark Hist

[jira] [Assigned] (SPARK-40312) Add missing configuration documentation in Spark History Server

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40312: Assignee: Apache Spark > Add missing configuration documentation in Spark History Server

[jira] [Commented] (SPARK-40312) Add missing configuration documentation in Spark History Server

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599361#comment-17599361 ] Apache Spark commented on SPARK-40312: -- User 'cxzl25' has created a pull request fo

[jira] [Assigned] (SPARK-40313) ps.DataFrame(data, index) should support the same anchor

2022-09-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40313: Assignee: Apache Spark > ps.DataFrame(data, index) should support the same anchor > -

[jira] [Created] (SPARK-40313) ps.DataFrame(data, index) should support the same anchor

2022-09-02 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40313: - Summary: ps.DataFrame(data, index) should support the same anchor Key: SPARK-40313 URL: https://issues.apache.org/jira/browse/SPARK-40313 Project: Spark Is

[jira] [Created] (SPARK-40312) Add missing configuration documentation in Spark History Server

2022-09-02 Thread dzcxzl (Jira)
dzcxzl created SPARK-40312: -- Summary: Add missing configuration documentation in Spark History Server Key: SPARK-40312 URL: https://issues.apache.org/jira/browse/SPARK-40312 Project: Spark Issue Ty

[jira] [Commented] (SPARK-40303) The performance will be worse after codegen

2022-09-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599332#comment-17599332 ] Yang Jie commented on SPARK-40303: -- Thank you for your explain, very clear [~rednaxelaf

[jira] [Commented] (SPARK-40303) The performance will be worse after codegen

2022-09-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599314#comment-17599314 ] Yang Jie commented on SPARK-40303: -- do some investigate on linux with spark `local[2]`

[jira] [Commented] (SPARK-40303) The performance will be worse after codegen

2022-09-02 Thread Kris Mok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599302#comment-17599302 ] Kris Mok commented on SPARK-40303: -- Interesting, thanks for posting your findings, [~Lu