[jira] [Resolved] (SPARK-40777) Use error classes for Protobuf exceptions

2022-11-03 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-40777. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38344

[jira] [Assigned] (SPARK-40777) Use error classes for Protobuf exceptions

2022-11-03 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-40777: Assignee: Sandish Kumar HN > Use error classes for Protobuf exceptions >

[jira] [Assigned] (SPARK-41012) Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41012: Assignee: (was: Apache Spark) > Rename _LEGACY_ERROR_TEMP_1022 to

[jira] [Assigned] (SPARK-41012) Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41012: Assignee: Apache Spark > Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE >

[jira] [Commented] (SPARK-41012) Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628675#comment-17628675 ] Apache Spark commented on SPARK-41012: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-41012) Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE

2022-11-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628673#comment-17628673 ] Haejoon Lee commented on SPARK-41012: - I'm working on it > Rename _LEGACY_ERROR_TEMP_1022 to

[jira] [Created] (SPARK-41012) Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE

2022-11-03 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-41012: --- Summary: Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE Key: SPARK-41012 URL: https://issues.apache.org/jira/browse/SPARK-41012 Project: Spark

[jira] [Created] (SPARK-41011) Refine Sequence#checkInputDataTypes related DataTypeMismatch

2022-11-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-41011: Summary: Refine Sequence#checkInputDataTypes related DataTypeMismatch Key: SPARK-41011 URL: https://issues.apache.org/jira/browse/SPARK-41011 Project: Spark Issue

[jira] [Assigned] (SPARK-40372) Migrate failures of array type checks onto error classes

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40372: Assignee: Apache Spark > Migrate failures of array type checks onto error classes >

[jira] [Assigned] (SPARK-40372) Migrate failures of array type checks onto error classes

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40372: Assignee: (was: Apache Spark) > Migrate failures of array type checks onto error

[jira] [Assigned] (SPARK-41001) Connection string support for Python client

2022-11-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41001: Assignee: Martin Grund > Connection string support for Python client >

[jira] [Resolved] (SPARK-41001) Connection string support for Python client

2022-11-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41001. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38501

[jira] [Resolved] (SPARK-40976) Upgrade sbt to 1.7.3

2022-11-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40976. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38502

[jira] [Assigned] (SPARK-40976) Upgrade sbt to 1.7.3

2022-11-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40976: Assignee: Yang Jie > Upgrade sbt to 1.7.3 > > >

[jira] [Commented] (SPARK-41010) Complete Support for Except and Intersect in Python client

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628559#comment-17628559 ] Apache Spark commented on SPARK-41010: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-41010) Complete Support for Except and Intersect in Python client

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628557#comment-17628557 ] Apache Spark commented on SPARK-41010: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41010) Complete Support for Except and Intersect in Python client

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41010: Assignee: Apache Spark > Complete Support for Except and Intersect in Python client >

[jira] [Assigned] (SPARK-41010) Complete Support for Except and Intersect in Python client

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41010: Assignee: (was: Apache Spark) > Complete Support for Except and Intersect in Python

[jira] [Commented] (SPARK-40622) Result of a single task in collect() must fit in 2GB

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628553#comment-17628553 ] Apache Spark commented on SPARK-40622: -- User 'liuzqt' has created a pull request for this issue:

[jira] [Commented] (SPARK-40622) Result of a single task in collect() must fit in 2GB

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628552#comment-17628552 ] Apache Spark commented on SPARK-40622: -- User 'liuzqt' has created a pull request for this issue:

[jira] [Commented] (SPARK-40681) Update gson transitive dependency to 2.8.9 or later

2022-11-03 Thread Michael deLeon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628549#comment-17628549 ] Michael deLeon commented on SPARK-40681: Is there any update on when we might we this in a spark

[jira] [Commented] (SPARK-40815) SymlinkTextInputFormat returns incorrect result due to enabled spark.hadoopRDD.ignoreEmptySplits

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628545#comment-17628545 ] Apache Spark commented on SPARK-40815: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Commented] (SPARK-40815) SymlinkTextInputFormat returns incorrect result due to enabled spark.hadoopRDD.ignoreEmptySplits

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628546#comment-17628546 ] Apache Spark commented on SPARK-40815: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Created] (SPARK-41010) Complete Support for Except and Intersect in Python client

2022-11-03 Thread Rui Wang (Jira)
Rui Wang created SPARK-41010: Summary: Complete Support for Except and Intersect in Python client Key: SPARK-41010 URL: https://issues.apache.org/jira/browse/SPARK-41010 Project: Spark Issue

[jira] [Updated] (SPARK-40801) Upgrade Apache Commons Text to 1.10

2022-11-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40801: - Fix Version/s: 3.2.3 > Upgrade Apache Commons Text to 1.10 >

[jira] [Assigned] (SPARK-40940) Fix the unsupported ops checker to allow chaining of stateful operators

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40940: Assignee: (was: Apache Spark) > Fix the unsupported ops checker to allow chaining of

[jira] [Assigned] (SPARK-40940) Fix the unsupported ops checker to allow chaining of stateful operators

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40940: Assignee: Apache Spark > Fix the unsupported ops checker to allow chaining of stateful

[jira] [Commented] (SPARK-40940) Fix the unsupported ops checker to allow chaining of stateful operators

2022-11-03 Thread Wei Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628472#comment-17628472 ] Wei Liu commented on SPARK-40940: - PR in:  https://github.com/apache/spark/pull/38503 > Fix the

[jira] [Commented] (SPARK-40940) Fix the unsupported ops checker to allow chaining of stateful operators

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628474#comment-17628474 ] Apache Spark commented on SPARK-40940: -- User 'WweiL' has created a pull request for this issue:

[jira] [Resolved] (SPARK-40869) KubernetesConf.getResourceNamePrefix creates invalid name prefixes

2022-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40869. --- Fix Version/s: 3.3.2 3.2.3 3.4.0 Resolution:

[jira] [Assigned] (SPARK-40869) KubernetesConf.getResourceNamePrefix creates invalid name prefixes

2022-11-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40869: - Assignee: Tobias Stadler > KubernetesConf.getResourceNamePrefix creates invalid name

[jira] [Commented] (SPARK-40976) Upgrade sbt to 1.7.3

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628438#comment-17628438 ] Apache Spark commented on SPARK-40976: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-41001) Connection string support for Python client

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628429#comment-17628429 ] Apache Spark commented on SPARK-41001: -- User 'grundprinzip' has created a pull request for this

[jira] [Updated] (SPARK-41002) Compatible `take`, `head` and `first` API in Python client

2022-11-03 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-41002: - Summary: Compatible `take`, `head` and `first` API in Python client (was: Compatible `take` and

[jira] [Commented] (SPARK-41009) Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1070

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628415#comment-17628415 ] Apache Spark commented on SPARK-41009: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41009) Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1070

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41009: Assignee: Apache Spark (was: Max Gekk) > Assign a name to the legacy error class

[jira] [Commented] (SPARK-41009) Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1070

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628414#comment-17628414 ] Apache Spark commented on SPARK-41009: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41009) Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1070

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41009: Assignee: Max Gekk (was: Apache Spark) > Assign a name to the legacy error class

[jira] [Created] (SPARK-41009) Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1070

2022-11-03 Thread Max Gekk (Jira)
Max Gekk created SPARK-41009: Summary: Assign a name to the legacy error class _LEGACY_ERROR_TEMP_1070 Key: SPARK-41009 URL: https://issues.apache.org/jira/browse/SPARK-41009 Project: Spark

[jira] [Updated] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-11-03 Thread Arne Koopman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arne Koopman updated SPARK-41008: - Description:   {code:python} import pandas as pd from pyspark.sql.types import DoubleType from

[jira] [Updated] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-11-03 Thread Arne Koopman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arne Koopman updated SPARK-41008: - Description:   {code:python} import pandas as pd from pyspark.sql.types import DoubleType from

[jira] [Updated] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-11-03 Thread Arne Koopman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arne Koopman updated SPARK-41008: - Description: {code:python} import pandas as pd from pyspark.sql.types import DoubleType from

[jira] [Updated] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-11-03 Thread Arne Koopman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arne Koopman updated SPARK-41008: - Description: ``` import pandas as pd from pyspark.sql.types import DoubleType from

[jira] [Updated] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-11-03 Thread Arne Koopman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arne Koopman updated SPARK-41008: - Description:   {{```}} import pandas as pd from pyspark.sql.types import DoubleType from

[jira] [Created] (SPARK-41008) Isotonic regression result differs from sklearn implementation

2022-11-03 Thread Arne Koopman (Jira)
Arne Koopman created SPARK-41008: Summary: Isotonic regression result differs from sklearn implementation Key: SPARK-41008 URL: https://issues.apache.org/jira/browse/SPARK-41008 Project: Spark

[jira] [Assigned] (SPARK-41007) BigInteger Serialization doesn't work with JavaBean Encoder

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41007: Assignee: Apache Spark > BigInteger Serialization doesn't work with JavaBean Encoder >

[jira] [Assigned] (SPARK-41007) BigInteger Serialization doesn't work with JavaBean Encoder

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41007: Assignee: (was: Apache Spark) > BigInteger Serialization doesn't work with JavaBean

[jira] [Commented] (SPARK-41007) BigInteger Serialization doesn't work with JavaBean Encoder

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628384#comment-17628384 ] Apache Spark commented on SPARK-41007: -- User 'dfit99' has created a pull request for this issue:

[jira] [Updated] (SPARK-41007) BigInteger Serialization doesn't work with JavaBean Encoder

2022-11-03 Thread Daniel Fiterma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Fiterma updated SPARK-41007: --- Description: When creating a dataset using the [Java Bean

[jira] [Commented] (SPARK-41007) BigInteger Serialization doesn't work with JavaBean Encoder

2022-11-03 Thread Daniel Fiterma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628372#comment-17628372 ] Daniel Fiterma commented on SPARK-41007: FYI: Have a fix for this already, going to push out a

[jira] [Updated] (SPARK-41007) BigInteger Serialization doesn't work with JavaBean Encoder

2022-11-03 Thread Daniel Fiterma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Fiterma updated SPARK-41007: --- Description: When creating a dataset using the [Java Bean

[jira] [Updated] (SPARK-41007) BigInteger Serialization doesn't work with JavaBean Encoder

2022-11-03 Thread Daniel Fiterma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Fiterma updated SPARK-41007: --- Description: When creating a dataset using the [Java Bean

[jira] [Created] (SPARK-41007) BigInteger Serialization doesn't work with JavaBean Encoder

2022-11-03 Thread Daniel Fiterma (Jira)
Daniel Fiterma created SPARK-41007: -- Summary: BigInteger Serialization doesn't work with JavaBean Encoder Key: SPARK-41007 URL: https://issues.apache.org/jira/browse/SPARK-41007 Project: Spark

[jira] [Updated] (SPARK-40996) Upgrade `sbt-checkstyle-plugin` to 4.0.0

2022-11-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40996: - Priority: Minor (was: Major) > Upgrade `sbt-checkstyle-plugin` to 4.0.0 >

[jira] [Resolved] (SPARK-40996) Upgrade `sbt-checkstyle-plugin` to 4.0.0

2022-11-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40996. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38481

[jira] [Assigned] (SPARK-40996) Upgrade `sbt-checkstyle-plugin` to 4.0.0

2022-11-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40996: Assignee: Yang Jie > Upgrade `sbt-checkstyle-plugin` to 4.0.0 >

[jira] [Assigned] (SPARK-40834) Use SparkListenerSQLExecutionEnd to track final SQL status in UI

2022-11-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40834: --- Assignee: XiDuo You > Use SparkListenerSQLExecutionEnd to track final SQL status in UI >

[jira] [Resolved] (SPARK-40834) Use SparkListenerSQLExecutionEnd to track final SQL status in UI

2022-11-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40834. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38302

[jira] [Updated] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2022-11-03 Thread Eric (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric updated SPARK-41006: - Description: If we use the Spark Launcher to launch our spark apps in k8s: {code:java} val sparkLauncher = new

[jira] [Updated] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2022-11-03 Thread Eric (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric updated SPARK-41006: - Description: If we use the Spark Launcher to launch our spark apps in k8s: {code:java} val sparkLauncher = new

[jira] [Resolved] (SPARK-27339) Decimal up cast to higher scale fails while reading parquet to Dataset

2022-11-03 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-27339. -- Resolution: Duplicate I can't reproduce this in the latest Spark, and think it might have

[jira] [Updated] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2022-11-03 Thread Eric (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric updated SPARK-41006: - Description: If we use the Spark Launcher to launch our spark apps in k8s: {code:java} val sparkLauncher = new

[jira] [Created] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2022-11-03 Thread Eric (Jira)
Eric created SPARK-41006: Summary: ConfigMap has the same name when launching two pods on the same namespace Key: SPARK-41006 URL: https://issues.apache.org/jira/browse/SPARK-41006 Project: Spark

[jira] [Assigned] (SPARK-40769) Migrate type check failures of aggregate expressions onto error classes

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40769: Assignee: Apache Spark > Migrate type check failures of aggregate expressions onto error

[jira] [Commented] (SPARK-40769) Migrate type check failures of aggregate expressions onto error classes

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628265#comment-17628265 ] Apache Spark commented on SPARK-40769: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-40769) Migrate type check failures of aggregate expressions onto error classes

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628264#comment-17628264 ] Apache Spark commented on SPARK-40769: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40769) Migrate type check failures of aggregate expressions onto error classes

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40769: Assignee: Apache Spark > Migrate type check failures of aggregate expressions onto error

[jira] [Assigned] (SPARK-40769) Migrate type check failures of aggregate expressions onto error classes

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40769: Assignee: (was: Apache Spark) > Migrate type check failures of aggregate expressions

[jira] [Commented] (SPARK-41005) Arrow based collect

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628261#comment-17628261 ] Apache Spark commented on SPARK-41005: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41005) Arrow based collect

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41005: Assignee: Apache Spark > Arrow based collect > --- > >

[jira] [Commented] (SPARK-41005) Arrow based collect

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628260#comment-17628260 ] Apache Spark commented on SPARK-41005: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41005) Arrow based collect

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41005: Assignee: (was: Apache Spark) > Arrow based collect > --- > >

[jira] [Created] (SPARK-41005) Arrow based collect

2022-11-03 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41005: - Summary: Arrow based collect Key: SPARK-41005 URL: https://issues.apache.org/jira/browse/SPARK-41005 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-40999) Hints on subqueries are not properly propagated

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628248#comment-17628248 ] Apache Spark commented on SPARK-40999: -- User 'fred-db' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40999) Hints on subqueries are not properly propagated

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40999: Assignee: (was: Apache Spark) > Hints on subqueries are not properly propagated >

[jira] [Assigned] (SPARK-40999) Hints on subqueries are not properly propagated

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40999: Assignee: Apache Spark > Hints on subqueries are not properly propagated >

[jira] [Commented] (SPARK-40999) Hints on subqueries are not properly propagated

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628245#comment-17628245 ] Apache Spark commented on SPARK-40999: -- User 'fred-db' has created a pull request for this issue:

[jira] [Commented] (SPARK-40819) Parquet INT64 (TIMESTAMP(NANOS,true)) now throwing Illegal Parquet type instead of automatically converting to LongType

2022-11-03 Thread Nikhil Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628239#comment-17628239 ] Nikhil Sharma commented on SPARK-40819: --- Thank you for sharing such good information. Very

[jira] [Commented] (SPARK-40708) Auto update table statistics based on write metrics

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628234#comment-17628234 ] Apache Spark commented on SPARK-40708: -- User 'wankunde' has created a pull request for this issue:

[jira] [Commented] (SPARK-40708) Auto update table statistics based on write metrics

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628235#comment-17628235 ] Apache Spark commented on SPARK-40708: -- User 'wankunde' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40708) Auto update table statistics based on write metrics

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40708: Assignee: (was: Apache Spark) > Auto update table statistics based on write metrics

[jira] [Assigned] (SPARK-40708) Auto update table statistics based on write metrics

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40708: Assignee: Apache Spark > Auto update table statistics based on write metrics >

[jira] [Commented] (SPARK-35531) Can not insert into hive bucket table if create table with upper case schema

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628225#comment-17628225 ] Apache Spark commented on SPARK-35531: -- User 'wankunde' has created a pull request for this issue:

[jira] [Commented] (SPARK-41004) Check error classes in InterceptorRegistrySuite

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628220#comment-17628220 ] Apache Spark commented on SPARK-41004: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-41004) Check error classes in InterceptorRegistrySuite

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41004: Assignee: Apache Spark > Check error classes in InterceptorRegistrySuite >

[jira] [Assigned] (SPARK-41004) Check error classes in InterceptorRegistrySuite

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41004: Assignee: (was: Apache Spark) > Check error classes in InterceptorRegistrySuite >

[jira] [Created] (SPARK-41004) Check error classes in InterceptorRegistrySuite

2022-11-03 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-41004: --- Summary: Check error classes in InterceptorRegistrySuite Key: SPARK-41004 URL: https://issues.apache.org/jira/browse/SPARK-41004 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38270) SQL CLI AM should keep same exitcode with client

2022-11-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628179#comment-17628179 ] Apache Spark commented on SPARK-38270: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-40999) Hints on subqueries are not properly propagated

2022-11-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40999: Fix Version/s: (was: 3.4.0) > Hints on subqueries are not properly propagated >