[jira] [Created] (SPARK-40766) Upgrade the guava defined in `plugins.sbt` to `31.0.1-jre`

2022-10-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-40766: Summary: Upgrade the guava defined in `plugins.sbt` to `31.0.1-jre` Key: SPARK-40766 URL: https://issues.apache.org/jira/browse/SPARK-40766 Project: Spark Issue

[jira] [Commented] (SPARK-38774) impl Series.autocorr

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616201#comment-17616201 ] Apache Spark commented on SPARK-38774: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-38774) impl Series.autocorr

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616200#comment-17616200 ] Apache Spark commented on SPARK-38774: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40654) Protobuf support MVP with descriptor files

2022-10-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-40654: -- Assignee: Sandish Kumar HN > Protobuf support MVP with descriptor files >

[jira] [Updated] (SPARK-40654) Protobuf support MVP with descriptor files

2022-10-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-40654: --- Affects Version/s: 3.4.0 (was: 3.3.0) > Protobuf support MVP

[jira] [Commented] (SPARK-40765) Optimize redundant fs operations in `CommandUtils#calculateSingleLocationSize#getPathSize` method

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616171#comment-17616171 ] Apache Spark commented on SPARK-40765: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40765) Optimize redundant fs operations in `CommandUtils#calculateSingleLocationSize#getPathSize` method

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40765: Assignee: Apache Spark > Optimize redundant fs operations in >

[jira] [Assigned] (SPARK-40765) Optimize redundant fs operations in `CommandUtils#calculateSingleLocationSize#getPathSize` method

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40765: Assignee: (was: Apache Spark) > Optimize redundant fs operations in >

[jira] [Created] (SPARK-40765) Optimize redundant fs operations in `CommandUtils#calculateSingleLocationSize#getPathSize` method

2022-10-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-40765: Summary: Optimize redundant fs operations in `CommandUtils#calculateSingleLocationSize#getPathSize` method Key: SPARK-40765 URL: https://issues.apache.org/jira/browse/SPARK-40765

[jira] [Commented] (SPARK-40704) Pyspark incompatible with Pypy

2022-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616168#comment-17616168 ] Hyukjin Kwon commented on SPARK-40704: -- [~ggbaker] Please go ahead and upgrade cloudpickle. See

[jira] [Created] (SPARK-40764) Extract partitioning through all children output expressions

2022-10-11 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40764: --- Summary: Extract partitioning through all children output expressions Key: SPARK-40764 URL: https://issues.apache.org/jira/browse/SPARK-40764 Project: Spark

[jira] [Resolved] (SPARK-40722) How to set BlockManager info of hostname as ipaddress

2022-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40722. -- Resolution: Invalid > How to set BlockManager info of hostname as ipaddress >

[jira] [Commented] (SPARK-40722) How to set BlockManager info of hostname as ipaddress

2022-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616167#comment-17616167 ] Hyukjin Kwon commented on SPARK-40722: -- [~casion] for questions, it's better to interact in Spark

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40736: - Component/s: SQL (was: Spark Core) > Spark 3.3.0 doesn't works with Hive

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40736: - Labels: Hive spark (was: Hive spark spark3.0) > Spark 3.3.0 doesn't works with Hive 3.1.2 >

[jira] [Updated] (SPARK-40736) Spark 3.3.0 doesn't works with Hive 3.1.2

2022-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40736: - Fix Version/s: (was: 3.3.1) > Spark 3.3.0 doesn't works with Hive 3.1.2 >

[jira] [Resolved] (SPARK-40741) spark项目bin/beeline对于distribute by sort by语句支持不好,输出结果错误

2022-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40741. -- Resolution: Incomplete > spark项目bin/beeline对于distribute by sort by语句支持不好,输出结果错误 >

[jira] [Commented] (SPARK-40741) spark项目bin/beeline对于distribute by sort by语句支持不好,输出结果错误

2022-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616166#comment-17616166 ] Hyukjin Kwon commented on SPARK-40741: -- [~lkqqingcao] would be great to file an issue in English

[jira] [Assigned] (SPARK-8731) Beeline doesn't work with -e option when started in background

2022-10-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-8731: --- Assignee: Apache Spark (was: Kent Yao) > Beeline doesn't work with -e option when started in

[jira] [Resolved] (SPARK-8731) Beeline doesn't work with -e option when started in background

2022-10-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-8731. - Fix Version/s: 3.4.0 3.2.3 3.3.2 Resolution: Fixed >

[jira] [Reopened] (SPARK-8731) Beeline doesn't work with -e option when started in background

2022-10-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reopened SPARK-8731: - Assignee: Kent Yao > Beeline doesn't work with -e option when started in background >

[jira] [Commented] (SPARK-40655) Protobuf functions in Python

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616155#comment-17616155 ] Apache Spark commented on SPARK-40655: -- User 'SandishKumarHN' has created a pull request for this

[jira] [Commented] (SPARK-40655) Protobuf functions in Python

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616156#comment-17616156 ] Apache Spark commented on SPARK-40655: -- User 'SandishKumarHN' has created a pull request for this

[jira] [Updated] (SPARK-40746) Make Dockerfile build workflow work in apache repo

2022-10-11 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-40746: Summary: Make Dockerfile build workflow work in apache repo (was: Switch workflow trigger event

[jira] [Resolved] (SPARK-40746) Switch workflow trigger event to `pull_request_target`

2022-10-11 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40746. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 7

[jira] [Assigned] (SPARK-40746) Switch workflow trigger event to `pull_request_target`

2022-10-11 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40746: --- Assignee: Yikun Jiang > Switch workflow trigger event to `pull_request_target` >

[jira] [Resolved] (SPARK-40757) Add PULL_REQUEST_TEMPLATE for spark-docker

2022-10-11 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40757. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 8

[jira] [Assigned] (SPARK-40757) Add PULL_REQUEST_TEMPLATE for spark-docker

2022-10-11 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40757: --- Assignee: Yikun Jiang > Add PULL_REQUEST_TEMPLATE for spark-docker >

[jira] [Resolved] (SPARK-40654) Protobuf support MVP with descriptor files

2022-10-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40654. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37972

[jira] [Assigned] (SPARK-40763) Should expose driver service name to config for user features

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40763: Assignee: (was: Apache Spark) > Should expose driver service name to config for user

[jira] [Assigned] (SPARK-40763) Should expose driver service name to config for user features

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40763: Assignee: Apache Spark > Should expose driver service name to config for user features >

[jira] [Created] (SPARK-40763) Should expose driver service name to config for user features

2022-10-11 Thread binjie yang (Jira)
binjie yang created SPARK-40763: --- Summary: Should expose driver service name to config for user features Key: SPARK-40763 URL: https://issues.apache.org/jira/browse/SPARK-40763 Project: Spark

[jira] [Commented] (SPARK-40763) Should expose driver service name to config for user features

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616138#comment-17616138 ] Apache Spark commented on SPARK-40763: -- User 'zwangsheng' has created a pull request for this

[jira] [Commented] (SPARK-37940) Use error classes in the compilation errors of partitions

2022-10-11 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616110#comment-17616110 ] BingKun Pan commented on SPARK-37940: - [~maxgekk] okay, I will work on this! > Use error classes in

[jira] [Commented] (SPARK-40457) upgrade jackson data mapper to latest

2022-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616103#comment-17616103 ] Hyukjin Kwon commented on SPARK-40457: -- We're going to drop Hadoop 2 from Apache Spark 3.4. is this

[jira] [Assigned] (SPARK-38959) DataSource V2: Support runtime group filtering in row-level commands

2022-10-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38959: - Assignee: Anton Okolnychyi > DataSource V2: Support runtime group filtering in

[jira] [Resolved] (SPARK-38959) DataSource V2: Support runtime group filtering in row-level commands

2022-10-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38959. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36304

[jira] [Commented] (SPARK-40416) Add error classes for subquery expression CheckAnalysis failures

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616057#comment-17616057 ] Apache Spark commented on SPARK-40416: -- User 'allisonwang-db' has created a pull request for this

[jira] [Commented] (SPARK-40416) Add error classes for subquery expression CheckAnalysis failures

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616056#comment-17616056 ] Apache Spark commented on SPARK-40416: -- User 'allisonwang-db' has created a pull request for this

[jira] [Commented] (SPARK-40658) Protobuf v2 & v3 support

2022-10-11 Thread Raghu Angadi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616010#comment-17616010 ] Raghu Angadi commented on SPARK-40658: -- > If we can get away without specifying V2 or V3 or ANY,

[jira] [Commented] (SPARK-33782) Place spark.files, spark.jars and spark.files under the current working directory on the driver in K8S cluster mode

2022-10-11 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615997#comment-17615997 ] pralabhkumar commented on SPARK-33782: -- [~hyukjin.kwon]    Can u please help to review the PR .

[jira] [Commented] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615987#comment-17615987 ] Apache Spark commented on SPARK-21195: -- User 'robert3005' has created a pull request for this

[jira] [Assigned] (SPARK-40762) Check error classes in ErrorParserSuite

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40762: Assignee: Apache Spark (was: Max Gekk) > Check error classes in ErrorParserSuite >

[jira] [Commented] (SPARK-40762) Check error classes in ErrorParserSuite

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615973#comment-17615973 ] Apache Spark commented on SPARK-40762: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-40762) Check error classes in ErrorParserSuite

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615974#comment-17615974 ] Apache Spark commented on SPARK-40762: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40762) Check error classes in ErrorParserSuite

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40762: Assignee: Max Gekk (was: Apache Spark) > Check error classes in ErrorParserSuite >

[jira] [Assigned] (SPARK-37946) Use error classes in the execution errors related to partitions

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-37946: Assignee: (was: Apache Spark) > Use error classes in the execution errors related to

[jira] [Assigned] (SPARK-40760) Migrate type check failures of interval expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40760: Assignee: (was: Max Gekk) > Migrate type check failures of interval expressions onto error

[jira] [Assigned] (SPARK-40761) Migrate type check failures of percentile expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40761: Assignee: (was: Max Gekk) > Migrate type check failures of percentile expressions onto error

[jira] [Assigned] (SPARK-40759) Migrate type check failures of time window onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40759: Assignee: (was: Max Gekk) > Migrate type check failures of time window onto error classes >

[jira] [Created] (SPARK-40762) Check error classes in ErrorParserSuite

2022-10-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-40762: Summary: Check error classes in ErrorParserSuite Key: SPARK-40762 URL: https://issues.apache.org/jira/browse/SPARK-40762 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-40361) Migrate arithmetic type check failures onto error classes

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615962#comment-17615962 ] Apache Spark commented on SPARK-40361: -- User 'lvshaokang' has created a pull request for this

[jira] [Assigned] (SPARK-40361) Migrate arithmetic type check failures onto error classes

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40361: Assignee: (was: Apache Spark) > Migrate arithmetic type check failures onto error

[jira] [Assigned] (SPARK-40361) Migrate arithmetic type check failures onto error classes

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40361: Assignee: Apache Spark > Migrate arithmetic type check failures onto error classes >

[jira] [Commented] (SPARK-40361) Migrate arithmetic type check failures onto error classes

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615961#comment-17615961 ] Apache Spark commented on SPARK-40361: -- User 'lvshaokang' has created a pull request for this

[jira] [Resolved] (SPARK-40745) Reduce the shuffle size of ALS in mllib

2022-10-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40745. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38203

[jira] [Assigned] (SPARK-40745) Reduce the shuffle size of ALS in mllib

2022-10-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40745: Assignee: Ruifeng Zheng > Reduce the shuffle size of ALS in mllib >

[jira] [Updated] (SPARK-40761) Migrate type check failures of percentile expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40761: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the percentile

[jira] [Created] (SPARK-40761) Migrate type check failures of percentile expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-40761: Summary: Migrate type check failures of percentile expressions onto error classes Key: SPARK-40761 URL: https://issues.apache.org/jira/browse/SPARK-40761 Project: Spark

[jira] [Commented] (SPARK-40457) upgrade jackson data mapper to latest

2022-10-11 Thread Bilna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615907#comment-17615907 ] Bilna commented on SPARK-40457: --- This link: https://github.com/bjornjorgensen/spark/security/dependabot/1

[jira] [Updated] (SPARK-40760) Migrate type check failures of interval expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40760: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the interval expressions:

[jira] [Updated] (SPARK-40753) Fix bug in test case for catalog directory operation

2022-10-11 Thread xiaoping.huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaoping.huang updated SPARK-40753: --- Component/s: (was: Tests) > Fix bug in test case for catalog directory operation >

[jira] [Created] (SPARK-40760) Migrate type check failures of interval expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-40760: Summary: Migrate type check failures of interval expressions onto error classes Key: SPARK-40760 URL: https://issues.apache.org/jira/browse/SPARK-40760 Project: Spark

[jira] [Updated] (SPARK-40759) Migrate type check failures of time window onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40759: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the time window

[jira] [Assigned] (SPARK-40759) Migrate type check failures of time window onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40759: Assignee: Max Gekk > Migrate type check failures of time window onto error classes >

[jira] [Created] (SPARK-40759) Migrate type check failures of time window onto error classes

2022-10-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-40759: Summary: Migrate type check failures of time window onto error classes Key: SPARK-40759 URL: https://issues.apache.org/jira/browse/SPARK-40759 Project: Spark Issue

[jira] [Created] (SPARK-40758) Upgrade Apache zookeeper to get rid of CVE-2020-10663

2022-10-11 Thread Bilna (Jira)
Bilna created SPARK-40758: - Summary: Upgrade Apache zookeeper to get rid of CVE-2020-10663 Key: SPARK-40758 URL: https://issues.apache.org/jira/browse/SPARK-40758 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40756) Migrate type check failures of string expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40756: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the string and regexp

[jira] [Created] (SPARK-40757) Add PULL_REQUEST_TEMPLATE for spark-docker

2022-10-11 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40757: --- Summary: Add PULL_REQUEST_TEMPLATE for spark-docker Key: SPARK-40757 URL: https://issues.apache.org/jira/browse/SPARK-40757 Project: Spark Issue Type:

[jira] [Created] (SPARK-40756) Migrate type check failures of string expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-40756: Summary: Migrate type check failures of string expressions onto error classes Key: SPARK-40756 URL: https://issues.apache.org/jira/browse/SPARK-40756 Project: Spark

[jira] [Updated] (SPARK-40748) Migrate type check failures of conditions onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40748: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the conditional

[jira] [Updated] (SPARK-40755) Migrate type check failures of number formatting onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40755: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the number formatting or

[jira] [Created] (SPARK-40755) Migrate type check failures of number formatting onto error classes

2022-10-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-40755: Summary: Migrate type check failures of number formatting onto error classes Key: SPARK-40755 URL: https://issues.apache.org/jira/browse/SPARK-40755 Project: Spark

[jira] [Commented] (SPARK-40753) Fix bug in test case for catalog directory operation

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615875#comment-17615875 ] Apache Spark commented on SPARK-40753: -- User 'huangxiaopingRD' has created a pull request for this

[jira] [Assigned] (SPARK-40753) Fix bug in test case for catalog directory operation

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40753: Assignee: Apache Spark > Fix bug in test case for catalog directory operation >

[jira] [Assigned] (SPARK-40753) Fix bug in test case for catalog directory operation

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40753: Assignee: (was: Apache Spark) > Fix bug in test case for catalog directory operation

[jira] [Commented] (SPARK-40753) Fix bug in test case for catalog directory operation

2022-10-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615874#comment-17615874 ] Apache Spark commented on SPARK-40753: -- User 'huangxiaopingRD' has created a pull request for this

[jira] [Created] (SPARK-40754) Add LICENSE and NOTICE for apache/spark-docker

2022-10-11 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40754: --- Summary: Add LICENSE and NOTICE for apache/spark-docker Key: SPARK-40754 URL: https://issues.apache.org/jira/browse/SPARK-40754 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40753) Fix bug in test case for catalog directory operation

2022-10-11 Thread xiaoping.huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaoping.huang updated SPARK-40753: --- Description: The implementation class of ExternalCatalog will perform folder operations

[jira] [Created] (SPARK-40753) Fix bug in test case for catalog directory operation

2022-10-11 Thread xiaoping.huang (Jira)
xiaoping.huang created SPARK-40753: -- Summary: Fix bug in test case for catalog directory operation Key: SPARK-40753 URL: https://issues.apache.org/jira/browse/SPARK-40753 Project: Spark

[jira] [Commented] (SPARK-33598) Support Java Class with circular references

2022-10-11 Thread Vivek Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615853#comment-17615853 ] Vivek Sharma commented on SPARK-33598: -- Thanks [~jacklzg] , I see the PR, however it seems there

[jira] [Comment Edited] (SPARK-37940) Use error classes in the compilation errors of partitions

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615820#comment-17615820 ] Max Gekk edited comment on SPARK-37940 at 10/11/22 1:50 PM: [~panbingkun]

[jira] [Commented] (SPARK-37940) Use error classes in the compilation errors of partitions

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17615820#comment-17615820 ] Max Gekk commented on SPARK-37940: -- @panbingkun Would you like to work on this? > Use error classes in

[jira] [Updated] (SPARK-40752) Migrate type check failures of misc expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40752: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the misc expressions: 1.

[jira] [Created] (SPARK-40752) Migrate type check failures of misc expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-40752: Summary: Migrate type check failures of misc expressions onto error classes Key: SPARK-40752 URL: https://issues.apache.org/jira/browse/SPARK-40752 Project: Spark

[jira] [Updated] (SPARK-40751) Migrate type check failures of high order functions onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40751: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the high-order functions

[jira] [Created] (SPARK-40751) Migrate type check failures of high order functions onto error classes

2022-10-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-40751: Summary: Migrate type check failures of high order functions onto error classes Key: SPARK-40751 URL: https://issues.apache.org/jira/browse/SPARK-40751 Project: Spark

[jira] [Updated] (SPARK-40749) Migrate type check failures of generators onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40749: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the generator expressions:

[jira] [Updated] (SPARK-40748) Migrate type check failures of conditions onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40748: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the conditional

[jira] [Updated] (SPARK-40750) Migrate type check failures of math expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40750: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the math expressions: 1.

[jira] [Created] (SPARK-40750) Migrate type check failures of math expressions onto error classes

2022-10-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-40750: Summary: Migrate type check failures of math expressions onto error classes Key: SPARK-40750 URL: https://issues.apache.org/jira/browse/SPARK-40750 Project: Spark

[jira] [Reopened] (SPARK-37935) Migrate onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reopened SPARK-37935: -- Closed by sub-task PR https://github.com/apache/spark/pull/38051 mistakenly. > Migrate onto error

[jira] [Resolved] (SPARK-40627) Eliminate error sub-classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40627. -- Assignee: Max Gekk Resolution: Fixed Resolved by https://github.com/apache/spark/pull/38051 >

[jira] [Updated] (SPARK-40749) Migrate type check failures of generators onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40749: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the complex type creator

[jira] [Resolved] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40735. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38191

[jira] [Assigned] (SPARK-40735) Consistently invoke bash with /usr/bin/env bash in scripts to make code more portable

2022-10-11 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40735: Assignee: xiaoping.huang > Consistently invoke bash with /usr/bin/env bash in scripts to

[jira] [Created] (SPARK-40749) Migrate type check failures of generators onto error classes

2022-10-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-40749: Summary: Migrate type check failures of generators onto error classes Key: SPARK-40749 URL: https://issues.apache.org/jira/browse/SPARK-40749 Project: Spark Issue

[jira] [Updated] (SPARK-40748) Migrate type check failures of conditions onto error classes

2022-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40748: - Description: Replace TypeCheckFailure by DataTypeMismatch in type checks in the complex type creator

[jira] [Created] (SPARK-40748) Migrate type check failures of conditions onto error classes

2022-10-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-40748: Summary: Migrate type check failures of conditions onto error classes Key: SPARK-40748 URL: https://issues.apache.org/jira/browse/SPARK-40748 Project: Spark Issue

[jira] [Updated] (SPARK-40732) Double type precision problem

2022-10-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40732: - Summary: Double type precision problem (was: Floating point precision changes) > Double type

  1   2   >