[jira] [Commented] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-02-15 Thread Mehul Batra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493042#comment-17493042 ] Mehul Batra commented on SPARK-38218: - When can we expect the next release? > Looks

[jira] [Commented] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493041#comment-17493041 ] Hyukjin Kwon commented on SPARK-38218: -- That'd be fixed from the next release since

[jira] [Created] (SPARK-38227) Apply strict nullability of nested column in time window / session window

2022-02-15 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-38227: Summary: Apply strict nullability of nested column in time window / session window Key: SPARK-38227 URL: https://issues.apache.org/jira/browse/SPARK-38227 Project: Sp

[jira] [Comment Edited] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-02-15 Thread Mehul Batra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493029#comment-17493029 ] Mehul Batra edited comment on SPARK-38218 at 2/16/22, 6:57 AM: ---

[jira] [Commented] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-02-15 Thread Mehul Batra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493029#comment-17493029 ] Mehul Batra commented on SPARK-38218: - So if I download tgz from the spark downloads

[jira] [Updated] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-02-15 Thread Mehul Batra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehul Batra updated SPARK-38218: Attachment: image-2022-02-16-12-26-32-871.png > Looks like the wrong package is available on the s

[jira] [Commented] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493007#comment-17493007 ] Apache Spark commented on SPARK-38226: -- User 'anchovYu' has created a pull request

[jira] [Assigned] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38226: Assignee: (was: Apache Spark) > Fix HiveCompatibilitySuite under ANSI mode >

[jira] [Assigned] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38226: Assignee: Apache Spark > Fix HiveCompatibilitySuite under ANSI mode > ---

[jira] [Commented] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493005#comment-17493005 ] Apache Spark commented on SPARK-38226: -- User 'anchovYu' has created a pull request

[jira] [Updated] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

2022-02-15 Thread Xinyi Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyi Yu updated SPARK-38226: - Description: Fix sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibi

[jira] [Created] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

2022-02-15 Thread Xinyi Yu (Jira)
Xinyi Yu created SPARK-38226: Summary: Fix HiveCompatibilitySuite under ANSI mode Key: SPARK-38226 URL: https://issues.apache.org/jira/browse/SPARK-38226 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-38173) Quoted column cannot be recognized correctly when quotedRegexColumnNames is true

2022-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38173: --- Assignee: Tongwei > Quoted column cannot be recognized correctly when quotedRegexColumnName

[jira] [Resolved] (SPARK-38173) Quoted column cannot be recognized correctly when quotedRegexColumnNames is true

2022-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38173. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35476 [https://gith

[jira] [Resolved] (SPARK-38201) Fix KubernetesUtils#uploadFileToHadoopCompatibleFS use passed in `delSrc` and `overwrite`

2022-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38201. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35509 [https://

[jira] [Assigned] (SPARK-38201) Fix KubernetesUtils#uploadFileToHadoopCompatibleFS use passed in `delSrc` and `overwrite`

2022-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38201: - Assignee: Yang Jie > Fix KubernetesUtils#uploadFileToHadoopCompatibleFS use passed in `

[jira] [Assigned] (SPARK-38225) Complete input validation of function to_binary

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38225: Assignee: (was: Apache Spark) > Complete input validation of function to_binary > ---

[jira] [Assigned] (SPARK-38225) Complete input validation of function to_binary

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38225: Assignee: Apache Spark > Complete input validation of function to_binary > --

[jira] [Commented] (SPARK-38225) Complete input validation of function to_binary

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492985#comment-17492985 ] Apache Spark commented on SPARK-38225: -- User 'xinrong-databricks' has created a pul

[jira] [Commented] (SPARK-38225) Complete input validation of function to_binary

2022-02-15 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492984#comment-17492984 ] Xinrong Meng commented on SPARK-38225: -- I am working on that. > Complete input val

[jira] [Created] (SPARK-38225) Complete input validation of function to_binary

2022-02-15 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-38225: Summary: Complete input validation of function to_binary Key: SPARK-38225 URL: https://issues.apache.org/jira/browse/SPARK-38225 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-38224) How do I get a lot of results in KDE

2022-02-15 Thread Ben Wan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Wan updated SPARK-38224: Priority: Trivial (was: Major) > How do I get a lot of results in KDE > -

[jira] [Created] (SPARK-38224) How do I get a lot of results in KDE

2022-02-15 Thread Ben Wan (Jira)
Ben Wan created SPARK-38224: --- Summary: How do I get a lot of results in KDE Key: SPARK-38224 URL: https://issues.apache.org/jira/browse/SPARK-38224 Project: Spark Issue Type: Question Com

[jira] [Commented] (SPARK-38223) PersistentVolumeClaim does not work in clusters with multiple nodes

2022-02-15 Thread Zimo Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492960#comment-17492960 ] Zimo Li commented on SPARK-38223: - [~hyukjin.kwon] Sorry I missed that. I just added a t

[jira] [Updated] (SPARK-38223) PersistentVolumeClaim does not work in clusters with multiple nodes

2022-02-15 Thread Zimo Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zimo Li updated SPARK-38223: Summary: PersistentVolumeClaim does not work in clusters with multiple nodes (was: Spark) > PersistentVo

[jira] [Resolved] (SPARK-38221) Group by a stream of complex expressions fails

2022-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38221. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/35537 > Group by a stream of

[jira] [Updated] (SPARK-38221) Group by a stream of complex expressions fails

2022-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38221: - Fix Version/s: 3.3.0 3.2.2 > Group by a stream of complex expressions fails >

[jira] [Resolved] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38218. -- Resolution: Duplicate probably it's a duplicate of SPARK-37445 > Looks like the wrong package

[jira] [Commented] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492952#comment-17492952 ] Hyukjin Kwon commented on SPARK-38218: -- [~ME_BAT] the images are broken. mind check

[jira] [Commented] (SPARK-38223) Spark

2022-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492951#comment-17492951 ] Hyukjin Kwon commented on SPARK-38223: -- [~lizimo] mind fixing the JIRA title to sum

[jira] [Assigned] (SPARK-38221) Group by a stream of complex expressions fails

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38221: Assignee: Apache Spark > Group by a stream of complex expressions fails > ---

[jira] [Commented] (SPARK-38221) Group by a stream of complex expressions fails

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492944#comment-17492944 ] Apache Spark commented on SPARK-38221: -- User 'bersprockets' has created a pull requ

[jira] [Assigned] (SPARK-38221) Group by a stream of complex expressions fails

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38221: Assignee: (was: Apache Spark) > Group by a stream of complex expressions fails >

[jira] [Assigned] (SPARK-38222) Expose Node Description attribute in SQL Rest API

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38222: Assignee: (was: Apache Spark) > Expose Node Description attribute in SQL Rest API > -

[jira] [Assigned] (SPARK-38222) Expose Node Description attribute in SQL Rest API

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38222: Assignee: Apache Spark > Expose Node Description attribute in SQL Rest API >

[jira] [Commented] (SPARK-38222) Expose Node Description attribute in SQL Rest API

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492927#comment-17492927 ] Apache Spark commented on SPARK-38222: -- User 'erenavsarogullari' has created a pull

[jira] [Resolved] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

2022-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38220. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35535 [https://gi

[jira] [Assigned] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

2022-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38220: Assignee: Dongjoon Hyun > Upgrade `commons-math3` to 3.6.1 >

[jira] [Created] (SPARK-38223) Spark

2022-02-15 Thread Zimo Li (Jira)
Zimo Li created SPARK-38223: --- Summary: Spark Key: SPARK-38223 URL: https://issues.apache.org/jira/browse/SPARK-38223 Project: Spark Issue Type: Bug Components: Kubernetes Affects Vers

[jira] [Created] (SPARK-38222) Expose nodeDesc attribute in SQL Rest API

2022-02-15 Thread Eren Avsarogullari (Jira)
Eren Avsarogullari created SPARK-38222: -- Summary: Expose nodeDesc attribute in SQL Rest API Key: SPARK-38222 URL: https://issues.apache.org/jira/browse/SPARK-38222 Project: Spark Issue T

[jira] [Updated] (SPARK-38222) Expose Node Description attribute in SQL Rest API

2022-02-15 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-38222: --- Summary: Expose Node Description attribute in SQL Rest API (was: Expose nodeDesc at

[jira] [Commented] (SPARK-38205) The columns in state schema should be relaxed to be nullable

2022-02-15 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492895#comment-17492895 ] Jungtaek Lim commented on SPARK-38205: -- I realized the output schema should also be

[jira] [Commented] (SPARK-38221) Group by a stream of complex expressions fails

2022-02-15 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492869#comment-17492869 ] Bruce Robbins commented on SPARK-38221: --- I think I have an idea what's going on. I

[jira] [Created] (SPARK-38221) Group by a stream of complex expressions fails

2022-02-15 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-38221: - Summary: Group by a stream of complex expressions fails Key: SPARK-38221 URL: https://issues.apache.org/jira/browse/SPARK-38221 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38115) No spark conf to control the path of _temporary when writing to target filesystem

2022-02-15 Thread kk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492824#comment-17492824 ] kk commented on SPARK-38115: Is there any config as such to stop using FileOutputCommiter, b

[jira] [Assigned] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38220: Assignee: Apache Spark > Upgrade `commons-math3` to 3.6.1 > -

[jira] [Assigned] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38220: Assignee: (was: Apache Spark) > Upgrade `commons-math3` to 3.6.1 > --

[jira] [Commented] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492823#comment-17492823 ] Apache Spark commented on SPARK-38220: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

2022-02-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-38220: - Summary: Upgrade `commons-math3` to 3.6.1 Key: SPARK-38220 URL: https://issues.apache.org/jira/browse/SPARK-38220 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-38115) No spark conf to control the path of _temporary when writing to target filesystem

2022-02-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492810#comment-17492810 ] Steve Loughran commented on SPARK-38115: * stop using the classic FileOutputComm

[jira] [Commented] (SPARK-38115) No spark conf to control the path of _temporary when writing to target filesystem

2022-02-15 Thread kk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492785#comment-17492785 ] kk commented on SPARK-38115: Hello [~hyukjin.kwon] did you get a chance to look into this >

[jira] [Resolved] (SPARK-38130) array_sort does not allow non-orderable datatypes

2022-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38130. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35426 [https://gith

[jira] [Assigned] (SPARK-38130) array_sort does not allow non-orderable datatypes

2022-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38130: --- Assignee: Steven Aerts > array_sort does not allow non-orderable datatypes > --

[jira] [Updated] (SPARK-36808) Upgrade Kafka to 2.8.1

2022-02-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36808: --- Fix Version/s: 3.2.2 > Upgrade Kafka to 2.8.1 > -- > > K

[jira] [Updated] (SPARK-36808) Upgrade Kafka to 2.8.1

2022-02-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36808: --- Affects Version/s: 3.2.1 > Upgrade Kafka to 2.8.1 > -- > >

[jira] [Commented] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.py

2022-02-15 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492616#comment-17492616 ] Maciej Szymkiewicz commented on SPARK-37425: Hi [~amirkdv] Just FYI ‒ most

[jira] [Assigned] (SPARK-37413) Inline type hints for python/pyspark/ml/tree.py

2022-02-15 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37413: -- Assignee: dch nguyen > Inline type hints for python/pyspark/ml/tree.py >

[jira] [Resolved] (SPARK-37413) Inline type hints for python/pyspark/ml/tree.py

2022-02-15 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37413. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35420

[jira] [Assigned] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37428: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/mllib/util.py >

[jira] [Assigned] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37428: Assignee: Apache Spark > Inline type hints for python/pyspark/mllib/util.py > ---

[jira] [Commented] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492599#comment-17492599 ] Apache Spark commented on SPARK-37428: -- User 'zero323' has created a pull request f

[jira] [Assigned] (SPARK-38199) Delete the unused `dataType` specified in the definition of `IntervalColumnAccessor`

2022-02-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38199: Assignee: Yang Jie > Delete the unused `dataType` specified in the definition of > `IntervalColu

[jira] [Resolved] (SPARK-38199) Delete the unused `dataType` specified in the definition of `IntervalColumnAccessor`

2022-02-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38199. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35507 [https://github.com

[jira] [Assigned] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38219: Assignee: Apache Spark > Support ANSI aggregation function percentile_cont as window func

[jira] [Assigned] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38219: Assignee: (was: Apache Spark) > Support ANSI aggregation function percentile_cont as

[jira] [Commented] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492571#comment-17492571 ] Apache Spark commented on SPARK-38219: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492572#comment-17492572 ] Apache Spark commented on SPARK-38219: -- User 'beliefer' has created a pull request

[jira] [Created] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

2022-02-15 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38219: -- Summary: Support ANSI aggregation function percentile_cont as window function Key: SPARK-38219 URL: https://issues.apache.org/jira/browse/SPARK-38219 Project: Spark

[jira] [Commented] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492558#comment-17492558 ] Apache Spark commented on SPARK-37405: -- User 'dchvn' has created a pull request for

[jira] [Commented] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492559#comment-17492559 ] Apache Spark commented on SPARK-37405: -- User 'dchvn' has created a pull request for

[jira] [Assigned] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37405: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/feature.py > ---

[jira] [Assigned] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37405: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/feature.py > ---

[jira] [Assigned] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37405: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/ml/feature.py >

[jira] [Updated] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-02-15 Thread Mehul Batra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehul Batra updated SPARK-38218: Attachment: Screenshot_20220214-013156.jpg > Looks like the wrong package is available on the spar

[jira] [Updated] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-02-15 Thread Mehul Batra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehul Batra updated SPARK-38218: Description: !https://files.slack.com/files-pri/T4S1WH2J3-F032FA551U7/screenshot_20220214-013156.j

[jira] [Created] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

2022-02-15 Thread Mehul Batra (Jira)
Mehul Batra created SPARK-38218: --- Summary: Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2 Key: SPARK-38218 URL:

[jira] [Commented] (SPARK-37913) Null Pointer Exception when Loading ML Pipeline Model with Custom Transformer

2022-02-15 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492517#comment-17492517 ] zhengruifeng commented on SPARK-37913: -- does the `MyTransformer` in the example wor

[jira] [Commented] (SPARK-38112) Use error classes in the execution errors of date/timestamp handling

2022-02-15 Thread huangtengfei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492514#comment-17492514 ] huangtengfei commented on SPARK-38112: -- I will work on this. Thanks [~maxgekk] > U

[jira] [Commented] (SPARK-38124) Revive HashClusteredDistribution and apply to stream-stream join

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492506#comment-17492506 ] Apache Spark commented on SPARK-38124: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-38124) Revive HashClusteredDistribution and apply to stream-stream join

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492505#comment-17492505 ] Apache Spark commented on SPARK-38124: -- User 'c21' has created a pull request for t

[jira] [Updated] (SPARK-38217) insert overwrite failed for external table with dynamic partition table

2022-02-15 Thread YuanGuanhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuanGuanhu updated SPARK-38217: --- Affects Version/s: (was: 3.3.0) > insert overwrite failed for external table with dynamic partit

[jira] [Updated] (SPARK-38217) insert overwrite failed for external table with dynamic partition table

2022-02-15 Thread YuanGuanhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuanGuanhu updated SPARK-38217: --- Description: can't insert overwrite dynamic partition table, reproduce step with spark3.2.1 hadoop

[jira] [Created] (SPARK-38217) insert overwrite failed for external table with dynamic partition table

2022-02-15 Thread YuanGuanhu (Jira)
YuanGuanhu created SPARK-38217: -- Summary: insert overwrite failed for external table with dynamic partition table Key: SPARK-38217 URL: https://issues.apache.org/jira/browse/SPARK-38217 Project: Spark

[jira] [Commented] (SPARK-38215) InsertIntoHiveDir support convert metadata

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492490#comment-17492490 ] Apache Spark commented on SPARK-38215: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-38215) InsertIntoHiveDir support convert metadata

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38215: Assignee: Apache Spark > InsertIntoHiveDir support convert metadata > ---

[jira] [Assigned] (SPARK-38215) InsertIntoHiveDir support convert metadata

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38215: Assignee: (was: Apache Spark) > InsertIntoHiveDir support convert metadata >

[jira] [Commented] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492489#comment-17492489 ] Apache Spark commented on SPARK-38216: -- User 'Yikf' has created a pull request for

[jira] [Commented] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492488#comment-17492488 ] Apache Spark commented on SPARK-38216: -- User 'Yikf' has created a pull request for

[jira] [Assigned] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38216: Assignee: (was: Apache Spark) > When creating a Hive table, fail early if all the col

[jira] [Assigned] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38216: Assignee: Apache Spark > When creating a Hive table, fail early if all the columns are pa

[jira] [Created] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

2022-02-15 Thread yikf (Jira)
yikf created SPARK-38216: Summary: When creating a Hive table, fail early if all the columns are partitioned columns Key: SPARK-38216 URL: https://issues.apache.org/jira/browse/SPARK-38216 Project: Spark

[jira] [Updated] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

2022-02-15 Thread yikf (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yikf updated SPARK-38216: - Description: In Hive the schema and partition columns must be disjoint sets, if hive table which all columns ar

[jira] [Created] (SPARK-38215) InsertIntoHiveDir support convert metadata

2022-02-15 Thread angerszhu (Jira)
angerszhu created SPARK-38215: - Summary: InsertIntoHiveDir support convert metadata Key: SPARK-38215 URL: https://issues.apache.org/jira/browse/SPARK-38215 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-38214) No need to filter data when the sliding window length is not redundant

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38214: Assignee: (was: Apache Spark) > No need to filter data when the sliding window length

[jira] [Commented] (SPARK-38214) No need to filter data when the sliding window length is not redundant

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492460#comment-17492460 ] Apache Spark commented on SPARK-38214: -- User 'nyingping' has created a pull request

[jira] [Assigned] (SPARK-38214) No need to filter data when the sliding window length is not redundant

2022-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38214: Assignee: Apache Spark > No need to filter data when the sliding window length is not red

[jira] [Commented] (SPARK-36808) Upgrade Kafka to 2.8.1

2022-02-15 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492452#comment-17492452 ] Kousuke Saruta commented on SPARK-36808: Ah, O.K. I misunderstood. I'll withdraw

[jira] [Created] (SPARK-38214) No need to filter data when the sliding window length is not redundant

2022-02-15 Thread nyingping (Jira)
nyingping created SPARK-38214: - Summary: No need to filter data when the sliding window length is not redundant Key: SPARK-38214 URL: https://issues.apache.org/jira/browse/SPARK-38214 Project: Spark

[jira] [Commented] (SPARK-36808) Upgrade Kafka to 2.8.1

2022-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492440#comment-17492440 ] Dongjoon Hyun commented on SPARK-36808: --- I approved the first one and added commen

[jira] [Commented] (SPARK-36808) Upgrade Kafka to 2.8.1

2022-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492437#comment-17492437 ] Dongjoon Hyun commented on SPARK-36808: --- Please consider `branch-3.2` only. > Upg

  1   2   >