[jira] [Commented] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493042#comment-17493042 ] Mehul Batra commented on SPARK-38218: - When can we expect the next release? > Looks like the wrong

[jira] [Commented] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493041#comment-17493041 ] Hyukjin Kwon commented on SPARK-38218: -- That'd be fixed from the next release since we fixed it in

[jira] [Created] (SPARK-38227) Apply strict nullability of nested column in time window / session window

Jungtaek Lim created SPARK-38227: Summary: Apply strict nullability of nested column in time window / session window Key: SPARK-38227 URL: https://issues.apache.org/jira/browse/SPARK-38227 Project:

[jira] [Comment Edited] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493029#comment-17493029 ] Mehul Batra edited comment on SPARK-38218 at 2/16/22, 6:57 AM: --- HI

[jira] [Commented] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493029#comment-17493029 ] Mehul Batra commented on SPARK-38218: - So if I download tgz from the spark downloads page will it

[jira] [Updated] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehul Batra updated SPARK-38218: Attachment: image-2022-02-16-12-26-32-871.png > Looks like the wrong package is available on the

[jira] [Commented] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493007#comment-17493007 ] Apache Spark commented on SPARK-38226: -- User 'anchovYu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38226: Assignee: (was: Apache Spark) > Fix HiveCompatibilitySuite under ANSI mode >

[jira] [Assigned] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38226: Assignee: Apache Spark > Fix HiveCompatibilitySuite under ANSI mode >

[jira] [Commented] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493005#comment-17493005 ] Apache Spark commented on SPARK-38226: -- User 'anchovYu' has created a pull request for this issue:

[jira] [Updated] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyi Yu updated SPARK-38226: - Description: Fix

[jira] [Created] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

Xinyi Yu created SPARK-38226: Summary: Fix HiveCompatibilitySuite under ANSI mode Key: SPARK-38226 URL: https://issues.apache.org/jira/browse/SPARK-38226 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-38173) Quoted column cannot be recognized correctly when quotedRegexColumnNames is true

[ https://issues.apache.org/jira/browse/SPARK-38173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38173: --- Assignee: Tongwei > Quoted column cannot be recognized correctly when

[jira] [Resolved] (SPARK-38173) Quoted column cannot be recognized correctly when quotedRegexColumnNames is true

[ https://issues.apache.org/jira/browse/SPARK-38173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38173. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35476

[jira] [Resolved] (SPARK-38201) Fix KubernetesUtils#uploadFileToHadoopCompatibleFS use passed in `delSrc` and `overwrite`

[ https://issues.apache.org/jira/browse/SPARK-38201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38201. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35509

[jira] [Assigned] (SPARK-38201) Fix KubernetesUtils#uploadFileToHadoopCompatibleFS use passed in `delSrc` and `overwrite`

[ https://issues.apache.org/jira/browse/SPARK-38201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38201: - Assignee: Yang Jie > Fix KubernetesUtils#uploadFileToHadoopCompatibleFS use passed in

[jira] [Assigned] (SPARK-38225) Complete input validation of function to_binary

[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38225: Assignee: (was: Apache Spark) > Complete input validation of function to_binary >

[jira] [Assigned] (SPARK-38225) Complete input validation of function to_binary

[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38225: Assignee: Apache Spark > Complete input validation of function to_binary >

[jira] [Commented] (SPARK-38225) Complete input validation of function to_binary

[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492985#comment-17492985 ] Apache Spark commented on SPARK-38225: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-38225) Complete input validation of function to_binary

[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492984#comment-17492984 ] Xinrong Meng commented on SPARK-38225: -- I am working on that. > Complete input validation of

[jira] [Created] (SPARK-38225) Complete input validation of function to_binary

Xinrong Meng created SPARK-38225: Summary: Complete input validation of function to_binary Key: SPARK-38225 URL: https://issues.apache.org/jira/browse/SPARK-38225 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38224) How do I get a lot of results in KDE

[ https://issues.apache.org/jira/browse/SPARK-38224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Wan updated SPARK-38224: Priority: Trivial (was: Major) > How do I get a lot of results in KDE >

[jira] [Created] (SPARK-38224) How do I get a lot of results in KDE

Ben Wan created SPARK-38224: --- Summary: How do I get a lot of results in KDE Key: SPARK-38224 URL: https://issues.apache.org/jira/browse/SPARK-38224 Project: Spark Issue Type: Question

[jira] [Commented] (SPARK-38223) PersistentVolumeClaim does not work in clusters with multiple nodes

[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492960#comment-17492960 ] Zimo Li commented on SPARK-38223: - [~hyukjin.kwon] Sorry I missed that. I just added a title. >

[jira] [Updated] (SPARK-38223) PersistentVolumeClaim does not work in clusters with multiple nodes

[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zimo Li updated SPARK-38223: Summary: PersistentVolumeClaim does not work in clusters with multiple nodes (was: Spark) >

[jira] [Resolved] (SPARK-38221) Group by a stream of complex expressions fails

[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38221. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/35537 > Group by a stream of

[jira] [Updated] (SPARK-38221) Group by a stream of complex expressions fails

[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38221: - Fix Version/s: 3.3.0 3.2.2 > Group by a stream of complex expressions fails

[jira] [Resolved] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38218. -- Resolution: Duplicate probably it's a duplicate of SPARK-37445 > Looks like the wrong

[jira] [Commented] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492952#comment-17492952 ] Hyukjin Kwon commented on SPARK-38218: -- [~ME_BAT] the images are broken. mind checking this please?

[jira] [Commented] (SPARK-38223) Spark

[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492951#comment-17492951 ] Hyukjin Kwon commented on SPARK-38223: -- [~lizimo] mind fixing the JIRA title to summarize the

[jira] [Assigned] (SPARK-38221) Group by a stream of complex expressions fails

[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38221: Assignee: Apache Spark > Group by a stream of complex expressions fails >

[jira] [Commented] (SPARK-38221) Group by a stream of complex expressions fails

[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492944#comment-17492944 ] Apache Spark commented on SPARK-38221: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-38221) Group by a stream of complex expressions fails

[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38221: Assignee: (was: Apache Spark) > Group by a stream of complex expressions fails >

[jira] [Assigned] (SPARK-38222) Expose Node Description attribute in SQL Rest API

[ https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38222: Assignee: (was: Apache Spark) > Expose Node Description attribute in SQL Rest API >

[jira] [Commented] (SPARK-38222) Expose Node Description attribute in SQL Rest API

[ https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492927#comment-17492927 ] Apache Spark commented on SPARK-38222: -- User 'erenavsarogullari' has created a pull request for

[jira] [Assigned] (SPARK-38222) Expose Node Description attribute in SQL Rest API

[ https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38222: Assignee: Apache Spark > Expose Node Description attribute in SQL Rest API >

[jira] [Resolved] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-38220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38220. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35535

[jira] [Assigned] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-38220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38220: Assignee: Dongjoon Hyun > Upgrade `commons-math3` to 3.6.1 >

[jira] [Created] (SPARK-38223) Spark

Zimo Li created SPARK-38223: --- Summary: Spark Key: SPARK-38223 URL: https://issues.apache.org/jira/browse/SPARK-38223 Project: Spark Issue Type: Bug Components: Kubernetes Affects

[jira] [Created] (SPARK-38222) Expose nodeDesc attribute in SQL Rest API

Eren Avsarogullari created SPARK-38222: -- Summary: Expose nodeDesc attribute in SQL Rest API Key: SPARK-38222 URL: https://issues.apache.org/jira/browse/SPARK-38222 Project: Spark Issue

[jira] [Updated] (SPARK-38222) Expose Node Description attribute in SQL Rest API

[ https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-38222: --- Summary: Expose Node Description attribute in SQL Rest API (was: Expose nodeDesc

[jira] [Commented] (SPARK-38205) The columns in state schema should be relaxed to be nullable

[ https://issues.apache.org/jira/browse/SPARK-38205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492895#comment-17492895 ] Jungtaek Lim commented on SPARK-38205: -- I realized the output schema should also be nullable (since

[jira] [Commented] (SPARK-38221) Group by a stream of complex expressions fails

[ https://issues.apache.org/jira/browse/SPARK-38221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492869#comment-17492869 ] Bruce Robbins commented on SPARK-38221: --- I think I have an idea what's going on. I will submit a

[jira] [Created] (SPARK-38221) Group by a stream of complex expressions fails

Bruce Robbins created SPARK-38221: - Summary: Group by a stream of complex expressions fails Key: SPARK-38221 URL: https://issues.apache.org/jira/browse/SPARK-38221 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38115) No spark conf to control the path of _temporary when writing to target filesystem

[ https://issues.apache.org/jira/browse/SPARK-38115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492824#comment-17492824 ] kk commented on SPARK-38115: Is there any config as such to stop using FileOutputCommiter, because we didn't

[jira] [Assigned] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-38220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38220: Assignee: Apache Spark > Upgrade `commons-math3` to 3.6.1 >

[jira] [Assigned] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-38220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38220: Assignee: (was: Apache Spark) > Upgrade `commons-math3` to 3.6.1 >

[jira] [Commented] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-38220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492823#comment-17492823 ] Apache Spark commented on SPARK-38220: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-38220) Upgrade `commons-math3` to 3.6.1

Dongjoon Hyun created SPARK-38220: - Summary: Upgrade `commons-math3` to 3.6.1 Key: SPARK-38220 URL: https://issues.apache.org/jira/browse/SPARK-38220 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-38115) No spark conf to control the path of _temporary when writing to target filesystem

[ https://issues.apache.org/jira/browse/SPARK-38115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492810#comment-17492810 ] Steve Loughran commented on SPARK-38115: * stop using the classic FileOutputCommitter for your

[jira] [Commented] (SPARK-38115) No spark conf to control the path of _temporary when writing to target filesystem

[ https://issues.apache.org/jira/browse/SPARK-38115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492785#comment-17492785 ] kk commented on SPARK-38115: Hello [~hyukjin.kwon] did you get a chance to look into this > No spark conf

[jira] [Resolved] (SPARK-38130) array_sort does not allow non-orderable datatypes

[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38130. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35426

[jira] [Assigned] (SPARK-38130) array_sort does not allow non-orderable datatypes

[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38130: --- Assignee: Steven Aerts > array_sort does not allow non-orderable datatypes >

[jira] [Updated] (SPARK-36808) Upgrade Kafka to 2.8.1

[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36808: --- Fix Version/s: 3.2.2 > Upgrade Kafka to 2.8.1 > -- > >

[jira] [Updated] (SPARK-36808) Upgrade Kafka to 2.8.1

[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36808: --- Affects Version/s: 3.2.1 > Upgrade Kafka to 2.8.1 > -- > >

[jira] [Commented] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492616#comment-17492616 ] Maciej Szymkiewicz commented on SPARK-37425: Hi [~amirkdv] Just FYI ‒ most of the blockers

[jira] [Assigned] (SPARK-37413) Inline type hints for python/pyspark/ml/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37413: -- Assignee: dch nguyen > Inline type hints for python/pyspark/ml/tree.py >

[jira] [Resolved] (SPARK-37413) Inline type hints for python/pyspark/ml/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37413. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py

[ https://issues.apache.org/jira/browse/SPARK-37428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37428: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/mllib/util.py >

[jira] [Assigned] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py

[ https://issues.apache.org/jira/browse/SPARK-37428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37428: Assignee: Apache Spark > Inline type hints for python/pyspark/mllib/util.py >

[jira] [Commented] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py

[ https://issues.apache.org/jira/browse/SPARK-37428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492599#comment-17492599 ] Apache Spark commented on SPARK-37428: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38199) Delete the unused `dataType` specified in the definition of `IntervalColumnAccessor`

[ https://issues.apache.org/jira/browse/SPARK-38199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38199: Assignee: Yang Jie > Delete the unused `dataType` specified in the definition of >

[jira] [Resolved] (SPARK-38199) Delete the unused `dataType` specified in the definition of `IntervalColumnAccessor`

[ https://issues.apache.org/jira/browse/SPARK-38199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38199. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35507

[jira] [Assigned] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

[ https://issues.apache.org/jira/browse/SPARK-38219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38219: Assignee: Apache Spark > Support ANSI aggregation function percentile_cont as window

[jira] [Assigned] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

[ https://issues.apache.org/jira/browse/SPARK-38219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38219: Assignee: (was: Apache Spark) > Support ANSI aggregation function percentile_cont as

[jira] [Commented] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

[ https://issues.apache.org/jira/browse/SPARK-38219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492571#comment-17492571 ] Apache Spark commented on SPARK-38219: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

[ https://issues.apache.org/jira/browse/SPARK-38219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492572#comment-17492572 ] Apache Spark commented on SPARK-38219: -- User 'beliefer' has created a pull request for this issue:

[jira] [Created] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

jiaan.geng created SPARK-38219: -- Summary: Support ANSI aggregation function percentile_cont as window function Key: SPARK-38219 URL: https://issues.apache.org/jira/browse/SPARK-38219 Project: Spark

[jira] [Commented] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492558#comment-17492558 ] Apache Spark commented on SPARK-37405: -- User 'dchvn' has created a pull request for this issue:

[jira] [Commented] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492559#comment-17492559 ] Apache Spark commented on SPARK-37405: -- User 'dchvn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37405: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/feature.py >

[jira] [Assigned] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37405: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/feature.py >

[jira] [Assigned] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37405: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/ml/feature.py >

[jira] [Updated] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehul Batra updated SPARK-38218: Attachment: Screenshot_20220214-013156.jpg > Looks like the wrong package is available on the

[jira] [Updated] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

[ https://issues.apache.org/jira/browse/SPARK-38218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehul Batra updated SPARK-38218: Description:

[jira] [Created] (SPARK-38218) Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2

Mehul Batra created SPARK-38218: --- Summary: Looks like the wrong package is available on the spark downloads page. The name reads pre built for hadoop3.3 but the tgz file is marked as hadoop3.2 Key: SPARK-38218

[jira] [Commented] (SPARK-37913) Null Pointer Exception when Loading ML Pipeline Model with Custom Transformer

[ https://issues.apache.org/jira/browse/SPARK-37913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492517#comment-17492517 ] zhengruifeng commented on SPARK-37913: -- does the `MyTransformer` in the example works? > Null

[jira] [Commented] (SPARK-38112) Use error classes in the execution errors of date/timestamp handling

[ https://issues.apache.org/jira/browse/SPARK-38112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492514#comment-17492514 ] huangtengfei commented on SPARK-38112: -- I will work on this. Thanks [~maxgekk] > Use error classes

[jira] [Commented] (SPARK-38124) Revive HashClusteredDistribution and apply to stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492506#comment-17492506 ] Apache Spark commented on SPARK-38124: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-38124) Revive HashClusteredDistribution and apply to stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492505#comment-17492505 ] Apache Spark commented on SPARK-38124: -- User 'c21' has created a pull request for this issue:

[jira] [Updated] (SPARK-38217) insert overwrite failed for external table with dynamic partition table

[ https://issues.apache.org/jira/browse/SPARK-38217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuanGuanhu updated SPARK-38217: --- Affects Version/s: (was: 3.3.0) > insert overwrite failed for external table with dynamic

[jira] [Updated] (SPARK-38217) insert overwrite failed for external table with dynamic partition table

[ https://issues.apache.org/jira/browse/SPARK-38217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YuanGuanhu updated SPARK-38217: --- Description: can't insert overwrite dynamic partition table, reproduce step with spark3.2.1 hadoop

[jira] [Created] (SPARK-38217) insert overwrite failed for external table with dynamic partition table

YuanGuanhu created SPARK-38217: -- Summary: insert overwrite failed for external table with dynamic partition table Key: SPARK-38217 URL: https://issues.apache.org/jira/browse/SPARK-38217 Project: Spark

[jira] [Commented] (SPARK-38215) InsertIntoHiveDir support convert metadata

[ https://issues.apache.org/jira/browse/SPARK-38215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492490#comment-17492490 ] Apache Spark commented on SPARK-38215: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-38215) InsertIntoHiveDir support convert metadata

[ https://issues.apache.org/jira/browse/SPARK-38215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38215: Assignee: Apache Spark > InsertIntoHiveDir support convert metadata >

[jira] [Assigned] (SPARK-38215) InsertIntoHiveDir support convert metadata

[ https://issues.apache.org/jira/browse/SPARK-38215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38215: Assignee: (was: Apache Spark) > InsertIntoHiveDir support convert metadata >

[jira] [Commented] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

[ https://issues.apache.org/jira/browse/SPARK-38216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492489#comment-17492489 ] Apache Spark commented on SPARK-38216: -- User 'Yikf' has created a pull request for this issue:

[jira] [Commented] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

[ https://issues.apache.org/jira/browse/SPARK-38216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492488#comment-17492488 ] Apache Spark commented on SPARK-38216: -- User 'Yikf' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

[ https://issues.apache.org/jira/browse/SPARK-38216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38216: Assignee: (was: Apache Spark) > When creating a Hive table, fail early if all the

[jira] [Assigned] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

[ https://issues.apache.org/jira/browse/SPARK-38216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38216: Assignee: Apache Spark > When creating a Hive table, fail early if all the columns are

[jira] [Created] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

yikf created SPARK-38216: Summary: When creating a Hive table, fail early if all the columns are partitioned columns Key: SPARK-38216 URL: https://issues.apache.org/jira/browse/SPARK-38216 Project: Spark

[jira] [Updated] (SPARK-38216) When creating a Hive table, fail early if all the columns are partitioned columns

[ https://issues.apache.org/jira/browse/SPARK-38216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yikf updated SPARK-38216: - Description: In Hive the schema and partition columns must be disjoint sets, if hive table which all columns

[jira] [Created] (SPARK-38215) InsertIntoHiveDir support convert metadata

angerszhu created SPARK-38215: - Summary: InsertIntoHiveDir support convert metadata Key: SPARK-38215 URL: https://issues.apache.org/jira/browse/SPARK-38215 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-38214) No need to filter data when the sliding window length is not redundant

[ https://issues.apache.org/jira/browse/SPARK-38214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38214: Assignee: (was: Apache Spark) > No need to filter data when the sliding window

[jira] [Commented] (SPARK-38214) No need to filter data when the sliding window length is not redundant

[ https://issues.apache.org/jira/browse/SPARK-38214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492460#comment-17492460 ] Apache Spark commented on SPARK-38214: -- User 'nyingping' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38214) No need to filter data when the sliding window length is not redundant

[ https://issues.apache.org/jira/browse/SPARK-38214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38214: Assignee: Apache Spark > No need to filter data when the sliding window length is not

[jira] [Commented] (SPARK-36808) Upgrade Kafka to 2.8.1

[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492452#comment-17492452 ] Kousuke Saruta commented on SPARK-36808: Ah, O.K. I misunderstood. I'll withdraw the PRs. >

[jira] [Created] (SPARK-38214) No need to filter data when the sliding window length is not redundant

nyingping created SPARK-38214: - Summary: No need to filter data when the sliding window length is not redundant Key: SPARK-38214 URL: https://issues.apache.org/jira/browse/SPARK-38214 Project: Spark

[jira] [Commented] (SPARK-36808) Upgrade Kafka to 2.8.1

[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492440#comment-17492440 ] Dongjoon Hyun commented on SPARK-36808: --- I approved the first one and added comments for the other

[jira] [Commented] (SPARK-36808) Upgrade Kafka to 2.8.1

[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492437#comment-17492437 ] Dongjoon Hyun commented on SPARK-36808: --- Please consider `branch-3.2` only. > Upgrade Kafka to

  1   2   >