[jira] [Commented] (SPARK-29528) Upgrade scala-maven-plugin to 4.3.0 for Scala 2.13.1

[ https://issues.apache.org/jira/browse/SPARK-29528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971022#comment-16971022 ] Dongjoon Hyun commented on SPARK-29528: --- Since 4.3.0 has the window fix, I made a

[jira] [Updated] (SPARK-29528) Upgrade scala-maven-plugin to 4.3.0 for Scala 2.13.1

[ https://issues.apache.org/jira/browse/SPARK-29528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29528: -- Description: Scala 2.13.1 seems to break the binary compatibility. We need to upgrade `scala-

[jira] [Updated] (SPARK-29528) Upgrade scala-maven-plugin to 4.3.0 for Scala 2.13.1

[ https://issues.apache.org/jira/browse/SPARK-29528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29528: -- Summary: Upgrade scala-maven-plugin to 4.3.0 for Scala 2.13.1 (was: Upgrade scala-maven-plugi

[jira] [Commented] (SPARK-29821) Allow calling non-aggregate SQL functions with column name

[ https://issues.apache.org/jira/browse/SPARK-29821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971016#comment-16971016 ] Aman Omer commented on SPARK-29821: --- Checking this issue. [~MaxHartwig] > Allow calli

[jira] [Updated] (SPARK-29649) Stop task set if FileAlreadyExistsException was thrown when writing to output file

[ https://issues.apache.org/jira/browse/SPARK-29649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29649: -- Component/s: (was: SQL) Spark Core > Stop task set if FileAlreadyExistsEx

[jira] [Updated] (SPARK-29649) Stop task set if FileAlreadyExistsException was thrown when writing to output file

[ https://issues.apache.org/jira/browse/SPARK-29649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29649: -- Component/s: SQL > Stop task set if FileAlreadyExistsException was thrown when writing to outp

[jira] [Updated] (SPARK-29799) Split a kafka partition into multiple KafkaRDD partitions in the kafka external plugin for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-29799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-29799: Attachment: 0001-add-implementation-for-issue-SPARK-29799.patch > Split a kafka partition into multiple Ka

[jira] [Updated] (SPARK-29791) Add a spark config to allow user to use executor cores virtually.

[ https://issues.apache.org/jira/browse/SPARK-29791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-29791: Attachment: 0001-add-implementation-for-issue-SPARK-29791.patch > Add a spark config to allow user to use

[jira] [Updated] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29682: -- Component/s: (was: Spark Core) SQL > Failure when resolving conflicting r

[jira] [Updated] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29682: -- Affects Version/s: 2.1.3 > Failure when resolving conflicting references in Join: > --

[jira] [Updated] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29682: -- Component/s: (was: Spark Submit) (was: Spark Shell) > Failure when re

[jira] [Updated] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29682: -- Affects Version/s: 2.2.3 > Failure when resolving conflicting references in Join: > --

[jira] [Updated] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29682: -- Affects Version/s: 2.3.4 > Failure when resolving conflicting references in Join: > --

[jira] [Assigned] (SPARK-29730) ALTER VIEW QUERY should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29730: - Assignee: Huaxin Gao > ALTER VIEW QUERY should look up catalog/table like v2 commands >

[jira] [Resolved] (SPARK-29730) ALTER VIEW QUERY should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29730. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26453 [https://

[jira] [Created] (SPARK-29821) Allow calling non-aggregate SQL functions with column name

Max Härtwig created SPARK-29821: --- Summary: Allow calling non-aggregate SQL functions with column name Key: SPARK-29821 URL: https://issues.apache.org/jira/browse/SPARK-29821 Project: Spark Issu

[jira] [Updated] (SPARK-29820) Use GitHub Action Cache for `./.m2/repository`

[ https://issues.apache.org/jira/browse/SPARK-29820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29820: -- Summary: Use GitHub Action Cache for `./.m2/repository` (was: Use GitHub Action cache for `./

[jira] [Created] (SPARK-29820) Use GitHub Action cache for `./.m2/repository`

Dongjoon Hyun created SPARK-29820: - Summary: Use GitHub Action cache for `./.m2/repository` Key: SPARK-29820 URL: https://issues.apache.org/jira/browse/SPARK-29820 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29654) Add configuration to allow disabling registration of static sources to the metrics system

[ https://issues.apache.org/jira/browse/SPARK-29654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29654. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26320 [https://

[jira] [Assigned] (SPARK-29654) Add configuration to allow disabling registration of static sources to the metrics system

[ https://issues.apache.org/jira/browse/SPARK-29654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29654: - Assignee: Luca Canali > Add configuration to allow disabling registration of static sou

[jira] [Created] (SPARK-29819) Introduce an enum for interval units

Maxim Gekk created SPARK-29819: -- Summary: Introduce an enum for interval units Key: SPARK-29819 URL: https://issues.apache.org/jira/browse/SPARK-29819 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-29818) Missing persist on RDD

[ https://issues.apache.org/jira/browse/SPARK-29818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29818: -- Issue Type: Improvement (was: Umbrella) > Missing persist on RDD > -- > >

[jira] [Updated] (SPARK-29809) Missing persist in Word2Vec.fit()

[ https://issues.apache.org/jira/browse/SPARK-29809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29809: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist in Word2Vec.fit

[jira] [Updated] (SPARK-29811) Missing persist on oldDataset in ml.RandomForestRegressor.train()

[ https://issues.apache.org/jira/browse/SPARK-29811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29811: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist on oldDataset i

[jira] [Updated] (SPARK-29810) Missing persist on retaggedInput in RandomForest.run()

[ https://issues.apache.org/jira/browse/SPARK-29810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29810: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist on retaggedInpu

[jira] [Updated] (SPARK-29812) Missing persist on predictionAndLabels in MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-29812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29812: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist on predictionAn

[jira] [Updated] (SPARK-29815) Missing persist in ml.tuning.CrossValidator.fit()

[ https://issues.apache.org/jira/browse/SPARK-29815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29815: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist in ml.tuning.Cr

[jira] [Updated] (SPARK-29814) Missing persist on sources in mllib.feature.PCA

[ https://issues.apache.org/jira/browse/SPARK-29814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29814: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist on sources in m

[jira] [Updated] (SPARK-29813) Missing persist in mllib.PrefixSpan.findFrequentItems()

[ https://issues.apache.org/jira/browse/SPARK-29813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29813: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist in mllib.Prefix

[jira] [Updated] (SPARK-29816) Missing persist in mllib.evaluation.BinaryClassificationMetrics.recallByThreshold()

[ https://issues.apache.org/jira/browse/SPARK-29816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29816: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist in > mllib.eva

[jira] [Updated] (SPARK-29817) Missing persist on docs in mllib.clustering.LDAOptimizer.initialize

[ https://issues.apache.org/jira/browse/SPARK-29817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29817: -- Parent: SPARK-29818 Issue Type: Sub-task (was: Improvement) > Missing persist on docs in mlli

[jira] [Updated] (SPARK-29818) Missing persist on RDD

[ https://issues.apache.org/jira/browse/SPARK-29818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29818: -- External issue ID: (was: SPARK-29817) External issue URL: (was: https://issues.apache.org/jir

[jira] [Updated] (SPARK-29818) Missing persist on RDD

[ https://issues.apache.org/jira/browse/SPARK-29818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29818: -- External issue ID: SPARK-29817 > Missing persist on RDD > -- > > K

[jira] [Updated] (SPARK-29818) Missing persist on RDD

[ https://issues.apache.org/jira/browse/SPARK-29818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Omer updated SPARK-29818: -- External issue URL: https://issues.apache.org/jira/browse/SPARK-29817 > Missing persist on RDD > -

[jira] [Created] (SPARK-29818) Missing persist on RDD

Aman Omer created SPARK-29818: - Summary: Missing persist on RDD Key: SPARK-29818 URL: https://issues.apache.org/jira/browse/SPARK-29818 Project: Spark Issue Type: Umbrella Components: M

[jira] [Updated] (SPARK-29816) Missing persist in mllib.evaluation.BinaryClassificationMetrics.recallByThreshold()

[ https://issues.apache.org/jira/browse/SPARK-29816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29816: - Priority: Minor (was: Major) > Missing persist in > mllib.evaluation.BinaryClassificationMetri

[jira] [Commented] (SPARK-29810) Missing persist on retaggedInput in RandomForest.run()

[ https://issues.apache.org/jira/browse/SPARK-29810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970909#comment-16970909 ] Aman Omer commented on SPARK-29810: --- Thanks [~spark_cachecheck] for reporting. I will

[jira] [Commented] (SPARK-29811) Missing persist on oldDataset in ml.RandomForestRegressor.train()

[ https://issues.apache.org/jira/browse/SPARK-29811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970908#comment-16970908 ] Aman Omer commented on SPARK-29811: --- Thanks [~spark_cachecheck] for reporting. I will

[jira] [Commented] (SPARK-29809) Missing persist in Word2Vec.fit()

[ https://issues.apache.org/jira/browse/SPARK-29809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970910#comment-16970910 ] Aman Omer commented on SPARK-29809: --- Thanks [~spark_cachecheck] for reporting. I will

[jira] [Commented] (SPARK-29812) Missing persist on predictionAndLabels in MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-29812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970907#comment-16970907 ] Aman Omer commented on SPARK-29812: --- Thanks [~spark_cachecheck] for reporting. I will

[jira] [Commented] (SPARK-29817) Missing persist on docs in mllib.clustering.LDAOptimizer.initialize

[ https://issues.apache.org/jira/browse/SPARK-29817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970866#comment-16970866 ] Aman Omer commented on SPARK-29817: --- Thanks [~spark_cachecheck] for reporting. I will

[jira] [Commented] (SPARK-29816) Missing persist in mllib.evaluation.BinaryClassificationMetrics.recallByThreshold()

[ https://issues.apache.org/jira/browse/SPARK-29816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970865#comment-16970865 ] Aman Omer commented on SPARK-29816: --- Thanks [~spark_cachecheck] for reporting. I will

[jira] [Created] (SPARK-29817) Missing persist on docs in mllib.clustering.LDAOptimizer.initialize

Dong Wang created SPARK-29817: - Summary: Missing persist on docs in mllib.clustering.LDAOptimizer.initialize Key: SPARK-29817 URL: https://issues.apache.org/jira/browse/SPARK-29817 Project: Spark

[jira] [Resolved] (SPARK-29795) Possible 'leak' of Metrics with dropwizard metrics 4.x

[ https://issues.apache.org/jira/browse/SPARK-29795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29795. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26427 [https://gi

[jira] [Created] (SPARK-29816) Missing persist in mllib.evaluation.BinaryClassificationMetrics.recallByThreshold()

Dong Wang created SPARK-29816: - Summary: Missing persist in mllib.evaluation.BinaryClassificationMetrics.recallByThreshold() Key: SPARK-29816 URL: https://issues.apache.org/jira/browse/SPARK-29816 Project

[jira] [Resolved] (SPARK-29788) Fix the typo errors in the SQL reference document merges

[ https://issues.apache.org/jira/browse/SPARK-29788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29788. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26424 [https://gi

[jira] [Updated] (SPARK-29788) Fix the typo errors in the SQL reference document merges

[ https://issues.apache.org/jira/browse/SPARK-29788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29788: - Priority: Trivial (was: Minor) > Fix the typo errors in the SQL reference document merges > ---

[jira] [Assigned] (SPARK-29788) Fix the typo errors in the SQL reference document merges

[ https://issues.apache.org/jira/browse/SPARK-29788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29788: Assignee: jobit mathew > Fix the typo errors in the SQL reference document merges > -

[jira] [Created] (SPARK-29815) Missing persist in ml.tuning.CrossValidator.fit()

Dong Wang created SPARK-29815: - Summary: Missing persist in ml.tuning.CrossValidator.fit() Key: SPARK-29815 URL: https://issues.apache.org/jira/browse/SPARK-29815 Project: Spark Issue Type: Impro

[jira] [Created] (SPARK-29814) Missing persist on sources in mllib.feature.PCA

Dong Wang created SPARK-29814: - Summary: Missing persist on sources in mllib.feature.PCA Key: SPARK-29814 URL: https://issues.apache.org/jira/browse/SPARK-29814 Project: Spark Issue Type: Improve

[jira] [Created] (SPARK-29813) Missing persist in mllib.PrefixSpan.findFrequentItems()

Dong Wang created SPARK-29813: - Summary: Missing persist in mllib.PrefixSpan.findFrequentItems() Key: SPARK-29813 URL: https://issues.apache.org/jira/browse/SPARK-29813 Project: Spark Issue Type:

[jira] [Created] (SPARK-29812) Missing persist on predictionAndLabels in MulticlassClassificationEvaluator

Dong Wang created SPARK-29812: - Summary: Missing persist on predictionAndLabels in MulticlassClassificationEvaluator Key: SPARK-29812 URL: https://issues.apache.org/jira/browse/SPARK-29812 Project: Spark

[jira] [Resolved] (SPARK-29385) Make `INTERVAL` values comparable

[ https://issues.apache.org/jira/browse/SPARK-29385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-29385. Fix Version/s: 3.0.0 Resolution: Fixed Resolved by the PR: https://github.com/apache/spark/

[jira] [Updated] (SPARK-29811) Missing persist on oldDataset in ml.RandomForestRegressor.train()

[ https://issues.apache.org/jira/browse/SPARK-29811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Wang updated SPARK-29811: -- Description: The rdd oldDataset in ml.regression.RandomForestRegressor.train() needs to be persisted,

[jira] [Updated] (SPARK-29811) Missing persist on oldDataset in ml.RandomForestRegressor.train()

[ https://issues.apache.org/jira/browse/SPARK-29811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Wang updated SPARK-29811: -- Description: The rdd oldDataset in ml.regression.RandomForestRegressor.train() needs to be persisted,

[jira] [Created] (SPARK-29811) Missing persist on oldDataset in ml.RandomForestRegressor.train()

Dong Wang created SPARK-29811: - Summary: Missing persist on oldDataset in ml.RandomForestRegressor.train() Key: SPARK-29811 URL: https://issues.apache.org/jira/browse/SPARK-29811 Project: Spark

[jira] [Created] (SPARK-29810) Missing persist on retaggedInput in RandomForest.run()

Dong Wang created SPARK-29810: - Summary: Missing persist on retaggedInput in RandomForest.run() Key: SPARK-29810 URL: https://issues.apache.org/jira/browse/SPARK-29810 Project: Spark Issue Type: