[jira] [Commented] (SPARK-31164) Inconsistent rdd and output partitioning for bucket table when output doesn't contain all bucket columns

[ https://issues.apache.org/jira/browse/SPARK-31164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060670#comment-17060670 ] Zhenhua Wang commented on SPARK-31164: -- Thanks [~dongjoon], I added 2.3.4 and 2.2.3

[jira] [Updated] (SPARK-31164) Inconsistent rdd and output partitioning for bucket table when output doesn't contain all bucket columns

[ https://issues.apache.org/jira/browse/SPARK-31164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-31164: - Affects Version/s: 2.2.3 2.3.4 > Inconsistent rdd and output partitioning

[jira] [Resolved] (SPARK-25355) Support --proxy-user for Spark on K8s

[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25355. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27422 [https://

[jira] [Assigned] (SPARK-25355) Support --proxy-user for Spark on K8s

[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25355: - Assignee: Pedro Gonçalves Rossi Rodrigues > Support --proxy-user for Spark on K8s > ---

[jira] [Resolved] (SPARK-31166) UNION map and other maps should not fail

[ https://issues.apache.org/jira/browse/SPARK-31166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31166. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27926 [https://gith

[jira] [Updated] (SPARK-30873) Handling Node Decommissioning for Yarn cluster manger in Spark

[ https://issues.apache.org/jira/browse/SPARK-30873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Chawla updated SPARK-30873: --- Description: In many public cloud environments, the node loss (in case of AWS SpotLoss,Spot

[jira] [Resolved] (SPARK-28423) merge Scan and Batch/Stream

[ https://issues.apache.org/jira/browse/SPARK-28423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28423. - Assignee: (was: Wenchen Fan) Resolution: Won't Fix > merge Scan and Batch/Stream > ---

[jira] [Updated] (SPARK-28423) merge Scan and Batch/Stream

[ https://issues.apache.org/jira/browse/SPARK-28423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-28423: Affects Version/s: (was: 3.1.0) 3.0.0 > merge Scan and Batch/Stream > -

[jira] [Updated] (SPARK-27856) do not forcibly add cast when inserting table

[ https://issues.apache.org/jira/browse/SPARK-27856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-27856: Affects Version/s: (was: 3.1.0) 3.0.0 > do not forcibly add cast when i

[jira] [Updated] (SPARK-29331) create DS v2 Write at physical plan

[ https://issues.apache.org/jira/browse/SPARK-29331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29331: Affects Version/s: (was: 3.1.0) 3.0.0 > create DS v2 Write at physical

[jira] [Resolved] (SPARK-29331) create DS v2 Write at physical plan

[ https://issues.apache.org/jira/browse/SPARK-29331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29331. - Assignee: (was: Wenchen Fan) Resolution: Won't Fix > create DS v2 Write at physical pl

[jira] [Resolved] (SPARK-27856) do not forcibly add cast when inserting table

[ https://issues.apache.org/jira/browse/SPARK-27856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27856. - Assignee: (was: Wenchen Fan) Resolution: Won't Fix This is not needed anymore as we ha

[jira] [Updated] (SPARK-25083) remove the type erasure hack in data source scan

[ https://issues.apache.org/jira/browse/SPARK-25083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-25083: Affects Version/s: (was: 3.1.0) 3.0.0 > remove the type erasure hack in

[jira] [Resolved] (SPARK-25083) remove the type erasure hack in data source scan

[ https://issues.apache.org/jira/browse/SPARK-25083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25083. - Fix Version/s: 3.0.0 Resolution: Fixed This is done after we introduce the columnar execu

[jira] [Updated] (SPARK-31019) make it clear that people can deduplicate map keys

[ https://issues.apache.org/jira/browse/SPARK-31019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31019: Affects Version/s: (was: 3.1.0) 3.0.0 > make it clear that people can d

[jira] [Resolved] (SPARK-31019) make it clear that people can deduplicate map keys

[ https://issues.apache.org/jira/browse/SPARK-31019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31019. - Fix Version/s: 3.0.0 Resolution: Fixed > make it clear that people can deduplicate map ke

[jira] [Resolved] (SPARK-26590) make fetch-block-to-disk backward compatible

[ https://issues.apache.org/jira/browse/SPARK-26590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-26590. - Assignee: (was: Wenchen Fan) Resolution: Won't Fix > make fetch-block-to-disk backward

[jira] [Updated] (SPARK-26590) make fetch-block-to-disk backward compatible

[ https://issues.apache.org/jira/browse/SPARK-26590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-26590: Affects Version/s: (was: 3.1.0) 3.0.0 > make fetch-block-to-disk backwa

[jira] [Resolved] (SPARK-29439) DDL commands should not use DataSourceV2Relation

[ https://issues.apache.org/jira/browse/SPARK-29439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29439. - Assignee: (was: Wenchen Fan) Resolution: Won't Fix > DDL commands should not use DataS

[jira] [Updated] (SPARK-29439) DDL commands should not use DataSourceV2Relation

[ https://issues.apache.org/jira/browse/SPARK-29439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29439: Affects Version/s: (was: 3.1.0) 3.0.0 > DDL commands should not use Dat

[jira] [Updated] (SPARK-31116) PrquetRowConverter does not follow case sensitivity

[ https://issues.apache.org/jira/browse/SPARK-31116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31116: -- Parent: SPARK-25603 Issue Type: Sub-task (was: Bug) > PrquetRowConverter does not fol

[jira] [Updated] (SPARK-29374) do not allow arbitrary v2 catalog as session catalog

[ https://issues.apache.org/jira/browse/SPARK-29374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29374: Affects Version/s: (was: 3.1.0) 3.0.0 > do not allow arbitrary v2 catal

[jira] [Resolved] (SPARK-29374) do not allow arbitrary v2 catalog as session catalog

[ https://issues.apache.org/jira/browse/SPARK-29374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29374. - Assignee: (was: Wenchen Fan) Resolution: Won't Fix > do not allow arbitrary v2 catalog

[jira] [Updated] (SPARK-29927) Parse timestamps in microsecond precision by `to_timestamp`, `to_unix_timestamp`, `unix_timestamp`

[ https://issues.apache.org/jira/browse/SPARK-29927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29927: Affects Version/s: (was: 3.1.0) 3.0.0 > Parse timestamps in microsecond

[jira] [Commented] (SPARK-29927) Parse timestamps in microsecond precision by `to_timestamp`, `to_unix_timestamp`, `unix_timestamp`

[ https://issues.apache.org/jira/browse/SPARK-29927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060614#comment-17060614 ] Wenchen Fan commented on SPARK-29927: - This is done in 3.0 as we switch to the java

[jira] [Resolved] (SPARK-29927) Parse timestamps in microsecond precision by `to_timestamp`, `to_unix_timestamp`, `unix_timestamp`

[ https://issues.apache.org/jira/browse/SPARK-29927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29927. - Fix Version/s: 3.0.0 Assignee: Maxim Gekk Resolution: Fixed > Parse timestamps i

[jira] [Resolved] (SPARK-30307) remove ReusedQueryStageExec

[ https://issues.apache.org/jira/browse/SPARK-30307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30307. - Fix Version/s: 3.0.0 Resolution: Fixed > remove ReusedQueryStageExec > --

[jira] [Updated] (SPARK-30307) remove ReusedQueryStageExec

[ https://issues.apache.org/jira/browse/SPARK-30307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30307: Affects Version/s: (was: 3.1.0) 3.0.0 > remove ReusedQueryStageExec > -

[jira] [Created] (SPARK-31170) Spark Cli does not respect hive-site.xml and spark.sql.warehouse.dir

Kent Yao created SPARK-31170: Summary: Spark Cli does not respect hive-site.xml and spark.sql.warehouse.dir Key: SPARK-31170 URL: https://issues.apache.org/jira/browse/SPARK-31170 Project: Spark

[jira] [Assigned] (SPARK-25826) Kerberos Support in Kubernetes resource manager

[ https://issues.apache.org/jira/browse/SPARK-25826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25826: - Assignee: Ilan Filonenko > Kerberos Support in Kubernetes resource manager > --

[jira] [Commented] (SPARK-25826) Kerberos Support in Kubernetes resource manager

[ https://issues.apache.org/jira/browse/SPARK-25826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060603#comment-17060603 ] Dongjoon Hyun commented on SPARK-25826: --- Hi, [~ifilonenko]. Can we resolve this um

[jira] [Updated] (SPARK-25355) Support --proxy-user for Spark on K8s

[ https://issues.apache.org/jira/browse/SPARK-25355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25355: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support --proxy-user for Sp

[jira] [Updated] (SPARK-25299) Use remote storage for persisting shuffle data

[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25299: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Use remote storage for pers

[jira] [Updated] (SPARK-24818) Ensure all the barrier tasks in the same stage are launched together

[ https://issues.apache.org/jira/browse/SPARK-24818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24818: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Ensure all the barrier task

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060574#comment-17060574 ] Dongjoon Hyun commented on SPARK-24432: --- I updated the affected version from 3.0.0

[jira] [Updated] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24432: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add support for dynamic res

[jira] [Updated] (SPARK-23482) R support for robust regression with Huber loss

[ https://issues.apache.org/jira/browse/SPARK-23482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23482: -- Affects Version/s: (was: 3.0.0) 3.1.0 > R support for robust regres

[jira] [Resolved] (SPARK-21505) A dynamic join operator to improve the join reliability

[ https://issues.apache.org/jira/browse/SPARK-21505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-21505. --- Resolution: Incomplete I close this issue due to long inactivity. Please feel free to reopen

[jira] [Updated] (SPARK-23443) Spark with Glue as external catalog

[ https://issues.apache.org/jira/browse/SPARK-23443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23443: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Spark with Glue as external

[jira] [Resolved] (SPARK-31148) Switching inner join statement yield different result

[ https://issues.apache.org/jira/browse/SPARK-31148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-31148. - Resolution: Won't Fix > Switching inner join statement yield different result >

[jira] [Commented] (SPARK-31148) Switching inner join statement yield different result

[ https://issues.apache.org/jira/browse/SPARK-31148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060572#comment-17060572 ] L. C. Hsieh commented on SPARK-31148: - I see. This seems to be Amazon EMR Spark cust

[jira] [Resolved] (SPARK-30569) Add DSL functions invoking percentile_approx

[ https://issues.apache.org/jira/browse/SPARK-30569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30569. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27278 [https://gi

[jira] [Assigned] (SPARK-30569) Add DSL functions invoking percentile_approx

[ https://issues.apache.org/jira/browse/SPARK-30569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30569: Assignee: Maciej Szymkiewicz > Add DSL functions invoking percentile_approx > ---

[jira] [Reopened] (SPARK-23367) Include python document style checking

[ https://issues.apache.org/jira/browse/SPARK-23367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-23367: -- Assignee: (was: Rekha Joshi) Reverted at SPARK-31155 and https://github.com/apache/spark

[jira] [Resolved] (SPARK-31155) Remove pydocstyle tests

[ https://issues.apache.org/jira/browse/SPARK-31155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31155. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27912 [https://gi

[jira] [Assigned] (SPARK-31155) Remove pydocstyle tests

[ https://issues.apache.org/jira/browse/SPARK-31155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31155: Assignee: Nicholas Chammas > Remove pydocstyle tests > --- > >

[jira] [Commented] (SPARK-31148) Switching inner join statement yield different result

[ https://issues.apache.org/jira/browse/SPARK-31148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060567#comment-17060567 ] Tanapol Nearunchorn commented on SPARK-31148: - I use spark on Amazon EMR 5.2

[jira] [Updated] (SPARK-31169) Random Forest in SparkML 2.3.3 vs 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-31169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Nhanduc updated SPARK-31169: --- Labels: MLLib, RandomForest SparkML (was: ) > Random Forest in SparkML 2.3.3 vs 2.4.x > ---

[jira] [Updated] (SPARK-31169) Random Forest in SparkML 2.3.3 vs 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-31169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Nhanduc updated SPARK-31169: --- Attachment: spark243.jpg > Random Forest in SparkML 2.3.3 vs 2.4.x > ---

[jira] [Updated] (SPARK-31169) Random Forest in SparkML 2.3.3 vs 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-31169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Nhanduc updated SPARK-31169: --- Attachment: (was: spark244.jpg) > Random Forest in SparkML 2.3.3 vs 2.4.x >

[jira] [Updated] (SPARK-31169) Random Forest in SparkML 2.3.3 vs 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-31169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Nhanduc updated SPARK-31169: --- Description: Hi all, When I trained the model with the Random Forest algorithm, I got diffe

[jira] [Updated] (SPARK-31169) Random Forest in SparkML 2.3.3 vs 2.4.x

[ https://issues.apache.org/jira/browse/SPARK-31169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nguyen Nhanduc updated SPARK-31169: --- Attachment: spark233.jpg spark240.jpg spark244.jpg > Random

[jira] [Created] (SPARK-31169) Random Forest in SparkML 2.3.3 vs 2.4.x

Nguyen Nhanduc created SPARK-31169: -- Summary: Random Forest in SparkML 2.3.3 vs 2.4.x Key: SPARK-31169 URL: https://issues.apache.org/jira/browse/SPARK-31169 Project: Spark Issue Type: Quest

[jira] [Updated] (SPARK-31162) Provide Configuration Parameter to select/enforce the Hive Hash for Bucketing

[ https://issues.apache.org/jira/browse/SPARK-31162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31162: - Affects Version/s: (was: 2.4.5) 3.1.0 > Provide Configuration

[jira] [Commented] (SPARK-31162) Provide Configuration Parameter to select/enforce the Hive Hash for Bucketing

[ https://issues.apache.org/jira/browse/SPARK-31162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060540#comment-17060540 ] Takeshi Yamamuro commented on SPARK-31162: -- I've checked the original PR ([http

[jira] [Updated] (SPARK-26185) add weightCol in python MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-26185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26185: -- Affects Version/s: (was: 3.0.0) 3.1.0 > add weightCol in python Mul

[jira] [Updated] (SPARK-29929) Allow V2 Datasources to require a data distribution

[ https://issues.apache.org/jira/browse/SPARK-29929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29929: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Allow V2 Datasources to req

[jira] [Updated] (SPARK-30273) Add melt() function

[ https://issues.apache.org/jira/browse/SPARK-30273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30273: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add melt() function > -

[jira] [Updated] (SPARK-27093) Honor ParseMode in AvroFileFormat

[ https://issues.apache.org/jira/browse/SPARK-27093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27093: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Honor ParseMode in AvroFile

[jira] [Updated] (SPARK-29439) DDL commands should not use DataSourceV2Relation

[ https://issues.apache.org/jira/browse/SPARK-29439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29439: -- Affects Version/s: (was: 3.0.0) 3.1.0 > DDL commands should not use

[jira] [Updated] (SPARK-28629) Capture the missing rules in HiveSessionStateBuilder

[ https://issues.apache.org/jira/browse/SPARK-28629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28629: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Capture the missing rules i

[jira] [Updated] (SPARK-30444) The same job will be computated for many times when using Dataset.show()

[ https://issues.apache.org/jira/browse/SPARK-30444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30444: -- Affects Version/s: (was: 3.0.0) 3.1.0 > The same job will be comput

[jira] [Updated] (SPARK-23609) Test EnsureRequirements's test cases to eliminate ShuffleExchange while is not expected

[ https://issues.apache.org/jira/browse/SPARK-23609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23609: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Test EnsureRequirements's t

[jira] [Updated] (SPARK-30469) Partition columns should not be involved when calculating sizeInBytes of Project logical plan

[ https://issues.apache.org/jira/browse/SPARK-30469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30469: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Partition columns should no

[jira] [Updated] (SPARK-29927) Parse timestamps in microsecond precision by `to_timestamp`, `to_unix_timestamp`, `unix_timestamp`

[ https://issues.apache.org/jira/browse/SPARK-29927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29927: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Parse timestamps in microse

[jira] [Updated] (SPARK-26987) Add a new method to RowFactory: Row with schema

[ https://issues.apache.org/jira/browse/SPARK-26987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26987: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add a new method to RowFact

[jira] [Updated] (SPARK-30046) linalg parity between scala and py sides

[ https://issues.apache.org/jira/browse/SPARK-30046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30046: -- Affects Version/s: (was: 3.0.0) 3.1.0 > linalg parity between scala

[jira] [Updated] (SPARK-30953) InsertAdaptiveSparkPlan should also skip v2 command

[ https://issues.apache.org/jira/browse/SPARK-30953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30953: -- Affects Version/s: (was: 3.0.0) 3.1.0 > InsertAdaptiveSparkPlan sho

[jira] [Updated] (SPARK-27640) Avoid duplicate lookups for datasource through provider

[ https://issues.apache.org/jira/browse/SPARK-27640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27640: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Avoid duplicate lookups for

[jira] [Updated] (SPARK-27523) Resolve scheme-less event log directory relative to default filesystem

[ https://issues.apache.org/jira/browse/SPARK-27523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27523: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Resolve scheme-less event l

[jira] [Updated] (SPARK-30846) Add AccumulatorV2 API in JavaSparkContext

[ https://issues.apache.org/jira/browse/SPARK-30846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30846: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add AccumulatorV2 API in Ja

[jira] [Updated] (SPARK-29586) spark jdbc method param lowerBound and upperBound DataType wrong

[ https://issues.apache.org/jira/browse/SPARK-29586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29586: -- Affects Version/s: (was: 3.0.0) 3.1.0 > spark jdbc method param low

[jira] [Updated] (SPARK-29785) Optimize opening a new session of Spark Thrift Server

[ https://issues.apache.org/jira/browse/SPARK-29785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29785: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Optimize opening a new sess

[jira] [Updated] (SPARK-24780) DataFrame.column_name should resolve to a distinct ref

[ https://issues.apache.org/jira/browse/SPARK-24780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24780: -- Affects Version/s: (was: 3.0.0) 3.1.0 > DataFrame.column_name shoul

[jira] [Updated] (SPARK-28867) InMemoryStore checkpoint to speed up replay log file in HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-28867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28867: -- Affects Version/s: (was: 3.0.0) 3.1.0 > InMemoryStore checkpoint to

[jira] [Updated] (SPARK-25927) Fix number of partitions returned by outputPartitioning

[ https://issues.apache.org/jira/browse/SPARK-25927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25927: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Fix number of partitions re

[jira] [Updated] (SPARK-28419) A patch for SparkThriftServer support multi-tenant authentication

[ https://issues.apache.org/jira/browse/SPARK-28419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28419: -- Affects Version/s: (was: 3.0.0) 3.1.0 > A patch for SparkThriftServ

[jira] [Updated] (SPARK-24611) Clean up OutputCommitCoordinator

[ https://issues.apache.org/jira/browse/SPARK-24611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24611: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Clean up OutputCommitCoordi

[jira] [Updated] (SPARK-27936) Support local dependency uploading from --py-files

[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27936: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support local dependency up

[jira] [Updated] (SPARK-29952) Pandas UDFs do not support vectors as input

[ https://issues.apache.org/jira/browse/SPARK-29952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29952: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Pandas UDFs do not support

[jira] [Updated] (SPARK-30548) Cached blockInfo in BlockMatrix.scala is never released

[ https://issues.apache.org/jira/browse/SPARK-30548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30548: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Cached blockInfo in BlockMa

[jira] [Updated] (SPARK-30567) setDelegateCatalog should be called if catalog has implemented CatalogExtension

[ https://issues.apache.org/jira/browse/SPARK-30567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30567: -- Affects Version/s: (was: 3.0.0) 3.1.0 > setDelegateCatalog should b

[jira] [Updated] (SPARK-30527) Add IsNotNull filter when use In, InSet and InSubQuery

[ https://issues.apache.org/jira/browse/SPARK-30527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30527: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add IsNotNull filter when u

[jira] [Updated] (SPARK-25732) Allow specifying a keytab/principal for proxy user for token renewal

[ https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25732: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Allow specifying a keytab/p

[jira] [Updated] (SPARK-27655) Persistent the table statistics to metadata after fall back to hdfs

[ https://issues.apache.org/jira/browse/SPARK-27655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27655: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Persistent the table statis

[jira] [Updated] (SPARK-27602) SparkSQL CBO can't get true size of partition table after partition pruning

[ https://issues.apache.org/jira/browse/SPARK-27602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27602: -- Affects Version/s: (was: 3.0.0) 3.1.0 > SparkSQL CBO can't get true

[jira] [Updated] (SPARK-29250) Upgrade to Hadoop 3.2.1

[ https://issues.apache.org/jira/browse/SPARK-29250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29250: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Upgrade to Hadoop 3.2.1 > -

[jira] [Updated] (SPARK-30059) Stop AsyncEventQueue when interrupted in dispatch

[ https://issues.apache.org/jira/browse/SPARK-30059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30059: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Stop AsyncEventQueue when i

[jira] [Updated] (SPARK-23719) Use correct hostname in non-host networking mode in hadoop 3 docker support

[ https://issues.apache.org/jira/browse/SPARK-23719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23719: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Use correct hostname in non

[jira] [Updated] (SPARK-28940) Subquery reuse across all subquery levels

[ https://issues.apache.org/jira/browse/SPARK-28940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28940: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Subquery reuse across all s

[jira] [Updated] (SPARK-25050) Handle more than two types in avro union types when writing avro files

[ https://issues.apache.org/jira/browse/SPARK-25050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25050: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Handle more than two types

[jira] [Updated] (SPARK-30461) details link when expanded should change the status from collapse to expand state

[ https://issues.apache.org/jira/browse/SPARK-30461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30461: -- Affects Version/s: (was: 3.0.0) 3.1.0 > details link when expanded

[jira] [Updated] (SPARK-27568) readLock leaked when method take() called on a cached rdd

[ https://issues.apache.org/jira/browse/SPARK-27568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27568: -- Affects Version/s: (was: 3.0.0) 3.1.0 > readLock leaked when method

[jira] [Updated] (SPARK-30394) Skip collecting stats in DetermineTableStats rule when hive table is convertible to datasource tables

[ https://issues.apache.org/jira/browse/SPARK-30394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30394: -- Affects Version/s: (was: 2.3.2) (was: 3.0.0)

[jira] [Updated] (SPARK-24254) Eagerly evaluate some subqueries over LocalRelation

[ https://issues.apache.org/jira/browse/SPARK-24254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24254: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Eagerly evaluate some subqu

[jira] [Updated] (SPARK-24855) Built-in AVRO support should support specified schema on write

[ https://issues.apache.org/jira/browse/SPARK-24855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24855: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Built-in AVRO support shoul

[jira] [Updated] (SPARK-30369) Prune uncomputed children of InMemoryRelation

[ https://issues.apache.org/jira/browse/SPARK-30369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30369: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Prune uncomputed children o

[jira] [Updated] (SPARK-30497) migrate DESCRIBE TABLE to the new framework

[ https://issues.apache.org/jira/browse/SPARK-30497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30497: -- Affects Version/s: (was: 3.0.0) 3.1.0 > migrate DESCRIBE TABLE to t

[jira] [Updated] (SPARK-26238) Set SPARK_CONF_DIR to be ${SPARK_HOME}/conf for K8S

[ https://issues.apache.org/jira/browse/SPARK-26238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26238: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Set SPARK_CONF_DIR to be ${

[jira] [Updated] (SPARK-25342) Support rolling back a result stage

[ https://issues.apache.org/jira/browse/SPARK-25342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25342: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support rolling back a resu

  1   2   3   4   5   6   >