[jira] [Commented] (SPARK-36327) Spark sql creates staging dir inside database directory rather than creating inside table directory

[ https://issues.apache.org/jira/browse/SPARK-36327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390851#comment-17390851 ] Senthil Kumar commented on SPARK-36327: --- Hi [~sunchao] Hive is creating .staging

[jira] [Created] (SPARK-36370) Avoid using SelectionMixin._builtin_table which is removed in pandas 1.3

Takuya Ueshin created SPARK-36370: - Summary: Avoid using SelectionMixin._builtin_table which is removed in pandas 1.3 Key: SPARK-36370 URL: https://issues.apache.org/jira/browse/SPARK-36370 Project: S

[jira] [Created] (SPARK-36369) Fix Index.union to follow pandas 1.3

Takuya Ueshin created SPARK-36369: - Summary: Fix Index.union to follow pandas 1.3 Key: SPARK-36369 URL: https://issues.apache.org/jira/browse/SPARK-36369 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36368) Fix CategoricalOps.astype to follow pandas 1.3

Takuya Ueshin created SPARK-36368: - Summary: Fix CategoricalOps.astype to follow pandas 1.3 Key: SPARK-36368 URL: https://issues.apache.org/jira/browse/SPARK-36368 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36367: -- Issue Type: Umbrella (was: Improvement) > Fix the behavior to follow pandas >= 1.3 >

[jira] [Assigned] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36367: Assignee: Apache Spark > Fix the behavior to follow pandas >= 1.3 > -

[jira] [Commented] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390822#comment-17390822 ] Apache Spark commented on SPARK-36367: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36367: Assignee: (was: Apache Spark) > Fix the behavior to follow pandas >= 1.3 > --

[jira] [Commented] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390821#comment-17390821 ] Apache Spark commented on SPARK-36367: -- User 'ueshin' has created a pull request fo

[jira] [Created] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

Takuya Ueshin created SPARK-36367: - Summary: Fix the behavior to follow pandas >= 1.3 Key: SPARK-36367 URL: https://issues.apache.org/jira/browse/SPARK-36367 Project: Spark Issue Type: Improv

[jira] [Created] (SPARK-36366) Google Kubernetes Engine authentication fails

Tiago Reis created SPARK-36366: -- Summary: Google Kubernetes Engine authentication fails Key: SPARK-36366 URL: https://issues.apache.org/jira/browse/SPARK-36366 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-36366) Google Kubernetes Engine authentication fails

[ https://issues.apache.org/jira/browse/SPARK-36366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tiago Reis updated SPARK-36366: --- Description: When connecting to a Google Kubernetes Engine, a command {{gcloud container clusters g

[jira] [Assigned] (SPARK-36365) Remove old workarounds related to null ordering.

[ https://issues.apache.org/jira/browse/SPARK-36365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36365: Assignee: (was: Apache Spark) > Remove old workarounds related to null ordering. > --

[jira] [Assigned] (SPARK-36365) Remove old workarounds related to null ordering.

[ https://issues.apache.org/jira/browse/SPARK-36365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36365: Assignee: Apache Spark > Remove old workarounds related to null ordering. > -

[jira] [Commented] (SPARK-36365) Remove old workarounds related to null ordering.

[ https://issues.apache.org/jira/browse/SPARK-36365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390813#comment-17390813 ] Apache Spark commented on SPARK-36365: -- User 'ueshin' has created a pull request fo

[jira] [Updated] (SPARK-36365) Remove old workarounds related to null ordering.

[ https://issues.apache.org/jira/browse/SPARK-36365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36365: -- Summary: Remove old workarounds related to null ordering. (was: Remove old workarounds relate

[jira] [Commented] (SPARK-36338) Move distributed-sequence implementation to Scala side

[ https://issues.apache.org/jira/browse/SPARK-36338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390807#comment-17390807 ] Apache Spark commented on SPARK-36338: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36345: Assignee: Dongjoon Hyun > Add mlflow/sklearn to GHA docker image > --

[jira] [Resolved] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36345. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33595 [https://gi

[jira] [Created] (SPARK-36365) Remove old workarounds related to ordering.

Takuya Ueshin created SPARK-36365: - Summary: Remove old workarounds related to ordering. Key: SPARK-36365 URL: https://issues.apache.org/jira/browse/SPARK-36365 Project: Spark Issue Type: Imp

[jira] [Created] (SPARK-36364) Move window and aggregate functions to DataTypeOps

Xinrong Meng created SPARK-36364: Summary: Move window and aggregate functions to DataTypeOps Key: SPARK-36364 URL: https://issues.apache.org/jira/browse/SPARK-36364 Project: Spark Issue Type

[jira] [Resolved] (SPARK-36140) Replace DataTypeOps tests that have operations on different Series

[ https://issues.apache.org/jira/browse/SPARK-36140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-36140. -- Resolution: Done > Replace DataTypeOps tests that have operations on different Series > --

[jira] [Assigned] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36345: Assignee: (was: Apache Spark) > Add mlflow/sklearn to GHA docker image >

[jira] [Commented] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390791#comment-17390791 ] Apache Spark commented on SPARK-36345: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390790#comment-17390790 ] Apache Spark commented on SPARK-36345: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36345: Assignee: Apache Spark > Add mlflow/sklearn to GHA docker image > ---

[jira] [Updated] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-35881: -- Fix Version/s: 3.2.0 > [SQL] AQE does not support columnar execution for the final query stage

[jira] [Updated] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35881: -- Fix Version/s: (was: 3.2.0) > [SQL] AQE does not support columnar execution for the final

[jira] [Created] (SPARK-36363) AKS SPark UI does not have executor tab showing up

Koushik created SPARK-36363: --- Summary: AKS SPark UI does not have executor tab showing up Key: SPARK-36363 URL: https://issues.apache.org/jira/browse/SPARK-36363 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-35881. --- Fix Version/s: 3.3.0 3.2.0 Resolution: Fixed > [SQL] AQE does not

[jira] [Assigned] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-35881: - Assignee: Andy Grove > [SQL] AQE does not support columnar execution for the final quer

[jira] [Resolved] (SPARK-36350) Make nanvl work with DataTypeOps

[ https://issues.apache.org/jira/browse/SPARK-36350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36350. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue resolve

[jira] [Commented] (SPARK-36362) Omnibus Java code static analyzer warning fixes

[ https://issues.apache.org/jira/browse/SPARK-36362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390705#comment-17390705 ] Apache Spark commented on SPARK-36362: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-36362) Omnibus Java code static analyzer warning fixes

[ https://issues.apache.org/jira/browse/SPARK-36362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36362: Assignee: Apache Spark (was: Sean R. Owen) > Omnibus Java code static analyzer warning f

[jira] [Assigned] (SPARK-36362) Omnibus Java code static analyzer warning fixes

[ https://issues.apache.org/jira/browse/SPARK-36362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36362: Assignee: Sean R. Owen (was: Apache Spark) > Omnibus Java code static analyzer warning f

[jira] [Created] (SPARK-36362) Omnibus Java code static analyzer warning fixes

Sean R. Owen created SPARK-36362: Summary: Omnibus Java code static analyzer warning fixes Key: SPARK-36362 URL: https://issues.apache.org/jira/browse/SPARK-36362 Project: Spark Issue Type: I

[jira] [Resolved] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36358. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33593 [https://

[jira] [Assigned] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36358: Assignee: Attila Zsolt Piros (was: Apache Spark) > Upgrade Kubernetes Client Version to

[jira] [Commented] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390627#comment-17390627 ] Apache Spark commented on SPARK-36358: -- User 'attilapiros' has created a pull reque

[jira] [Commented] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390626#comment-17390626 ] Apache Spark commented on SPARK-36358: -- User 'attilapiros' has created a pull reque

[jira] [Assigned] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36358: Assignee: Apache Spark (was: Attila Zsolt Piros) > Upgrade Kubernetes Client Version to

[jira] [Assigned] (SPARK-36360) StreamingSource duplicates appName

[ https://issues.apache.org/jira/browse/SPARK-36360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36360: Assignee: Apache Spark > StreamingSource duplicates appName > ---

[jira] [Assigned] (SPARK-36360) StreamingSource duplicates appName

[ https://issues.apache.org/jira/browse/SPARK-36360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36360: Assignee: (was: Apache Spark) > StreamingSource duplicates appName >

[jira] [Commented] (SPARK-36360) StreamingSource duplicates appName

[ https://issues.apache.org/jira/browse/SPARK-36360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390585#comment-17390585 ] Apache Spark commented on SPARK-36360: -- User 'mrclneumann' has created a pull reque

[jira] [Resolved] (SPARK-36338) Move distributed-sequence implementation to Scala side

[ https://issues.apache.org/jira/browse/SPARK-36338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36338. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33570 [https://gi

[jira] [Assigned] (SPARK-36338) Move distributed-sequence implementation to Scala side

[ https://issues.apache.org/jira/browse/SPARK-36338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36338: Assignee: Hyukjin Kwon > Move distributed-sequence implementation to Scala side > ---

[jira] [Assigned] (SPARK-36092) Migrate to GitHub Actions Codecov from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-36092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36092: Assignee: Apache Spark > Migrate to GitHub Actions Codecov from Jenkins > ---

[jira] [Commented] (SPARK-36092) Migrate to GitHub Actions Codecov from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-36092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390580#comment-17390580 ] Apache Spark commented on SPARK-36092: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-36092) Migrate to GitHub Actions Codecov from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-36092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36092: Assignee: (was: Apache Spark) > Migrate to GitHub Actions Codecov from Jenkins >

[jira] [Created] (SPARK-36361) Install coverage in Python 3.9 and PyPy 3 in GitHub Actions image

Hyukjin Kwon created SPARK-36361: Summary: Install coverage in Python 3.9 and PyPy 3 in GitHub Actions image Key: SPARK-36361 URL: https://issues.apache.org/jira/browse/SPARK-36361 Project: Spark

[jira] [Updated] (SPARK-36360) StreamingSource duplicates appName

[ https://issues.apache.org/jira/browse/SPARK-36360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcel Neumann updated SPARK-36360: --- Description: The StreamingSource includes the appName in its sourceName. This is not desired

[jira] [Created] (SPARK-36360) StreamingSource duplicates appName

Marcel Neumann created SPARK-36360: -- Summary: StreamingSource duplicates appName Key: SPARK-36360 URL: https://issues.apache.org/jira/browse/SPARK-36360 Project: Spark Issue Type: Improvemen

[jira] [Assigned] (SPARK-36359) Coalesce returns the first expression if it is non nullable

[ https://issues.apache.org/jira/browse/SPARK-36359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36359: Assignee: Apache Spark > Coalesce returns the first expression if it is non nullable > --

[jira] [Commented] (SPARK-36254) Install mlflow/sklearn in Github Actions CI

[ https://issues.apache.org/jira/browse/SPARK-36254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390538#comment-17390538 ] Apache Spark commented on SPARK-36254: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-36359) Coalesce returns the first expression if it is non nullable

[ https://issues.apache.org/jira/browse/SPARK-36359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390537#comment-17390537 ] Apache Spark commented on SPARK-36359: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-36359) Coalesce returns the first expression if it is non nullable

[ https://issues.apache.org/jira/browse/SPARK-36359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36359: Assignee: (was: Apache Spark) > Coalesce returns the first expression if it is non nu

[jira] [Created] (SPARK-36359) Coalesce returns the first expression if it is non nullable

Yuming Wang created SPARK-36359: --- Summary: Coalesce returns the first expression if it is non nullable Key: SPARK-36359 URL: https://issues.apache.org/jira/browse/SPARK-36359 Project: Spark Is

[jira] [Updated] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36358: --- Description: This way [Retry HTTP operation in case IOException too (exponential bac

[jira] [Created] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

Attila Zsolt Piros created SPARK-36358: -- Summary: Upgrade Kubernetes Client Version to 5.6.0 Key: SPARK-36358 URL: https://issues.apache.org/jira/browse/SPARK-36358 Project: Spark Issue

[jira] [Commented] (SPARK-28330) ANSI SQL: Top-level in

[ https://issues.apache.org/jira/browse/SPARK-28330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390508#comment-17390508 ] Alexander Bij commented on SPARK-28330: --- I'm looking forward to this feature!  

[jira] [Assigned] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36346: Assignee: (was: Apache Spark) > Support TimestampNTZ type in Orc file source > --

[jira] [Assigned] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36346: Assignee: Apache Spark > Support TimestampNTZ type in Orc file source > -

[jira] [Commented] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390506#comment-17390506 ] Apache Spark commented on SPARK-36346: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-36357) Support pushdown Timestamp with local time zone for orc

[ https://issues.apache.org/jira/browse/SPARK-36357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390504#comment-17390504 ] jiaan.geng commented on SPARK-36357: I'm working on. > Support pushdown Timestamp w

[jira] [Created] (SPARK-36357) Support pushdown Timestamp with local time zone for orc

jiaan.geng created SPARK-36357: -- Summary: Support pushdown Timestamp with local time zone for orc Key: SPARK-36357 URL: https://issues.apache.org/jira/browse/SPARK-36357 Project: Spark Issue Typ

[jira] [Updated] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36346: --- Description: As per https://orc.apache.org/docs/types.html, Orc supports both TIMESTAMP_NTZ and TIM

[jira] [Updated] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36346: --- Description: As per https://orc.apache.org/docs/types.html, Orc supports both TIMESTAMP_NTZ and TIM

[jira] [Created] (SPARK-36356) RemoveRedundantAlias should keep output schema

angerszhu created SPARK-36356: - Summary: RemoveRedundantAlias should keep output schema Key: SPARK-36356 URL: https://issues.apache.org/jira/browse/SPARK-36356 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-36353) RemoveNoopOperators should keep output schema

[ https://issues.apache.org/jira/browse/SPARK-36353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36353: -- Description: !image-2021-07-30-17-46-59-196.png|width=539,height=220! [https://github.com/apache/spar

[jira] [Commented] (SPARK-36353) RemoveNoopOperators should keep output schema

[ https://issues.apache.org/jira/browse/SPARK-36353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390458#comment-17390458 ] angerszhu commented on SPARK-36353: --- Raise a pr soon > RemoveNoopOperators should kee

[jira] [Updated] (SPARK-36353) RemoveNoopOperators should keep output schema

[ https://issues.apache.org/jira/browse/SPARK-36353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36353: -- Attachment: image-2021-07-30-17-46-59-196.png > RemoveNoopOperators should keep output schema > --

[jira] [Commented] (SPARK-36355) NamedExpression add method `withName(newName: String)`

[ https://issues.apache.org/jira/browse/SPARK-36355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390456#comment-17390456 ] Apache Spark commented on SPARK-36355: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-36355) NamedExpression add method `withName(newName: String)`

[ https://issues.apache.org/jira/browse/SPARK-36355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36355: Assignee: Apache Spark > NamedExpression add method `withName(newName: String)` > ---

[jira] [Assigned] (SPARK-36355) NamedExpression add method `withName(newName: String)`

[ https://issues.apache.org/jira/browse/SPARK-36355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36355: Assignee: (was: Apache Spark) > NamedExpression add method `withName(newName: String)

[jira] [Created] (SPARK-36355) NamedExpression add method `withName(newName: String)`

angerszhu created SPARK-36355: - Summary: NamedExpression add method `withName(newName: String)` Key: SPARK-36355 URL: https://issues.apache.org/jira/browse/SPARK-36355 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36065) date_trunc returns incorrect output

[ https://issues.apache.org/jira/browse/SPARK-36065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390421#comment-17390421 ] Peter Toth commented on SPARK-36065: I think the output is correct as there was a ti

[jira] [Commented] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

[ https://issues.apache.org/jira/browse/SPARK-36354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390390#comment-17390390 ] Apache Spark commented on SPARK-36354: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

[ https://issues.apache.org/jira/browse/SPARK-36354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36354: Assignee: Apache Spark > EventLogFileReaders should not complain in case of no event log

[jira] [Assigned] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

[ https://issues.apache.org/jira/browse/SPARK-36354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36354: Assignee: (was: Apache Spark) > EventLogFileReaders should not complain in case of no

[jira] [Commented] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

[ https://issues.apache.org/jira/browse/SPARK-36354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390392#comment-17390392 ] Apache Spark commented on SPARK-36354: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

Dongjoon Hyun created SPARK-36354: - Summary: EventLogFileReaders should not complain in case of no event log files Key: SPARK-36354 URL: https://issues.apache.org/jira/browse/SPARK-36354 Project: Spar

[jira] [Commented] (SPARK-35976) Adjust `astype` method for ExtensionDtype in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390374#comment-17390374 ] Apache Spark commented on SPARK-35976: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-35976) Adjust `astype` method for ExtensionDtype in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390372#comment-17390372 ] Apache Spark commented on SPARK-35976: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-35976) Adjust `astype` method for ExtensionDtype in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35976: Assignee: Apache Spark > Adjust `astype` method for ExtensionDtype in pandas API on Spark

[jira] [Assigned] (SPARK-35976) Adjust `astype` method for ExtensionDtype in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35976: Assignee: (was: Apache Spark) > Adjust `astype` method for ExtensionDtype in pandas A

[jira] [Commented] (SPARK-36351) Separate partition filters and data filters in PushDownUtils

[ https://issues.apache.org/jira/browse/SPARK-36351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390364#comment-17390364 ] Apache Spark commented on SPARK-36351: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-36351) Separate partition filters and data filters in PushDownUtils

[ https://issues.apache.org/jira/browse/SPARK-36351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36351: Assignee: (was: Apache Spark) > Separate partition filters and data filters in PushDo

[jira] [Assigned] (SPARK-36351) Separate partition filters and data filters in PushDownUtils

[ https://issues.apache.org/jira/browse/SPARK-36351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36351: Assignee: Apache Spark > Separate partition filters and data filters in PushDownUtils > -

[jira] [Comment Edited] (SPARK-36327) Spark sql creates staging dir inside database directory rather than creating inside table directory

[ https://issues.apache.org/jira/browse/SPARK-36327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390358#comment-17390358 ] Dongjoon Hyun edited comment on SPARK-36327 at 7/30/21, 7:22 AM: -

[jira] [Commented] (SPARK-36327) Spark sql creates staging dir inside database directory rather than creating inside table directory

[ https://issues.apache.org/jira/browse/SPARK-36327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390358#comment-17390358 ] Dongjoon Hyun commented on SPARK-36327: --- I commented on the PR and looped other re

[jira] [Resolved] (SPARK-36254) Install mlflow in Github Actions CI

[ https://issues.apache.org/jira/browse/SPARK-36254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36254. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33567 [https://

[jira] [Updated] (SPARK-36254) Install mlflow/sklearn in Github Actions CI

[ https://issues.apache.org/jira/browse/SPARK-36254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36254: -- Summary: Install mlflow/sklearn in Github Actions CI (was: Install mlflow in Github Actions C

[jira] [Commented] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390341#comment-17390341 ] Dongjoon Hyun commented on SPARK-36345: --- Thank you for reporting. I revised the ti

[jira] [Assigned] (SPARK-36254) Install mlflow in Github Actions CI

[ https://issues.apache.org/jira/browse/SPARK-36254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36254: - Assignee: Haejoon Lee > Install mlflow in Github Actions CI > -

[jira] [Updated] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36345: -- Summary: Add mlflow/sklearn to GHA docker image (was: Create docker image that has mlflow and