[jira] [Resolved] (SPARK-38575) Duduplicate branch specification in GitHub Actions workflow

2022-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38575. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35882 [https://gi

[jira] [Assigned] (SPARK-38575) Duduplicate branch specification in GitHub Actions workflow

2022-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38575: Assignee: Hyukjin Kwon > Duduplicate branch specification in GitHub Actions workflow > --

[jira] [Created] (SPARK-38578) Avoid unnecessary sort in FileFormatWriter if user has specified sort

2022-03-16 Thread XiDuo You (Jira)
XiDuo You created SPARK-38578: - Summary: Avoid unnecessary sort in FileFormatWriter if user has specified sort Key: SPARK-38578 URL: https://issues.apache.org/jira/browse/SPARK-38578 Project: Spark

[jira] [Updated] (SPARK-38578) Avoid unnecessary sort in FileFormatWriter if user has specified sort

2022-03-16 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38578: -- Parent: SPARK-37063 Issue Type: Sub-task (was: Improvement) > Avoid unnecessary sort in FileF

[jira] [Commented] (SPARK-38575) Duduplicate branch specification in GitHub Actions workflow

2022-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507946#comment-17507946 ] Apache Spark commented on SPARK-38575: -- User 'HyukjinKwon' has created a pull reque

[jira] [Created] (SPARK-38579) Requesting Restful API can cause NullPointerException

2022-03-16 Thread Yimin Yang (Jira)
Yimin Yang created SPARK-38579: -- Summary: Requesting Restful API can cause NullPointerException Key: SPARK-38579 URL: https://issues.apache.org/jira/browse/SPARK-38579 Project: Spark Issue Type:

[jira] [Created] (SPARK-38580) Requesting Restful API can cause NullPointerException

2022-03-16 Thread Yimin Yang (Jira)
Yimin Yang created SPARK-38580: -- Summary: Requesting Restful API can cause NullPointerException Key: SPARK-38580 URL: https://issues.apache.org/jira/browse/SPARK-38580 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-38580) Requesting Restful API can cause NullPointerException

2022-03-16 Thread Yimin Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yimin Yang resolved SPARK-38580. Resolution: Duplicate > Requesting Restful API can cause NullPointerException > --

[jira] [Assigned] (SPARK-38579) Requesting Restful API can cause NullPointerException

2022-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38579: Assignee: (was: Apache Spark) > Requesting Restful API can cause NullPointerException

[jira] [Commented] (SPARK-38579) Requesting Restful API can cause NullPointerException

2022-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507958#comment-17507958 ] Apache Spark commented on SPARK-38579: -- User 'yym1995' has created a pull request f

[jira] [Assigned] (SPARK-38579) Requesting Restful API can cause NullPointerException

2022-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38579: Assignee: Apache Spark > Requesting Restful API can cause NullPointerException >

[jira] [Created] (SPARK-38581) List of supported pandas APIs for pandas API on Spark docs.

2022-03-16 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-38581: --- Summary: List of supported pandas APIs for pandas API on Spark docs. Key: SPARK-38581 URL: https://issues.apache.org/jira/browse/SPARK-38581 Project: Spark Is

[jira] [Commented] (SPARK-38581) List of supported pandas APIs for pandas API on Spark docs.

2022-03-16 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507962#comment-17507962 ] Haejoon Lee commented on SPARK-38581: - I'm working on it > List of supported pandas

[jira] [Updated] (SPARK-38581) List of supported pandas APIs for pandas API on Spark docs.

2022-03-16 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-38581: Issue Type: Documentation (was: Bug) > List of supported pandas APIs for pandas API on Spark docs

[jira] [Updated] (SPARK-38578) Avoid unnecessary sort in FileFormatWriter if user has specified sort in AQE

2022-03-16 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38578: -- Summary: Avoid unnecessary sort in FileFormatWriter if user has specified sort in AQE (was: Avoid unn

[jira] [Resolved] (SPARK-38557) What may be a cause for HDFSMetadataCommitter: Error while fetching MetaData and how to fix or work around this?

2022-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38557. -- Resolution: Invalid > What may be a cause for HDFSMetadataCommitter: Error while fetching Meta

[jira] [Commented] (SPARK-38557) What may be a cause for HDFSMetadataCommitter: Error while fetching MetaData and how to fix or work around this?

2022-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507976#comment-17507976 ] Hyukjin Kwon commented on SPARK-38557: -- For questions, we should better interact wi

[jira] [Created] (SPARK-38582) Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern

2022-03-16 Thread qian (Jira)
qian created SPARK-38582: Summary: Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern Key: SPARK-38582 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Updated] (SPARK-38583) to_timestamp should allow numeric types

2022-03-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38583: - Description: SPARK-38240 mistakenly disallowed numeric type at to_timestamp. We should allow it

[jira] [Created] (SPARK-38583) to_timestamp should allow numeric types

2022-03-16 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-38583: Summary: to_timestamp should allow numeric types Key: SPARK-38583 URL: https://issues.apache.org/jira/browse/SPARK-38583 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-38566) Revert the parser changes for DEFAULT column support

2022-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507993#comment-17507993 ] Apache Spark commented on SPARK-38566: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-38566) Revert the parser changes for DEFAULT column support

2022-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507994#comment-17507994 ] Apache Spark commented on SPARK-38566: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-38582) Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern

2022-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507995#comment-17507995 ] Apache Spark commented on SPARK-38582: -- User 'dcoliversun' has created a pull reque

[jira] [Assigned] (SPARK-38582) Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern

2022-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38582: Assignee: Apache Spark > Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` fo

[jira] [Commented] (SPARK-38582) Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern

2022-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507996#comment-17507996 ] Apache Spark commented on SPARK-38582: -- User 'dcoliversun' has created a pull reque

[jira] [Assigned] (SPARK-38582) Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern

2022-03-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38582: Assignee: (was: Apache Spark) > Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithF

[jira] [Created] (SPARK-38584) Unify the data validation

2022-03-16 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-38584: Summary: Unify the data validation Key: SPARK-38584 URL: https://issues.apache.org/jira/browse/SPARK-38584 Project: Spark Issue Type: Improvement C

[jira] [Updated] (SPARK-38584) Unify the data validation

2022-03-16 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-38584: - Description: 1, input vector validation is missing in most algorithms, when the input dataset c

<    1   2