[jira] [Assigned] (SPARK-42179) Upgrade ORC to 1.7.8

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42179: Assignee: (was: Apache Spark) > Upgrade ORC to 1.7.8 > > >

[jira] [Assigned] (SPARK-42179) Upgrade ORC to 1.7.8

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42179: Assignee: Apache Spark > Upgrade ORC to 1.7.8 > > >

[jira] [Commented] (SPARK-42179) Upgrade ORC to 1.7.8

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680476#comment-17680476 ] Apache Spark commented on SPARK-42179: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-42179) Upgrade ORC to 1.7.8

2023-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42179: -- Component/s: Build > Upgrade ORC to 1.7.8 > > > Key:

[jira] [Created] (SPARK-42179) Upgrade ORC to 1.7.8

2023-01-24 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42179: - Summary: Upgrade ORC to 1.7.8 Key: SPARK-42179 URL: https://issues.apache.org/jira/browse/SPARK-42179 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-41812) DataFrame.join: ambiguous column

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680467#comment-17680467 ] Apache Spark commented on SPARK-41812: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41823) DataFrame.join creating ambiguous column names

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680468#comment-17680468 ] Apache Spark commented on SPARK-41823: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41812) DataFrame.join: ambiguous column

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41812: Assignee: (was: Apache Spark) > DataFrame.join: ambiguous column >

[jira] [Assigned] (SPARK-41812) DataFrame.join: ambiguous column

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41812: Assignee: Apache Spark > DataFrame.join: ambiguous column >

[jira] [Commented] (SPARK-42178) Handle remaining null string values in ui protobuf serializer and add tests

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680455#comment-17680455 ] Apache Spark commented on SPARK-42178: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-42178) Handle remaining null string values in ui protobuf serializer and add tests

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680454#comment-17680454 ] Apache Spark commented on SPARK-42178: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-42178) Handle remaining null string values in ui protobuf serializer and add tests

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42178: Assignee: Gengliang Wang (was: Apache Spark) > Handle remaining null string values in

[jira] [Assigned] (SPARK-42178) Handle remaining null string values in ui protobuf serializer and add tests

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42178: Assignee: Apache Spark (was: Gengliang Wang) > Handle remaining null string values in

[jira] [Created] (SPARK-42178) Handle remaining null string values in ui protobuf serializer and add tests

2023-01-24 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-42178: -- Summary: Handle remaining null string values in ui protobuf serializer and add tests Key: SPARK-42178 URL: https://issues.apache.org/jira/browse/SPARK-42178

[jira] [Commented] (SPARK-42177) Change master to brach-3.4 in GitHub Actions

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680438#comment-17680438 ] Apache Spark commented on SPARK-42177: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-42177) Change master to brach-3.4 in GitHub Actions

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680437#comment-17680437 ] Apache Spark commented on SPARK-42177: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-42177) Change master to brach-3.4 in GitHub Actions

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680435#comment-17680435 ] Apache Spark commented on SPARK-42177: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-42177) Change master to brach-3.4 in GitHub Actions

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42177: Assignee: Hyukjin Kwon > Change master to brach-3.4 in GitHub Actions >

[jira] [Resolved] (SPARK-42177) Change master to brach-3.4 in GitHub Actions

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42177. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39731

[jira] [Updated] (SPARK-42176) Cast boolean to timestamp fails with ClassCastException

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42176: - Affects Version/s: 3.5.0 > Cast boolean to timestamp fails with ClassCastException >

[jira] [Updated] (SPARK-42176) Cast boolean to timestamp fails with ClassCastException

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42176: - Fix Version/s: 3.5.0 > Cast boolean to timestamp fails with ClassCastException >

[jira] [Assigned] (SPARK-42176) Cast boolean to timestamp fails with ClassCastException

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42176: Assignee: Ivan Sadikov > Cast boolean to timestamp fails with ClassCastException >

[jira] [Resolved] (SPARK-42176) Cast boolean to timestamp fails with ClassCastException

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42176. -- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-42177) Change master to brach-3.4 in GitHub Actions

2023-01-24 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-42177: Summary: Change master to brach-3.4 in GitHub Actions Key: SPARK-42177 URL: https://issues.apache.org/jira/browse/SPARK-42177 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-42176) Cast boolean to timestamp fails with ClassCastException

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42176: Assignee: (was: Apache Spark) > Cast boolean to timestamp fails with

[jira] [Assigned] (SPARK-42176) Cast boolean to timestamp fails with ClassCastException

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42176: Assignee: Apache Spark > Cast boolean to timestamp fails with ClassCastException >

[jira] [Commented] (SPARK-42176) Cast boolean to timestamp fails with ClassCastException

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680427#comment-17680427 ] Apache Spark commented on SPARK-42176: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Commented] (SPARK-42107) Spark 3.3.0 binary breaking change missing from release notes

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680420#comment-17680420 ] Hyukjin Kwon commented on SPARK-42107: -- cc [~cloud_fan] and [~dchvn]. I think we should at least

[jira] [Commented] (SPARK-42118) Wrong result when parsing a multiline JSON file with differing types for same column

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680419#comment-17680419 ] Hyukjin Kwon commented on SPARK-42118: -- As a workaround you can do: {code} val df =

[jira] [Commented] (SPARK-42175) Implement more methods in the Scala Client Dataset API

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680418#comment-17680418 ] Apache Spark commented on SPARK-42175: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42175) Implement more methods in the Scala Client Dataset API

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42175: Assignee: (was: Apache Spark) > Implement more methods in the Scala Client Dataset

[jira] [Commented] (SPARK-42175) Implement more methods in the Scala Client Dataset API

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680417#comment-17680417 ] Apache Spark commented on SPARK-42175: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42175) Implement more methods in the Scala Client Dataset API

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42175: Assignee: Apache Spark > Implement more methods in the Scala Client Dataset API >

[jira] [Comment Edited] (SPARK-42127) Spark 3.3.0, Error with java.io.IOException: Mkdirs failed to create file

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680414#comment-17680414 ] Hyukjin Kwon edited comment on SPARK-42127 at 1/25/23 12:55 AM:

[jira] [Commented] (SPARK-42127) Spark 3.3.0, Error with java.io.IOException: Mkdirs failed to create file

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680414#comment-17680414 ] Hyukjin Kwon commented on SPARK-42127: -- [~shamim_er123]how did you reproduce this? > Spark 3.3.0,

[jira] [Commented] (SPARK-42033) Docker Tag Error 25 on gitlab-ci.yml trying to start GitLab Pipeline

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680413#comment-17680413 ] Hyukjin Kwon commented on SPARK-42033: -- How is this a Spark issue? > Docker Tag Error 25 on

[jira] [Commented] (SPARK-42034) QueryExecutionListener and Observation API, df.observe do not work with `foreach` action.

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680412#comment-17680412 ] Hyukjin Kwon commented on SPARK-42034: -- please go ahead a PR if you're interested in doing that! >

[jira] [Commented] (SPARK-42034) QueryExecutionListener and Observation API, df.observe do not work with `foreach` action.

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680411#comment-17680411 ] Hyukjin Kwon commented on SPARK-42034: -- I think the action has to be triggered by using

[jira] [Updated] (SPARK-42033) Docker Tag Error 25 on gitlab-ci.yml trying to start GitLab Pipeline

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42033: - Target Version/s: (was: 1.5.2) > Docker Tag Error 25 on gitlab-ci.yml trying to start GitLab

[jira] [Updated] (SPARK-42033) Docker Tag Error 25 on gitlab-ci.yml trying to start GitLab Pipeline

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42033: - Fix Version/s: (was: 1.6.2) > Docker Tag Error 25 on gitlab-ci.yml trying to start GitLab

[jira] [Created] (SPARK-42176) Cast boolean to timestamp fails with ClassCastException

2023-01-24 Thread Ivan Sadikov (Jira)
Ivan Sadikov created SPARK-42176: Summary: Cast boolean to timestamp fails with ClassCastException Key: SPARK-42176 URL: https://issues.apache.org/jira/browse/SPARK-42176 Project: Spark

[jira] [Updated] (SPARK-42176) Cast boolean to timestamp fails with ClassCastException

2023-01-24 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Sadikov updated SPARK-42176: - Description: When casting a boolean value to timestamp, the following error is thrown:

[jira] [Updated] (SPARK-42175) Implement more methods in the Scala Client Dataset API

2023-01-24 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-42175: Description: Also fix the TODOs in the MiMa compatibility test.

[jira] [Created] (SPARK-42175) Implement more methods in the Scala Client Dataset API

2023-01-24 Thread Zhen Li (Jira)
Zhen Li created SPARK-42175: --- Summary: Implement more methods in the Scala Client Dataset API Key: SPARK-42175 URL: https://issues.apache.org/jira/browse/SPARK-42175 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42173) IPv6 address mapping can fail with sparse addresses

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680410#comment-17680410 ] Apache Spark commented on SPARK-42173: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42173) IPv6 address mapping can fail with sparse addresses

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42173: Assignee: Holden Karau (was: Apache Spark) > IPv6 address mapping can fail with sparse

[jira] [Commented] (SPARK-42173) IPv6 address mapping can fail with sparse addresses

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680409#comment-17680409 ] Apache Spark commented on SPARK-42173: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42173) IPv6 address mapping can fail with sparse addresses

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42173: Assignee: Apache Spark (was: Holden Karau) > IPv6 address mapping can fail with sparse

[jira] [Assigned] (SPARK-42119) Add built-in table-valued functions inline and inline_outer

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42119: Assignee: Allison Wang > Add built-in table-valued functions inline and inline_outer >

[jira] [Resolved] (SPARK-42119) Add built-in table-valued functions inline and inline_outer

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42119. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39656

[jira] [Assigned] (SPARK-42174) Use scikit-learn instead of sklearn

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42174: Assignee: Dongjoon Hyun > Use scikit-learn instead of sklearn >

[jira] [Resolved] (SPARK-42174) Use scikit-learn instead of sklearn

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42174. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39727

[jira] [Assigned] (SPARK-36124) Support set operators to be on correlation paths

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36124: Assignee: Allison Wang > Support set operators to be on correlation paths >

[jira] [Resolved] (SPARK-36124) Support set operators to be on correlation paths

2023-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36124. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39375

[jira] [Commented] (SPARK-42174) Use scikit-learn instead of sklearn

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680379#comment-17680379 ] Apache Spark commented on SPARK-42174: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42174) Use scikit-learn instead of sklearn

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42174: Assignee: Apache Spark > Use scikit-learn instead of sklearn >

[jira] [Assigned] (SPARK-42174) Use scikit-learn instead of sklearn

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42174: Assignee: (was: Apache Spark) > Use scikit-learn instead of sklearn >

[jira] [Created] (SPARK-42174) Use scikit-learn instead of sklearn

2023-01-24 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42174: - Summary: Use scikit-learn instead of sklearn Key: SPARK-42174 URL: https://issues.apache.org/jira/browse/SPARK-42174 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-42123) Include column default values in DESCRIBE output

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680362#comment-17680362 ] Apache Spark commented on SPARK-42123: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42171) Fix `pyspark-errors` module and enable it in GitHub Action

2023-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42171. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39721

[jira] [Assigned] (SPARK-42171) Fix `pyspark-errors` module and enable it in GitHub Action

2023-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42171: - Assignee: Dongjoon Hyun > Fix `pyspark-errors` module and enable it in GitHub Action >

[jira] [Commented] (SPARK-33573) Server side metrics related to push-based shuffle

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680350#comment-17680350 ] Apache Spark commented on SPARK-33573: -- User 'rmcyang' has created a pull request for this issue:

[jira] [Created] (SPARK-42173) IPv6 address mapping can fail with sparse addresses

2023-01-24 Thread Holden Karau (Jira)
Holden Karau created SPARK-42173: Summary: IPv6 address mapping can fail with sparse addresses Key: SPARK-42173 URL: https://issues.apache.org/jira/browse/SPARK-42173 Project: Spark Issue

[jira] [Resolved] (SPARK-42103) Add Instrumentation

2023-01-24 Thread Rithwik Ediga Lakhamsani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rithwik Ediga Lakhamsani resolved SPARK-42103. -- Resolution: Not A Problem > Add Instrumentation > ---

[jira] [Resolved] (SPARK-41590) Implement Baseline API Code

2023-01-24 Thread Rithwik Ediga Lakhamsani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rithwik Ediga Lakhamsani resolved SPARK-41590. -- Resolution: Fixed > Implement Baseline API Code >

[jira] [Commented] (SPARK-41775) Implement training functions as input

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680337#comment-17680337 ] Apache Spark commented on SPARK-41775: -- User 'rithwik-db' has created a pull request for this

[jira] [Commented] (SPARK-41775) Implement training functions as input

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680336#comment-17680336 ] Apache Spark commented on SPARK-41775: -- User 'rithwik-db' has created a pull request for this

[jira] [Assigned] (SPARK-41302) Assign a name to the error class _LEGACY_ERROR_TEMP_1185

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41302: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_1185 >

[jira] [Commented] (SPARK-41302) Assign a name to the error class _LEGACY_ERROR_TEMP_1185

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680324#comment-17680324 ] Apache Spark commented on SPARK-41302: -- User 'NarekDW' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41302) Assign a name to the error class _LEGACY_ERROR_TEMP_1185

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41302: Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] [Commented] (SPARK-42172) Compatibility check for Scala Client

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680321#comment-17680321 ] Apache Spark commented on SPARK-42172: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42172) Compatibility check for Scala Client

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42172: Assignee: (was: Apache Spark) > Compatibility check for Scala Client >

[jira] [Assigned] (SPARK-42172) Compatibility check for Scala Client

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42172: Assignee: Apache Spark > Compatibility check for Scala Client >

[jira] [Created] (SPARK-42172) Compatibility check for Scala Client

2023-01-24 Thread Zhen Li (Jira)
Zhen Li created SPARK-42172: --- Summary: Compatibility check for Scala Client Key: SPARK-42172 URL: https://issues.apache.org/jira/browse/SPARK-42172 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42162) Memory usage on executors increased drastically for a complex query with large number of addition operations

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680317#comment-17680317 ] Apache Spark commented on SPARK-42162: -- User 'db-scnakandala' has created a pull request for this

[jira] [Commented] (SPARK-42162) Memory usage on executors increased drastically for a complex query with large number of addition operations

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680316#comment-17680316 ] Apache Spark commented on SPARK-42162: -- User 'db-scnakandala' has created a pull request for this

[jira] [Assigned] (SPARK-42162) Memory usage on executors increased drastically for a complex query with large number of addition operations

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42162: Assignee: (was: Apache Spark) > Memory usage on executors increased drastically for

[jira] [Assigned] (SPARK-42162) Memory usage on executors increased drastically for a complex query with large number of addition operations

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42162: Assignee: Apache Spark > Memory usage on executors increased drastically for a complex

[jira] [Updated] (SPARK-42171) Fix `pyspark-errors` module and enable it in GitHub Action

2023-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42171: -- Summary: Fix `pyspark-errors` module and enable it in GitHub Action (was: Enable

[jira] [Updated] (SPARK-42171) Enable `pyspark-errors` module test in GitHub Action

2023-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42171: -- Labels: 3.4.0 (was: ) > Enable `pyspark-errors` module test in GitHub Action >

[jira] [Updated] (SPARK-42171) Enable `pyspark-errors` module test in GitHub Action

2023-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42171: -- Priority: Blocker (was: Major) > Enable `pyspark-errors` module test in GitHub Action >

[jira] [Updated] (SPARK-42171) Enable `pyspark-errors` module test in GitHub Action

2023-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42171: -- Component/s: Tests > Enable `pyspark-errors` module test in GitHub Action >

[jira] [Updated] (SPARK-42090) Introduce sasl retry count in RetryingBlockTransferor

2023-01-24 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-42090: Fix Version/s: 3.2.4 3.3.2 > Introduce sasl retry count in

[jira] [Assigned] (SPARK-42171) Enable `pyspark-errors` module test in GitHub Action

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42171: Assignee: Apache Spark > Enable `pyspark-errors` module test in GitHub Action >

[jira] [Assigned] (SPARK-42171) Enable `pyspark-errors` module test in GitHub Action

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42171: Assignee: (was: Apache Spark) > Enable `pyspark-errors` module test in GitHub Action

[jira] [Commented] (SPARK-42171) Enable `pyspark-errors` module test in GitHub Action

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680307#comment-17680307 ] Apache Spark commented on SPARK-42171: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-42171) Enable `pyspark-errors` module test in GitHub Action

2023-01-24 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42171: - Summary: Enable `pyspark-errors` module test in GitHub Action Key: SPARK-42171 URL: https://issues.apache.org/jira/browse/SPARK-42171 Project: Spark Issue

[jira] [Assigned] (SPARK-42167) Improve GitHub Action `lint` job to stop on failures earlier

2023-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42167: - Assignee: Dongjoon Hyun > Improve GitHub Action `lint` job to stop on failures earlier

[jira] [Resolved] (SPARK-42167) Improve GitHub Action `lint` job to stop on failures earlier

2023-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42167. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39716

[jira] [Commented] (SPARK-41500) auto generate concat as Double when string minus an INTERVAL type

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680279#comment-17680279 ] Apache Spark commented on SPARK-41500: -- User 'NarekDW' has created a pull request for this issue:

[jira] [Commented] (SPARK-41500) auto generate concat as Double when string minus an INTERVAL type

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680278#comment-17680278 ] Apache Spark commented on SPARK-41500: -- User 'NarekDW' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41500) auto generate concat as Double when string minus an INTERVAL type

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41500: Assignee: (was: Apache Spark) > auto generate concat as Double when string minus an

[jira] [Assigned] (SPARK-41500) auto generate concat as Double when string minus an INTERVAL type

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41500: Assignee: Apache Spark > auto generate concat as Double when string minus an INTERVAL

[jira] [Commented] (SPARK-42169) Implement code generation for `to_csv` function (StructsToCsv)

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680254#comment-17680254 ] Apache Spark commented on SPARK-42169: -- User 'NarekDW' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42169) Implement code generation for `to_csv` function (StructsToCsv)

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42169: Assignee: Apache Spark > Implement code generation for `to_csv` function (StructsToCsv)

[jira] [Assigned] (SPARK-42169) Implement code generation for `to_csv` function (StructsToCsv)

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42169: Assignee: (was: Apache Spark) > Implement code generation for `to_csv` function

[jira] [Commented] (SPARK-42169) Implement code generation for `to_csv` function (StructsToCsv)

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680251#comment-17680251 ] Apache Spark commented on SPARK-42169: -- User 'NarekDW' has created a pull request for this issue:

[jira] [Commented] (SPARK-42163) Schema pruning fails on non-foldable array index or map key

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680248#comment-17680248 ] Apache Spark commented on SPARK-42163: -- User 'cashmand' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42163) Schema pruning fails on non-foldable array index or map key

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42163: Assignee: Apache Spark > Schema pruning fails on non-foldable array index or map key >

[jira] [Assigned] (SPARK-42163) Schema pruning fails on non-foldable array index or map key

2023-01-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42163: Assignee: (was: Apache Spark) > Schema pruning fails on non-foldable array index or

  1   2   >