[jira] [Created] (SPARK-36507) Remove/Replace missing links to AMP Camp materials from index.md

2021-08-12 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36507: -- Summary: Remove/Replace missing links to AMP Camp materials from index.md Key: SPARK-36507 URL: https://issues.apache.org/jira/browse/SPARK-36507 Project: Spark

[jira] [Resolved] (SPARK-36428) the 'seconds' parameter of 'make_timestamp' should accept integer type

2021-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36428. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33665

[jira] [Resolved] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36502. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33732

[jira] [Assigned] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36502: Assignee: Dongjoon Hyun > Remove jaxb-api from `sql/catalyst` module >

[jira] [Resolved] (SPARK-36447) Avoid inlining non-deterministic With-CTEs

2021-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36447. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33671

[jira] [Assigned] (SPARK-36447) Avoid inlining non-deterministic With-CTEs

2021-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36447: --- Assignee: Wei Xue > Avoid inlining non-deterministic With-CTEs >

[jira] [Resolved] (SPARK-36497) Support Interval add/subtract NULL

2021-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36497. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33727

[jira] [Updated] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36501: - Fix Version/s: 3.2.0 > LSHModel.approxSimilarityJoin can generate invalid column names >

[jira] [Resolved] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36501. -- Assignee: Tim Armstrong Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-36506) Improve test coverage for series.py and indexes/*.py.

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36506: Summary: Improve test coverage for series.py and indexes/*.py. (was: [PYTHON] Improve test

[jira] [Updated] (SPARK-36505) Improve test coverage for frame.py

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36505: Summary: Improve test coverage for frame.py (was: [PYTHON] Improve test coverage for frame.py)

[jira] [Commented] (SPARK-36387) Fix Series.astype from datetime to nullable string

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398373#comment-17398373 ] Haejoon Lee commented on SPARK-36387: - [~dc-heros] np!! Let me take this one :) > Fix Series.astype

[jira] [Resolved] (SPARK-36483) Fix intermittent test failure due to netty dependency version bump

2021-08-12 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-36483. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-36483) Fix intermittent test failure due to netty dependency version bump

2021-08-12 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-36483: --- Assignee: Min Shen > Fix intermittent test failure due to netty dependency

[jira] [Created] (SPARK-36506) [PYTHON] Improve test coverage for series.py and indexes/*.py.

2021-08-12 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-36506: --- Summary: [PYTHON] Improve test coverage for series.py and indexes/*.py. Key: SPARK-36506 URL: https://issues.apache.org/jira/browse/SPARK-36506 Project: Spark

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: *

[jira] [Created] (SPARK-36505) [PYTHON] Improve test coverage for frame.py

2021-08-12 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-36505: --- Summary: [PYTHON] Improve test coverage for frame.py Key: SPARK-36505 URL: https://issues.apache.org/jira/browse/SPARK-36505 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-36503) Add RowToColumnConverter for BinaryType

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36503: Assignee: (was: Apache Spark) > Add RowToColumnConverter for BinaryType >

[jira] [Assigned] (SPARK-36503) Add RowToColumnConverter for BinaryType

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36503: Assignee: Apache Spark > Add RowToColumnConverter for BinaryType >

[jira] [Commented] (SPARK-36503) Add RowToColumnConverter for BinaryType

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398368#comment-17398368 ] Apache Spark commented on SPARK-36503: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: *

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: *

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: *

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: *

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Attachment: Screen Shot 2021-08-13 at 9.59.23 AM.png > Improve test coverage for pandas API on

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: *

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: *

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: *

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Attachment: (was: Screen Shot 2021-08-13 at 9.56.48 AM.png) > Improve test coverage for

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Attachment: Screen Shot 2021-08-13 at 9.56.48 AM.png > Improve test coverage for pandas API on

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Attachment: Screen Shot 2021-08-13 at 9.56.48 AM.png > Improve test coverage for pandas API on

[jira] [Created] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-36504: --- Summary: Improve test coverage for pandas API on Spark Key: SPARK-36504 URL: https://issues.apache.org/jira/browse/SPARK-36504 Project: Spark Issue Type:

[jira] [Created] (SPARK-36503) Add RowToColumnConverter for BinaryType

2021-08-12 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-36503: -- Summary: Add RowToColumnConverter for BinaryType Key: SPARK-36503 URL: https://issues.apache.org/jira/browse/SPARK-36503 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36502: Assignee: (was: Apache Spark) > Remove jaxb-api from `sql/catalyst` module >

[jira] [Assigned] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36502: Assignee: Apache Spark > Remove jaxb-api from `sql/catalyst` module >

[jira] [Commented] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398318#comment-17398318 ] Apache Spark commented on SPARK-36502: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-36502: - Summary: Remove jaxb-api from `sql/catalyst` module Key: SPARK-36502 URL: https://issues.apache.org/jira/browse/SPARK-36502 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36500) The temp_shuffle files are not cleaned up when a task is interrupted

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398289#comment-17398289 ] Apache Spark commented on SPARK-36500: -- User 'jiangxb1987' has created a pull request for this

[jira] [Assigned] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36501: Assignee: Apache Spark > LSHModel.approxSimilarityJoin can generate invalid column names

[jira] [Assigned] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36501: Assignee: (was: Apache Spark) > LSHModel.approxSimilarityJoin can generate invalid

[jira] [Commented] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398264#comment-17398264 ] Apache Spark commented on SPARK-36501: -- User 'timarmstrong' has created a pull request for this

[jira] [Commented] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398252#comment-17398252 ] Tim Armstrong commented on SPARK-36501: --- I have a fix for this... > LSHModel.approxSimilarityJoin

[jira] [Created] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Tim Armstrong (Jira)
Tim Armstrong created SPARK-36501: - Summary: LSHModel.approxSimilarityJoin can generate invalid column names Key: SPARK-36501 URL: https://issues.apache.org/jira/browse/SPARK-36501 Project: Spark

[jira] [Updated] (SPARK-36500) The temp_shuffle files are not cleaned up when a task is interrupted

2021-08-12 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-36500: - Description: We discovered a potential file leak on the long running cluster. As the cluster

[jira] [Created] (SPARK-36500) The temp_shuffle files are not cleaned up when a task is interrupted

2021-08-12 Thread Xingbo Jiang (Jira)
Xingbo Jiang created SPARK-36500: Summary: The temp_shuffle files are not cleaned up when a task is interrupted Key: SPARK-36500 URL: https://issues.apache.org/jira/browse/SPARK-36500 Project: Spark

[jira] [Assigned] (SPARK-36499) Test Interval multiply / divide null

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36499: Assignee: Gengliang Wang (was: Apache Spark) > Test Interval multiply / divide null >

[jira] [Assigned] (SPARK-36499) Test Interval multiply / divide null

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36499: Assignee: Apache Spark (was: Gengliang Wang) > Test Interval multiply / divide null >

[jira] [Commented] (SPARK-36499) Test Interval multiply / divide null

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398151#comment-17398151 ] Apache Spark commented on SPARK-36499: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-36499) Test Interval multiply / divide null

2021-08-12 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36499: -- Summary: Test Interval multiply / divide null Key: SPARK-36499 URL: https://issues.apache.org/jira/browse/SPARK-36499 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-36498) Reorder inner fields of the input query in byName V2 write

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36498: Assignee: Apache Spark > Reorder inner fields of the input query in byName V2 write >

[jira] [Commented] (SPARK-36498) Reorder inner fields of the input query in byName V2 write

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398123#comment-17398123 ] Apache Spark commented on SPARK-36498: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36498) Reorder inner fields of the input query in byName V2 write

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36498: Assignee: (was: Apache Spark) > Reorder inner fields of the input query in byName V2

[jira] [Created] (SPARK-36498) Reorder inner fields of the input query in byName V2 write

2021-08-12 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-36498: --- Summary: Reorder inner fields of the input query in byName V2 write Key: SPARK-36498 URL: https://issues.apache.org/jira/browse/SPARK-36498 Project: Spark

[jira] [Assigned] (SPARK-36497) Support Interval add/subtract NULL

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36497: Assignee: Gengliang Wang (was: Apache Spark) > Support Interval add/subtract NULL >

[jira] [Assigned] (SPARK-36497) Support Interval add/subtract NULL

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36497: Assignee: Apache Spark (was: Gengliang Wang) > Support Interval add/subtract NULL >

[jira] [Commented] (SPARK-36497) Support Interval add/subtract NULL

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398117#comment-17398117 ] Apache Spark commented on SPARK-36497: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-36497) Support Interval add/subtract NULL

2021-08-12 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36497: -- Summary: Support Interval add/subtract NULL Key: SPARK-36497 URL: https://issues.apache.org/jira/browse/SPARK-36497 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36493: Assignee: (was: Apache Spark) > SparkFiles.get is not needed for the JDBC keytab

[jira] [Commented] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398055#comment-17398055 ] Apache Spark commented on SPARK-36494: -- User 'zengruios' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36494: Assignee: Apache Spark > SortMergeJoin do unnecessary shuffle for tables whose provider

[jira] [Assigned] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36493: Assignee: Apache Spark > SparkFiles.get is not needed for the JDBC keytab provided by

[jira] [Assigned] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36494: Assignee: (was: Apache Spark) > SortMergeJoin do unnecessary shuffle for tables

[jira] [Commented] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398051#comment-17398051 ] Zikun commented on SPARK-36493: --- A PR is submitted for this issue

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if

[jira] [Commented] (SPARK-36445) ANSI type coercion rule for date time operations

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398031#comment-17398031 ] Apache Spark commented on SPARK-36445: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-36495) Use Type match to simplify CatalystTypeConverter.toCatalyst

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36495: Assignee: Apache Spark > Use Type match to simplify CatalystTypeConverter.toCatalyst >

[jira] [Assigned] (SPARK-36495) Use Type match to simplify CatalystTypeConverter.toCatalyst

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36495: Assignee: (was: Apache Spark) > Use Type match to simplify

[jira] [Commented] (SPARK-36495) Use Type match to simplify CatalystTypeConverter.toCatalyst

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398029#comment-17398029 ] Apache Spark commented on SPARK-36495: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-36496) Remove literals from grouping expressions when using the DataFrame API

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36496: Assignee: (was: Apache Spark) > Remove literals from grouping expressions when using

[jira] [Commented] (SPARK-36496) Remove literals from grouping expressions when using the DataFrame API

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398026#comment-17398026 ] Apache Spark commented on SPARK-36496: -- User 'tanelk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36496) Remove literals from grouping expressions when using the DataFrame API

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36496: Assignee: Apache Spark > Remove literals from grouping expressions when using the

[jira] [Updated] (SPARK-36496) Remove literals from grouping expressions when using the DataFrame API

2021-08-12 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-36496: --- Description: The RemoveLiteralFromGroupExpressions rule might not work, when using the DataFrame

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if

[jira] [Created] (SPARK-36496) Remove literals from grouping expressions when using the DataFrame API

2021-08-12 Thread Tanel Kiis (Jira)
Tanel Kiis created SPARK-36496: -- Summary: Remove literals from grouping expressions when using the DataFrame API Key: SPARK-36496 URL: https://issues.apache.org/jira/browse/SPARK-36496 Project: Spark

[jira] [Created] (SPARK-36495) Use Type match to simplify CatalystTypeConverter.toCatalyst

2021-08-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-36495: Summary: Use Type match to simplify CatalystTypeConverter.toCatalyst Key: SPARK-36495 URL: https://issues.apache.org/jira/browse/SPARK-36495 Project: Spark Issue

[jira] [Assigned] (SPARK-32210) Failed to serialize large MapStatuses

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32210: Assignee: (was: Apache Spark) > Failed to serialize large MapStatuses >

[jira] [Commented] (SPARK-32210) Failed to serialize large MapStatuses

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397995#comment-17397995 ] Apache Spark commented on SPARK-32210: -- User 'kazuyukitanimura' has created a pull request for this

[jira] [Assigned] (SPARK-32210) Failed to serialize large MapStatuses

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32210: Assignee: Apache Spark > Failed to serialize large MapStatuses >

[jira] [Updated] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-36494: Description: Create two tables in spark like this: {code:java} CREATE TABLE catalog_sales (

[jira] [Updated] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-36494: Description: Create two tables in spark like this: {code:java} CREATE TABLE catalog_sales (

[jira] [Created] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread zengrui (Jira)
zengrui created SPARK-36494: --- Summary: SortMergeJoin do unnecessary shuffle for tables whose provider is hive Key: SPARK-36494 URL: https://issues.apache.org/jira/browse/SPARK-36494 Project: Spark

[jira] [Created] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
Zikun created SPARK-36493: - Summary: SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option Key: SPARK-36493 URL: https://issues.apache.org/jira/browse/SPARK-36493 Project: Spark

[jira] [Commented] (SPARK-36387) Fix Series.astype from datetime to nullable string

2021-08-12 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397953#comment-17397953 ] dgd_contributor commented on SPARK-36387: - Sry about my late, please go ahead! this's my first

[jira] [Assigned] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36492: Assignee: (was: Apache Spark) > Add hive-thriftserver to parent maven pom file >

[jira] [Commented] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397944#comment-17397944 ] Apache Spark commented on SPARK-36492: -- User 'dgd-contributor' has created a pull request for this

[jira] [Assigned] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36492: Assignee: Apache Spark > Add hive-thriftserver to parent maven pom file >

[jira] [Commented] (SPARK-36490) Make from_csv/to_csv to handle timestamp_ntz type properly

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397912#comment-17397912 ] Apache Spark commented on SPARK-36490: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36490) Make from_csv/to_csv to handle timestamp_ntz type properly

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36490: Assignee: Kousuke Saruta (was: Apache Spark) > Make from_csv/to_csv to handle

[jira] [Assigned] (SPARK-36490) Make from_csv/to_csv to handle timestamp_ntz type properly

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36490: Assignee: Apache Spark (was: Kousuke Saruta) > Make from_csv/to_csv to handle

[jira] [Updated] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread timothy65535 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] timothy65535 updated SPARK-36492: - Component/s: SQL > Add hive-thriftserver to parent maven pom file >

[jira] [Updated] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread timothy65535 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] timothy65535 updated SPARK-36492: - Component/s: (was: Build) > Add hive-thriftserver to parent maven pom file >

[jira] [Updated] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread timothy65535 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] timothy65535 updated SPARK-36492: - Description: hive-thriftserver module does not exist in the parent pom file, it's not friendly

[jira] [Updated] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread timothy65535 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] timothy65535 updated SPARK-36492: - Description: hive-thriftserver module does not exist in the parent pom file,  > Add

[jira] [Created] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread timothy65535 (Jira)
timothy65535 created SPARK-36492: Summary: Add hive-thriftserver to parent maven pom file Key: SPARK-36492 URL: https://issues.apache.org/jira/browse/SPARK-36492 Project: Spark Issue Type:

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2021-08-12 Thread Cameron Todd (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397898#comment-17397898 ] Cameron Todd commented on SPARK-18105: -- Oh sorry, I meant just a portion of the code can be

[jira] [Created] (SPARK-36491) Make from_json/to_json to handle timestamp_ntz type properly

2021-08-12 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36491: -- Summary: Make from_json/to_json to handle timestamp_ntz type properly Key: SPARK-36491 URL: https://issues.apache.org/jira/browse/SPARK-36491 Project: Spark

[jira] [Resolved] (SPARK-36097) Group exception messages in core/scheduler

2021-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36097. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33529

[jira] [Assigned] (SPARK-36097) Group exception messages in core/scheduler

2021-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36097: --- Assignee: dgd_contributor > Group exception messages in core/scheduler >

  1   2   >