[jira] [Commented] (SPARK-36507) Remove/Replace missing links to AMP Camp materials from index.md

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398456#comment-17398456 ] Apache Spark commented on SPARK-36507: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36507) Remove/Replace missing links to AMP Camp materials from index.md

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36507: Assignee: Apache Spark (was: Kousuke Saruta) > Remove/Replace missing links to AMP Camp

[jira] [Assigned] (SPARK-36507) Remove/Replace missing links to AMP Camp materials from index.md

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36507: Assignee: Kousuke Saruta (was: Apache Spark) > Remove/Replace missing links to AMP Camp

[jira] [Created] (SPARK-36507) Remove/Replace missing links to AMP Camp materials from index.md

2021-08-12 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36507: -- Summary: Remove/Replace missing links to AMP Camp materials from index.md Key: SPARK-36507 URL: https://issues.apache.org/jira/browse/SPARK-36507 Project: Spark

[jira] [Resolved] (SPARK-36428) the 'seconds' parameter of 'make_timestamp' should accept integer type

2021-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36428. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33665 [https://gith

[jira] [Resolved] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36502. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33732 [https://gi

[jira] [Assigned] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36502: Assignee: Dongjoon Hyun > Remove jaxb-api from `sql/catalyst` module > --

[jira] [Resolved] (SPARK-36447) Avoid inlining non-deterministic With-CTEs

2021-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36447. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33671 [https://gith

[jira] [Assigned] (SPARK-36447) Avoid inlining non-deterministic With-CTEs

2021-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36447: --- Assignee: Wei Xue > Avoid inlining non-deterministic With-CTEs > --

[jira] [Resolved] (SPARK-36497) Support Interval add/subtract NULL

2021-08-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36497. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33727 [https://gith

[jira] [Updated] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36501: - Fix Version/s: 3.2.0 > LSHModel.approxSimilarityJoin can generate invalid column names > ---

[jira] [Resolved] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36501. -- Assignee: Tim Armstrong Resolution: Fixed Fixed in https://github.com/apache/spark/pull/

[jira] [Updated] (SPARK-36506) Improve test coverage for series.py and indexes/*.py.

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36506: Summary: Improve test coverage for series.py and indexes/*.py. (was: [PYTHON] Improve test covera

[jira] [Updated] (SPARK-36505) Improve test coverage for frame.py

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36505: Summary: Improve test coverage for frame.py (was: [PYTHON] Improve test coverage for frame.py) >

[jira] [Commented] (SPARK-36387) Fix Series.astype from datetime to nullable string

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398373#comment-17398373 ] Haejoon Lee commented on SPARK-36387: - [~dc-heros] np!! Let me take this one :) > F

[jira] [Resolved] (SPARK-36483) Fix intermittent test failure due to netty dependency version bump

2021-08-12 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-36483. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 337

[jira] [Assigned] (SPARK-36483) Fix intermittent test failure due to netty dependency version bump

2021-08-12 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-36483: --- Assignee: Min Shen > Fix intermittent test failure due to netty dependency

[jira] [Created] (SPARK-36506) [PYTHON] Improve test coverage for series.py and indexes/*.py.

2021-08-12 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-36506: --- Summary: [PYTHON] Improve test coverage for series.py and indexes/*.py. Key: SPARK-36506 URL: https://issues.apache.org/jira/browse/SPARK-36506 Project: Spark

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: * (Series

[jira] [Created] (SPARK-36505) [PYTHON] Improve test coverage for frame.py

2021-08-12 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-36505: --- Summary: [PYTHON] Improve test coverage for frame.py Key: SPARK-36505 URL: https://issues.apache.org/jira/browse/SPARK-36505 Project: Spark Issue Type: Sub-tas

[jira] [Assigned] (SPARK-36503) Add RowToColumnConverter for BinaryType

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36503: Assignee: (was: Apache Spark) > Add RowToColumnConverter for BinaryType > ---

[jira] [Assigned] (SPARK-36503) Add RowToColumnConverter for BinaryType

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36503: Assignee: Apache Spark > Add RowToColumnConverter for BinaryType > --

[jira] [Commented] (SPARK-36503) Add RowToColumnConverter for BinaryType

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398368#comment-17398368 ] Apache Spark commented on SPARK-36503: -- User 'huaxingao' has created a pull request

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: * (Series

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: * (Series

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: * (Series

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: * (Series

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Attachment: Screen Shot 2021-08-13 at 9.59.23 AM.png > Improve test coverage for pandas API on Spa

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: * (Series

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: * (Series

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Description: There are many codes in pandas-on-Spark are not being tested, for example: * (Series

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Attachment: (was: Screen Shot 2021-08-13 at 9.56.48 AM.png) > Improve test coverage for pandas

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Attachment: Screen Shot 2021-08-13 at 9.56.48 AM.png > Improve test coverage for pandas API on Spa

[jira] [Updated] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-36504: Attachment: Screen Shot 2021-08-13 at 9.56.48 AM.png > Improve test coverage for pandas API on Spa

[jira] [Created] (SPARK-36504) Improve test coverage for pandas API on Spark

2021-08-12 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-36504: --- Summary: Improve test coverage for pandas API on Spark Key: SPARK-36504 URL: https://issues.apache.org/jira/browse/SPARK-36504 Project: Spark Issue Type: Umbre

[jira] [Created] (SPARK-36503) Add RowToColumnConverter for BinaryType

2021-08-12 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-36503: -- Summary: Add RowToColumnConverter for BinaryType Key: SPARK-36503 URL: https://issues.apache.org/jira/browse/SPARK-36503 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36502: Assignee: (was: Apache Spark) > Remove jaxb-api from `sql/catalyst` module >

[jira] [Assigned] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36502: Assignee: Apache Spark > Remove jaxb-api from `sql/catalyst` module > ---

[jira] [Commented] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398318#comment-17398318 ] Apache Spark commented on SPARK-36502: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-36502) Remove jaxb-api from `sql/catalyst` module

2021-08-12 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-36502: - Summary: Remove jaxb-api from `sql/catalyst` module Key: SPARK-36502 URL: https://issues.apache.org/jira/browse/SPARK-36502 Project: Spark Issue Type: Impr

[jira] [Commented] (SPARK-36500) The temp_shuffle files are not cleaned up when a task is interrupted

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398289#comment-17398289 ] Apache Spark commented on SPARK-36500: -- User 'jiangxb1987' has created a pull reque

[jira] [Assigned] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36501: Assignee: Apache Spark > LSHModel.approxSimilarityJoin can generate invalid column names

[jira] [Assigned] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36501: Assignee: (was: Apache Spark) > LSHModel.approxSimilarityJoin can generate invalid co

[jira] [Commented] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398264#comment-17398264 ] Apache Spark commented on SPARK-36501: -- User 'timarmstrong' has created a pull requ

[jira] [Commented] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398252#comment-17398252 ] Tim Armstrong commented on SPARK-36501: --- I have a fix for this... > LSHModel.appr

[jira] [Created] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Tim Armstrong (Jira)
Tim Armstrong created SPARK-36501: - Summary: LSHModel.approxSimilarityJoin can generate invalid column names Key: SPARK-36501 URL: https://issues.apache.org/jira/browse/SPARK-36501 Project: Spark

[jira] [Updated] (SPARK-36500) The temp_shuffle files are not cleaned up when a task is interrupted

2021-08-12 Thread Xingbo Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-36500: - Description: We discovered a potential file leak on the long running cluster. As the cluster run

[jira] [Created] (SPARK-36500) The temp_shuffle files are not cleaned up when a task is interrupted

2021-08-12 Thread Xingbo Jiang (Jira)
Xingbo Jiang created SPARK-36500: Summary: The temp_shuffle files are not cleaned up when a task is interrupted Key: SPARK-36500 URL: https://issues.apache.org/jira/browse/SPARK-36500 Project: Spark

[jira] [Assigned] (SPARK-36499) Test Interval multiply / divide null

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36499: Assignee: Gengliang Wang (was: Apache Spark) > Test Interval multiply / divide null > --

[jira] [Assigned] (SPARK-36499) Test Interval multiply / divide null

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36499: Assignee: Apache Spark (was: Gengliang Wang) > Test Interval multiply / divide null > --

[jira] [Commented] (SPARK-36499) Test Interval multiply / divide null

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398151#comment-17398151 ] Apache Spark commented on SPARK-36499: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-36499) Test Interval multiply / divide null

2021-08-12 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36499: -- Summary: Test Interval multiply / divide null Key: SPARK-36499 URL: https://issues.apache.org/jira/browse/SPARK-36499 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-36498) Reorder inner fields of the input query in byName V2 write

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36498: Assignee: Apache Spark > Reorder inner fields of the input query in byName V2 write > ---

[jira] [Commented] (SPARK-36498) Reorder inner fields of the input query in byName V2 write

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398123#comment-17398123 ] Apache Spark commented on SPARK-36498: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-36498) Reorder inner fields of the input query in byName V2 write

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36498: Assignee: (was: Apache Spark) > Reorder inner fields of the input query in byName V2

[jira] [Created] (SPARK-36498) Reorder inner fields of the input query in byName V2 write

2021-08-12 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-36498: --- Summary: Reorder inner fields of the input query in byName V2 write Key: SPARK-36498 URL: https://issues.apache.org/jira/browse/SPARK-36498 Project: Spark Issu

[jira] [Assigned] (SPARK-36497) Support Interval add/subtract NULL

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36497: Assignee: Gengliang Wang (was: Apache Spark) > Support Interval add/subtract NULL >

[jira] [Assigned] (SPARK-36497) Support Interval add/subtract NULL

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36497: Assignee: Apache Spark (was: Gengliang Wang) > Support Interval add/subtract NULL >

[jira] [Commented] (SPARK-36497) Support Interval add/subtract NULL

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398117#comment-17398117 ] Apache Spark commented on SPARK-36497: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-36497) Support Interval add/subtract NULL

2021-08-12 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36497: -- Summary: Support Interval add/subtract NULL Key: SPARK-36497 URL: https://issues.apache.org/jira/browse/SPARK-36497 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36493: Assignee: (was: Apache Spark) > SparkFiles.get is not needed for the JDBC keytab prov

[jira] [Commented] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398055#comment-17398055 ] Apache Spark commented on SPARK-36494: -- User 'zengruios' has created a pull request

[jira] [Assigned] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36494: Assignee: Apache Spark > SortMergeJoin do unnecessary shuffle for tables whose provider i

[jira] [Assigned] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36493: Assignee: Apache Spark > SparkFiles.get is not needed for the JDBC keytab provided by the

[jira] [Assigned] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36494: Assignee: (was: Apache Spark) > SortMergeJoin do unnecessary shuffle for tables whose

[jira] [Commented] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398051#comment-17398051 ] Zikun commented on SPARK-36493: --- A PR is submitted for this issue https://github.com/apac

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if (k

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if (k

[jira] [Commented] (SPARK-36445) ANSI type coercion rule for date time operations

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398031#comment-17398031 ] Apache Spark commented on SPARK-36445: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-36495) Use Type match to simplify CatalystTypeConverter.toCatalyst

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36495: Assignee: Apache Spark > Use Type match to simplify CatalystTypeConverter.toCatalyst > --

[jira] [Assigned] (SPARK-36495) Use Type match to simplify CatalystTypeConverter.toCatalyst

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36495: Assignee: (was: Apache Spark) > Use Type match to simplify CatalystTypeConverter.toCa

[jira] [Commented] (SPARK-36495) Use Type match to simplify CatalystTypeConverter.toCatalyst

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398029#comment-17398029 ] Apache Spark commented on SPARK-36495: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-36496) Remove literals from grouping expressions when using the DataFrame API

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36496: Assignee: (was: Apache Spark) > Remove literals from grouping expressions when using

[jira] [Commented] (SPARK-36496) Remove literals from grouping expressions when using the DataFrame API

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398026#comment-17398026 ] Apache Spark commented on SPARK-36496: -- User 'tanelk' has created a pull request fo

[jira] [Assigned] (SPARK-36496) Remove literals from grouping expressions when using the DataFrame API

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36496: Assignee: Apache Spark > Remove literals from grouping expressions when using the DataFra

[jira] [Updated] (SPARK-36496) Remove literals from grouping expressions when using the DataFrame API

2021-08-12 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-36496: --- Description: The RemoveLiteralFromGroupExpressions rule might not work, when using the DataFrame API

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if (k

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option if (k

[jira] [Created] (SPARK-36496) Remove literals from grouping expressions when using the DataFrame API

2021-08-12 Thread Tanel Kiis (Jira)
Tanel Kiis created SPARK-36496: -- Summary: Remove literals from grouping expressions when using the DataFrame API Key: SPARK-36496 URL: https://issues.apache.org/jira/browse/SPARK-36496 Project: Spark

[jira] [Created] (SPARK-36495) Use Type match to simplify CatalystTypeConverter.toCatalyst

2021-08-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-36495: Summary: Use Type match to simplify CatalystTypeConverter.toCatalyst Key: SPARK-36495 URL: https://issues.apache.org/jira/browse/SPARK-36495 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-32210) Failed to serialize large MapStatuses

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32210: Assignee: (was: Apache Spark) > Failed to serialize large MapStatuses > -

[jira] [Commented] (SPARK-32210) Failed to serialize large MapStatuses

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397995#comment-17397995 ] Apache Spark commented on SPARK-32210: -- User 'kazuyukitanimura' has created a pull

[jira] [Assigned] (SPARK-32210) Failed to serialize large MapStatuses

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32210: Assignee: Apache Spark > Failed to serialize large MapStatuses >

[jira] [Updated] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-36494: Description: Create two tables in spark like this: {code:java} CREATE TABLE catalog_sales ( cs_sold_da

[jira] [Updated] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread zengrui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengrui updated SPARK-36494: Description: Create two tables in spark like this: {code:java} CREATE TABLE catalog_sales ( cs_sold_da

[jira] [Created] (SPARK-36494) SortMergeJoin do unnecessary shuffle for tables whose provider is hive

2021-08-12 Thread zengrui (Jira)
zengrui created SPARK-36494: --- Summary: SortMergeJoin do unnecessary shuffle for tables whose provider is hive Key: SPARK-36494 URL: https://issues.apache.org/jira/browse/SPARK-36494 Project: Spark

[jira] [Created] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

2021-08-12 Thread Zikun (Jira)
Zikun created SPARK-36493: - Summary: SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option Key: SPARK-36493 URL: https://issues.apache.org/jira/browse/SPARK-36493 Project: Spark

[jira] [Commented] (SPARK-36387) Fix Series.astype from datetime to nullable string

2021-08-12 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397953#comment-17397953 ] dgd_contributor commented on SPARK-36387: - Sry about my late, please go ahead! t

[jira] [Assigned] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36492: Assignee: (was: Apache Spark) > Add hive-thriftserver to parent maven pom file >

[jira] [Commented] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397944#comment-17397944 ] Apache Spark commented on SPARK-36492: -- User 'dgd-contributor' has created a pull r

[jira] [Assigned] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36492: Assignee: Apache Spark > Add hive-thriftserver to parent maven pom file > ---

[jira] [Commented] (SPARK-36490) Make from_csv/to_csv to handle timestamp_ntz type properly

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397912#comment-17397912 ] Apache Spark commented on SPARK-36490: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36490) Make from_csv/to_csv to handle timestamp_ntz type properly

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36490: Assignee: Kousuke Saruta (was: Apache Spark) > Make from_csv/to_csv to handle timestamp_

[jira] [Assigned] (SPARK-36490) Make from_csv/to_csv to handle timestamp_ntz type properly

2021-08-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36490: Assignee: Apache Spark (was: Kousuke Saruta) > Make from_csv/to_csv to handle timestamp_

[jira] [Updated] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread timothy65535 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] timothy65535 updated SPARK-36492: - Component/s: SQL > Add hive-thriftserver to parent maven pom file >

[jira] [Updated] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread timothy65535 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] timothy65535 updated SPARK-36492: - Component/s: (was: Build) > Add hive-thriftserver to parent maven pom file > ---

[jira] [Updated] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread timothy65535 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] timothy65535 updated SPARK-36492: - Description: hive-thriftserver module does not exist in the parent pom file, it's not friendly

[jira] [Updated] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread timothy65535 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] timothy65535 updated SPARK-36492: - Description: hive-thriftserver module does not exist in the parent pom file,  > Add hive-thrift

[jira] [Created] (SPARK-36492) Add hive-thriftserver to parent maven pom file

2021-08-12 Thread timothy65535 (Jira)
timothy65535 created SPARK-36492: Summary: Add hive-thriftserver to parent maven pom file Key: SPARK-36492 URL: https://issues.apache.org/jira/browse/SPARK-36492 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2021-08-12 Thread Cameron Todd (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397898#comment-17397898 ] Cameron Todd commented on SPARK-18105: -- Oh sorry, I meant just a portion of the cod

  1   2   >