[jira] [Updated] (SPARK-37389) Check unclosed bracketed comments

2021-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-37389: Fix Version/s: 3.1.3 > Check unclosed bracketed comments > - > >

[jira] [Assigned] (SPARK-36861) Partition columns are overly eagerly parsed as dates

2021-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36861: --- Assignee: Max Gekk > Partition columns are overly eagerly parsed as dates >

[jira] [Resolved] (SPARK-36861) Partition columns are overly eagerly parsed as dates

2021-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36861. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34700

[jira] [Resolved] (SPARK-34332) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests

2021-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34332. - Resolution: Fixed Issue resolved by pull request 34610

[jira] [Assigned] (SPARK-34332) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests

2021-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34332: --- Assignee: Terry Kim (was: Max Gekk) > Unify v1 and v2 ALTER TABLE .. SET LOCATION tests >

[jira] [Resolved] (SPARK-37456) CREATE NAMESPACE should qualify location for v2 command

2021-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37456. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34704

[jira] [Assigned] (SPARK-37456) CREATE NAMESPACE should qualify location for v2 command

2021-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37456: --- Assignee: Terry Kim > CREATE NAMESPACE should qualify location for v2 command >

[jira] [Resolved] (SPARK-37459) Upgrade commons-cli to 1.5.0

2021-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37459. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34707

[jira] [Commented] (SPARK-37459) Upgrade commons-cli to 1.5.0

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448935#comment-17448935 ] Apache Spark commented on SPARK-37459: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37459) Upgrade commons-cli to 1.5.0

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37459: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade commons-cli to 1.5.0 >

[jira] [Commented] (SPARK-37459) Upgrade commons-cli to 1.5.0

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448934#comment-17448934 ] Apache Spark commented on SPARK-37459: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37459) Upgrade commons-cli to 1.5.0

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37459: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade commons-cli to 1.5.0 >

[jira] [Created] (SPARK-37459) Upgrade commons-cli to 1.5.0

2021-11-24 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-37459: -- Summary: Upgrade commons-cli to 1.5.0 Key: SPARK-37459 URL: https://issues.apache.org/jira/browse/SPARK-37459 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-37458) Remove unnecessary object serialization on foreachBatch

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448920#comment-17448920 ] Apache Spark commented on SPARK-37458: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-37458) Remove unnecessary object serialization on foreachBatch

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37458: Assignee: (was: Apache Spark) > Remove unnecessary object serialization on

[jira] [Assigned] (SPARK-37458) Remove unnecessary object serialization on foreachBatch

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37458: Assignee: Apache Spark > Remove unnecessary object serialization on foreachBatch >

[jira] [Created] (SPARK-37458) Remove unnecessary object serialization on foreachBatch

2021-11-24 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-37458: Summary: Remove unnecessary object serialization on foreachBatch Key: SPARK-37458 URL: https://issues.apache.org/jira/browse/SPARK-37458 Project: Spark

[jira] [Commented] (SPARK-37458) Remove unnecessary object serialization on foreachBatch

2021-11-24 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448915#comment-17448915 ] Jungtaek Lim commented on SPARK-37458: -- Will submit a PR soon. > Remove unnecessary object

[jira] [Commented] (SPARK-37325) Result vector from pandas_udf was not the required length

2021-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448914#comment-17448914 ] Hyukjin Kwon commented on SPARK-37325: -- you can use pandas aggregate funciton. for questions, you

[jira] [Resolved] (SPARK-37325) Result vector from pandas_udf was not the required length

2021-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37325. -- Resolution: Invalid > Result vector from pandas_udf was not the required length >

[jira] [Closed] (SPARK-37325) Result vector from pandas_udf was not the required length

2021-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon closed SPARK-37325. > Result vector from pandas_udf was not the required length >

[jira] [Reopened] (SPARK-37325) Result vector from pandas_udf was not the required length

2021-11-24 Thread liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liu reopened SPARK-37325: - > Result vector from pandas_udf was not the required length >

[jira] [Assigned] (SPARK-37457) Update cloudpickle to v2.0.0

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37457: Assignee: (was: Apache Spark) > Update cloudpickle to v2.0.0 >

[jira] [Commented] (SPARK-37457) Update cloudpickle to v2.0.0

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448912#comment-17448912 ] Apache Spark commented on SPARK-37457: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37457) Update cloudpickle to v2.0.0

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37457: Assignee: Apache Spark > Update cloudpickle to v2.0.0 > > >

[jira] [Commented] (SPARK-37457) Update cloudpickle to v2.0.0

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448911#comment-17448911 ] Apache Spark commented on SPARK-37457: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-37457) Update cloudpickle to v2.0.0

2021-11-24 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-37457: Summary: Update cloudpickle to v2.0.0 Key: SPARK-37457 URL: https://issues.apache.org/jira/browse/SPARK-37457 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-37456) CREATE NAMESPACE should qualify location for v2 command

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448899#comment-17448899 ] Apache Spark commented on SPARK-37456: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37456) CREATE NAMESPACE should qualify location for v2 command

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37456: Assignee: Apache Spark > CREATE NAMESPACE should qualify location for v2 command >

[jira] [Assigned] (SPARK-37456) CREATE NAMESPACE should qualify location for v2 command

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37456: Assignee: (was: Apache Spark) > CREATE NAMESPACE should qualify location for v2

[jira] [Created] (SPARK-37456) CREATE NAMESPACE should qualify location for v2 command

2021-11-24 Thread Terry Kim (Jira)
Terry Kim created SPARK-37456: - Summary: CREATE NAMESPACE should qualify location for v2 command Key: SPARK-37456 URL: https://issues.apache.org/jira/browse/SPARK-37456 Project: Spark Issue

[jira] [Updated] (SPARK-37357) Add small partition factor for rebalance partitions

2021-11-24 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-37357: -- Summary: Add small partition factor for rebalance partitions (was: Create skew partition specs

[jira] [Resolved] (SPARK-37446) hive-2.3.9 related API use invoke method

2021-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37446. -- Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-37446) hive-2.3.9 related API use invoke method

2021-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37446: Assignee: angerszhu > hive-2.3.9 related API use invoke method >

[jira] [Resolved] (SPARK-37453) Split TPC-DS build in GitHub Actions

2021-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37453. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34698

[jira] [Assigned] (SPARK-37453) Split TPC-DS build in GitHub Actions

2021-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37453: Assignee: Hyukjin Kwon > Split TPC-DS build in GitHub Actions >

[jira] [Assigned] (SPARK-37455) Replace hash with sort aggregate if child is already sorted

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37455: Assignee: (was: Apache Spark) > Replace hash with sort aggregate if child is already

[jira] [Commented] (SPARK-37455) Replace hash with sort aggregate if child is already sorted

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448879#comment-17448879 ] Apache Spark commented on SPARK-37455: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37455) Replace hash with sort aggregate if child is already sorted

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37455: Assignee: Apache Spark > Replace hash with sort aggregate if child is already sorted >

[jira] [Assigned] (SPARK-37455) Replace hash with sort aggregate if child is already sorted

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37455: Assignee: Apache Spark > Replace hash with sort aggregate if child is already sorted >

[jira] [Created] (SPARK-37455) Replace hash with sort aggregate if child is already sorted

2021-11-24 Thread Cheng Su (Jira)
Cheng Su created SPARK-37455: Summary: Replace hash with sort aggregate if child is already sorted Key: SPARK-37455 URL: https://issues.apache.org/jira/browse/SPARK-37455 Project: Spark Issue

[jira] [Updated] (SPARK-34287) Object hash and sort aggregation improvement

2021-11-24 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34287: - Summary: Object hash and sort aggregation improvement (was: Object hash and sort aggregation execution

[jira] [Assigned] (SPARK-37450) Spark SQL reads unnecessary nested fields (another type of pruning case)

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37450: Assignee: (was: Apache Spark) > Spark SQL reads unnecessary nested fields (another

[jira] [Assigned] (SPARK-37450) Spark SQL reads unnecessary nested fields (another type of pruning case)

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37450: Assignee: Apache Spark > Spark SQL reads unnecessary nested fields (another type of

[jira] [Commented] (SPARK-37450) Spark SQL reads unnecessary nested fields (another type of pruning case)

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448878#comment-17448878 ] Apache Spark commented on SPARK-37450: -- User 'viirya' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-37450) Spark SQL reads unnecessary nested fields (another type of pruning case)

2021-11-24 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448824#comment-17448824 ] L. C. Hsieh edited comment on SPARK-37450 at 11/24/21, 11:33 PM: - Okay,

[jira] [Commented] (SPARK-37450) Spark SQL reads unnecessary nested fields (another type of pruning case)

2021-11-24 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448824#comment-17448824 ] L. C. Hsieh commented on SPARK-37450: - Okay, it sounds like a possible optimization case, although I

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448808#comment-17448808 ] Apache Spark commented on SPARK-36861: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36861) Partition columns are overly eagerly parsed as dates

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36861: Assignee: (was: Apache Spark) > Partition columns are overly eagerly parsed as dates

[jira] [Assigned] (SPARK-36861) Partition columns are overly eagerly parsed as dates

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36861: Assignee: Apache Spark > Partition columns are overly eagerly parsed as dates >

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448807#comment-17448807 ] Apache Spark commented on SPARK-36861: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37444) ALTER NAMESPACE ... SET LOCATION should handle empty location consistently across v1 and v2 command

2021-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37444: --- Assignee: Terry Kim > ALTER NAMESPACE ... SET LOCATION should handle empty location

[jira] [Resolved] (SPARK-37444) ALTER NAMESPACE ... SET LOCATION should handle empty location consistently across v1 and v2 command

2021-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37444. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34686

[jira] [Commented] (SPARK-37454) support expressions in time travel timestamp

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448692#comment-17448692 ] Apache Spark commented on SPARK-37454: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-37454) support expressions in time travel timestamp

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448691#comment-17448691 ] Apache Spark commented on SPARK-37454: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37454) support expressions in time travel timestamp

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37454: Assignee: (was: Apache Spark) > support expressions in time travel timestamp >

[jira] [Assigned] (SPARK-37454) support expressions in time travel timestamp

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37454: Assignee: Apache Spark > support expressions in time travel timestamp >

[jira] [Comment Edited] (SPARK-26663) Cannot query a Hive table with subdirectories

2021-11-24 Thread Valeriy Borysyuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448678#comment-17448678 ] Valeriy Borysyuk edited comment on SPARK-26663 at 11/24/21, 3:46 PM: -

[jira] [Created] (SPARK-37454) support expressions in time travel timestamp

2021-11-24 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-37454: --- Summary: support expressions in time travel timestamp Key: SPARK-37454 URL: https://issues.apache.org/jira/browse/SPARK-37454 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-26663) Cannot query a Hive table with subdirectories

2021-11-24 Thread Valeriy Borysyuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448678#comment-17448678 ] Valeriy Borysyuk edited comment on SPARK-26663 at 11/24/21, 3:35 PM: -

[jira] [Commented] (SPARK-26663) Cannot query a Hive table with subdirectories

2021-11-24 Thread Valeriy Borysyuk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448678#comment-17448678 ] Valeriy Borysyuk commented on SPARK-26663: -- To reproduce this, Hive steps in description should

[jira] [Commented] (SPARK-32929) StreamSuite failure on IBM Z: - SPARK-20432: union one stream with itself

2021-11-24 Thread Kun Lu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448644#comment-17448644 ] Kun Lu commented on SPARK-32929: This issue could be closed. > StreamSuite failure on IBM Z: -

[jira] [Commented] (SPARK-37453) Split TPC-DS build in GitHub Actions

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448543#comment-17448543 ] Apache Spark commented on SPARK-37453: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37453) Split TPC-DS build in GitHub Actions

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37453: Assignee: (was: Apache Spark) > Split TPC-DS build in GitHub Actions >

[jira] [Resolved] (SPARK-37399) Inline type hints for python/pyspark/ml/common.py

2021-11-24 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37399. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37399) Inline type hints for python/pyspark/ml/common.py

2021-11-24 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37399: -- Assignee: Nicholas Chammas > Inline type hints for

[jira] [Resolved] (SPARK-37403) Inline type hints for python/pyspark/mllib/common.py

2021-11-24 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37403. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37403) Inline type hints for python/pyspark/mllib/common.py

2021-11-24 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37403: -- Assignee: Nicholas Chammas > Inline type hints for

[jira] [Comment Edited] (SPARK-37449) Side effects between PySpark Pandas UDF and Numpy indexing

2021-11-24 Thread Carlos Gameiro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448500#comment-17448500 ] Carlos Gameiro edited comment on SPARK-37449 at 11/24/21, 10:50 AM:

[jira] [Assigned] (SPARK-37453) Split TPC-DS build in GitHub Actions

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37453: Assignee: Apache Spark > Split TPC-DS build in GitHub Actions >

[jira] [Commented] (SPARK-37453) Split TPC-DS build in GitHub Actions

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448542#comment-17448542 ] Apache Spark commented on SPARK-37453: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Comment Edited] (SPARK-37449) Side effects between PySpark Pandas UDF and Numpy indexing

2021-11-24 Thread Carlos Gameiro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448539#comment-17448539 ] Carlos Gameiro edited comment on SPARK-37449 at 11/24/21, 10:49 AM:

[jira] [Comment Edited] (SPARK-37449) Side effects between PySpark Pandas UDF and Numpy indexing

2021-11-24 Thread Carlos Gameiro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448539#comment-17448539 ] Carlos Gameiro edited comment on SPARK-37449 at 11/24/21, 10:49 AM:

[jira] [Commented] (SPARK-37449) Side effects between PySpark Pandas UDF and Numpy indexing

2021-11-24 Thread Carlos Gameiro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448539#comment-17448539 ] Carlos Gameiro commented on SPARK-37449: Sometimes there is no natural way to group a dataframe

[jira] [Created] (SPARK-37453) Split TPC-DS build in GitHub Actions

2021-11-24 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-37453: Summary: Split TPC-DS build in GitHub Actions Key: SPARK-37453 URL: https://issues.apache.org/jira/browse/SPARK-37453 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448510#comment-17448510 ] Apache Spark commented on SPARK-37452: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37452: Assignee: (was: Apache Spark) > Char and Varchar breaks backward compatibility

[jira] [Commented] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448508#comment-17448508 ] Apache Spark commented on SPARK-37452: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37452: Assignee: Apache Spark > Char and Varchar breaks backward compatibility between v3 and

[jira] [Commented] (SPARK-37449) Side effects between PySpark Pandas UDF and Numpy indexing

2021-11-24 Thread Carlos Gameiro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448500#comment-17448500 ] Carlos Gameiro commented on SPARK-37449: You are right. I'm selecting the first 4 indexes of

[jira] [Created] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

2021-11-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-37452: Summary: Char and Varchar breaks backward compatibility between v3 and v2 Key: SPARK-37452 URL: https://issues.apache.org/jira/browse/SPARK-37452 Project: Spark

[jira] [Resolved] (SPARK-28299) Evaluation of multiple CTE uses

2021-11-24 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth resolved SPARK-28299. Resolution: Duplicate > Evaluation of multiple CTE uses > - > >

[jira] [Commented] (SPARK-37389) Check unclosed bracketed comments

2021-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448474#comment-17448474 ] Apache Spark commented on SPARK-37389: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37389) Check unclosed bracketed comments

2021-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37389: --- Assignee: jiaan.geng > Check unclosed bracketed comments >

[jira] [Resolved] (SPARK-37389) Check unclosed bracketed comments

2021-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37389. - Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by pull