[jira] [Issue Comment Deleted] (SPARK-37105) Pass all UTs in `sql/hive` with Java 17

2021-10-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-37105: - Comment: was deleted (was: Add `extraJavaTestArgs` to sql/hive pom.xml and run  {code:java} build/mvn

[jira] [Updated] (SPARK-37105) Pass all UTs in `sql/hive` with Java 17

2021-10-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-37105: - Description: Add `extraJavaTestArgs` to sql/hive pom.xml and run  {code:java} build/mvn clean install

[jira] [Commented] (SPARK-37105) Pass all UTs in `sql/hive` with Java 17

2021-10-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17433562#comment-17433562 ] Yang Jie commented on SPARK-37105: -- Add `extraJavaTestArgs` to sql/hive pom.xml and run  {code:java}

[jira] [Resolved] (SPARK-37101) In class ShuffleBlockPusher, use config instead of key

2021-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37101. -- Fix Version/s: 3.3.0 Assignee: jinhai Resolution: Fixed Fixed in

[jira] [Assigned] (SPARK-37107) Inline type hints for files in python/pyspark/status.py

2021-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37107: Assignee: (was: Apache Spark) > Inline type hints for files in

[jira] [Assigned] (SPARK-37107) Inline type hints for files in python/pyspark/status.py

2021-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37107: Assignee: Apache Spark > Inline type hints for files in python/pyspark/status.py >

[jira] [Commented] (SPARK-37107) Inline type hints for files in python/pyspark/status.py

2021-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17433548#comment-17433548 ] Apache Spark commented on SPARK-37107: -- User 'dchvn' has created a pull request for this issue:

[jira] [Created] (SPARK-37107) Inline type hints for files in python/pyspark/status.py

2021-10-24 Thread dch nguyen (Jira)
dch nguyen created SPARK-37107: -- Summary: Inline type hints for files in python/pyspark/status.py Key: SPARK-37107 URL: https://issues.apache.org/jira/browse/SPARK-37107 Project: Spark Issue

[jira] [Updated] (SPARK-37105) Pass all UTs in `sql/hive` with Java 17

2021-10-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-37105: - Summary: Pass all UTs in `sql/hive` with Java 17 (was: Pass all UTs in `sql/core` with Java 17) >

[jira] [Created] (SPARK-37105) Pass all UTs in `sql/core` with Java 17

2021-10-24 Thread Yang Jie (Jira)
Yang Jie created SPARK-37105: Summary: Pass all UTs in `sql/core` with Java 17 Key: SPARK-37105 URL: https://issues.apache.org/jira/browse/SPARK-37105 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-37106) Pass all UTs in `yarn` with Java 17

2021-10-24 Thread Yang Jie (Jira)
Yang Jie created SPARK-37106: Summary: Pass all UTs in `yarn` with Java 17 Key: SPARK-37106 URL: https://issues.apache.org/jira/browse/SPARK-37106 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-36968) ps.Series.dot raise "matrices are not aligned" if index is not same

2021-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36968: Assignee: dch nguyen > ps.Series.dot raise "matrices are not aligned" if index is not

[jira] [Resolved] (SPARK-36968) ps.Series.dot raise "matrices are not aligned" if index is not same

2021-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36968. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34235

[jira] [Updated] (SPARK-37101) In class ShuffleBlockPusher, use config instead of key

2021-10-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37101: Affects Version/s: (was: 3.2.0) 3.3.0 > In class ShuffleBlockPusher,

[jira] [Commented] (SPARK-36057) Support volcano/alternative schedulers

2021-10-24 Thread Jiaxin Shan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17433527#comment-17433527 ] Jiaxin Shan commented on SPARK-36057: - Is it better to do this at the operator level? > Support

[jira] [Resolved] (SPARK-37089) ParquetFileFormat registers task completion listeners lazily, causing Python writer thread to segfault when off-heap vectorized reader is enabled

2021-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37089. -- Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-37081) Upgrade the version of RDBMS and corresponding JDBC drivers used by docker-integration-tests

2021-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37081. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34350

[jira] [Resolved] (SPARK-37103) Switch from Maven to SBT to build Spark on AppVeyor

2021-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37103. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34373

[jira] [Assigned] (SPARK-37091) Support Java 17 in SparkR SystemRequirements

2021-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37091: Assignee: Darek > Support Java 17 in SparkR SystemRequirements >

[jira] [Resolved] (SPARK-37091) Support Java 17 in SparkR SystemRequirements

2021-10-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37091. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34371

[jira] [Assigned] (SPARK-37037) Improve byte array sort by unify compareTo function of UTF8String and ByteArray

2021-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37037: Assignee: XiDuo You > Improve byte array sort by unify compareTo function of UTF8String

[jira] [Resolved] (SPARK-37037) Improve byte array sort by unify compareTo function of UTF8String and ByteArray

2021-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37037. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34310

[jira] [Updated] (SPARK-37037) Improve byte array sort by unify compareTo function of UTF8String and ByteArray

2021-10-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37037: - Priority: Minor (was: Major) > Improve byte array sort by unify compareTo function of

[jira] [Assigned] (SPARK-37104) RDD and DStream should be covariant

2021-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37104: Assignee: Apache Spark > RDD and DStream should be covariant >

[jira] [Assigned] (SPARK-37104) RDD and DStream should be covariant

2021-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37104: Assignee: (was: Apache Spark) > RDD and DStream should be covariant >

[jira] [Commented] (SPARK-37104) RDD and DStream should be covariant

2021-10-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17433427#comment-17433427 ] Apache Spark commented on SPARK-37104: -- User 'zero323' has created a pull request for this issue:

[jira] [Created] (SPARK-37104) RDD and DStream should be covariant

2021-10-24 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-37104: -- Summary: RDD and DStream should be covariant Key: SPARK-37104 URL: https://issues.apache.org/jira/browse/SPARK-37104 Project: Spark Issue Type: