[jira] [Assigned] (SPARK-32276) Remove redundant sorts before repartition nodes

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32276: Assignee: Apache Spark > Remove redundant sorts before repartition nodes >

[jira] [Assigned] (SPARK-32276) Remove redundant sorts before repartition nodes

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32276: Assignee: (was: Apache Spark) > Remove redundant sorts before repartition nodes >

[jira] [Commented] (SPARK-32318) Add a test case to EliminateSortsSuite for protecting ORDER BY in DISTRIBUTE BY

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157906#comment-17157906 ] Apache Spark commented on SPARK-32318: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-32318) Add a test case to EliminateSortsSuite for protecting ORDER BY in DISTRIBUTE BY

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32318: Assignee: (was: Apache Spark) > Add a test case to EliminateSortsSuite for

[jira] [Commented] (SPARK-32318) Add a test case to EliminateSortsSuite for protecting ORDER BY in DISTRIBUTE BY

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157905#comment-17157905 ] Apache Spark commented on SPARK-32318: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-32318) Add a test case to EliminateSortsSuite for protecting ORDER BY in DISTRIBUTE BY

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32318: Assignee: Apache Spark > Add a test case to EliminateSortsSuite for protecting ORDER BY

[jira] [Updated] (SPARK-32318) Add a test case to EliminateSortsSuite for protecting ORDER BY in DISTRIBUTE BY

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32318: -- Description: This is found during reviewing SPARK-32276. *AFTER SPARK-32276* {code} scala>

[jira] [Created] (SPARK-32318) Add a test case to EliminateSortsSuite for protecting ORDER BY in DISTRIBUTE BY

2020-07-14 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-32318: - Summary: Add a test case to EliminateSortsSuite for protecting ORDER BY in DISTRIBUTE BY Key: SPARK-32318 URL: https://issues.apache.org/jira/browse/SPARK-32318

[jira] [Updated] (SPARK-32318) Add a test case to EliminateSortsSuite for protecting ORDER BY in DISTRIBUTE BY

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32318: -- Affects Version/s: (was: 2.4.6) 2.4.7 > Add a test case to

[jira] [Commented] (SPARK-32276) Remove redundant sorts before repartition nodes

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157889#comment-17157889 ] Dongjoon Hyun commented on SPARK-32276: --- Due to the regression

[jira] [Assigned] (SPARK-32276) Remove redundant sorts before repartition nodes

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32276: - Assignee: (was: Anton Okolnychyi) > Remove redundant sorts before repartition

[jira] [Updated] (SPARK-32276) Remove redundant sorts before repartition nodes

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32276: -- Fix Version/s: (was: 3.1.0) > Remove redundant sorts before repartition nodes >

[jira] [Reopened] (SPARK-32276) Remove redundant sorts before repartition nodes

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-32276: --- > Remove redundant sorts before repartition nodes >

[jira] [Assigned] (SPARK-31985) Remove the incomplete code path on aggregation for continuous mode

2020-07-14 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-31985: Assignee: Jungtaek Lim > Remove the incomplete code path on aggregation for continuous

[jira] [Resolved] (SPARK-31985) Remove the incomplete code path on aggregation for continuous mode

2020-07-14 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-31985. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29077

[jira] [Updated] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-14 Thread Krish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krish updated SPARK-32317: -- Description: Hi,   We generate parquet files which are partitioned on Date on a daily basis, and we send

[jira] [Updated] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-14 Thread Krish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krish updated SPARK-32317: -- Description: Hi,   We generate parquet files which are partitioned on Date on a daily basis, and we send

[jira] [Resolved] (SPARK-32276) Remove redundant sorts before repartition nodes

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32276. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29089

[jira] [Assigned] (SPARK-32276) Remove redundant sorts before repartition nodes

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32276: - Assignee: Anton Okolnychyi > Remove redundant sorts before repartition nodes >

[jira] [Commented] (SPARK-5594) SparkException: Failed to get broadcast (TorrentBroadcast)

2020-07-14 Thread vipin Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157857#comment-17157857 ] vipin Kumar commented on SPARK-5594: I am getting this in Spark 2.4.3 in Google Dataproc 

[jira] [Resolved] (SPARK-32316) Test PySpark with Python 3.8 in Github Actions as well

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32316. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29116

[jira] [Assigned] (SPARK-32316) Test PySpark with Python 3.8 in Github Actions as well

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32316: - Assignee: Hyukjin Kwon > Test PySpark with Python 3.8 in Github Actions as well >

[jira] [Created] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-14 Thread Krish (Jira)
Krish created SPARK-32317: - Summary: Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected Key: SPARK-32317 URL: https://issues.apache.org/jira/browse/SPARK-32317

[jira] [Updated] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-14 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-32307: - Description: {code:java} spark.udf.register("key", udf((m: Map[String, String]) => m.keys.head.toInt))

[jira] [Commented] (SPARK-32316) Test PySpark with Python 3.8 in Github Actions as well

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157805#comment-17157805 ] Apache Spark commented on SPARK-32316: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32316) Test PySpark with Python 3.8 in Github Actions as well

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157804#comment-17157804 ] Apache Spark commented on SPARK-32316: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-32316) Test PySpark with Python 3.8 in Github Actions as well

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32316: Assignee: (was: Apache Spark) > Test PySpark with Python 3.8 in Github Actions as

[jira] [Assigned] (SPARK-32316) Test PySpark with Python 3.8 in Github Actions as well

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32316: Assignee: Apache Spark > Test PySpark with Python 3.8 in Github Actions as well >

[jira] [Updated] (SPARK-32316) Test PySpark with Python 3.8 in Github Actions as well

2020-07-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32316: - Summary: Test PySpark with Python 3.8 in Github Actions as well (was: Test PySpark with Python

[jira] [Created] (SPARK-32316) Test PySpark with Python 3.8 in Github Actions as well.

2020-07-14 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32316: Summary: Test PySpark with Python 3.8 in Github Actions as well. Key: SPARK-32316 URL: https://issues.apache.org/jira/browse/SPARK-32316 Project: Spark

[jira] [Assigned] (SPARK-32315) Provide an explanation error message when calling require

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32315: Assignee: (was: Apache Spark) > Provide an explanation error message when calling

[jira] [Assigned] (SPARK-32315) Provide an explanation error message when calling require

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32315: Assignee: Apache Spark > Provide an explanation error message when calling require >

[jira] [Commented] (SPARK-32315) Provide an explanation error message when calling require

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157794#comment-17157794 ] Apache Spark commented on SPARK-32315: -- User 'dzlab' has created a pull request for this issue:

[jira] [Commented] (SPARK-32315) Provide an explanation error message when calling require

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157795#comment-17157795 ] Apache Spark commented on SPARK-32315: -- User 'dzlab' has created a pull request for this issue:

[jira] [Commented] (SPARK-32094) Patch cloudpickle.py with typing module side-effect fix

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157792#comment-17157792 ] Apache Spark commented on SPARK-32094: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-32315) Provide an explanation error message when calling require

2020-07-14 Thread dzlabs (Jira)
dzlabs created SPARK-32315: -- Summary: Provide an explanation error message when calling require Key: SPARK-32315 URL: https://issues.apache.org/jira/browse/SPARK-32315 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-32314) [SHS] Add config to control whether log old format of stacktrace

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32314: Assignee: Apache Spark > [SHS] Add config to control whether log old format of

[jira] [Commented] (SPARK-32314) [SHS] Add config to control whether log old format of stacktrace

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157780#comment-17157780 ] Apache Spark commented on SPARK-32314: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-32314) [SHS] Add config to control whether log old format of stacktrace

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32314: Assignee: (was: Apache Spark) > [SHS] Add config to control whether log old format

[jira] [Commented] (SPARK-32314) [SHS] Add config to control whether log old format of stacktrace

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1715#comment-1715 ] Apache Spark commented on SPARK-32314: -- User 'warrenzhu25' has created a pull request for this

[jira] [Created] (SPARK-32314) [SHS] Add config to control whether log old format of stacktrace

2020-07-14 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-32314: Summary: [SHS] Add config to control whether log old format of stacktrace Key: SPARK-32314 URL: https://issues.apache.org/jira/browse/SPARK-32314 Project: Spark

[jira] [Resolved] (SPARK-32301) Add a test case for toPandas to work with empty partitioned Spark DataFrame

2020-07-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32301. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-32301) Add a test case for toPandas to work with empty partitioned Spark DataFrame

2020-07-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32301: Assignee: Hyukjin Kwon > Add a test case for toPandas to work with empty partitioned

[jira] [Assigned] (SPARK-32303) Remove leftover from editable mode installation in PIP test

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32303: - Assignee: Hyukjin Kwon > Remove leftover from editable mode installation in PIP test >

[jira] [Resolved] (SPARK-32303) Remove leftover from editable mode installation in PIP test

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32303. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29102

[jira] [Assigned] (SPARK-31608) Add a hybrid KVStore to make UI loading faster

2020-07-14 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-31608: Assignee: Baohe Zhang > Add a hybrid KVStore to make UI loading faster >

[jira] [Resolved] (SPARK-31608) Add a hybrid KVStore to make UI loading faster

2020-07-14 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-31608. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28412

[jira] [Commented] (SPARK-32279) Install Sphinx in Python 3 on Jenkins machines

2020-07-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157736#comment-17157736 ] Hyukjin Kwon commented on SPARK-32279: -- Awesome! > Install Sphinx in Python 3 on Jenkins machines

[jira] [Commented] (SPARK-32310) ML params default value parity

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157718#comment-17157718 ] Apache Spark commented on SPARK-32310: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32310) ML params default value parity

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32310: Assignee: (was: Apache Spark) > ML params default value parity >

[jira] [Commented] (SPARK-32310) ML params default value parity

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157717#comment-17157717 ] Apache Spark commented on SPARK-32310: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32310) ML params default value parity

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32310: Assignee: Apache Spark > ML params default value parity > --

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157681#comment-17157681 ] Apache Spark commented on SPARK-29292: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32300) toPandas with no partitions should work

2020-07-14 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-32300: Assignee: Hyukjin Kwon > toPandas with no partitions should work >

[jira] [Resolved] (SPARK-32300) toPandas with no partitions should work

2020-07-14 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-32300. -- Fix Version/s: 2.4.7 Resolution: Fixed Issue resolved by pull request 29098

[jira] [Resolved] (SPARK-32311) Remove duplicate import

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32311. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29109

[jira] [Assigned] (SPARK-32311) Remove duplicate import

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32311: - Assignee: Fokko Driesprong > Remove duplicate import > --- > >

[jira] [Commented] (SPARK-32305) Make `mvn clean` remove `metastore_db` and `spark-warehouse`

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157629#comment-17157629 ] Dongjoon Hyun commented on SPARK-32305: --- For a record, `hive-1.2` profile is officially and

[jira] [Assigned] (SPARK-32305) Should automatically cleanup meta data generated by test cases not in target dir

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32305: - Assignee: Yang Jie > Should automatically cleanup meta data generated by test cases

[jira] [Resolved] (SPARK-32305) Should automatically cleanup meta data generated by test cases not in target dir

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32305. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29103

[jira] [Updated] (SPARK-32305) Make `mvn clean` remove `metastore_db` and `spark-warehouse`

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32305: -- Summary: Make `mvn clean` remove `metastore_db` and `spark-warehouse` (was: Should

[jira] [Updated] (SPARK-32305) Should automatically cleanup meta data generated by test cases not in target dir

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32305: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Should automatically

[jira] [Resolved] (SPARK-32309) Fix missing import

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32309. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29108

[jira] [Assigned] (SPARK-32309) Fix missing import

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32309: - Assignee: Fokko Driesprong > Fix missing import > -- > >

[jira] [Closed] (SPARK-27757) Bump Jackson to 2.9.9

2020-07-14 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong closed SPARK-27757. Master is on Jackson 2.10 now :) > Bump Jackson to 2.9.9 > - > >

[jira] [Assigned] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32307: - Assignee: wuyi > Aggression that use map type input UDF as group expression can fail >

[jira] [Resolved] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32307. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-17333) Make pyspark interface friendly with mypy static analysis

2020-07-14 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-17333: - Summary: Make pyspark interface friendly with mypy static analysis (was: Make pyspark

[jira] [Commented] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157594#comment-17157594 ] Dongjoon Hyun commented on SPARK-32307: --- I'll update it. > Aggression that use map type input UDF

[jira] [Updated] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32307: -- Affects Version/s: (was: 3.0.0) 3.0.1 > Aggression that use map

[jira] [Commented] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157586#comment-17157586 ] Dongjoon Hyun commented on SPARK-32307: --- If this exists at `branch-3.0` and doesn't released yet,

[jira] [Commented] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157576#comment-17157576 ] Dongjoon Hyun commented on SPARK-32307: --- Hi, [~Ngone51]. I cannot reproduce the bug with the

[jira] [Commented] (SPARK-32279) Install Sphinx in Python 3 on Jenkins machines

2020-07-14 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157574#comment-17157574 ] Shane Knapp commented on SPARK-32279: - done > Install Sphinx in Python 3 on Jenkins machines >

[jira] [Resolved] (SPARK-32279) Install Sphinx in Python 3 on Jenkins machines

2020-07-14 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp resolved SPARK-32279. - Resolution: Fixed > Install Sphinx in Python 3 on Jenkins machines >

[jira] [Commented] (SPARK-32279) Install Sphinx in Python 3 on Jenkins machines

2020-07-14 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157573#comment-17157573 ] shane knapp commented on SPARK-32279: - never mind. we're not doing this for pypy. this will be

[jira] [Commented] (SPARK-32279) Install Sphinx in Python 3 on Jenkins machines

2020-07-14 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157571#comment-17157571 ] shane knapp commented on SPARK-32279: - hmm, this is going to be a little bit more complex, as the

[jira] [Assigned] (SPARK-32313) Remove Python 2 artifacts

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32313: Assignee: (was: Apache Spark) > Remove Python 2 artifacts >

[jira] [Commented] (SPARK-32313) Remove Python 2 artifacts

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157551#comment-17157551 ] Apache Spark commented on SPARK-32313: -- User 'Fokko' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32313) Remove Python 2 artifacts

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32313: Assignee: Apache Spark > Remove Python 2 artifacts > - > >

[jira] [Created] (SPARK-32313) Remove Python 2 artifacts

2020-07-14 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32313: Summary: Remove Python 2 artifacts Key: SPARK-32313 URL: https://issues.apache.org/jira/browse/SPARK-32313 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32311) Remove duplicate import

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157548#comment-17157548 ] Apache Spark commented on SPARK-32311: -- User 'Fokko' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32311) Remove duplicate import

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32311: Assignee: Apache Spark > Remove duplicate import > --- > >

[jira] [Commented] (SPARK-32311) Remove duplicate import

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157549#comment-17157549 ] Apache Spark commented on SPARK-32311: -- User 'Fokko' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32311) Remove duplicate import

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32311: Assignee: (was: Apache Spark) > Remove duplicate import > --- >

[jira] [Commented] (SPARK-32312) Upgrade Apache Arrow to 1.0.0

2020-07-14 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157543#comment-17157543 ] Bryan Cutler commented on SPARK-32312: -- I've been doing local testing and will submit a WIP PR

[jira] [Created] (SPARK-32311) Remove duplicate import

2020-07-14 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32311: Summary: Remove duplicate import Key: SPARK-32311 URL: https://issues.apache.org/jira/browse/SPARK-32311 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32312) Upgrade Apache Arrow to 1.0.0

2020-07-14 Thread Bryan Cutler (Jira)
Bryan Cutler created SPARK-32312: Summary: Upgrade Apache Arrow to 1.0.0 Key: SPARK-32312 URL: https://issues.apache.org/jira/browse/SPARK-32312 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32309) Fix missing import

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157541#comment-17157541 ] Apache Spark commented on SPARK-32309: -- User 'Fokko' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32309) Fix missing import

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32309: Assignee: (was: Apache Spark) > Fix missing import > -- > >

[jira] [Assigned] (SPARK-32309) Fix missing import

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32309: Assignee: Apache Spark > Fix missing import > -- > >

[jira] [Commented] (SPARK-32309) Fix missing import

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157540#comment-17157540 ] Apache Spark commented on SPARK-32309: -- User 'Fokko' has created a pull request for this issue:

[jira] [Created] (SPARK-32310) ML params default value parity

2020-07-14 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-32310: -- Summary: ML params default value parity Key: SPARK-32310 URL: https://issues.apache.org/jira/browse/SPARK-32310 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32309) Fix missing import

2020-07-14 Thread Fokko Driesprong (Jira)
Fokko Driesprong created SPARK-32309: Summary: Fix missing import Key: SPARK-32309 URL: https://issues.apache.org/jira/browse/SPARK-32309 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32308) Move by-name resolution logic of unionByName from API code to analysis phase

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157513#comment-17157513 ] Apache Spark commented on SPARK-32308: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32308) Move by-name resolution logic of unionByName from API code to analysis phase

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32308: Assignee: L. C. Hsieh (was: Apache Spark) > Move by-name resolution logic of

[jira] [Assigned] (SPARK-32308) Move by-name resolution logic of unionByName from API code to analysis phase

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32308: Assignee: Apache Spark (was: L. C. Hsieh) > Move by-name resolution logic of

[jira] [Commented] (SPARK-32308) Move by-name resolution logic of unionByName from API code to analysis phase

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157512#comment-17157512 ] Apache Spark commented on SPARK-32308: -- User 'viirya' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

2020-07-14 Thread Saurabh Chawla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157503#comment-17157503 ] Saurabh Chawla edited comment on SPARK-32234 at 7/14/20, 4:48 PM: --

[jira] [Commented] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157507#comment-17157507 ] Apache Spark commented on SPARK-32307: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32307) Aggression that use map type input UDF as group expression can fail

2020-07-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32307: Assignee: (was: Apache Spark) > Aggression that use map type input UDF as group

  1   2   >