[jira] [Assigned] (SPARK-32412) Unify error handling for spark thrift server operations

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32412: Assignee: Apache Spark (was: Kent Yao) > Unify error handling for spark thrift server

[jira] [Assigned] (SPARK-32412) Unify error handling for spark thrift server operations

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32412: Assignee: Kent Yao (was: Apache Spark) > Unify error handling for spark thrift server

[jira] [Reopened] (SPARK-32412) Unify error handling for spark thrift server operations

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-32412: - > Unify error handling for spark thrift server operations >

[jira] [Commented] (SPARK-32110) -0.0 vs 0.0 is inconsistent

2020-08-24 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183747#comment-17183747 ] L. C. Hsieh commented on SPARK-32110: - For `HyperLogLogPlusPlus`, seems its problem is that we use

[jira] [Resolved] (SPARK-32641) withField + getField on null structs returns incorrect results

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32641. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29522

[jira] [Assigned] (SPARK-32641) withField + getField on null structs returns incorrect results

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32641: --- Assignee: fqaiser94 > withField + getField on null structs returns incorrect results >

[jira] [Resolved] (SPARK-32646) ORC predicate pushdown should work with case-insensitive analysis

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32646. - Resolution: Fixed > ORC predicate pushdown should work with case-insensitive analysis >

[jira] [Updated] (SPARK-32646) ORC predicate pushdown should work with case-insensitive analysis

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32646: Fix Version/s: 3.0.1 > ORC predicate pushdown should work with case-insensitive analysis >

[jira] [Resolved] (SPARK-31000) Add ability to set table description in the catalog

2020-08-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31000. -- Fix Version/s: 3.1.0 Resolution: Fixed Merged at

[jira] [Updated] (SPARK-26164) [SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort

2020-08-24 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-26164: - Affects Version/s: 3.0.0 > [SQL] Allow FileFormatWriter to write multiple partitions/buckets without

[jira] [Commented] (SPARK-32694) Pushdown cast to data sources

2020-08-24 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183719#comment-17183719 ] Rakesh Raushan commented on SPARK-32694: One of the proposed

[jira] [Commented] (SPARK-32110) -0.0 vs 0.0 is inconsistent

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183709#comment-17183709 ] Wenchen Fan commented on SPARK-32110: - > Is the idea to not change writing path to

[jira] [Commented] (SPARK-32466) Add support to catch SparkPlan regression base on TPC-DS queries

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183701#comment-17183701 ] Apache Spark commented on SPARK-32466: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32695) Add 'build' and 'project/build.properties' into cache key of SBT and Zinc

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32695: Assignee: (was: Apache Spark) > Add 'build' and 'project/build.properties' into

[jira] [Assigned] (SPARK-32695) Add 'build' and 'project/build.properties' into cache key of SBT and Zinc

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32695: Assignee: Apache Spark > Add 'build' and 'project/build.properties' into cache key of

[jira] [Commented] (SPARK-32695) Add 'build' and 'project/build.properties' into cache key of SBT and Zinc

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183676#comment-17183676 ] Apache Spark commented on SPARK-32695: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-32695) Add 'build' and 'project/build.properties' into cache key of SBT and Zinc

2020-08-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32695: - Description: The version information is included in {{build}} and {{project/build.properties}}.

[jira] [Updated] (SPARK-32695) Add 'build' and 'project/build.properties' into cache key of SBT and Zinc

2020-08-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32695: - Summary: Add 'build' and 'project/build.properties' into cache key of SBT and Zinc (was: Add

[jira] [Created] (SPARK-32695) Add files that conatin SBT version and Zinc version into the cache hash

2020-08-24 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32695: Summary: Add files that conatin SBT version and Zinc version into the cache hash Key: SPARK-32695 URL: https://issues.apache.org/jira/browse/SPARK-32695 Project:

[jira] [Commented] (SPARK-32592) Make `DataFrameReader.table` take the specified options

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183647#comment-17183647 ] Apache Spark commented on SPARK-32592: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32592) Make `DataFrameReader.table` take the specified options

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32592: Assignee: Apache Spark > Make `DataFrameReader.table` take the specified options >

[jira] [Commented] (SPARK-32592) Make `DataFrameReader.table` take the specified options

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183646#comment-17183646 ] Apache Spark commented on SPARK-32592: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32592) Make `DataFrameReader.table` take the specified options

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32592: Assignee: (was: Apache Spark) > Make `DataFrameReader.table` take the specified

[jira] [Commented] (SPARK-26164) [SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort

2020-08-24 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183643#comment-17183643 ] Cheng Su commented on SPARK-26164: -- [~cloud_fan] and [~hyukjin.kwon] - sorry for keeping ping. Would

[jira] [Updated] (SPARK-32592) Make `DataFrameReader.table` take the specified options

2020-08-24 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-32592: --- Priority: Minor (was: Major) > Make `DataFrameReader.table` take the specified options >

[jira] [Commented] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

2020-08-24 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183622#comment-17183622 ] Mridul Muralidharan commented on SPARK-30602: - SPIP proposal document:

[jira] [Assigned] (SPARK-32686) Un-deprecate inferring DataFrame schema from list of dictionaries

2020-08-24 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-32686: Assignee: Nicholas Chammas > Un-deprecate inferring DataFrame schema from list of

[jira] [Resolved] (SPARK-32686) Un-deprecate inferring DataFrame schema from list of dictionaries

2020-08-24 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-32686. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29510

[jira] [Commented] (SPARK-32692) Support INSERT OVERWRITE DIR cross cluster

2020-08-24 Thread Rohit Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183611#comment-17183611 ] Rohit Mishra commented on SPARK-32692: -- [~angerszhuuu], Can you please add a description? >

[jira] [Commented] (SPARK-32694) Pushdown cast to data sources

2020-08-24 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183592#comment-17183592 ] Chao Sun commented on SPARK-32694: -- Seems there could be more cases like this, such as: {code} scala>

[jira] [Commented] (SPARK-24266) Spark client terminates while driver is still running

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183590#comment-17183590 ] Apache Spark commented on SPARK-24266: -- User 'jkleckner' has created a pull request for this issue:

[jira] [Updated] (SPARK-32694) Pushdown cast to data sources

2020-08-24 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-32694: - Description: Currently we don't support pushing down cast to data source (see

[jira] [Updated] (SPARK-32694) Pushdown cast to data sources

2020-08-24 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-32694: - Description: Currently we don't support pushing down cast to data source (see

[jira] [Created] (SPARK-32694) Pushdown cast to data sources

2020-08-24 Thread Chao Sun (Jira)
Chao Sun created SPARK-32694: Summary: Pushdown cast to data sources Key: SPARK-32694 URL: https://issues.apache.org/jira/browse/SPARK-32694 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32569) Gaussian can not handle data close to MaxDouble

2020-08-24 Thread Tobias Haar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183583#comment-17183583 ] Tobias Haar commented on SPARK-32569: - Thanks for your feedback! I hopefully removed most of the

[jira] [Commented] (SPARK-21708) use sbt 1.x

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183579#comment-17183579 ] Apache Spark commented on SPARK-21708: -- User 'gemelen' has created a pull request for this issue:

[jira] [Commented] (SPARK-21708) use sbt 1.x

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183578#comment-17183578 ] Apache Spark commented on SPARK-21708: -- User 'gemelen' has created a pull request for this issue:

[jira] [Resolved] (SPARK-4591) Algorithm/model parity for spark.ml (Scala)

2020-08-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-4591. - Resolution: Done > Algorithm/model parity for spark.ml (Scala) >

[jira] [Updated] (SPARK-32569) Gaussian can not handle data close to MaxDouble

2020-08-24 Thread Tobias Haar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobias Haar updated SPARK-32569: Description: Running Gaussian from Apache Spark MLlib with [this

[jira] [Commented] (SPARK-32673) Pyspark/cloudpickle.py - no module named 'wfdb'

2020-08-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183557#comment-17183557 ] Sean R. Owen commented on SPARK-32673: -- This might be databricks-specific somehow. I don't see any

[jira] [Resolved] (SPARK-32654) Provide a graph algorithm library based on GraphX named GraphLib

2020-08-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32654. -- Resolution: Not A Problem Not sure what this is proposing - if you have a library, that's

[jira] [Updated] (SPARK-32673) Pyspark/cloudpickle.py - no module named 'wfdb'

2020-08-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-32673: - Description: Running Spark in a Databricks notebook.   Ran into this issue when executing a

[jira] [Commented] (SPARK-32110) -0.0 vs 0.0 is inconsistent

2020-08-24 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183509#comment-17183509 ] L. C. Hsieh commented on SPARK-32110: - [~cloud_fan] Is the idea to not change writing path to

[jira] [Resolved] (SPARK-32516) path option is treated differently for 'format("parquet").load(path)' vs. 'parquet(path)'

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32516. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29328

[jira] [Assigned] (SPARK-32516) path option is treated differently for 'format("parquet").load(path)' vs. 'parquet(path)'

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32516: --- Assignee: Terry Kim > path option is treated differently for

[jira] [Commented] (SPARK-32412) Unify error handling for spark thrift server operations

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183426#comment-17183426 ] Apache Spark commented on SPARK-32412: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-32412) Unify error handling for spark thrift server operations

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183427#comment-17183427 ] Apache Spark commented on SPARK-32412: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-32646) ORC predicate pushdown should work with case-insensitive analysis

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183405#comment-17183405 ] Apache Spark commented on SPARK-32646: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-32646) ORC predicate pushdown should work with case-insensitive analysis

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183406#comment-17183406 ] Apache Spark commented on SPARK-32646: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-32693) Compare two dataframes with same schema except nullable property

2020-08-24 Thread david bernuau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] david bernuau updated SPARK-32693: -- Description: My aim is to compare two dataframes with very close schemas : same number of

[jira] [Commented] (SPARK-32110) -0.0 vs 0.0 is inconsistent

2020-08-24 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183398#comment-17183398 ] Tanel Kiis commented on SPARK-32110: Another thing to note is that -0.0 and 0.0 can have different

[jira] [Updated] (SPARK-32693) Compare two dataframes with same schema except nullable property

2020-08-24 Thread david bernuau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] david bernuau updated SPARK-32693: -- Description: My aim is to compare two dataframes with very close schemas : same number of

[jira] [Updated] (SPARK-32693) Compare two dataframes with same schema except nullable property

2020-08-24 Thread david bernuau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] david bernuau updated SPARK-32693: -- Description: My aim is to compare two dataframes with very close schemas : same number of

[jira] [Updated] (SPARK-32693) Compare two dataframes with same schema except nullable property

2020-08-24 Thread david bernuau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] david bernuau updated SPARK-32693: -- Description: My aim is to compare two dataframes with very close schemas : same number of

[jira] [Created] (SPARK-32693) Compare two dataframes with same schema except nullable property

2020-08-24 Thread david bernuau (Jira)
david bernuau created SPARK-32693: - Summary: Compare two dataframes with same schema except nullable property Key: SPARK-32693 URL: https://issues.apache.org/jira/browse/SPARK-32693 Project: Spark

[jira] [Resolved] (SPARK-32588) SizeEstimator class not always properly initialized in tests.

2020-08-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32588. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-32588) SizeEstimator class not always properly initialized in tests.

2020-08-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-32588: Assignee: Michael Munday > SizeEstimator class not always properly initialized in tests.

[jira] [Resolved] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32690. -- Resolution: Duplicate > Spark-32550 affects the performance of some cases >

[jira] [Commented] (SPARK-32110) -0.0 vs 0.0 is inconsistent

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183344#comment-17183344 ] Wenchen Fan commented on SPARK-32110: - I'd like to discuss the expected behavior here. AFAIK Spark

[jira] [Commented] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183325#comment-17183325 ] Apache Spark commented on SPARK-32690: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32690: Assignee: (was: Apache Spark) > Spark-32550 affects the performance of some cases >

[jira] [Commented] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183326#comment-17183326 ] Apache Spark commented on SPARK-32690: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32690: Assignee: Apache Spark > Spark-32550 affects the performance of some cases >

[jira] [Commented] (SPARK-32688) LiteralGenerator for float and double does not generate special values

2020-08-24 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183319#comment-17183319 ] Tanel Kiis commented on SPARK-32688: The introduced tests will fail when SPARK-32110 is not fixed >

[jira] [Commented] (SPARK-32550) Make SpecificInternalRow constructors faster by using while loops instead of maps

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183219#comment-17183219 ] Apache Spark commented on SPARK-32550: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-32550) Make SpecificInternalRow constructors faster by using while loops instead of maps

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183216#comment-17183216 ] Apache Spark commented on SPARK-32550: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183218#comment-17183218 ] Yang Jie commented on SPARK-32690: -- cc [~sowen]  I gave a pr to revert 

[jira] [Created] (SPARK-32692) Support INSERT OVERWRITE DIR cross cluster

2020-08-24 Thread angerszhu (Jira)
angerszhu created SPARK-32692: - Summary: Support INSERT OVERWRITE DIR cross cluster Key: SPARK-32692 URL: https://issues.apache.org/jira/browse/SPARK-32692 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

2020-08-24 Thread huangtianhua (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183189#comment-17183189 ] huangtianhua commented on SPARK-32691: -- [~dongjoon], I took tests for several times locally, the

[jira] [Created] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

2020-08-24 Thread huangtianhua (Jira)
huangtianhua created SPARK-32691: Summary: Test org.apache.spark.DistributedSuite failed on arm64 jenkins Key: SPARK-32691 URL: https://issues.apache.org/jira/browse/SPARK-32691 Project: Spark

[jira] [Updated] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-32690: - Attachment: (was: image-2020-08-24-19-30-55-380.png) > Spark-32550 affects the performance of some

[jira] [Updated] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-32690: - Description: I found that [Spark-32550|https://github.com/apache/spark/pull/29366] affected the

[jira] [Updated] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-32690: - Attachment: (was: image-2020-08-24-19-30-17-712.png) > Spark-32550 affects the performance of some

[jira] [Updated] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-32690: - Attachment: image-2020-08-24-19-30-17-712.png > Spark-32550 affects the performance of some cases >

[jira] [Updated] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-32690: - Attachment: image-2020-08-24-19-30-55-380.png > Spark-32550 affects the performance of some cases >

[jira] [Updated] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-32690: - Description: I found that [Spark-32550|https://github.com/apache/spark/pull/29366] affected the

[jira] [Created] (SPARK-32690) Spark-32550 affects the performance of some cases

2020-08-24 Thread Yang Jie (Jira)
Yang Jie created SPARK-32690: Summary: Spark-32550 affects the performance of some cases Key: SPARK-32690 URL: https://issues.apache.org/jira/browse/SPARK-32690 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32110) -0.0 vs 0.0 is inconsistent

2020-08-24 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183107#comment-17183107 ] Tanel Kiis commented on SPARK-32110: there is also inconsistency in the code gen and the interpreted

[jira] [Commented] (SPARK-32683) Datetime Pattern F not working as expected

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183081#comment-17183081 ] Wenchen Fan commented on SPARK-32683: - It's unfortunate that we missed it before the 3.0 release. I

[jira] [Resolved] (SPARK-32649) Optimize BHJ/SHJ inner and semi join with empty hashed relation

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32649. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29484

[jira] [Assigned] (SPARK-32649) Optimize BHJ/SHJ inner and semi join with empty hashed relation

2020-08-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32649: --- Assignee: Cheng Su > Optimize BHJ/SHJ inner and semi join with empty hashed relation >

[jira] [Commented] (SPARK-32676) Fix double caching in KMeans/BiKMeans

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183012#comment-17183012 ] Apache Spark commented on SPARK-32676: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-32676) Fix double caching in KMeans/BiKMeans

2020-08-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183010#comment-17183010 ] Apache Spark commented on SPARK-32676: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Resolved] (SPARK-25872) Add an optimizer tracker for TPC-DS queries

2020-08-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-25872. - Resolution: Fixed > Add an optimizer tracker for TPC-DS queries >

[jira] [Updated] (SPARK-25872) Add an optimizer tracker for TPC-DS queries

2020-08-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25872: Fix Version/s: 3.1.0 > Add an optimizer tracker for TPC-DS queries >