[
https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32412:
Assignee: Apache Spark (was: Kent Yao)
> Unify error handling for spark thrift server
[
https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32412:
Assignee: Kent Yao (was: Apache Spark)
> Unify error handling for spark thrift server
[
https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reopened SPARK-32412:
-
> Unify error handling for spark thrift server operations
>
[
https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183747#comment-17183747
]
L. C. Hsieh commented on SPARK-32110:
-
For `HyperLogLogPlusPlus`, seems its problem is that we use
[
https://issues.apache.org/jira/browse/SPARK-32641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-32641.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29522
[
https://issues.apache.org/jira/browse/SPARK-32641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-32641:
---
Assignee: fqaiser94
> withField + getField on null structs returns incorrect results
>
[
https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-32646.
-
Resolution: Fixed
> ORC predicate pushdown should work with case-insensitive analysis
>
[
https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-32646:
Fix Version/s: 3.0.1
> ORC predicate pushdown should work with case-insensitive analysis
>
[
https://issues.apache.org/jira/browse/SPARK-31000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31000.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Merged at
[
https://issues.apache.org/jira/browse/SPARK-26164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Su updated SPARK-26164:
-
Affects Version/s: 3.0.0
> [SQL] Allow FileFormatWriter to write multiple partitions/buckets without
[
https://issues.apache.org/jira/browse/SPARK-32694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183719#comment-17183719
]
Rakesh Raushan commented on SPARK-32694:
One of the proposed
[
https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183709#comment-17183709
]
Wenchen Fan commented on SPARK-32110:
-
> Is the idea to not change writing path to
[
https://issues.apache.org/jira/browse/SPARK-32466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183701#comment-17183701
]
Apache Spark commented on SPARK-32466:
--
User 'Ngone51' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32695:
Assignee: (was: Apache Spark)
> Add 'build' and 'project/build.properties' into
[
https://issues.apache.org/jira/browse/SPARK-32695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32695:
Assignee: Apache Spark
> Add 'build' and 'project/build.properties' into cache key of
[
https://issues.apache.org/jira/browse/SPARK-32695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183676#comment-17183676
]
Apache Spark commented on SPARK-32695:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-32695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-32695:
-
Description: The version information is included in {{build}} and
{{project/build.properties}}.
[
https://issues.apache.org/jira/browse/SPARK-32695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-32695:
-
Summary: Add 'build' and 'project/build.properties' into cache key of SBT
and Zinc (was: Add
Hyukjin Kwon created SPARK-32695:
Summary: Add files that conatin SBT version and Zinc version into
the cache hash
Key: SPARK-32695
URL: https://issues.apache.org/jira/browse/SPARK-32695
Project:
[
https://issues.apache.org/jira/browse/SPARK-32592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183647#comment-17183647
]
Apache Spark commented on SPARK-32592:
--
User 'huaxingao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32592:
Assignee: Apache Spark
> Make `DataFrameReader.table` take the specified options
>
[
https://issues.apache.org/jira/browse/SPARK-32592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183646#comment-17183646
]
Apache Spark commented on SPARK-32592:
--
User 'huaxingao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32592:
Assignee: (was: Apache Spark)
> Make `DataFrameReader.table` take the specified
[
https://issues.apache.org/jira/browse/SPARK-26164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183643#comment-17183643
]
Cheng Su commented on SPARK-26164:
--
[~cloud_fan] and [~hyukjin.kwon] - sorry for keeping ping. Would
[
https://issues.apache.org/jira/browse/SPARK-32592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huaxin Gao updated SPARK-32592:
---
Priority: Minor (was: Major)
> Make `DataFrameReader.table` take the specified options
>
[
https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183622#comment-17183622
]
Mridul Muralidharan commented on SPARK-30602:
-
SPIP proposal document:
[
https://issues.apache.org/jira/browse/SPARK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler reassigned SPARK-32686:
Assignee: Nicholas Chammas
> Un-deprecate inferring DataFrame schema from list of
[
https://issues.apache.org/jira/browse/SPARK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler resolved SPARK-32686.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29510
[
https://issues.apache.org/jira/browse/SPARK-32692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183611#comment-17183611
]
Rohit Mishra commented on SPARK-32692:
--
[~angerszhuuu], Can you please add a description?
>
[
https://issues.apache.org/jira/browse/SPARK-32694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183592#comment-17183592
]
Chao Sun commented on SPARK-32694:
--
Seems there could be more cases like this, such as:
{code}
scala>
[
https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183590#comment-17183590
]
Apache Spark commented on SPARK-24266:
--
User 'jkleckner' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-32694:
-
Description:
Currently we don't support pushing down cast to data source (see
[
https://issues.apache.org/jira/browse/SPARK-32694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-32694:
-
Description:
Currently we don't support pushing down cast to data source (see
Chao Sun created SPARK-32694:
Summary: Pushdown cast to data sources
Key: SPARK-32694
URL: https://issues.apache.org/jira/browse/SPARK-32694
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-32569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183583#comment-17183583
]
Tobias Haar commented on SPARK-32569:
-
Thanks for your feedback! I hopefully removed most of the
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183579#comment-17183579
]
Apache Spark commented on SPARK-21708:
--
User 'gemelen' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183578#comment-17183578
]
Apache Spark commented on SPARK-21708:
--
User 'gemelen' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-4591.
-
Resolution: Done
> Algorithm/model parity for spark.ml (Scala)
>
[
https://issues.apache.org/jira/browse/SPARK-32569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tobias Haar updated SPARK-32569:
Description:
Running Gaussian from Apache Spark MLlib with [this
[
https://issues.apache.org/jira/browse/SPARK-32673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183557#comment-17183557
]
Sean R. Owen commented on SPARK-32673:
--
This might be databricks-specific somehow. I don't see any
[
https://issues.apache.org/jira/browse/SPARK-32654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-32654.
--
Resolution: Not A Problem
Not sure what this is proposing - if you have a library, that's
[
https://issues.apache.org/jira/browse/SPARK-32673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-32673:
-
Description:
Running Spark in a Databricks notebook.
Ran into this issue when executing a
[
https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183509#comment-17183509
]
L. C. Hsieh commented on SPARK-32110:
-
[~cloud_fan] Is the idea to not change writing path to
[
https://issues.apache.org/jira/browse/SPARK-32516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-32516.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29328
[
https://issues.apache.org/jira/browse/SPARK-32516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-32516:
---
Assignee: Terry Kim
> path option is treated differently for
[
https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183426#comment-17183426
]
Apache Spark commented on SPARK-32412:
--
User 'yaooqinn' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183427#comment-17183427
]
Apache Spark commented on SPARK-32412:
--
User 'yaooqinn' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183405#comment-17183405
]
Apache Spark commented on SPARK-32646:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183406#comment-17183406
]
Apache Spark commented on SPARK-32646:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
david bernuau updated SPARK-32693:
--
Description:
My aim is to compare two dataframes with very close schemas : same number of
[
https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183398#comment-17183398
]
Tanel Kiis commented on SPARK-32110:
Another thing to note is that -0.0 and 0.0 can have different
[
https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
david bernuau updated SPARK-32693:
--
Description:
My aim is to compare two dataframes with very close schemas : same number of
[
https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
david bernuau updated SPARK-32693:
--
Description:
My aim is to compare two dataframes with very close schemas : same number of
[
https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
david bernuau updated SPARK-32693:
--
Description:
My aim is to compare two dataframes with very close schemas : same number of
david bernuau created SPARK-32693:
-
Summary: Compare two dataframes with same schema except nullable
property
Key: SPARK-32693
URL: https://issues.apache.org/jira/browse/SPARK-32693
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-32588.
--
Fix Version/s: 3.1.0
3.0.1
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-32588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-32588:
Assignee: Michael Munday
> SizeEstimator class not always properly initialized in tests.
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-32690.
--
Resolution: Duplicate
> Spark-32550 affects the performance of some cases
>
[
https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183344#comment-17183344
]
Wenchen Fan commented on SPARK-32110:
-
I'd like to discuss the expected behavior here.
AFAIK Spark
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183325#comment-17183325
]
Apache Spark commented on SPARK-32690:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32690:
Assignee: (was: Apache Spark)
> Spark-32550 affects the performance of some cases
>
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183326#comment-17183326
]
Apache Spark commented on SPARK-32690:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32690:
Assignee: Apache Spark
> Spark-32550 affects the performance of some cases
>
[
https://issues.apache.org/jira/browse/SPARK-32688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183319#comment-17183319
]
Tanel Kiis commented on SPARK-32688:
The introduced tests will fail when SPARK-32110 is not fixed
>
[
https://issues.apache.org/jira/browse/SPARK-32550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183219#comment-17183219
]
Apache Spark commented on SPARK-32550:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-32550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183216#comment-17183216
]
Apache Spark commented on SPARK-32550:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183218#comment-17183218
]
Yang Jie commented on SPARK-32690:
--
cc [~sowen] I gave a pr to revert
angerszhu created SPARK-32692:
-
Summary: Support INSERT OVERWRITE DIR cross cluster
Key: SPARK-32692
URL: https://issues.apache.org/jira/browse/SPARK-32692
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183189#comment-17183189
]
huangtianhua commented on SPARK-32691:
--
[~dongjoon], I took tests for several times locally, the
huangtianhua created SPARK-32691:
Summary: Test org.apache.spark.DistributedSuite failed on arm64
jenkins
Key: SPARK-32691
URL: https://issues.apache.org/jira/browse/SPARK-32691
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-32690:
-
Attachment: (was: image-2020-08-24-19-30-55-380.png)
> Spark-32550 affects the performance of some
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-32690:
-
Description:
I found that [Spark-32550|https://github.com/apache/spark/pull/29366] affected
the
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-32690:
-
Attachment: (was: image-2020-08-24-19-30-17-712.png)
> Spark-32550 affects the performance of some
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-32690:
-
Attachment: image-2020-08-24-19-30-17-712.png
> Spark-32550 affects the performance of some cases
>
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-32690:
-
Attachment: image-2020-08-24-19-30-55-380.png
> Spark-32550 affects the performance of some cases
>
[
https://issues.apache.org/jira/browse/SPARK-32690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-32690:
-
Description:
I found that [Spark-32550|https://github.com/apache/spark/pull/29366] affected
the
Yang Jie created SPARK-32690:
Summary: Spark-32550 affects the performance of some cases
Key: SPARK-32690
URL: https://issues.apache.org/jira/browse/SPARK-32690
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183107#comment-17183107
]
Tanel Kiis commented on SPARK-32110:
there is also inconsistency in the code gen and the interpreted
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183081#comment-17183081
]
Wenchen Fan commented on SPARK-32683:
-
It's unfortunate that we missed it before the 3.0 release. I
[
https://issues.apache.org/jira/browse/SPARK-32649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-32649.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29484
[
https://issues.apache.org/jira/browse/SPARK-32649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-32649:
---
Assignee: Cheng Su
> Optimize BHJ/SHJ inner and semi join with empty hashed relation
>
[
https://issues.apache.org/jira/browse/SPARK-32676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183012#comment-17183012
]
Apache Spark commented on SPARK-32676:
--
User 'huaxingao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183010#comment-17183010
]
Apache Spark commented on SPARK-32676:
--
User 'huaxingao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-25872.
-
Resolution: Fixed
> Add an optimizer tracker for TPC-DS queries
>
[
https://issues.apache.org/jira/browse/SPARK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-25872:
Fix Version/s: 3.1.0
> Add an optimizer tracker for TPC-DS queries
>
85 matches
Mail list logo