deshanxiao created SPARK-30106:
--
Summary: DynamicPartitionPruningSuite#"no predicate on the
dimension table" is not be tested
Key: SPARK-30106
URL: https://issues.apache.org/jira/browse/SPARK-30106
Proje
[
https://issues.apache.org/jira/browse/SPARK-29900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986660#comment-16986660
]
Wenchen Fan commented on SPARK-29900:
-
CREATE TABLE is not actual table lookup, so m
[
https://issues.apache.org/jira/browse/SPARK-29591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986657#comment-16986657
]
Aman Omer commented on SPARK-29591:
---
Thanks for confirming. I will start working on th
[
https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30101.
-
Resolution: Not A Problem
Yes, it's expected
> Dataset distinct does not respect spark.default.
[
https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986645#comment-16986645
]
Jungtaek Lim edited comment on SPARK-30101 at 12/3/19 6:14 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986645#comment-16986645
]
Jungtaek Lim commented on SPARK-30101:
--
Spark SQL has a configuration for the numbe
[
https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986619#comment-16986619
]
Aman Omer edited comment on SPARK-30101 at 12/3/19 5:19 AM:
[
https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986619#comment-16986619
]
Aman Omer edited comment on SPARK-30101 at 12/3/19 5:18 AM:
[
https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986619#comment-16986619
]
Aman Omer commented on SPARK-30101:
---
{code:java}
scala> ds.distinct.explain
== Physic
[
https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aman Omer updated SPARK-30101:
--
Comment: was deleted
(was: I am checking this.)
> Dataset distinct does not respect spark.default.par
[
https://issues.apache.org/jira/browse/SPARK-30082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30082:
--
Component/s: (was: PySpark)
SQL
> Zeros are being treated as NaNs
> -
[
https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986594#comment-16986594
]
Aman Omer commented on SPARK-30101:
---
I am checking this.
> Dataset distinct does not
[
https://issues.apache.org/jira/browse/SPARK-30044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng reassigned SPARK-30044:
Assignee: zhengruifeng
> MNB/CNB/BNB use empty matrix instead of null
> -
[
https://issues.apache.org/jira/browse/SPARK-30044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng resolved SPARK-30044.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26679
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-29591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986494#comment-16986494
]
Takeshi Yamamuro commented on SPARK-29591:
--
yea, IIUC this is a common feature
Abhijeet Prasad created SPARK-30105:
---
Summary: Add StreamingQueryListener support to PySpark
Key: SPARK-30105
URL: https://issues.apache.org/jira/browse/SPARK-30105
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-29943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29943.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26577
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-29943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-29943:
Assignee: dzcxzl
> Improve error messages for unsupported data type
> ---
[
https://issues.apache.org/jira/browse/SPARK-29632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986458#comment-16986458
]
Takeshi Yamamuro commented on SPARK-29632:
--
Yea, I agree. I will resolve this a
[
https://issues.apache.org/jira/browse/SPARK-29632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-29632.
--
Resolution: Won't Fix
> Support ALTER TABLE [relname] SET SCHEMA [dbname]
> --
[
https://issues.apache.org/jira/browse/SPARK-27764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986452#comment-16986452
]
Takeshi Yamamuro commented on SPARK-27764:
--
Yea, thanks, [~hyukjin.kwon]. I'll
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986438#comment-16986438
]
Tim Kellogg edited comment on SPARK-30063 at 12/2/19 11:08 PM:
---
Terry Kim created SPARK-30104:
-
Summary: global temp db name can be used as a table name under v2
catalog
Key: SPARK-30104
URL: https://issues.apache.org/jira/browse/SPARK-30104
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986438#comment-16986438
]
Tim Kellogg commented on SPARK-30063:
-
Additional notes on UDFs returning {{ArrayTyp
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986373#comment-16986373
]
Tim Kellogg commented on SPARK-30063:
-
This appears to be 100% related to pyarrow ve
[
https://issues.apache.org/jira/browse/SPARK-30072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-30072:
-
Assignee: Ali Afroozeh
> Create dedicated planner for subqueries
>
[
https://issues.apache.org/jira/browse/SPARK-30072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-30072.
---
Fix Version/s: 3.0.0
Resolution: Fixed
> Create dedicated planner for subquer
[
https://issues.apache.org/jira/browse/SPARK-30053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986305#comment-16986305
]
Andrew K Long commented on SPARK-30053:
---
https://github.com/apache/spark/pull/2674
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986304#comment-16986304
]
Tim Kellogg commented on SPARK-30063:
-
I attached variety-of-schemas.ipynb. It seems
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Kellogg updated SPARK-30063:
Attachment: variety-of-schemas.ipynb
> Failure when returning a value from multiple Pandas UDFs
>
[
https://issues.apache.org/jira/browse/SPARK-30052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew K Long reopened SPARK-30052:
---
There will be a cr shortly that will help clarify this.
> Add support for specifying data sort
[
https://issues.apache.org/jira/browse/SPARK-30052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew K Long updated SPARK-30052:
--
Description:
Summary: When spark optimizes a physical plan, Ensure requirements iterates
th
[
https://issues.apache.org/jira/browse/SPARK-30053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986288#comment-16986288
]
Andrew K Long commented on SPARK-30053:
---
I don't own the ansi docs so i can't answ
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986253#comment-16986253
]
Tim Kellogg commented on SPARK-30063:
-
I added the expanded query plan, hopefully th
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Kellogg updated SPARK-30063:
Description:
I have 20 Pandas UDFs that I'm trying to evaluate all at the same time.
* PandasUDFT
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986242#comment-16986242
]
Tim Kellogg commented on SPARK-30063:
-
[~RBerenguel] I agree that the schema seems t
[
https://issues.apache.org/jira/browse/SPARK-30063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986236#comment-16986236
]
Tim Kellogg commented on SPARK-30063:
-
pyarrow==0.15.1
pandas==0.24.2
I've tried s
[
https://issues.apache.org/jira/browse/SPARK-30034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30034:
--
Labels: release-notes (was: )
> Use Apache Hive 2.3 dependency by default
> -
[
https://issues.apache.org/jira/browse/SPARK-30075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-30075.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26709
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-30085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-30085.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26721
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-30075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-30075:
Assignee: Jungtaek Lim
> ArrayIndexType doesn't implement hashCode correctly
> --
[
https://issues.apache.org/jira/browse/SPARK-30085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-30085:
Assignee: Huaxin Gao
> standardize sql reference
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-27721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-27721.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26636
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-27721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-27721:
Assignee: huangtianhua
> spark ./build/mvn test failed on aarch64
> -
[
https://issues.apache.org/jira/browse/SPARK-30049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986108#comment-16986108
]
Jason Darrell Lowe commented on SPARK-30049:
I just tested SQLite, and it su
Fokko Driesprong created SPARK-30103:
Summary: Remove duplicate schema merge logic
Key: SPARK-30103
URL: https://issues.apache.org/jira/browse/SPARK-30103
Project: Spark
Issue Type: Impro
[
https://issues.apache.org/jira/browse/SPARK-30082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986041#comment-16986041
]
John Ayad commented on SPARK-30082:
---
[~hyukjin.kwon] already working on a PR
> Zeros
[
https://issues.apache.org/jira/browse/SPARK-30047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30047.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26680
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-30047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30047:
---
Assignee: Kent Yao
> HashAggregate support for interval value aggs
> --
[
https://issues.apache.org/jira/browse/SPARK-30062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guy Huinen reopened SPARK-30062:
why would it be a db2 issue. DB2 requires since version 9.7 the key word
IMMEDIATE, so spark jdbc doe
zhengruifeng created SPARK-30102:
Summary: GMM supports instance weighting
Key: SPARK-30102
URL: https://issues.apache.org/jira/browse/SPARK-30102
Project: Spark
Issue Type: Improvement
sam created SPARK-30101:
---
Summary: Dataset distinct does not respect
spark.default.parallelism
Key: SPARK-30101
URL: https://issues.apache.org/jira/browse/SPARK-30101
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-30100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joby Joje updated SPARK-30100:
--
Description:
When trying to load data from JDBC(Oracle) into Spark, there seems to be
precision loss
[
https://issues.apache.org/jira/browse/SPARK-30100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joby Joje updated SPARK-30100:
--
Description:
When trying to load data from JDBC(Oracle) into Spark, there seems to be
precision loss
[
https://issues.apache.org/jira/browse/SPARK-30100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joby Joje updated SPARK-30100:
--
Description:
When trying to load data from JDBC(Oracle) into Spark, there seems to be
precision loss
[
https://issues.apache.org/jira/browse/SPARK-30099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jobit mathew updated SPARK-30099:
-
Description:
Spark SQL
explain extended select * from any non existing table shows duplicate
Joby Joje created SPARK-30100:
-
Summary: Decimal Precision Inferred from JDBC via Spark
Key: SPARK-30100
URL: https://issues.apache.org/jira/browse/SPARK-30100
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-30099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jobit mathew updated SPARK-30099:
-
Description:
Spark SQL
explain extended select * from any non existing table shows
explain e
jobit mathew created SPARK-30099:
Summary: Improve Analyzed Logical Plan as duplicate
AnalysisExceptions are coming
Key: SPARK-30099
URL: https://issues.apache.org/jira/browse/SPARK-30099
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-29839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-29839:
---
Assignee: Lantao Jin
> Supporting STORED AS in CREATE TABLE LIKE
>
[
https://issues.apache.org/jira/browse/SPARK-29839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-29839.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26466
[https://gith
wuyi created SPARK-30098:
Summary: Use default datasource as provider for CREATE TABLE syntax
Key: SPARK-30098
URL: https://issues.apache.org/jira/browse/SPARK-30098
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-30025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30025.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26663
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-30025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30025:
---
Assignee: Yuanjian Li
> Continuous shuffle block fetching should be disabled by default whe
64 matches
Mail list logo
