Jungtaek Lim created SPARK-29281:
Summary: Examples in Like/RLike doesn't consider the default value
of spark.sql.parser.escapedStringLiterals
Key: SPARK-29281
URL: https://issues.apache.org/jira/browse/SPARK-2928
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939879#comment-16939879
]
Yuming Wang commented on SPARK-29274:
-
Mysql also return incorrect values.
{noformat
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939875#comment-16939875
]
Yuming Wang edited comment on SPARK-29274 at 9/28/19 6:22 AM:
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939875#comment-16939875
]
Yuming Wang commented on SPARK-29274:
-
I don't konw how DB2 work. But ir returns cor
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939867#comment-16939867
]
Yuming Wang commented on SPARK-29274:
-
I don't know how Vertica works. But it return
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939865#comment-16939865
]
Yuming Wang commented on SPARK-29274:
-
Oracle will cast varchar type to number type:
[
https://issues.apache.org/jira/browse/SPARK-29280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-29280:
-
Description:
[DataFrameWriter|http://spark.apache.org/docs/latest/api/python/pyspark.sql
[
https://issues.apache.org/jira/browse/SPARK-29102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939856#comment-16939856
]
Nicholas Chammas edited comment on SPARK-29102 at 9/28/19 5:35 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-29280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939864#comment-16939864
]
Nicholas Chammas commented on SPARK-29280:
--
cc [~hyukjin.kwon], [~cloud_fan]
>
Nicholas Chammas created SPARK-29280:
Summary: DataFrameReader should support a compression option
Key: SPARK-29280
URL: https://issues.apache.org/jira/browse/SPARK-29280
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939862#comment-16939862
]
Yuming Wang commented on SPARK-29274:
-
SQL server will cast string type to decimal t
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939862#comment-16939862
]
Yuming Wang edited comment on SPARK-29274 at 9/28/19 5:26 AM:
[
https://issues.apache.org/jira/browse/SPARK-29102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939856#comment-16939856
]
Nicholas Chammas commented on SPARK-29102:
--
I figured it out. Looks like the co
Terry Kim created SPARK-29279:
-
Summary: DataSourceV2: merge SHOW NAMESPACES and SHOW DATABASES
code path
Key: SPARK-29279
URL: https://issues.apache.org/jira/browse/SPARK-29279
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-29273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939827#comment-16939827
]
angerszhu edited comment on SPARK-29273 at 9/28/19 3:07 AM:
[
https://issues.apache.org/jira/browse/SPARK-29273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939827#comment-16939827
]
angerszhu edited comment on SPARK-29273 at 9/28/19 3:06 AM:
[
https://issues.apache.org/jira/browse/SPARK-29273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939827#comment-16939827
]
angerszhu commented on SPARK-29273:
---
[~UncleHuang]
{code}
/**
* Peak memory used
[
https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939825#comment-16939825
]
angerszhu commented on SPARK-29186:
---
In spark-2.4 & and master branch.
RUN SQL
{cod
[
https://issues.apache.org/jira/browse/SPARK-29278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Terry Kim updated SPARK-29278:
--
Summary: Implement CATALOG/NAMESPACE related SQL commands for Data Source
V2 (was: Implement NAMESPAC
Terry Kim created SPARK-29278:
-
Summary: Implement NAMESPACE related SQL commands for Data Source
V2
Key: SPARK-29278
URL: https://issues.apache.org/jira/browse/SPARK-29278
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-29221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-29221.
--
Fix Version/s: 3.0.0
Resolution: Fixed
This is resolved via [https://github.com/apache/
Ryan Blue created SPARK-29277:
-
Summary: DataSourceV2: Add early filter and projection pushdown
Key: SPARK-29277
URL: https://issues.apache.org/jira/browse/SPARK-29277
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939787#comment-16939787
]
Jim Kleckner commented on SPARK-29055:
--
[~Geopap] How quickly does the memory grow?
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz updated SPARK-29265:
-
Description:
Hi,
I had this problem in "real" environments and also made a self-cont
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz closed SPARK-29265.
> Window+collect_list causing single-task operation
>
[
https://issues.apache.org/jira/browse/SPARK-27254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-27254.
--
Fix Version/s: 3.0.0
Assignee: Jungtaek Lim
Resolution: Fixed
> Cleanup comple
[
https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939712#comment-16939712
]
Jiaqi Guo commented on SPARK-29232:
---
[~aman_omer], here is [an example from the Spark
[
https://issues.apache.org/jira/browse/SPARK-26431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939667#comment-16939667
]
Xingbo Jiang edited comment on SPARK-26431 at 9/27/19 6:39 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-29263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939670#comment-16939670
]
Xingbo Jiang edited comment on SPARK-29263 at 9/27/19 6:38 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-29263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xingbo Jiang updated SPARK-29263:
-
Target Version/s: (was: 2.4.0)
> availableSlots in scheduler can change before being checked b
[
https://issues.apache.org/jira/browse/SPARK-29263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xingbo Jiang updated SPARK-29263:
-
Affects Version/s: (was: 3.0.0)
2.4.0
> availableSlots in scheduler c
[
https://issues.apache.org/jira/browse/SPARK-29263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xingbo Jiang resolved SPARK-29263.
--
Fix Version/s: 3.0.0
Target Version/s: 2.4.0
Assignee: Juliusz Sompolski
[
https://issues.apache.org/jira/browse/SPARK-26431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xingbo Jiang resolved SPARK-26431.
--
Fix Version/s: 3.0.0
Assignee: Juliusz Sompolski
Resolution: Fixed
Resolved by
[
https://issues.apache.org/jira/browse/SPARK-29070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin resolved SPARK-29070.
Fix Version/s: 3.0.0
Assignee: Jeff Evans
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-29240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-29240.
---
Fix Version/s: 3.0.0
2.4.5
Assignee: Hyukjin Kwon
Resoluti
[
https://issues.apache.org/jira/browse/SPARK-29240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29240:
--
Labels: (was: beginner easyfix newbie starter)
> PySpark 2.4 about sql function 'element_at'
[
https://issues.apache.org/jira/browse/SPARK-29240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29240:
--
Issue Type: Bug (was: Improvement)
> PySpark 2.4 about sql function 'element_at' param 'extra
[
https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939583#comment-16939583
]
Dongjoon Hyun commented on SPARK-29245:
---
Like we missed this last time, there migh
[
https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-29015.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25775
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-29015:
Assignee: angerszhu
> Can't use 'add jar' jar's class as create table serde class on JDK
Jochen Hebbrecht created SPARK-29276:
Summary: Spark job fails because of timeout to Driver
Key: SPARK-29276
URL: https://issues.apache.org/jira/browse/SPARK-29276
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-29273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939466#comment-16939466
]
huangweiyi commented on SPARK-29273:
i do the same thing like shs for replaying the
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939423#comment-16939423
]
Florentino Sainz commented on SPARK-29265:
--
Ok just realized what's happening,
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz updated SPARK-29265:
-
Comment: was deleted
(was: Ok, after quite a bit of research, I had to change my Window
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939414#comment-16939414
]
Yuming Wang commented on SPARK-29274:
-
PostgreSQL need to add explicit type casts:
{
[
https://issues.apache.org/jira/browse/SPARK-29267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939393#comment-16939393
]
Hyukjin Kwon commented on SPARK-29267:
--
Do you mean countApprox should fail by its
Maxim Gekk created SPARK-29275:
--
Summary: Update the SQL migration guide regarding special
date/timestamp values
Key: SPARK-29275
URL: https://issues.apache.org/jira/browse/SPARK-29275
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-21914:
Assignee: Maxim Gekk
> Running examples as tests in SQL builtin function documentation
>
[
https://issues.apache.org/jira/browse/SPARK-21914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-21914.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25942
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-29274:
---
Assignee: Pengfei Chang (was: Yuming Wang)
> Can not coerce decimal type to double type wh
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-29274:
Description:
How to reproduce this issue:
{code:sql}
create table t1 (incdata_id decimal(21,0), v
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-29274:
---
Assignee: Yuming Wang
> Can not coerce decimal type to double type when it's join key
> ---
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-29274:
Description:
How to reproduce this issue:
{code:sql}
create table t1 (incdata_id decimal(21,0), v
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939384#comment-16939384
]
Yuming Wang commented on SPARK-29274:
-
I'll asgin this ticket to [~pfchang] who fou
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-29274:
Description:
How to reproduce this issue:
{code:sql}
create table t1 (incdata_id decimal(21,0), v
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-29274:
Attachment: image-2019-09-27-20-20-24-238.png
> Can not coerce decimal type to double type when it
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz updated SPARK-29265:
-
Summary: Window+collect_list causing single-task operation (was: Window
orderBy causing
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz updated SPARK-29265:
-
Description:
Hi,
I had this problem in "real" environments and also made a self-cont
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz updated SPARK-29265:
-
Description:
Hi,
I had this problem in "real" environments and also made a self-cont
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939381#comment-16939381
]
Florentino Sainz commented on SPARK-29265:
--
Ok, after quite a bit of research,
Yuming Wang created SPARK-29274:
---
Summary: Can not coerce decimal type to double type when it's join
key
Key: SPARK-29274
URL: https://issues.apache.org/jira/browse/SPARK-29274
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-29232:
-
Priority: Major (was: Critical)
> RandomForestRegressionModel does not update the parameter map
[
https://issues.apache.org/jira/browse/SPARK-29238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29238.
--
Resolution: Not A Problem
> Add newColumn using withColumn to an empty Dataframe
> ---
[
https://issues.apache.org/jira/browse/SPARK-29238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939379#comment-16939379
]
Hyukjin Kwon commented on SPARK-29238:
--
Since there's no record, there would be any
[
https://issues.apache.org/jira/browse/SPARK-29262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939371#comment-16939371
]
Hyukjin Kwon commented on SPARK-29262:
--
[~hzfeiwang] please be clear about what thi
[
https://issues.apache.org/jira/browse/SPARK-29272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29272.
--
Resolution: Invalid
> dataframe.write.format("libsvm").save() take too much time
> ---
[
https://issues.apache.org/jira/browse/SPARK-29272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939367#comment-16939367
]
Hyukjin Kwon commented on SPARK-29272:
--
Questions should go to mailing list or stac
[
https://issues.apache.org/jira/browse/SPARK-29273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939365#comment-16939365
]
Hyukjin Kwon commented on SPARK-29273:
--
Can you show reproducer with the current /
huangweiyi created SPARK-29273:
--
Summary: Spark peakExecutionMemory metrics is zero
Key: SPARK-29273
URL: https://issues.apache.org/jira/browse/SPARK-29273
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-29242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29242.
--
Resolution: Duplicate
> Check results of expression examples automatically
> -
[
https://issues.apache.org/jira/browse/SPARK-29253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29253.
--
Resolution: Won't Fix
> Add agg(Spark, Spark*) to SQL Dataset
> --
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
George Papa updated SPARK-29055:
Description:
I used Spark 2.1.1 and I upgraded into new versions. After Spark version 2.3.3,
I o
[
https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939293#comment-16939293
]
Aman Omer commented on SPARK-29232:
---
I used some examples for RF regression but can't
[
https://issues.apache.org/jira/browse/SPARK-29152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Raushan updated SPARK-29152:
---
Description:
*Issue Description*
Spark Executor Plugin API *shutdown handling is not proper
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
George Papa updated SPARK-29055:
Affects Version/s: (was: 2.4.4)
(was: 2.4.3)
> Memory leak in Spark
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
George Papa updated SPARK-29055:
Summary: Memory leak in Spark (was: Memory leak in Spark Driver)
> Memory leak in Spark
> ---
[
https://issues.apache.org/jira/browse/SPARK-29272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
张焕明 updated SPARK-29272:
Description:
I have a pyspark dataframe with about 10 thousand records，while using pyspark
api to dump the whole
[
https://issues.apache.org/jira/browse/SPARK-29272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
张焕明 updated SPARK-29272:
Summary: dataframe.write.format("libsvm").save() take too much time (was:
dataframe.write.format("libsvm").save()
张焕明 created SPARK-29272:
---
Summary: dataframe.write.format("libsvm").save() 保存时间太长
Key: SPARK-29272
URL: https://issues.apache.org/jira/browse/SPARK-29272
Project: Spark
Issue Type: Question
C
[
https://issues.apache.org/jira/browse/SPARK-29213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-29213:
---
Assignee: Wang Shuo
> Make it consistent when get notnull output and generate null checks i
[
https://issues.apache.org/jira/browse/SPARK-29213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-29213.
-
Fix Version/s: 3.0.0
2.4.5
Resolution: Fixed
Issue resolved by pull re
[
https://issues.apache.org/jira/browse/SPARK-29270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu resolved SPARK-29270.
---
Resolution: Duplicate
> Run HiveSparkSubmitSuite with hive jars use maven 3.1.2 won't stop then
> t
[
https://issues.apache.org/jira/browse/SPARK-29257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-29257.
-
Resolution: Not A Problem
> All Task attempts scheduled to the same executor inevitably access t
83 matches
Mail list logo
