[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939867#comment-16939867
]
Yuming Wang commented on SPARK-29274:
-
I don't know how Vertica works. But it returns incorrect
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939865#comment-16939865
]
Yuming Wang commented on SPARK-29274:
-
Oracle will cast varchar type to number type:
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-29280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-29280:
-
Description:
[
https://issues.apache.org/jira/browse/SPARK-29102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939856#comment-16939856
]
Nicholas Chammas edited comment on SPARK-29102 at 9/28/19 5:35 AM:
---
I
[
https://issues.apache.org/jira/browse/SPARK-29280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939864#comment-16939864
]
Nicholas Chammas commented on SPARK-29280:
--
cc [~hyukjin.kwon], [~cloud_fan]
> DataFrameReader
Nicholas Chammas created SPARK-29280:
Summary: DataFrameReader should support a compression option
Key: SPARK-29280
URL: https://issues.apache.org/jira/browse/SPARK-29280
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939862#comment-16939862
]
Yuming Wang commented on SPARK-29274:
-
SQL server will cast string type to decimal type:
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939862#comment-16939862
]
Yuming Wang edited comment on SPARK-29274 at 9/28/19 5:26 AM:
--
SQL Server
[
https://issues.apache.org/jira/browse/SPARK-29102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939856#comment-16939856
]
Nicholas Chammas commented on SPARK-29102:
--
I figured it out. Looks like the correct setting is
Terry Kim created SPARK-29279:
-
Summary: DataSourceV2: merge SHOW NAMESPACES and SHOW DATABASES
code path
Key: SPARK-29279
URL: https://issues.apache.org/jira/browse/SPARK-29279
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939827#comment-16939827
]
angerszhu edited comment on SPARK-29273 at 9/28/19 3:07 AM:
[~UncleHuang]
[
https://issues.apache.org/jira/browse/SPARK-29273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939827#comment-16939827
]
angerszhu edited comment on SPARK-29273 at 9/28/19 3:06 AM:
[~UncleHuang]
[
https://issues.apache.org/jira/browse/SPARK-29273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939827#comment-16939827
]
angerszhu commented on SPARK-29273:
---
[~UncleHuang]
{code}
/**
* Peak memory used by internal
[
https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939825#comment-16939825
]
angerszhu commented on SPARK-29186:
---
In spark-2.4 & and master branch.
RUN SQL
{code:java}
create
[
https://issues.apache.org/jira/browse/SPARK-29278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Terry Kim updated SPARK-29278:
--
Summary: Implement CATALOG/NAMESPACE related SQL commands for Data Source
V2 (was: Implement
Terry Kim created SPARK-29278:
-
Summary: Implement NAMESPACE related SQL commands for Data Source
V2
Key: SPARK-29278
URL: https://issues.apache.org/jira/browse/SPARK-29278
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-29221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-29221.
--
Fix Version/s: 3.0.0
Resolution: Fixed
This is resolved via
Ryan Blue created SPARK-29277:
-
Summary: DataSourceV2: Add early filter and projection pushdown
Key: SPARK-29277
URL: https://issues.apache.org/jira/browse/SPARK-29277
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939787#comment-16939787
]
Jim Kleckner commented on SPARK-29055:
--
[~Geopap] How quickly does the memory grow?
> Memory leak
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz updated SPARK-29265:
-
Description:
Hi,
I had this problem in "real" environments and also made a
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz closed SPARK-29265.
> Window+collect_list causing single-task operation
>
[
https://issues.apache.org/jira/browse/SPARK-27254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-27254.
--
Fix Version/s: 3.0.0
Assignee: Jungtaek Lim
Resolution: Fixed
> Cleanup
[
https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939712#comment-16939712
]
Jiaqi Guo commented on SPARK-29232:
---
[~aman_omer], here is [an example from the Spark
[
https://issues.apache.org/jira/browse/SPARK-26431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939667#comment-16939667
]
Xingbo Jiang edited comment on SPARK-26431 at 9/27/19 6:39 PM:
---
Resolved
[
https://issues.apache.org/jira/browse/SPARK-29263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939670#comment-16939670
]
Xingbo Jiang edited comment on SPARK-29263 at 9/27/19 6:38 PM:
---
Resolved
[
https://issues.apache.org/jira/browse/SPARK-29263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xingbo Jiang updated SPARK-29263:
-
Target Version/s: (was: 2.4.0)
> availableSlots in scheduler can change before being checked
[
https://issues.apache.org/jira/browse/SPARK-29263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xingbo Jiang updated SPARK-29263:
-
Affects Version/s: (was: 3.0.0)
2.4.0
> availableSlots in scheduler
[
https://issues.apache.org/jira/browse/SPARK-29263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xingbo Jiang resolved SPARK-29263.
--
Fix Version/s: 3.0.0
Target Version/s: 2.4.0
Assignee: Juliusz Sompolski
[
https://issues.apache.org/jira/browse/SPARK-26431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xingbo Jiang resolved SPARK-26431.
--
Fix Version/s: 3.0.0
Assignee: Juliusz Sompolski
Resolution: Fixed
Resolved
[
https://issues.apache.org/jira/browse/SPARK-29070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin resolved SPARK-29070.
Fix Version/s: 3.0.0
Assignee: Jeff Evans
Resolution:
[
https://issues.apache.org/jira/browse/SPARK-29240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-29240.
---
Fix Version/s: 3.0.0
2.4.5
Assignee: Hyukjin Kwon
[
https://issues.apache.org/jira/browse/SPARK-29240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29240:
--
Labels: (was: beginner easyfix newbie starter)
> PySpark 2.4 about sql function
[
https://issues.apache.org/jira/browse/SPARK-29240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29240:
--
Issue Type: Bug (was: Improvement)
> PySpark 2.4 about sql function 'element_at' param
[
https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939583#comment-16939583
]
Dongjoon Hyun commented on SPARK-29245:
---
Like we missed this last time, there might be more code
[
https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-29015.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25775
[
https://issues.apache.org/jira/browse/SPARK-29015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-29015:
Assignee: angerszhu
> Can't use 'add jar' jar's class as create table serde class on JDK
Jochen Hebbrecht created SPARK-29276:
Summary: Spark job fails because of timeout to Driver
Key: SPARK-29276
URL: https://issues.apache.org/jira/browse/SPARK-29276
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-29273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939466#comment-16939466
]
huangweiyi commented on SPARK-29273:
i do the same thing like shs for replaying the spark-event-log,
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939423#comment-16939423
]
Florentino Sainz commented on SPARK-29265:
--
Ok just realized what's happening, we did have one
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz updated SPARK-29265:
-
Comment: was deleted
(was: Ok, after quite a bit of research, I had to change my Window
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939414#comment-16939414
]
Yuming Wang commented on SPARK-29274:
-
PostgreSQL need to add explicit type casts:
{code:sql}
[
https://issues.apache.org/jira/browse/SPARK-29267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939393#comment-16939393
]
Hyukjin Kwon commented on SPARK-29267:
--
Do you mean countApprox should fail by its timeout?
Maxim Gekk created SPARK-29275:
--
Summary: Update the SQL migration guide regarding special
date/timestamp values
Key: SPARK-29275
URL: https://issues.apache.org/jira/browse/SPARK-29275
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-21914:
Assignee: Maxim Gekk
> Running examples as tests in SQL builtin function documentation
>
[
https://issues.apache.org/jira/browse/SPARK-21914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-21914.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25942
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-29274:
---
Assignee: Pengfei Chang (was: Yuming Wang)
> Can not coerce decimal type to double type
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-29274:
Description:
How to reproduce this issue:
{code:sql}
create table t1 (incdata_id decimal(21,0), v
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-29274:
---
Assignee: Yuming Wang
> Can not coerce decimal type to double type when it's join key
>
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-29274:
Description:
How to reproduce this issue:
{code:sql}
create table t1 (incdata_id decimal(21,0), v
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939384#comment-16939384
]
Yuming Wang commented on SPARK-29274:
-
I'll asgin this ticket to [~pfchang] who found this issue.
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-29274:
Description:
How to reproduce this issue:
{code:sql}
create table t1 (incdata_id decimal(21,0), v
[
https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-29274:
Attachment: image-2019-09-27-20-20-24-238.png
> Can not coerce decimal type to double type when
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz updated SPARK-29265:
-
Summary: Window+collect_list causing single-task operation (was: Window
orderBy
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz updated SPARK-29265:
-
Description:
Hi,
I had this problem in "real" environments and also made a
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Florentino Sainz updated SPARK-29265:
-
Description:
Hi,
I had this problem in "real" environments and also made a
[
https://issues.apache.org/jira/browse/SPARK-29265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939381#comment-16939381
]
Florentino Sainz commented on SPARK-29265:
--
Ok, after quite a bit of research, I had to change
Yuming Wang created SPARK-29274:
---
Summary: Can not coerce decimal type to double type when it's join
key
Key: SPARK-29274
URL: https://issues.apache.org/jira/browse/SPARK-29274
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-29232:
-
Priority: Major (was: Critical)
> RandomForestRegressionModel does not update the parameter
[
https://issues.apache.org/jira/browse/SPARK-29238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29238.
--
Resolution: Not A Problem
> Add newColumn using withColumn to an empty Dataframe
>
[
https://issues.apache.org/jira/browse/SPARK-29238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939379#comment-16939379
]
Hyukjin Kwon commented on SPARK-29238:
--
Since there's no record, there would be anything will be
[
https://issues.apache.org/jira/browse/SPARK-29262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939371#comment-16939371
]
Hyukjin Kwon commented on SPARK-29262:
--
[~hzfeiwang] please be clear about what this JIRA means.
[
https://issues.apache.org/jira/browse/SPARK-29272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29272.
--
Resolution: Invalid
> dataframe.write.format("libsvm").save() take too much time
>
[
https://issues.apache.org/jira/browse/SPARK-29272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939367#comment-16939367
]
Hyukjin Kwon commented on SPARK-29272:
--
Questions should go to mailing list or stackoverflow. You
[
https://issues.apache.org/jira/browse/SPARK-29273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939365#comment-16939365
]
Hyukjin Kwon commented on SPARK-29273:
--
Can you show reproducer with the current / expected & input
huangweiyi created SPARK-29273:
--
Summary: Spark peakExecutionMemory metrics is zero
Key: SPARK-29273
URL: https://issues.apache.org/jira/browse/SPARK-29273
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-29242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29242.
--
Resolution: Duplicate
> Check results of expression examples automatically
>
[
https://issues.apache.org/jira/browse/SPARK-29253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29253.
--
Resolution: Won't Fix
> Add agg(Spark, Spark*) to SQL Dataset
>
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
George Papa updated SPARK-29055:
Description:
I used Spark 2.1.1 and I upgraded into new versions. After Spark version 2.3.3,
I
[
https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939293#comment-16939293
]
Aman Omer commented on SPARK-29232:
---
I used some examples for RF regression but can't use
[
https://issues.apache.org/jira/browse/SPARK-29152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Raushan updated SPARK-29152:
---
Description:
*Issue Description*
Spark Executor Plugin API *shutdown handling is not
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
George Papa updated SPARK-29055:
Affects Version/s: (was: 2.4.4)
(was: 2.4.3)
> Memory leak in
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
George Papa updated SPARK-29055:
Summary: Memory leak in Spark (was: Memory leak in Spark Driver)
> Memory leak in Spark
>
[
https://issues.apache.org/jira/browse/SPARK-29272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
张焕明 updated SPARK-29272:
Description:
I have a pyspark dataframe with about 10 thousand records，while using pyspark
api to dump the whole
[
https://issues.apache.org/jira/browse/SPARK-29272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
张焕明 updated SPARK-29272:
Summary: dataframe.write.format("libsvm").save() take too much time (was:
张焕明 created SPARK-29272:
---
Summary: dataframe.write.format("libsvm").save() 保存时间太长
Key: SPARK-29272
URL: https://issues.apache.org/jira/browse/SPARK-29272
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-29213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-29213:
---
Assignee: Wang Shuo
> Make it consistent when get notnull output and generate null checks
[
https://issues.apache.org/jira/browse/SPARK-29213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-29213.
-
Fix Version/s: 3.0.0
2.4.5
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-29270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu resolved SPARK-29270.
---
Resolution: Duplicate
> Run HiveSparkSubmitSuite with hive jars use maven 3.1.2 won't stop then
>
[
https://issues.apache.org/jira/browse/SPARK-29257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-29257.
-
Resolution: Not A Problem
> All Task attempts scheduled to the same executor inevitably access
[
https://issues.apache.org/jira/browse/SPARK-29271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-29271:
--
Description:
Reproduce in master, run this UT
[
https://issues.apache.org/jira/browse/SPARK-29271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-29271:
--
Description:
Reproduce in master, run this UT
!WeChat33ff9dee6d78fe7be280d5f3b974e6ac.png!
[
https://issues.apache.org/jira/browse/SPARK-29271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-29271:
--
Description: Reproduce in master, run this UT (was: Reproduce in master,
run this UT
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-29271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-29271:
--
Attachment: WeChat33ff9dee6d78fe7be280d5f3b974e6ac.png
> Run HiveSparkSubmitSuite with hive jars use
[
https://issues.apache.org/jira/browse/SPARK-29271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-29271:
--
Description:
Reproduce in master, run this UT
{code:java}
{code}
was:
Reproduce in master, run
angerszhu created SPARK-29271:
-
Summary: Run HiveSparkSubmitSuite with hive jars use maven 3.1.2
won't stop then timeout
Key: SPARK-29271
URL: https://issues.apache.org/jira/browse/SPARK-29271
Project:
angerszhu created SPARK-29270:
-
Summary: Run HiveSparkSubmitSuite with hive jars use maven 3.1.2
won't stop then timeout
Key: SPARK-29270
URL: https://issues.apache.org/jira/browse/SPARK-29270
Project:
[
https://issues.apache.org/jira/browse/SPARK-29203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-29203:
Parent: SPARK-25604
Issue Type: Sub-task (was: Improvement)
> Reduce shuffle partitions
[
https://issues.apache.org/jira/browse/SPARK-29195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939155#comment-16939155
]
Eric Sun commented on SPARK-29195:
--
It is very likely in Spark -
88 matches
Mail list logo
