[
https://issues.apache.org/jira/browse/SPARK-28633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900648#comment-16900648
]
Chris Bedford commented on SPARK-28633:
---
[~Udbhav Agrawal] - Before you start working on this...
[
https://issues.apache.org/jira/browse/SPARK-28617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28617:
Component/s: Tests
> Fix misplacement when comment is at the end of the query
>
[
https://issues.apache.org/jira/browse/SPARK-28617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28617:
Summary: Fix misplacement when comment is at the end of the query (was:
Completely remove
[
https://issues.apache.org/jira/browse/SPARK-28633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900639#comment-16900639
]
Chris Bedford commented on SPARK-28633:
---
Thanks [~Udbhav Agrawal] ! – so it does look like a bug?
[
https://issues.apache.org/jira/browse/SPARK-28633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900625#comment-16900625
]
Udbhav Agrawal commented on SPARK-28633:
I will work on this issue!
>
Chris Bedford created SPARK-28633:
-
Summary:
.write.option("mode","overwrite").saveAsTable("foo") fails with
'already exists' if table foo exists
Key: SPARK-28633
URL:
[
https://issues.apache.org/jira/browse/SPARK-28601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-28601.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25335
[
https://issues.apache.org/jira/browse/SPARK-28601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-28601:
-
Assignee: Jungtaek Lim
> Use StandardCharsets.UTF_8 instead of "UTF-8" string
[
https://issues.apache.org/jira/browse/SPARK-28344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-28344.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25107
[
https://issues.apache.org/jira/browse/SPARK-28537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-28537.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Target Version/s: (was:
Juan created SPARK-28632:
Summary: Cannot read from a partitioned table by Int
Key: SPARK-28632
URL: https://issues.apache.org/jira/browse/SPARK-28632
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900411#comment-16900411
]
Stavros Kontopoulos edited comment on SPARK-27936 at 8/5/19 9:06 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900411#comment-16900411
]
Stavros Kontopoulos commented on SPARK-27936:
-
[~eje] I have started working on this, maybe
Ismaël Mejía created SPARK-28631:
Summary: Update Kinesis dependencies to the Apache version
licensed versions
Key: SPARK-28631
URL: https://issues.apache.org/jira/browse/SPARK-28631
Project: Spark
nirav patel created SPARK-28630:
---
Summary: Union fails when column order is different
Key: SPARK-28630
URL: https://issues.apache.org/jira/browse/SPARK-28630
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-28629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-28629:
Description: A general mistake for new contributors is to forget adding the
corresponding rules into the
[
https://issues.apache.org/jira/browse/SPARK-28629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-28629:
Summary: Capture the missing rules in HiveSessionStateBuilder (was:
Avoid/capture the missing rules in
Xiao Li created SPARK-28629:
---
Summary: Avoid/capture the missing rules in HiveSessionStateBuilder
Key: SPARK-28629
URL: https://issues.apache.org/jira/browse/SPARK-28629
Project: Spark
Issue Type:
Ryan Blue created SPARK-28628:
-
Summary: Support namespaces in V2SessionCatalog
Key: SPARK-28628
URL: https://issues.apache.org/jira/browse/SPARK-28628
Project: Spark
Issue Type: Bug
Roland Johann created SPARK-28627:
-
Summary: properties file via SPARK_CONF_DIR and --properties-file
prevents definition of own properties via secrets/own mounts
Key: SPARK-28627
URL:
[
https://issues.apache.org/jira/browse/SPARK-28626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid updated SPARK-28626:
-
Description:
Severity: Important
Vendor: The Apache Software Foundation
Versions
[
https://issues.apache.org/jira/browse/SPARK-28626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid updated SPARK-28626:
-
Description:
Severity: Important
Vendor: The Apache Software Foundation
Versions
Imran Rashid created SPARK-28626:
Summary: Spark leaves unencrypted data on local disk, even with
encryption turned on (CVE-2019-10099)
Key: SPARK-28626
URL: https://issues.apache.org/jira/browse/SPARK-28626
[
https://issues.apache.org/jira/browse/SPARK-28626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid resolved SPARK-28626.
--
Resolution: Fixed
> Spark leaves unencrypted data on local disk, even with encryption turned
[
https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900090#comment-16900090
]
Maxim Gekk commented on SPARK-28624:
Just in case, the issue exists for negative years storing to
[
https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900083#comment-16900083
]
Maxim Gekk commented on SPARK-28624:
The problem is in storing values of DATE type to a hive table.
[
https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-28624:
---
Attachment: Screen Shot 2019-08-05 at 18.19.39.png
> make_date is inconsistent when reading from
Yuanjian Li created SPARK-28625:
---
Summary: Shuffle Writer API: Indeterminate shuffle support in
ShuffleMapOutputWriter
Key: SPARK-28625
URL: https://issues.apache.org/jira/browse/SPARK-28625
Project:
[
https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900059#comment-16900059
]
Maxim Gekk commented on SPARK-28624:
[~yumwang] Thanks. I will take a look at the issue.
>
[
https://issues.apache.org/jira/browse/SPARK-28619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28619:
Description:
List all cases where the golden result file is different from {{spark-sql}}.
Case 1
[
https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28624:
Summary: make_date is inconsistent when reading from table (was: make_date
is inconsistent when
[
https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900031#comment-16900031
]
Yuming Wang commented on SPARK-28624:
-
cc [~maxgekk]
> make_date is inconsistent when reading from
Yuming Wang created SPARK-28624:
---
Summary: make_date is inconsistent when reading from a table
Key: SPARK-28624
URL: https://issues.apache.org/jira/browse/SPARK-28624
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-28017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-28017:
---
Summary: Enhance DATE_TRUNC (was: Enhance EXTRACT/DATE_TRUNC)
> Enhance DATE_TRUNC
>
[
https://issues.apache.org/jira/browse/SPARK-28017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-28017:
---
Description:
For DATE_TRUNC, we need support: microseconds, milliseconds, decade, century,
[
https://issues.apache.org/jira/browse/SPARK-28623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-28623:
---
Description:
Currently, we support these field for EXTRACT: YEAR, QUARTER, MONTH, WEEK, DAY,
Maxim Gekk created SPARK-28623:
--
Summary: Enhance EXTRACT
Key: SPARK-28623
URL: https://issues.apache.org/jira/browse/SPARK-28623
Project: Spark
Issue Type: Sub-task
Components: SQL
[
https://issues.apache.org/jira/browse/SPARK-28486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28486.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25262
Hyukjin Kwon created SPARK-28622:
Summary: Move PullOutPythonUDFInJoinCondition rule into 'Extract
Python UDFs'
Key: SPARK-28622
URL: https://issues.apache.org/jira/browse/SPARK-28622
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-28621:
---
Description:
CheckCartesianProducts do not work correctly.
There're some cases:
providing:
{code}
Weichen Xu created SPARK-28621:
--
Summary: CheckCartesianProducts do not work correctly
Key: SPARK-28621
URL: https://issues.apache.org/jira/browse/SPARK-28621
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-28575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kushal Mahajan updated SPARK-28575:
---
Description:
Steps to reproduce:
# Read a directory(consisting of txt files) using spark
[
https://issues.apache.org/jira/browse/SPARK-28575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kushal Mahajan updated SPARK-28575:
---
Summary: Time lag between two consecutive spark actions using Spark 2.3.1
(was: Spark job
[
https://issues.apache.org/jira/browse/SPARK-28593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-28593.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25327
[
https://issues.apache.org/jira/browse/SPARK-28593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-28593:
---
Assignee: Yuanjian Li
> Rename ShuffleClient to BlockStoreClient which more close to its
[
https://issues.apache.org/jira/browse/SPARK-28620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28620:
Description:
{code:sql}
test("SPARK-28620") {
withJdbcStatement {
statement =>
Yuming Wang created SPARK-28620:
---
Summary: Double type returned for float type in Beeline/JDBC
Key: SPARK-28620
URL: https://issues.apache.org/jira/browse/SPARK-28620
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-28575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kushal Mahajan reopened SPARK-28575:
> Spark job time increasing when upgrading Spark from 2.1.1 to 2.3.1
>
[
https://issues.apache.org/jira/browse/SPARK-28575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899848#comment-16899848
]
Kushal Mahajan commented on SPARK-28575:
Attached are the screenshot for Spark UI for 2.1 and
[
https://issues.apache.org/jira/browse/SPARK-28575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kushal Mahajan updated SPARK-28575:
---
Attachment: spark_2.3_screenshot.PNG
spark_2.1_screenshot.PNG
> Spark job
[
https://issues.apache.org/jira/browse/SPARK-28596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899834#comment-16899834
]
Maxim Gekk commented on SPARK-28596:
DateTimeBenchmark shows performance degradation up to 3 times
Yuming Wang created SPARK-28619:
---
Summary: List all cases where the golden result file is different
from spark-sql
Key: SPARK-28619
URL: https://issues.apache.org/jira/browse/SPARK-28619
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899818#comment-16899818
]
Yuming Wang commented on SPARK-28611:
-
Tested by {{bin/spark-sql}}.
> Histogram's height is
[
https://issues.apache.org/jira/browse/SPARK-28603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899817#comment-16899817
]
Raja edited comment on SPARK-28603 at 8/5/19 6:42 AM:
--
Hi Dongjoon,
We are
[
https://issues.apache.org/jira/browse/SPARK-28603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899817#comment-16899817
]
Raja commented on SPARK-28603:
--
Hi Dongjoon,
We are using the Datastax enterprise with Spark
[
https://issues.apache.org/jira/browse/SPARK-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu resolved SPARK-28618.
---
Resolution: Auto Closed
> SparkSQL Plan CollectLimitExec may cause OOM
>
[
https://issues.apache.org/jira/browse/SPARK-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-28618:
--
Description: When we call a limit in SQL or DataFrame, it will execute like
below,if we call
[
https://issues.apache.org/jira/browse/SPARK-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-28618:
--
Description:
When we call a limit in SQL or DataFrame, it will execute like below,if we call
[
https://issues.apache.org/jira/browse/SPARK-28603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899793#comment-16899793
]
Dongjoon Hyun commented on SPARK-28603:
---
Please reopen this with the live Spark versions.
> Spark
[
https://issues.apache.org/jira/browse/SPARK-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-28618:
--
Attachment: image-2019-08-05-14-03-16-112.png
> SparkSQL Plan CollectLimitExec may cause OOM
>
[
https://issues.apache.org/jira/browse/SPARK-28603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-28603.
---
Resolution: Cannot Reproduce
> Spark Streaming application receives inconsistent input
[
https://issues.apache.org/jira/browse/SPARK-28618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-28618:
--
Attachment: image-2019-08-05-14-02-51-577.png
> SparkSQL Plan CollectLimitExec may cause OOM
>
angerszhu created SPARK-28618:
-
Summary: SparkSQL Plan CollectLimitExec may cause OOM
Key: SPARK-28618
URL: https://issues.apache.org/jira/browse/SPARK-28618
Project: Spark
Issue Type: Wish
[
https://issues.apache.org/jira/browse/SPARK-28603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899791#comment-16899791
]
Dongjoon Hyun commented on SPARK-28603:
---
Hi, [~Raja.Boyangari]. All Spark versions below 2.3 are
64 matches
Mail list logo
