[
https://issues.apache.org/jira/browse/SPARK-32518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174113#comment-17174113
]
Apache Spark commented on SPARK-32518:
--
User 'Ngone51' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-32191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-32191.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29385
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-32191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-32191:
Assignee: L. C. Hsieh
> Migration Guide
> ---
>
> Key: SPARK-
[
https://issues.apache.org/jira/browse/SPARK-32578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shay Elbaz updated SPARK-32578:
---
Description:
The core sendMessage method is incorrect:
{code:java}
def sendMessage(edge: EdgeTriplet
Shay Elbaz created SPARK-32578:
--
Summary: PageRank not sending the correct values in Pergel
sendMessage
Key: SPARK-32578
URL: https://issues.apache.org/jira/browse/SPARK-32578
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-32337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-32337:
---
Assignee: Allison Wang
> Show initial plan in AQE plan tree string
> --
[
https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172091#comment-17172091
]
Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:15 AM:
[
https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172091#comment-17172091
]
Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:15 AM:
[
https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172091#comment-17172091
]
Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:14 AM:
[
https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172091#comment-17172091
]
Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:14 AM:
[
https://issues.apache.org/jira/browse/SPARK-32456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-32456.
--
Fix Version/s: 3.1.0
3.0.1
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-32456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-32456:
Assignee: Yuanjian Li
> Check the Distinct by assuming it as Aggregate for Structured Str
[
https://issues.apache.org/jira/browse/SPARK-32424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32424:
--
Labels: correctness (was: )
> Fix silent data change for timestamp parsing if overflow happen
[
https://issues.apache.org/jira/browse/SPARK-32337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-32337.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29137
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dustin Smith updated SPARK-32046:
-
Affects Version/s: 3.0.0
> current_timestamp called in a cache dataframe freezes the time for al
[
https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174064#comment-17174064
]
Saurabh Chawla commented on SPARK-32234:
[~ramks] - We faced the similar issue i
[
https://issues.apache.org/jira/browse/SPARK-32536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174060#comment-17174060
]
Lantao Jin commented on SPARK-32536:
{quote}
I found that I mistake the issue condit
[
https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174048#comment-17174048
]
Hyukjin Kwon commented on SPARK-32500:
--
This is a nice analysis. Thanks [~JinxinTan
[
https://issues.apache.org/jira/browse/SPARK-32536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-32536.
--
Resolution: Invalid
Please discuss with the vendor if the issue is reproduced with the vendor'
[
https://issues.apache.org/jira/browse/SPARK-30866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30866:
-
Assignee: Jungtaek Lim
> FileStreamSource: Cache fetched list of files beyond maxFilesP
[
https://issues.apache.org/jira/browse/SPARK-30866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30866.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27620
[https://
[
https://issues.apache.org/jira/browse/SPARK-32566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
srpn closed SPARK-32566.
> kafka consumer cache capacity is unclear
>
>
> Key: SPARK-3
[
https://issues.apache.org/jira/browse/SPARK-32566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
srpn resolved SPARK-32566.
--
Resolution: Not A Problem
> kafka consumer cache capacity is unclear
> ---
[
https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-32575:
-
Assignee: Devesh Agrawal
> BlockManagerDecommissionIntegrationSuite is still flaky
> --
[
https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-32575.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29388
[https://
Cheng Su created SPARK-32577:
Summary: Fix the config value for shuffled hash join in test
in-joins.sql
Key: SPARK-32577
URL: https://issues.apache.org/jira/browse/SPARK-32577
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32576:
--
Summary: Support PostgreSQL `bpchar` type and array of char type (was:
Support PostgreSQL `bp
[
https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-32576.
---
Fix Version/s: 3.1.0
3.0.1
Resolution: Fixed
Issue resolved by pul
[
https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-32576:
-
Assignee: Jakub Korzeniowski
> Support PostgreSQL `bpchar` array
>
[
https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174017#comment-17174017
]
Hyukjin Kwon commented on SPARK-30643:
--
[~Kelvin.FE] you can try to create a PR to
[
https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32576:
--
Summary: Support PostgreSQL `bpchar` array (was: Add tests for all the
character types in Pos
[
https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32576:
Assignee: Apache Spark
> Add tests for all the character types in PostgresIntegrationSuit
[
https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32576:
Assignee: (was: Apache Spark)
> Add tests for all the character types in PostgresInte
[
https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174016#comment-17174016
]
Apache Spark commented on SPARK-32576:
--
User 'kujon' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32393:
--
Component/s: (was: Input/Output)
SQL
> Add tests for all the character ty
[
https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32576:
--
Component/s: (was: Input/Output)
SQL
> Add tests for all the character ty
[
https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32393:
--
Issue Type: Test (was: Bug)
> Add tests for all the character types in PostgresIntegrationSui
[
https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-32576:
-
Assignee: (was: Takeshi Yamamuro)
> Add tests for all the character types in Postgr
[
https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32393:
--
Description: (was: Attempting to read the following table:
{code:java}
CREATE TABLE test_ta
[
https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32576:
--
Fix Version/s: (was: 3.0.1)
(was: 3.1.0)
> Add tests for all the ch
Dongjoon Hyun created SPARK-32576:
-
Summary: Add tests for all the character types in
PostgresIntegrationSuite
Key: SPARK-32576
URL: https://issues.apache.org/jira/browse/SPARK-32576
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32393:
--
Summary: Add tests for all the character types in PostgresIntegrationSuite
(was: PostgreSQL:
[
https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-32393:
-
Assignee: Takeshi Yamamuro
> PostgreSQL: blank-padded, fixed length character arrays ar
[
https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-32393.
---
Fix Version/s: 3.1.0
3.0.1
Resolution: Fixed
Issue resolved by pul
[
https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174004#comment-17174004
]
Apache Spark commented on SPARK-32575:
--
User 'agrawaldevesh' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32575:
Assignee: Apache Spark
> BlockManagerDecommissionIntegrationSuite is still flaky
> --
[
https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32575:
Assignee: (was: Apache Spark)
> BlockManagerDecommissionIntegrationSuite is still fla
[
https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174003#comment-17174003
]
Apache Spark commented on SPARK-32575:
--
User 'agrawaldevesh' has created a pull req
Devesh Agrawal created SPARK-32575:
--
Summary: BlockManagerDecommissionIntegrationSuite is still flaky
Key: SPARK-32575
URL: https://issues.apache.org/jira/browse/SPARK-32575
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173999#comment-17173999
]
Zhaoyang Qin commented on SPARK-30643:
--
I can't understand the experts' opinion. Ob
[
https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173997#comment-17173997
]
Apache Spark commented on SPARK-32393:
--
User 'maropu' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173998#comment-17173998
]
Apache Spark commented on SPARK-32393:
--
User 'maropu' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-32557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-32557.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29374
[https://
[
https://issues.apache.org/jira/browse/SPARK-32557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-32557:
-
Assignee: Yan Xiaole
> Logging and Swallowing the Exception Per Entry in History Server
[
https://issues.apache.org/jira/browse/SPARK-31703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michail Giannakopoulos updated SPARK-31703:
---
Description:
Trying to upgrade to Apache Spark 2.4.5 in our IBM systems (AIX
[
https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173967#comment-17173967
]
Xiao Han commented on SPARK-29767:
--
[~maropu] I also tried to reproduce this issue, the
[
https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Han updated SPARK-29767:
-
Attachment: test.py
> Core dump happening on executors while doing simple union of Data Frames
> ---
[
https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32559:
--
Priority: Major (was: Minor)
> Fix the trim logic in UTF8String.toInt/toLong did't handle Chi
[
https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32559:
--
Labels: correctness (was: )
> Fix the trim logic in UTF8String.toInt/toLong did't handle Chin
[
https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-32559.
---
Fix Version/s: 3.0.1
Assignee: EdisonWang
Resolution: Fixed
> Fix the trim l
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173947#comment-17173947
]
Dongjoon Hyun edited comment on SPARK-32558 at 8/9/20, 7:00 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173947#comment-17173947
]
Dongjoon Hyun commented on SPARK-32558:
---
[~ramks].
You are referring "Upgrading f
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32558:
--
Attachment: Screen Shot 2020-08-09 at 11.41.59 AM.png
> ORC target files that Spark_3.0 produc
[
https://issues.apache.org/jira/browse/SPARK-32411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173944#comment-17173944
]
Chitral Verma edited comment on SPARK-32411 at 8/9/20, 6:38 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32558:
--
Attachment: (was: image.png)
> ORC target files that Spark_3.0 produces does not work with
[
https://issues.apache.org/jira/browse/SPARK-32411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173944#comment-17173944
]
Chitral Verma commented on SPARK-32411:
---
[~vinhdiesal] were you able to resolve th
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32558:
--
Attachment: image.png
> ORC target files that Spark_3.0 produces does not work with Hive_2.1.1
[
https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173924#comment-17173924
]
Ramakrishna Prasad K S commented on SPARK-32234:
[~saurabhc100] has the
[
https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173924#comment-17173924
]
Ramakrishna Prasad K S edited comment on SPARK-32234 at 8/9/20, 5:14 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna Prasad K S updated SPARK-32558:
---
Description:
Steps to reproduce the issue:
---
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779
]
Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 9:00 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779
]
Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 9:00 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779
]
Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:57 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779
]
Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:57 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779
]
Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:56 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779
]
Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:52 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779
]
Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:51 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779
]
Ramakrishna Prasad K S commented on SPARK-32558:
Hi [~dongjoon]
Thanks
[
https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna Prasad K S updated SPARK-32558:
---
Attachment: image-2020-08-09-14-07-00-521.png
> ORC target files that Spark_
[
https://issues.apache.org/jira/browse/SPARK-32563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yx91490 updated SPARK-32563:
Description:
spark-sql doesn't support insert into mixed static & dynamic partition, for
example:
source
80 matches
Mail list logo