[jira] [Commented] (SPARK-32518) CoarseGrainedSchedulerBackend.maxNumConcurrentTasks should consider all kinds of resources

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174113#comment-17174113 ] Apache Spark commented on SPARK-32518: -- User 'Ngone51' has created a pull request f

[jira] [Resolved] (SPARK-32191) Migration Guide

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32191. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29385 [https://gi

[jira] [Assigned] (SPARK-32191) Migration Guide

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32191: Assignee: L. C. Hsieh > Migration Guide > --- > > Key: SPARK-

[jira] [Updated] (SPARK-32578) PageRank not sending the correct values in Pergel sendMessage

2020-08-09 Thread Shay Elbaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shay Elbaz updated SPARK-32578: --- Description: The core sendMessage method is incorrect: {code:java} def sendMessage(edge: EdgeTriplet

[jira] [Created] (SPARK-32578) PageRank not sending the correct values in Pergel sendMessage

2020-08-09 Thread Shay Elbaz (Jira)
Shay Elbaz created SPARK-32578: -- Summary: PageRank not sending the correct values in Pergel sendMessage Key: SPARK-32578 URL: https://issues.apache.org/jira/browse/SPARK-32578 Project: Spark Is

[jira] [Assigned] (SPARK-32337) Show initial plan in AQE plan tree string

2020-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32337: --- Assignee: Allison Wang > Show initial plan in AQE plan tree string > --

[jira] [Comment Edited] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172091#comment-17172091 ] Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:15 AM:

[jira] [Comment Edited] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172091#comment-17172091 ] Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:15 AM:

[jira] [Comment Edited] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172091#comment-17172091 ] Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:14 AM:

[jira] [Comment Edited] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172091#comment-17172091 ] Yang Jie edited comment on SPARK-32526 at 8/10/20, 5:14 AM:

[jira] [Resolved] (SPARK-32456) Check the Distinct by assuming it as Aggregate for Structured Streaming

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32456. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-32456) Check the Distinct by assuming it as Aggregate for Structured Streaming

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32456: Assignee: Yuanjian Li > Check the Distinct by assuming it as Aggregate for Structured Str

[jira] [Updated] (SPARK-32424) Fix silent data change for timestamp parsing if overflow happens

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32424: -- Labels: correctness (was: ) > Fix silent data change for timestamp parsing if overflow happen

[jira] [Resolved] (SPARK-32337) Show initial plan in AQE plan tree string

2020-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32337. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29137 [https://gith

[jira] [Updated] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-08-09 Thread Dustin Smith (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Smith updated SPARK-32046: - Affects Version/s: 3.0.0 > current_timestamp called in a cache dataframe freezes the time for al

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

2020-08-09 Thread Saurabh Chawla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174064#comment-17174064 ] Saurabh Chawla commented on SPARK-32234: [~ramks] - We faced the similar issue i

[jira] [Commented] (SPARK-32536) deleted not existing hdfs locations when use spark sql to execute "insert overwrite" statement to dynamic partition

2020-08-09 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174060#comment-17174060 ] Lantao Jin commented on SPARK-32536: {quote} I found that I mistake the issue condit

[jira] [Commented] (SPARK-32500) Query and Batch Id not set for Structured Streaming Jobs in case of ForeachBatch in PySpark

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174048#comment-17174048 ] Hyukjin Kwon commented on SPARK-32500: -- This is a nice analysis. Thanks [~JinxinTan

[jira] [Resolved] (SPARK-32536) deleted not existing hdfs locations when use spark sql to execute "insert overwrite" statement to dynamic partition

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32536. -- Resolution: Invalid Please discuss with the vendor if the issue is reproduced with the vendor'

[jira] [Assigned] (SPARK-30866) FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30866: - Assignee: Jungtaek Lim > FileStreamSource: Cache fetched list of files beyond maxFilesP

[jira] [Resolved] (SPARK-30866) FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30866. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27620 [https://

[jira] [Closed] (SPARK-32566) kafka consumer cache capacity is unclear

2020-08-09 Thread srpn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] srpn closed SPARK-32566. > kafka consumer cache capacity is unclear > > > Key: SPARK-3

[jira] [Resolved] (SPARK-32566) kafka consumer cache capacity is unclear

2020-08-09 Thread srpn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] srpn resolved SPARK-32566. -- Resolution: Not A Problem > kafka consumer cache capacity is unclear > ---

[jira] [Assigned] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32575: - Assignee: Devesh Agrawal > BlockManagerDecommissionIntegrationSuite is still flaky > --

[jira] [Resolved] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32575. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29388 [https://

[jira] [Created] (SPARK-32577) Fix the config value for shuffled hash join in test in-joins.sql

2020-08-09 Thread Cheng Su (Jira)
Cheng Su created SPARK-32577: Summary: Fix the config value for shuffled hash join in test in-joins.sql Key: SPARK-32577 URL: https://issues.apache.org/jira/browse/SPARK-32577 Project: Spark Iss

[jira] [Updated] (SPARK-32576) Support PostgreSQL `bpchar` type and array of char type

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32576: -- Summary: Support PostgreSQL `bpchar` type and array of char type (was: Support PostgreSQL `bp

[jira] [Resolved] (SPARK-32576) Support PostgreSQL `bpchar` array

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32576. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-32576) Support PostgreSQL `bpchar` array

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32576: - Assignee: Jakub Korzeniowski > Support PostgreSQL `bpchar` array >

[jira] [Commented] (SPARK-30643) Add support for embedding Hive 3

2020-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174017#comment-17174017 ] Hyukjin Kwon commented on SPARK-30643: -- [~Kelvin.FE] you can try to create a PR to

[jira] [Updated] (SPARK-32576) Support PostgreSQL `bpchar` array

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32576: -- Summary: Support PostgreSQL `bpchar` array (was: Add tests for all the character types in Pos

[jira] [Assigned] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32576: Assignee: Apache Spark > Add tests for all the character types in PostgresIntegrationSuit

[jira] [Assigned] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32576: Assignee: (was: Apache Spark) > Add tests for all the character types in PostgresInte

[jira] [Commented] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174016#comment-17174016 ] Apache Spark commented on SPARK-32576: -- User 'kujon' has created a pull request for

[jira] [Updated] (SPARK-32393) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32393: -- Component/s: (was: Input/Output) SQL > Add tests for all the character ty

[jira] [Updated] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32576: -- Component/s: (was: Input/Output) SQL > Add tests for all the character ty

[jira] [Updated] (SPARK-32393) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32393: -- Issue Type: Test (was: Bug) > Add tests for all the character types in PostgresIntegrationSui

[jira] [Assigned] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32576: - Assignee: (was: Takeshi Yamamuro) > Add tests for all the character types in Postgr

[jira] [Updated] (SPARK-32393) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32393: -- Description: (was: Attempting to read the following table: {code:java} CREATE TABLE test_ta

[jira] [Updated] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32576: -- Fix Version/s: (was: 3.0.1) (was: 3.1.0) > Add tests for all the ch

[jira] [Created] (SPARK-32576) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-32576: - Summary: Add tests for all the character types in PostgresIntegrationSuite Key: SPARK-32576 URL: https://issues.apache.org/jira/browse/SPARK-32576 Project: Spark

[jira] [Updated] (SPARK-32393) Add tests for all the character types in PostgresIntegrationSuite

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32393: -- Summary: Add tests for all the character types in PostgresIntegrationSuite (was: PostgreSQL:

[jira] [Assigned] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32393: - Assignee: Takeshi Yamamuro > PostgreSQL: blank-padded, fixed length character arrays ar

[jira] [Resolved] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32393. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pul

[jira] [Commented] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174004#comment-17174004 ] Apache Spark commented on SPARK-32575: -- User 'agrawaldevesh' has created a pull req

[jira] [Assigned] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32575: Assignee: Apache Spark > BlockManagerDecommissionIntegrationSuite is still flaky > --

[jira] [Assigned] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32575: Assignee: (was: Apache Spark) > BlockManagerDecommissionIntegrationSuite is still fla

[jira] [Commented] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174003#comment-17174003 ] Apache Spark commented on SPARK-32575: -- User 'agrawaldevesh' has created a pull req

[jira] [Created] (SPARK-32575) BlockManagerDecommissionIntegrationSuite is still flaky

2020-08-09 Thread Devesh Agrawal (Jira)
Devesh Agrawal created SPARK-32575: -- Summary: BlockManagerDecommissionIntegrationSuite is still flaky Key: SPARK-32575 URL: https://issues.apache.org/jira/browse/SPARK-32575 Project: Spark I

[jira] [Commented] (SPARK-30643) Add support for embedding Hive 3

2020-08-09 Thread Zhaoyang Qin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173999#comment-17173999 ] Zhaoyang Qin commented on SPARK-30643: -- I can't understand the experts' opinion. Ob

[jira] [Commented] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173997#comment-17173997 ] Apache Spark commented on SPARK-32393: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-08-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173998#comment-17173998 ] Apache Spark commented on SPARK-32393: -- User 'maropu' has created a pull request fo

[jira] [Resolved] (SPARK-32557) Logging and Swallowing the Exception Per Entry in History Server

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32557. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29374 [https://

[jira] [Assigned] (SPARK-32557) Logging and Swallowing the Exception Per Entry in History Server

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32557: - Assignee: Yan Xiaole > Logging and Swallowing the Exception Per Entry in History Server

[jira] [Updated] (SPARK-31703) Changes made by SPARK-26985 break reading parquet files correctly in BigEndian architectures (AIX + LinuxPPC64)

2020-08-09 Thread Michail Giannakopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michail Giannakopoulos updated SPARK-31703: --- Description: Trying to upgrade to Apache Spark 2.4.5 in our IBM systems (AIX

[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2020-08-09 Thread Xiao Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173967#comment-17173967 ] Xiao Han commented on SPARK-29767: -- [~maropu] I also tried to reproduce this issue, the

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2020-08-09 Thread Xiao Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Han updated SPARK-29767: - Attachment: test.py > Core dump happening on executors while doing simple union of Data Frames > ---

[jira] [Updated] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32559: -- Priority: Major (was: Minor) > Fix the trim logic in UTF8String.toInt/toLong did't handle Chi

[jira] [Updated] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32559: -- Labels: correctness (was: ) > Fix the trim logic in UTF8String.toInt/toLong did't handle Chin

[jira] [Resolved] (SPARK-32559) Fix the trim logic in UTF8String.toInt/toLong did't handle Chinese characters correctly

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32559. --- Fix Version/s: 3.0.1 Assignee: EdisonWang Resolution: Fixed > Fix the trim l

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173947#comment-17173947 ] Dongjoon Hyun edited comment on SPARK-32558 at 8/9/20, 7:00 PM: --

[jira] [Commented] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173947#comment-17173947 ] Dongjoon Hyun commented on SPARK-32558: --- [~ramks]. You are referring "Upgrading f

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32558: -- Attachment: Screen Shot 2020-08-09 at 11.41.59 AM.png > ORC target files that Spark_3.0 produc

[jira] [Comment Edited] (SPARK-32411) GPU Cluster Fail

2020-08-09 Thread Chitral Verma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173944#comment-17173944 ] Chitral Verma edited comment on SPARK-32411 at 8/9/20, 6:38 PM: --

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32558: -- Attachment: (was: image.png) > ORC target files that Spark_3.0 produces does not work with

[jira] [Commented] (SPARK-32411) GPU Cluster Fail

2020-08-09 Thread Chitral Verma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173944#comment-17173944 ] Chitral Verma commented on SPARK-32411: --- [~vinhdiesal] were you able to resolve th

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32558: -- Attachment: image.png > ORC target files that Spark_3.0 produces does not work with Hive_2.1.1

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173924#comment-17173924 ] Ramakrishna Prasad K S commented on SPARK-32234: [~saurabhc100] has the

[jira] [Comment Edited] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173924#comment-17173924 ] Ramakrishna Prasad K S edited comment on SPARK-32234 at 8/9/20, 5:14 PM: -

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 9:00 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 9:00 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:57 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:57 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:56 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:52 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:51 AM: -

[jira] [Commented] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S commented on SPARK-32558: Hi [~dongjoon] Thanks

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

2020-08-09 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Attachment: image-2020-08-09-14-07-00-521.png > ORC target files that Spark_

[jira] [Updated] (SPARK-32563) spark-sql doesn't support insert into mixed static & dynamic partition

2020-08-09 Thread yx91490 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yx91490 updated SPARK-32563: Description: spark-sql doesn't support insert into mixed static & dynamic partition, for example: source