[jira] [Commented] (SPARK-32251) fix SQL keyword document

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163266#comment-17163266 ] Apache Spark commented on SPARK-32251: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-32402) Implement ALTER TABLE in JDBC Table Catalog

2020-07-22 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32402: -- Summary: Implement ALTER TABLE in JDBC Table Catalog Key: SPARK-32402 URL: https://issues.apache.org/jira/browse/SPARK-32402 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-31605) Unable to insert data with partial dynamic partition with Spark & Hive 3

2020-07-22 Thread Mulan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163233#comment-17163233 ] Mulan commented on SPARK-31605: --- HDP 3.1.X can't use 2.4 version. Has any other way? > Un

[jira] [Commented] (SPARK-32105) Refactor current script transform code

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163218#comment-17163218 ] Apache Spark commented on SPARK-32105: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-32105) Refactor current script transform code

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163217#comment-17163217 ] Apache Spark commented on SPARK-32105: -- User 'AngersZh' has created a pull requ

[jira] [Closed] (SPARK-32152) ./bin/spark-sql got error with reading hive metastore

2020-07-22 Thread jung bak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jung bak closed SPARK-32152. > ./bin/spark-sql got error with reading hive metastore >

[jira] [Resolved] (SPARK-32152) ./bin/spark-sql got error with reading hive metastore

2020-07-22 Thread jung bak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jung bak resolved SPARK-32152. -- Resolution: Fixed > ./bin/spark-sql got error with reading hive metastore > --

[jira] [Commented] (SPARK-32152) ./bin/spark-sql got error with reading hive metastore

2020-07-22 Thread jung bak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163214#comment-17163214 ] jung bak commented on SPARK-32152: -- I got the hint in manual below. [https://spark.apa

[jira] [Created] (SPARK-32401) Migrate function related commands to new framework

2020-07-22 Thread Terry Kim (Jira)
Terry Kim created SPARK-32401: - Summary: Migrate function related commands to new framework Key: SPARK-32401 URL: https://issues.apache.org/jira/browse/SPARK-32401 Project: Spark Issue Type: Sub-

[jira] [Assigned] (SPARK-32401) Migrate function related commands to new framework

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32401: Assignee: Apache Spark > Migrate function related commands to new framework > ---

[jira] [Commented] (SPARK-32401) Migrate function related commands to new framework

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163207#comment-17163207 ] Apache Spark commented on SPARK-32401: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-32401) Migrate function related commands to new framework

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32401: Assignee: (was: Apache Spark) > Migrate function related commands to new framework >

[jira] [Commented] (SPARK-32401) Migrate function related commands to new framework

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163208#comment-17163208 ] Apache Spark commented on SPARK-32401: -- User 'imback82' has created a pull request

[jira] [Resolved] (SPARK-32217) Track whether the worker is also being decommissioned along with an executor

2020-07-22 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32217. -- Fix Version/s: 3.1.0 Assignee: Devesh Agrawal Resolution: Fixed > Track whethe

[jira] [Commented] (SPARK-27020) Unable to insert data with partial dynamic partition with Spark & Hive 3

2020-07-22 Thread Mulan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163198#comment-17163198 ] Mulan commented on SPARK-27020: --- Are you use Spark HDP 2.3.2 version . I had the same prob

[jira] [Assigned] (SPARK-32395) Commit output files after task attempt succeed in dynamic partition datawriter

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32395: Assignee: (was: Apache Spark) > Commit output files after task attempt succeed in dy

[jira] [Commented] (SPARK-32395) Commit output files after task attempt succeed in dynamic partition datawriter

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163191#comment-17163191 ] Apache Spark commented on SPARK-32395: -- User 'wankunde' has created a pull request

[jira] [Assigned] (SPARK-32395) Commit output files after task attempt succeed in dynamic partition datawriter

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32395: Assignee: Apache Spark > Commit output files after task attempt succeed in dynamic parti

[jira] [Created] (SPARK-32400) Test coverage of HiveScripTransformationExec

2020-07-22 Thread angerszhu (Jira)
angerszhu created SPARK-32400: - Summary: Test coverage of HiveScripTransformationExec Key: SPARK-32400 URL: https://issues.apache.org/jira/browse/SPARK-32400 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-32395) Commit output files after task attempt succeed in dynamic partition datawriter

2020-07-22 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-32395: Summary: Commit output files after task attempt succeed in dynamic partition datawriter (was: Commit tas

[jira] [Updated] (SPARK-32395) Commit taskattempt's output after succeed in dynamic partition datawriter

2020-07-22 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-32395: Description: Generally, distributed jobs have two stages of committing files: committing task's output fi

[jira] [Updated] (SPARK-32395) Commit taskattempt's output after succeed in dynamic partition datawriter

2020-07-22 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-32395: Description: Generally, distributed jobs have two stages of committing files: committing task's output fi

[jira] [Updated] (SPARK-32395) Commit taskattempt's output after succeed in dynamic partition datawriter

2020-07-22 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-32395: Attachment: 112.png > Commit taskattempt's output after succeed in dynamic partition datawriter >

[jira] [Updated] (SPARK-32395) Commit taskattempt's output after succeed in dynamic partition datawriter

2020-07-22 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-32395: Attachment: 111.png > Commit taskattempt's output after succeed in dynamic partition datawriter >

[jira] [Updated] (SPARK-32395) Commit taskattempt's output after succeed in dynamic partition datawriter

2020-07-22 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-32395: Description: Generally, distributed jobs have two stages of committing files: committing task's output fi

[jira] [Updated] (SPARK-32341) add mutiple filter in rdd function

2020-07-22 Thread gaokui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaokui updated SPARK-32341: --- Affects Version/s: 3.0.0 Description: when i use spark rdd . i often use to read kafka data.And ka

[jira] [Assigned] (SPARK-32280) AnalysisException thrown when query contains several JOINs

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32280: Assignee: (was: Apache Spark) > AnalysisException thrown when query contains several

[jira] [Assigned] (SPARK-32280) AnalysisException thrown when query contains several JOINs

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32280: Assignee: (was: Apache Spark) > AnalysisException thrown when query contains several

[jira] [Commented] (SPARK-32280) AnalysisException thrown when query contains several JOINs

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163165#comment-17163165 ] Apache Spark commented on SPARK-32280: -- User 'Ngone51' has created a pull request f

[jira] [Assigned] (SPARK-32280) AnalysisException thrown when query contains several JOINs

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32280: Assignee: Apache Spark > AnalysisException thrown when query contains several JOINs > ---

[jira] [Commented] (SPARK-32398) Upgrade to scalatest 3.2.0 for Scala 2.13.3 compatibility

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163161#comment-17163161 ] Apache Spark commented on SPARK-32398: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-32398) Upgrade to scalatest 3.2.0 for Scala 2.13.3 compatibility

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32398: Assignee: Sean R. Owen (was: Apache Spark) > Upgrade to scalatest 3.2.0 for Scala 2.13.3

[jira] [Assigned] (SPARK-32398) Upgrade to scalatest 3.2.0 for Scala 2.13.3 compatibility

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32398: Assignee: Apache Spark (was: Sean R. Owen) > Upgrade to scalatest 3.2.0 for Scala 2.13.3

[jira] [Commented] (SPARK-31937) Support processing array and map type using spark noserde mode

2020-07-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163160#comment-17163160 ] angerszhu commented on SPARK-31937: --- raise a pr soon {code:java} -- SPARK-31937 transf

[jira] [Resolved] (SPARK-32392) Reduce duplicate error log for executing sql statement operation in thrift server

2020-07-22 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32392. -- Fix Version/s: 3.1.0 Assignee: Kent Yao Resolution: Fixed Resolved by 

[jira] [Commented] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

2020-07-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163150#comment-17163150 ] Dongjoon Hyun commented on SPARK-32347: --- Thank you, [~cltlfcjin] and [~JinxinTang]

[jira] [Closed] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

2020-07-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-32347. - > BROADCAST hint makes a weird message that "column can't be resolved" (it was > OK in Spark 2.4) >

[jira] [Resolved] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

2020-07-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32347. --- Resolution: Duplicate > BROADCAST hint makes a weird message that "column can't be resolved"

[jira] [Updated] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

2020-07-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32347: -- Fix Version/s: (was: 3.0.1) > BROADCAST hint makes a weird message that "column can't be r

[jira] [Commented] (SPARK-27292) Spark Job Fails with Unknown Error writing to S3 from AWS EMR

2020-07-22 Thread KOTI REDDY NUSUM (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163147#comment-17163147 ] KOTI REDDY NUSUM commented on SPARK-27292: -- what is the reason for this issue?

[jira] [Commented] (SPARK-27292) Spark Job Fails with Unknown Error writing to S3 from AWS EMR

2020-07-22 Thread KOTI REDDY NUSUM (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163146#comment-17163146 ] KOTI REDDY NUSUM commented on SPARK-27292: -- Is the issue resolved? Can you plea

[jira] [Commented] (SPARK-32338) Add overload for slice that accepts Columns or Int

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163108#comment-17163108 ] Apache Spark commented on SPARK-32338: -- User 'ueshin' has created a pull request fo

[jira] [Created] (SPARK-32399) Support full outer join in shuffled hash join and broadcast hash join

2020-07-22 Thread Cheng Su (Jira)
Cheng Su created SPARK-32399: Summary: Support full outer join in shuffled hash join and broadcast hash join Key: SPARK-32399 URL: https://issues.apache.org/jira/browse/SPARK-32399 Project: Spark

[jira] [Commented] (SPARK-30616) Introduce TTL config option for SQL Metadata Cache

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163080#comment-17163080 ] Apache Spark commented on SPARK-30616: -- User 'ueshin' has created a pull request fo

[jira] [Commented] (SPARK-24266) Spark client terminates while driver is still running

2020-07-22 Thread Jim Kleckner (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163066#comment-17163066 ] Jim Kleckner commented on SPARK-24266: -- Would be reasonable to add a target version

[jira] [Commented] (SPARK-32348) Get tests working for Scala 2.13 build

2020-07-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163051#comment-17163051 ] Sean R. Owen commented on SPARK-32348: -- Broke this out as https://issues.apache.org

[jira] [Created] (SPARK-32398) Upgrade to scalatest 3.2.0 for Scala 2.13.3 compatibility

2020-07-22 Thread Sean R. Owen (Jira)
Sean R. Owen created SPARK-32398: Summary: Upgrade to scalatest 3.2.0 for Scala 2.13.3 compatibility Key: SPARK-32398 URL: https://issues.apache.org/jira/browse/SPARK-32398 Project: Spark Iss

[jira] [Resolved] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-07-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29292. -- Fix Version/s: 3.1.0 Resolution: Fixed Declaring this done - this just covers 2.13 comp

[jira] [Created] (SPARK-32397) Snapshot artifacts can have differing timestamps, making it hard to consume

2020-07-22 Thread Holden Karau (Jira)
Holden Karau created SPARK-32397: Summary: Snapshot artifacts can have differing timestamps, making it hard to consume Key: SPARK-32397 URL: https://issues.apache.org/jira/browse/SPARK-32397 Project:

[jira] [Assigned] (SPARK-31999) Add refresh function command

2020-07-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31999: --- Assignee: ulysses you > Add refresh function command > > >

[jira] [Resolved] (SPARK-31999) Add refresh function command

2020-07-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31999. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28840 [https://gith

[jira] [Commented] (SPARK-32003) Shuffle files for lost executor are not unregistered if fetch failure occurs after executor is lost

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163010#comment-17163010 ] Apache Spark commented on SPARK-32003: -- User 'wypoon' has created a pull request fo

[jira] [Commented] (SPARK-32003) Shuffle files for lost executor are not unregistered if fetch failure occurs after executor is lost

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163009#comment-17163009 ] Apache Spark commented on SPARK-32003: -- User 'wypoon' has created a pull request fo

[jira] [Created] (SPARK-32396) Support BATCH_READ by JDBCTable

2020-07-22 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32396: -- Summary: Support BATCH_READ by JDBCTable Key: SPARK-32396 URL: https://issues.apache.org/jira/browse/SPARK-32396 Project: Spark Issue Type: Sub-task Co

[jira] [Created] (SPARK-32395) Commit taskattempt's output after succeed in dynamic partition datawriter

2020-07-22 Thread Wan Kun (Jira)
Wan Kun created SPARK-32395: --- Summary: Commit taskattempt's output after succeed in dynamic partition datawriter Key: SPARK-32395 URL: https://issues.apache.org/jira/browse/SPARK-32395 Project: Spark

[jira] [Commented] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162929#comment-17162929 ] Apache Spark commented on SPARK-32393: -- User 'kujon' has created a pull request for

[jira] [Assigned] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32393: Assignee: Apache Spark > PostgreSQL: blank-padded, fixed length character arrays are not

[jira] [Assigned] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32393: Assignee: (was: Apache Spark) > PostgreSQL: blank-padded, fixed length character arra

[jira] [Commented] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162928#comment-17162928 ] Apache Spark commented on SPARK-32393: -- User 'kujon' has created a pull request for

[jira] [Resolved] (SPARK-32394) Incorrect Board - Please Delete

2020-07-22 Thread Hunter Logan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hunter Logan resolved SPARK-32394. -- Resolution: Not A Problem > Incorrect Board - Please Delete > ---

[jira] [Updated] (SPARK-32394) Incorrect Board - Please Delete

2020-07-22 Thread Hunter Logan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hunter Logan updated SPARK-32394: - Summary: Incorrect Board - Please Delete (was: Improve Github PR Template) > Incorrect Board -

[jira] [Created] (SPARK-32394) Improve Github PR Template

2020-07-22 Thread Hunter Logan (Jira)
Hunter Logan created SPARK-32394: Summary: Improve Github PR Template Key: SPARK-32394 URL: https://issues.apache.org/jira/browse/SPARK-32394 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162913#comment-17162913 ] Apache Spark commented on SPARK-32364: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162911#comment-17162911 ] Apache Spark commented on SPARK-32364: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-07-22 Thread Jakub Korzeniowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakub Korzeniowski updated SPARK-32393: --- Description: Attempting to read the following table: {code:java} CREATE TABLE test_t

[jira] [Updated] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-07-22 Thread Jakub Korzeniowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakub Korzeniowski updated SPARK-32393: --- Description: Attempting to read the following table: {code:java} CREATE TABLE test_t

[jira] [Created] (SPARK-32393) PostgreSQL: blank-padded, fixed length character arrays are not supported

2020-07-22 Thread Jakub Korzeniowski (Jira)
Jakub Korzeniowski created SPARK-32393: -- Summary: PostgreSQL: blank-padded, fixed length character arrays are not supported Key: SPARK-32393 URL: https://issues.apache.org/jira/browse/SPARK-32393

[jira] [Assigned] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-07-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32364: - Assignee: Dongjoon Hyun > Use CaseInsensitiveMap for DataFrameReader/Writer options > -

[jira] [Resolved] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-07-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32364. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pul

[jira] [Resolved] (SPARK-32003) Shuffle files for lost executor are not unregistered if fetch failure occurs after executor is lost

2020-07-22 Thread Imran Rashid (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-32003. -- Fix Version/s: 3.1.0 Resolution: Fixed Fixed in master for 3.1 by https://github.com/ap

[jira] [Assigned] (SPARK-32003) Shuffle files for lost executor are not unregistered if fetch failure occurs after executor is lost

2020-07-22 Thread Imran Rashid (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-32003: Assignee: Wing Yew Poon > Shuffle files for lost executor are not unregistered if fetch f

[jira] [Updated] (SPARK-31937) Support processing array and map type using spark noserde mode

2020-07-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31937: -- Summary: Support processing array and map type using spark noserde mode (was: Support processing arra

[jira] [Issue Comment Deleted] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-22 Thread Christopher Blum (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Blum updated SPARK-32365: - Comment: was deleted (was: Thanks) > Fix java.lang.IndexOutOfBoundsException: No group

[jira] [Commented] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-22 Thread Christopher Blum (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162846#comment-17162846 ] Christopher Blum commented on SPARK-32365: -- Thanks > Fix java.lang.IndexOutOfB

[jira] [Commented] (SPARK-32392) Reduce duplicate error log for executing sql statement operation in thrift server

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162785#comment-17162785 ] Apache Spark commented on SPARK-32392: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-32392) Reduce duplicate error log for executing sql statement operation in thrift server

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32392: Assignee: (was: Apache Spark) > Reduce duplicate error log for executing sql statemen

[jira] [Commented] (SPARK-32392) Reduce duplicate error log for executing sql statement operation in thrift server

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162784#comment-17162784 ] Apache Spark commented on SPARK-32392: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-32392) Reduce duplicate error log for executing sql statement operation in thrift server

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32392: Assignee: Apache Spark > Reduce duplicate error log for executing sql statement operation

[jira] [Created] (SPARK-32392) Reduce duplicate error log for executing sql statement operation in thrift server

2020-07-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-32392: Summary: Reduce duplicate error log for executing sql statement operation in thrift server Key: SPARK-32392 URL: https://issues.apache.org/jira/browse/SPARK-32392 Project: Sp

[jira] [Updated] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

2020-07-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32391: - Description: After SPARK-32179, {{pydata_sphinx_theme}} https://pypi.org/project/pydata-sphinx-

[jira] [Updated] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

2020-07-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32391: - Description: After SPARK-32179, {{pydata_sphinx_theme}} https://pypi.org/project/pydata-sphinx-

[jira] [Created] (SPARK-32391) Install pydata_sphinx_theme in Jenkins machines

2020-07-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32391: Summary: Install pydata_sphinx_theme in Jenkins machines Key: SPARK-32391 URL: https://issues.apache.org/jira/browse/SPARK-32391 Project: Spark Issue Type: S

[jira] [Comment Edited] (SPARK-27318) Join operation on bucketing table fails with base adaptive enabled

2020-07-22 Thread Shay Elbaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162641#comment-17162641 ] Shay Elbaz edited comment on SPARK-27318 at 7/22/20, 11:54 AM: ---

[jira] [Resolved] (SPARK-32313) Remove Python 2 artifacts

2020-07-22 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved SPARK-32313. -- Resolution: Won't Fix > Remove Python 2 artifacts > - > >

[jira] [Commented] (SPARK-32388) TRANSFORM when schema less should keep same with hive

2020-07-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162681#comment-17162681 ] angerszhu commented on SPARK-32388: --- [https://github.com/apache/spark/pull/29085#discu

[jira] [Created] (SPARK-32390) TRANSFORM with hive serde support CalendarIntervalType and UserDefinedType

2020-07-22 Thread angerszhu (Jira)
angerszhu created SPARK-32390: - Summary: TRANSFORM with hive serde support CalendarIntervalType and UserDefinedType Key: SPARK-32390 URL: https://issues.apache.org/jira/browse/SPARK-32390 Project: Spark

[jira] [Comment Edited] (SPARK-27318) Join operation on bucketing table fails with base adaptive enabled

2020-07-22 Thread Shay Elbaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162641#comment-17162641 ] Shay Elbaz edited comment on SPARK-27318 at 7/22/20, 10:14 AM: ---

[jira] [Commented] (SPARK-32188) API Reference

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162672#comment-17162672 ] Apache Spark commented on SPARK-32188: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-32188) API Reference

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162673#comment-17162673 ] Apache Spark commented on SPARK-32188: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32188) API Reference

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32188: Assignee: Hyukjin Kwon (was: Apache Spark) > API Reference > - > >

[jira] [Assigned] (SPARK-32188) API Reference

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32188: Assignee: Apache Spark (was: Hyukjin Kwon) > API Reference > - > >

[jira] [Assigned] (SPARK-32179) Replace and redesign the documentation base

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32179: Assignee: Hyukjin Kwon (was: Apache Spark) > Replace and redesign the documentation base

[jira] [Commented] (SPARK-32179) Replace and redesign the documentation base

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162671#comment-17162671 ] Apache Spark commented on SPARK-32179: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32179) Replace and redesign the documentation base

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32179: Assignee: Apache Spark (was: Hyukjin Kwon) > Replace and redesign the documentation base

[jira] [Updated] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-07-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32364: -- Description: When a user have multiple options like path, paTH, and PATH for the same key pat

[jira] [Updated] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-07-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32364: -- Summary: Use CaseInsensitiveMap for DataFrameReader/Writer options (was: `path` argument of D

[jira] [Updated] (SPARK-32385) Publish a "bill of materials" (BOM) descriptor for Spark with correct versions of various dependencies

2020-07-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32385: -- Affects Version/s: (was: 2.4.6) (was: 3.0.0)

[jira] [Assigned] (SPARK-32387) Extract UninterruptibleThread runner logic from KafkaOffsetReader

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32387: Assignee: (was: Apache Spark) > Extract UninterruptibleThread runner logic from Kafka

[jira] [Commented] (SPARK-32387) Extract UninterruptibleThread runner logic from KafkaOffsetReader

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162648#comment-17162648 ] Apache Spark commented on SPARK-32387: -- User 'gaborgsomogyi' has created a pull req

[jira] [Assigned] (SPARK-32387) Extract UninterruptibleThread runner logic from KafkaOffsetReader

2020-07-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32387: Assignee: Apache Spark > Extract UninterruptibleThread runner logic from KafkaOffsetReade

  1   2   >