[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true'，the ExchangeCoord

[jira] [Updated] (SPARK-26544) escape string when serialize map/array make it a valid json (keep alignment with hive)

[ https://issues.apache.org/jira/browse/SPARK-26544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] EdisonWang updated SPARK-26544: --- Summary: escape string when serialize map/array make it a valid json (keep alignment with hive) (wa

[jira] [Updated] (SPARK-26544) escape string when serialize map/array to make it a valid json (keep alignment with hive)

[ https://issues.apache.org/jira/browse/SPARK-26544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] EdisonWang updated SPARK-26544: --- Summary: escape string when serialize map/array to make it a valid json (keep alignment with hive)

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: image-2019-01-05-13-18-30-487.png > Support the coordinator to demerminte post-shuffle par

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: screenshot-1.png > Support the coordinator to demerminte post-shuffle partitions more reas

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: (was: screenshot-1.png) > Support the coordinator to demerminte post-shuffle partition

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true'，the ExchangeCoord

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true'，the ExchangeCoord

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true'，the ExchangeCoord

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true'，the ExchangeCoord

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: (was: 15_24_38__12_27_2018.jpg) > Support the coordinator to demerminte post-shuffle p

[jira] [Created] (SPARK-26544) the string serialized from map/array type is not a valid json (while hive is)

EdisonWang created SPARK-26544: -- Summary: the string serialized from map/array type is not a valid json (while hive is) Key: SPARK-26544 URL: https://issues.apache.org/jira/browse/SPARK-26544 Project: Sp

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true'，the ExchangeCoo

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Description: For SparkSQL ,when we open AE by 'set spark.sql.adapative.enable=true'，the ExchangeCoor

[jira] [Updated] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

[ https://issues.apache.org/jira/browse/SPARK-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26543: -- Attachment: 15_24_38__12_27_2018.jpg > Support the coordinator to demerminte post-shuffle partitions m

[jira] [Created] (SPARK-26543) Support the coordinator to demerminte post-shuffle partitions more reasonably

chenliang created SPARK-26543: - Summary: Support the coordinator to demerminte post-shuffle partitions more reasonably Key: SPARK-26543 URL: https://issues.apache.org/jira/browse/SPARK-26543 Project: Spar

[jira] [Created] (SPARK-26542) Support the coordinator to demerminte post-shuffle partitions more reasonably

chenliang created SPARK-26542: - Summary: Support the coordinator to demerminte post-shuffle partitions more reasonably Key: SPARK-26542 URL: https://issues.apache.org/jira/browse/SPARK-26542 Project: Spar

[jira] [Resolved] (SPARK-26536) Upgrade Mockito to 2.23.4

[ https://issues.apache.org/jira/browse/SPARK-26536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26536. --- Resolution: Fixed Assignee: Dongjoon Hyun (was: Apache Spark) Fix Version/s:

[jira] [Assigned] (SPARK-26541) Add `-Pdocker-integration-tests` to `dev/scalastyle`

[ https://issues.apache.org/jira/browse/SPARK-26541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26541: Assignee: Apache Spark > Add `-Pdocker-integration-tests` to `dev/scalastyle` > -

[jira] [Assigned] (SPARK-26541) Add `-Pdocker-integration-tests` to `dev/scalastyle`

[ https://issues.apache.org/jira/browse/SPARK-26541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26541: Assignee: (was: Apache Spark) > Add `-Pdocker-integration-tests` to `dev/scalastyle`

[jira] [Created] (SPARK-26541) Add `-Pdocker-integration-tests` to `dev/scalastyle`

Dongjoon Hyun created SPARK-26541: - Summary: Add `-Pdocker-integration-tests` to `dev/scalastyle` Key: SPARK-26541 URL: https://issues.apache.org/jira/browse/SPARK-26541 Project: Spark Issue

[jira] [Updated] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26540: -- Affects Version/s: 2.0.2 2.1.3 > Requirement failed when reading numeri

[jira] [Assigned] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26540: Assignee: (was: Apache Spark) > Requirement failed when reading numeric arrays from P

[jira] [Assigned] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26540: Assignee: Apache Spark > Requirement failed when reading numeric arrays from PostgreSQL >

[jira] [Commented] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734731#comment-16734731 ] Dongjoon Hyun commented on SPARK-26540: --- Thank you for checking, [~maropu]. I made

[jira] [Comment Edited] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734727#comment-16734727 ] Takeshi Yamamuro edited comment on SPARK-26540 at 1/5/19 1:42 AM:

[jira] [Comment Edited] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734719#comment-16734719 ] Dongjoon Hyun edited comment on SPARK-26540 at 1/5/19 1:34 AM: ---

[jira] [Commented] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734727#comment-16734727 ] Takeshi Yamamuro commented on SPARK-26540: -- yea, the workaround is good. The qu

[jira] [Comment Edited] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734719#comment-16734719 ] Dongjoon Hyun edited comment on SPARK-26540 at 1/5/19 1:41 AM: ---

[jira] [Updated] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26540: -- Issue Type: Bug (was: Improvement) > Requirement failed when reading numeric arrays from Post

[jira] [Commented] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734719#comment-16734719 ] Dongjoon Hyun commented on SPARK-26540: --- Given that Apache Spark handles the decim

[jira] [Updated] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26540: -- Issue Type: Improvement (was: Bug) > Requirement failed when reading numeric arrays from Post

[jira] [Updated] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26540: -- Priority: Minor (was: Major) > Requirement failed when reading numeric arrays from PostgreSQL

[jira] [Commented] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734718#comment-16734718 ] Dongjoon Hyun commented on SPARK-26540: --- [~maropu]. Please specify the precision

[jira] [Commented] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734715#comment-16734715 ] Dongjoon Hyun commented on SPARK-26540: --- I'm checking the information PostgresJDBC

[jira] [Comment Edited] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734715#comment-16734715 ] Dongjoon Hyun edited comment on SPARK-26540 at 1/5/19 12:58 AM: --

[jira] [Commented] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734708#comment-16734708 ] Dongjoon Hyun commented on SPARK-26540: --- For me, this is not a correctness issue a

[jira] [Comment Edited] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734708#comment-16734708 ] Dongjoon Hyun edited comment on SPARK-26540 at 1/5/19 12:41 AM: --

[jira] [Commented] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734701#comment-16734701 ] Takeshi Yamamuro commented on SPARK-26540: -- [~dongjoon] [~smilegator] could you

[jira] [Updated] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-26540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26540: - Description: This bug was reported in spark-user: http://apache-spark-user-list.1001560

[jira] [Created] (SPARK-26540) Requirement failed when reading numeric arrays from PostgreSQL

Takeshi Yamamuro created SPARK-26540: Summary: Requirement failed when reading numeric arrays from PostgreSQL Key: SPARK-26540 URL: https://issues.apache.org/jira/browse/SPARK-26540 Project: Spark

[jira] [Updated] (SPARK-26078) WHERE .. IN fails to filter rows when used in combination with UNION

[ https://issues.apache.org/jira/browse/SPARK-26078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26078: -- Fix Version/s: 2.4.1 > WHERE .. IN fails to filter rows when used in combination with UNION >

[jira] [Resolved] (SPARK-26306) Flaky test: org.apache.spark.util.collection.SorterSuite

[ https://issues.apache.org/jira/browse/SPARK-26306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26306. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23425 [https://github.c

[jira] [Resolved] (SPARK-26503) Get rid of spark.sql.legacy.timeParser.enabled

[ https://issues.apache.org/jira/browse/SPARK-26503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26503. --- Resolution: Won't Fix See PR discussion > Get rid of spark.sql.legacy.timeParser.enabled >

[jira] [Assigned] (SPARK-26306) Flaky test: org.apache.spark.util.collection.SorterSuite

[ https://issues.apache.org/jira/browse/SPARK-26306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26306: - Assignee: Sean Owen > Flaky test: org.apache.spark.util.collection.SorterSuite > --

[jira] [Assigned] (SPARK-26539) Remove spark.memory.useLegacyMode memory settings + StaticMemoryManager

[ https://issues.apache.org/jira/browse/SPARK-26539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26539: Assignee: Sean Owen (was: Apache Spark) > Remove spark.memory.useLegacyMode memory setti

[jira] [Updated] (SPARK-26539) Remove spark.memory.useLegacyMode memory settings + StaticMemoryManager

[ https://issues.apache.org/jira/browse/SPARK-26539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26539: -- Docs Text: The legacy memory manager, enabled by spark.memory.useLegacyMode, has been removed in Spark

[jira] [Assigned] (SPARK-26539) Remove spark.memory.useLegacyMode memory settings + StaticMemoryManager

[ https://issues.apache.org/jira/browse/SPARK-26539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26539: Assignee: Apache Spark (was: Sean Owen) > Remove spark.memory.useLegacyMode memory setti

[jira] [Created] (SPARK-26539) Remove spark.memory.useLegacyMode memory settings + StaticMemoryManager

Sean Owen created SPARK-26539: - Summary: Remove spark.memory.useLegacyMode memory settings + StaticMemoryManager Key: SPARK-26539 URL: https://issues.apache.org/jira/browse/SPARK-26539 Project: Spark

[jira] [Assigned] (SPARK-26538) Postgres numeric array support

[ https://issues.apache.org/jira/browse/SPARK-26538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26538: Assignee: (was: Apache Spark) > Postgres numeric array support >

[jira] [Assigned] (SPARK-26538) Postgres numeric array support

[ https://issues.apache.org/jira/browse/SPARK-26538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26538: Assignee: Apache Spark > Postgres numeric array support > --

[jira] [Created] (SPARK-26538) Postgres numeric array support

Oleksii created SPARK-26538: --- Summary: Postgres numeric array support Key: SPARK-26538 URL: https://issues.apache.org/jira/browse/SPARK-26538 Project: Spark Issue Type: Bug Components: SQ

[jira] [Commented] (SPARK-26537) update the release scripts to point to gitbox

[ https://issues.apache.org/jira/browse/SPARK-26537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734540#comment-16734540 ] shane knapp commented on SPARK-26537: - [~srowen] i'm pretty sure that my change to t

[jira] [Assigned] (SPARK-26537) update the release scripts to point to gitbox

[ https://issues.apache.org/jira/browse/SPARK-26537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26537: Assignee: shane knapp (was: Apache Spark) > update the release scripts to point to gitbo

[jira] [Assigned] (SPARK-26537) update the release scripts to point to gitbox

[ https://issues.apache.org/jira/browse/SPARK-26537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26537: Assignee: Apache Spark (was: shane knapp) > update the release scripts to point to gitbo

[jira] [Comment Edited] (SPARK-26537) update the release scripts to point to gitbox

[ https://issues.apache.org/jira/browse/SPARK-26537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734531#comment-16734531 ] Dongjoon Hyun edited comment on SPARK-26537 at 1/4/19 8:20 PM: ---

[jira] [Commented] (SPARK-26537) update the release scripts to point to gitbox

[ https://issues.apache.org/jira/browse/SPARK-26537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734531#comment-16734531 ] Dongjoon Hyun commented on SPARK-26537: --- Thank you for investing this, [~shaneknap

[jira] [Created] (SPARK-26537) update the release scripts to point to gitbox

shane knapp created SPARK-26537: --- Summary: update the release scripts to point to gitbox Key: SPARK-26537 URL: https://issues.apache.org/jira/browse/SPARK-26537 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-19809) NullPointerException on zero-size ORC file

[ https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734510#comment-16734510 ] Prashanth Sandela edited comment on SPARK-19809 at 1/4/19 7:40 PM: ---

[jira] [Commented] (SPARK-19809) NullPointerException on zero-size ORC file

[ https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734523#comment-16734523 ] Prashanth Sandela commented on SPARK-19809: --- Awesome! This config of `spark.sq

[jira] [Commented] (SPARK-19809) NullPointerException on zero-size ORC file

[ https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734521#comment-16734521 ] Dongjoon Hyun commented on SPARK-19809: --- Hi, did you use `spark.sql.orc.impl=nativ

[jira] [Commented] (SPARK-19809) NullPointerException on zero-size ORC file

[ https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734510#comment-16734510 ] Prashanth Sandela commented on SPARK-19809: --- [~dongjoon] I'm encountering same

[jira] [Commented] (SPARK-26254) Move delegation token providers into a separate project

[ https://issues.apache.org/jira/browse/SPARK-26254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734393#comment-16734393 ] Gabor Somogyi commented on SPARK-26254: --- [~hyukjin.kwon] In my last comment right

[jira] [Assigned] (SPARK-26089) Handle large corrupt shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-26089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26089: Assignee: Apache Spark > Handle large corrupt shuffle blocks > --

[jira] [Assigned] (SPARK-26089) Handle large corrupt shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-26089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26089: Assignee: (was: Apache Spark) > Handle large corrupt shuffle blocks > ---

[jira] [Commented] (SPARK-26362) Remove 'spark.driver.allowMultipleContexts' to disallow multiple Spark contexts

[ https://issues.apache.org/jira/browse/SPARK-26362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734371#comment-16734371 ] Hyukjin Kwon commented on SPARK-26362: -- Sure will do. > Remove 'spark.driver.allow

[jira] [Issue Comment Deleted] (SPARK-26366) Except with transform regression

[ https://issues.apache.org/jira/browse/SPARK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-26366: Comment: was deleted (was: mgaido91 opened a new pull request #23372: [SPARK-26366][SQL][BACKPORT

[jira] [Updated] (SPARK-26362) Remove 'spark.driver.allowMultipleContexts' to disallow multiple Spark contexts

[ https://issues.apache.org/jira/browse/SPARK-26362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26362: -- Docs Text: Support for multiple Spark contexts in the same driver has been removed in Spark 3. > Remo

[jira] [Updated] (SPARK-26362) Remove 'spark.driver.allowMultipleContexts' to disallow multiple Spark contexts

[ https://issues.apache.org/jira/browse/SPARK-26362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26362: -- Priority: Minor (was: Major) > Remove 'spark.driver.allowMultipleContexts' to disallow multiple Spark

[jira] [Updated] (SPARK-26362) Remove 'spark.driver.allowMultipleContexts' to disallow multiple Spark contexts

[ https://issues.apache.org/jira/browse/SPARK-26362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-26362: Labels: releasenotes (was: ) > Remove 'spark.driver.allowMultipleContexts' to disallow multiple S

[jira] [Issue Comment Deleted] (SPARK-26362) Remove 'spark.driver.allowMultipleContexts' to disallow multiple Spark contexts

[ https://issues.apache.org/jira/browse/SPARK-26362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-26362: Comment: was deleted (was: asfgit closed pull request #23311: [SPARK-26362][CORE] Remove 'spark.d

[jira] [Issue Comment Deleted] (SPARK-26366) Except with transform regression

[ https://issues.apache.org/jira/browse/SPARK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-26366: Comment: was deleted (was: mgaido91 opened a new pull request #23350: [SPARK-26366][SQL][BACKPORT

[jira] [Issue Comment Deleted] (SPARK-26366) Except with transform regression

[ https://issues.apache.org/jira/browse/SPARK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-26366: Comment: was deleted (was: mgaido91 opened a new pull request #23315: [SPARK-26366][SQL] ReplaceE

[jira] [Issue Comment Deleted] (SPARK-26366) Except with transform regression

[ https://issues.apache.org/jira/browse/SPARK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-26366: Comment: was deleted (was: gatorsmile closed pull request #23350: [SPARK-26366][SQL][BACKPORT-2.3]

[jira] [Commented] (SPARK-26366) Except with transform regression

[ https://issues.apache.org/jira/browse/SPARK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734363#comment-16734363 ] Reynold Xin commented on SPARK-26366: - Please make sure you guys tag these tickets w

[jira] [Updated] (SPARK-26366) Except with transform regression

[ https://issues.apache.org/jira/browse/SPARK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-26366: Labels: correctness (was: ) > Except with transform regression >

[jira] [Issue Comment Deleted] (SPARK-26366) Except with transform regression

[ https://issues.apache.org/jira/browse/SPARK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-26366: Comment: was deleted (was: asfgit closed pull request #23315: [SPARK-26366][SQL] ReplaceExceptWit

[jira] [Issue Comment Deleted] (SPARK-26246) Infer timestamp types from JSON

[ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-26246: Comment: was deleted (was: asfgit closed pull request #23201: [SPARK-26246][SQL] Inferring Timest

[jira] [Comment Edited] (SPARK-26246) Infer timestamp types from JSON

[ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734361#comment-16734361 ] Reynold Xin edited comment on SPARK-26246 at 1/4/19 5:22 PM: -

[jira] [Commented] (SPARK-26246) Infer timestamp types from JSON

[ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734361#comment-16734361 ] Reynold Xin commented on SPARK-26246: - |Is there an option flag for this? This is a

[jira] [Commented] (SPARK-26362) Remove 'spark.driver.allowMultipleContexts' to disallow multiple Spark contexts

[ https://issues.apache.org/jira/browse/SPARK-26362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734355#comment-16734355 ] Reynold Xin commented on SPARK-26362: - [~hyukjin.kwon] please make sure we add relea

[jira] [Updated] (SPARK-26536) Upgrade Mockito to 2.23.4

[ https://issues.apache.org/jira/browse/SPARK-26536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26536: -- Description: This issue upgrades Mockito from 1.10.19 to 2.23.4. The following changes are re

[jira] [Assigned] (SPARK-26536) Upgrade Mockito to 2.23.4

[ https://issues.apache.org/jira/browse/SPARK-26536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26536: Assignee: (was: Apache Spark) > Upgrade Mockito to 2.23.4 > -

[jira] [Assigned] (SPARK-26536) Upgrade Mockito to 2.23.4

[ https://issues.apache.org/jira/browse/SPARK-26536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26536: Assignee: Apache Spark > Upgrade Mockito to 2.23.4 > - > >

[jira] [Assigned] (SPARK-26536) Upgrade Mockito to 2.23.4

[ https://issues.apache.org/jira/browse/SPARK-26536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26536: Assignee: Apache Spark > Upgrade Mockito to 2.23.4 > - > >

[jira] [Updated] (SPARK-26536) Upgrade Mockito to 2.23.4

[ https://issues.apache.org/jira/browse/SPARK-26536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26536: -- Component/s: Tests > Upgrade Mockito to 2.23.4 > - > >

[jira] [Created] (SPARK-26536) Upgrade Mockito to 2.23.4

Dongjoon Hyun created SPARK-26536: - Summary: Upgrade Mockito to 2.23.4 Key: SPARK-26536 URL: https://issues.apache.org/jira/browse/SPARK-26536 Project: Spark Issue Type: Sub-task Co

[jira] [Created] (SPARK-26535) Parsing literals as DOUBLE instead of DECIMAL

Marco Gaido created SPARK-26535: --- Summary: Parsing literals as DOUBLE instead of DECIMAL Key: SPARK-26535 URL: https://issues.apache.org/jira/browse/SPARK-26535 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-26436) Dataframe resulting from a GroupByKey and flatMapGroups operation throws java.lang.UnsupportedException when groupByKey is applied on it.

[ https://issues.apache.org/jira/browse/SPARK-26436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734267#comment-16734267 ] Manish commented on SPARK-26436: [~viirya]: Thanks for the explanation. But should group

[jira] [Commented] (SPARK-26436) Dataframe resulting from a GroupByKey and flatMapGroups operation throws java.lang.UnsupportedException when groupByKey is applied on it.

[ https://issues.apache.org/jira/browse/SPARK-26436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734282#comment-16734282 ] Liang-Chi Hsieh commented on SPARK-26436: - Sorry I don't know what you mean "sho

[jira] [Created] (SPARK-26534) Closure Cleaner Bug

sam created SPARK-26534: --- Summary: Closure Cleaner Bug Key: SPARK-26534 URL: https://issues.apache.org/jira/browse/SPARK-26534 Project: Spark Issue Type: Bug Components: Spark Core Affect

[jira] [Commented] (SPARK-8602) Shared cached DataFrames

[ https://issues.apache.org/jira/browse/SPARK-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734216#comment-16734216 ] Hyukjin Kwon commented on SPARK-8602: - I think we now have one Spark context and mult

[jira] [Resolved] (SPARK-8427) Incorrect ACL checking for partitioned table in Spark SQL-1.4

[ https://issues.apache.org/jira/browse/SPARK-8427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-8427. - Resolution: Not A Problem We're heading for Spark 3.0 and the issue was Spark 1.4. The codes have

[jira] [Commented] (SPARK-9218) Falls back to getAllPartitions when getPartitionsByFilter fails

[ https://issues.apache.org/jira/browse/SPARK-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734218#comment-16734218 ] Hyukjin Kwon commented on SPARK-9218: - ping [~lian cheng] > Falls back to getAllPart

[jira] [Resolved] (SPARK-8370) Add API for data sources to register databases

[ https://issues.apache.org/jira/browse/SPARK-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-8370. - Resolution: Not A Problem > Add API for data sources to register databases >

[jira] [Resolved] (SPARK-8602) Shared cached DataFrames

[ https://issues.apache.org/jira/browse/SPARK-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-8602. - Resolution: Not A Problem > Shared cached DataFrames > > >

[jira] [Resolved] (SPARK-8577) ScalaReflectionLock.synchronized can cause deadlock

[ https://issues.apache.org/jira/browse/SPARK-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-8577. - Resolution: Not A Problem I'm leaving resolved since we removed 2.10. > ScalaReflectionLock.sync

[jira] [Resolved] (SPARK-8403) Pruner partition won't effective when partition field and fieldSchema exist in sql predicate

[ https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-8403. - Resolution: Incomplete Leaving this resolved due to reporter's inactivity. > Pruner partition wo

[jira] [Commented] (SPARK-8370) Add API for data sources to register databases

[ https://issues.apache.org/jira/browse/SPARK-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734205#comment-16734205 ] Hyukjin Kwon commented on SPARK-8370: - I think we're working on multiple catalog supp

[jira] [Commented] (SPARK-7754) [SQL] Use PartialFunction literals instead of objects in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734197#comment-16734197 ] Hyukjin Kwon commented on SPARK-7754: - I don't think we're going to change if it targ

  1   2   >