[jira] [Resolved] (SPARK-29103) CheckAnalysis for data source V2 ALTER TABLE ignores case sensitivity

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29103. -- Resolution: Duplicate Fixed at SPARK-30615 > CheckAnalysis for data source V2 ALTER TABLE ign

[jira] [Updated] (SPARK-29103) CheckAnalysis for data source V2 ALTER TABLE ignores case sensitivity

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29103: - Priority: Blocker (was: Major) > CheckAnalysis for data source V2 ALTER TABLE ignores case sens

[jira] [Updated] (SPARK-29103) CheckAnalysis for data source V2 ALTER TABLE ignores case sensitivity

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29103: - Priority: Major (was: Blocker) > CheckAnalysis for data source V2 ALTER TABLE ignores case sens

[jira] [Resolved] (SPARK-28155) do not leak SaveMode to file source v2

2020-02-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28155. - Fix Version/s: 3.0.0 Resolution: Fixed This is already done during a series of refactor f

[jira] [Updated] (SPARK-28125) dataframes created by randomSplit have overlapping rows

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28125: - Labels: (was: correctness data-corruption data-integrity data-loss) > dataframes created by ra

[jira] [Updated] (SPARK-28125) dataframes created by randomSplit have overlapping rows

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28125: - Priority: Major (was: Blocker) > dataframes created by randomSplit have overlapping rows >

[jira] [Updated] (SPARK-28125) dataframes created by randomSplit have overlapping rows

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28125: - Target Version/s: (was: 3.0.0) > dataframes created by randomSplit have overlapping rows > ---

[jira] [Commented] (SPARK-28024) Incorrect numeric values when out of range

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039775#comment-17039775 ] Hyukjin Kwon commented on SPARK-28024: -- Case 1 is fixed. Case 2, 3, and 4 seem not

[jira] [Resolved] (SPARK-27784) Alias ID reuse can break correctness when substituting foldable expressions

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27784. -- Resolution: Cannot Reproduce I am resolving this as the reported issue cannot be reproduced ac

[jira] [Commented] (SPARK-27282) Spark incorrect results when using UNION with GROUP BY clause

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039769#comment-17039769 ] Hyukjin Kwon commented on SPARK-27282: -- Spark 2.3.x is EOL. Let's reopen when we ca

[jira] [Updated] (SPARK-27282) Spark incorrect results when using UNION with GROUP BY clause

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27282: - Labels: (was: correctness) > Spark incorrect results when using UNION with GROUP BY clause > -

[jira] [Updated] (SPARK-27282) Spark incorrect results when using UNION with GROUP BY clause

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27282: - Priority: Major (was: Blocker) > Spark incorrect results when using UNION with GROUP BY clause

[jira] [Resolved] (SPARK-27282) Spark incorrect results when using UNION with GROUP BY clause

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27282. -- Resolution: Incomplete > Spark incorrect results when using UNION with GROUP BY clause > -

[jira] [Updated] (SPARK-27282) Spark incorrect results when using UNION with GROUP BY clause

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27282: - Target Version/s: (was: 3.0.0) > Spark incorrect results when using UNION with GROUP BY clause

[jira] [Updated] (SPARK-27213) Unexpected results when filter is used after distinct

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27213: - Priority: Major (was: Critical) > Unexpected results when filter is used after distinct > -

[jira] [Updated] (SPARK-27213) Unexpected results when filter is used after distinct

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27213: - Target Version/s: (was: 3.0.0) > Unexpected results when filter is used after distinct > -

[jira] [Comment Edited] (SPARK-27213) Unexpected results when filter is used after distinct

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039763#comment-17039763 ] Hyukjin Kwon edited comment on SPARK-27213 at 2/19/20 7:33 AM: ---

[jira] [Updated] (SPARK-27213) Unexpected results when filter is used after distinct

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27213: - Labels: distinct filter (was: correctness distinct filter) > Unexpected results when filter is

[jira] [Commented] (SPARK-27213) Unexpected results when filter is used after distinct

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039763#comment-17039763 ] Hyukjin Kwon commented on SPARK-27213: -- I am lowering the priority to {{Critical}}.

[jira] [Updated] (SPARK-27213) Unexpected results when filter is used after distinct

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27213: - Priority: Critical (was: Blocker) > Unexpected results when filter is used after distinct > ---

[jira] [Commented] (SPARK-27213) Unexpected results when filter is used after distinct

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039761#comment-17039761 ] Hyukjin Kwon commented on SPARK-27213: -- Does this case make sense? {code} df.selec

[jira] [Resolved] (SPARK-30785) Create table like should keep tracksPartitionsInCatalog same with source table

2020-02-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30785. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27538 [https://gith

[jira] [Assigned] (SPARK-30785) Create table like should keep tracksPartitionsInCatalog same with source table

2020-02-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30785: --- Assignee: Lantao Jin > Create table like should keep tracksPartitionsInCatalog same with so

[jira] [Commented] (SPARK-30868) Throw Exception if runHive(sql) failed

2020-02-18 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039749#comment-17039749 ] Ankit Raj Boudh commented on SPARK-30868: - [~Jackey Lee], you mean after add jar

[jira] [Commented] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

2020-02-18 Thread Damianos Christophides (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039730#comment-17039730 ] Damianos Christophides commented on SPARK-30852: thanks [~rakson] and [~

[jira] [Commented] (SPARK-30619) org.slf4j.Logger and org.apache.commons.collections classes not built as part of hadoop-provided profile

2020-02-18 Thread Abhishek Rao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039728#comment-17039728 ] Abhishek Rao commented on SPARK-30619: -- [~hyukjin.kwon] Were you able to reproduce

[jira] [Updated] (SPARK-30872) Constraints inferred from inferred attributes

2020-02-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30872: Description: {code:scala} scala> spark.range(20).selectExpr("id as a", "id as b", "id as c").wri

[jira] [Created] (SPARK-30872) Constraints inferred from inferred attributes

2020-02-18 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-30872: --- Summary: Constraints inferred from inferred attributes Key: SPARK-30872 URL: https://issues.apache.org/jira/browse/SPARK-30872 Project: Spark Issue Type: Impro

[jira] [Resolved] (SPARK-30814) Add Columns references should be able to resolve each other

2020-02-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30814. - Fix Version/s: 3.0.0 Assignee: Terry Kim Resolution: Fixed > Add Columns referen

[jira] [Resolved] (SPARK-28883) Fix a flaky test: ThriftServerQueryTestSuite

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28883. -- Resolution: Duplicate > Fix a flaky test: ThriftServerQueryTestSuite > ---

[jira] [Updated] (SPARK-26974) Invalid data in grouped cached dataset, formed by joining a large cached dataset with a small dataset

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26974: - Target Version/s: (was: 3.0.0) > Invalid data in grouped cached dataset, formed by joining a l

[jira] [Commented] (SPARK-26974) Invalid data in grouped cached dataset, formed by joining a large cached dataset with a small dataset

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039702#comment-17039702 ] Hyukjin Kwon commented on SPARK-26974: -- Please avoid to set Critical+ which is rese

[jira] [Updated] (SPARK-26974) Invalid data in grouped cached dataset, formed by joining a large cached dataset with a small dataset

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26974: - Priority: Major (was: Blocker) > Invalid data in grouped cached dataset, formed by joining a la

[jira] [Resolved] (SPARK-26974) Invalid data in grouped cached dataset, formed by joining a large cached dataset with a small dataset

2020-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26974. -- Resolution: Incomplete > Invalid data in grouped cached dataset, formed by joining a large cac

[jira] [Commented] (SPARK-30868) Throw Exception if runHive(sql) failed

2020-02-18 Thread Ankit Raj Boudh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039694#comment-17039694 ] Ankit Raj Boudh commented on SPARK-30868: - i am working on this > Throw Excepti

[jira] [Commented] (SPARK-30869) Convert dates to/from timestamps in microseconds precision

2020-02-18 Thread YoungGyu Chun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039671#comment-17039671 ] YoungGyu Chun commented on SPARK-30869: --- I am working on this > Convert dates to/

[jira] [Commented] (SPARK-24894) Invalid DNS name due to hostname truncation

2020-02-18 Thread Thi Nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039580#comment-17039580 ] Thi Nguyen commented on SPARK-24894: Why is Fix Version 3.0.0? This looks like a bug

[jira] [Commented] (SPARK-27213) Unexpected results when filter is used after distinct

2020-02-18 Thread Sunitha Kambhampati (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039556#comment-17039556 ] Sunitha Kambhampati commented on SPARK-27213: - I tried it now on master trun

[jira] [Created] (SPARK-30871) Protobuf vulnerability

2020-02-18 Thread Florencia Puppo (Jira)
Florencia Puppo created SPARK-30871: --- Summary: Protobuf vulnerability Key: SPARK-30871 URL: https://issues.apache.org/jira/browse/SPARK-30871 Project: Spark Issue Type: Dependency upgrade

[jira] [Commented] (SPARK-28067) Incorrect results in decimal aggregation with whole-stage code gen enabled

2020-02-18 Thread Sunitha Kambhampati (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039516#comment-17039516 ] Sunitha Kambhampati commented on SPARK-28067: - I have submitted the two pr's

[jira] [Commented] (SPARK-26675) Error happened during creating avro files

2020-02-18 Thread Thomas Humphries (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039508#comment-17039508 ] Thomas Humphries commented on SPARK-26675: -- *bump 2020* - issue still occurs wi

[jira] [Resolved] (SPARK-30811) CTE that refers to non-existent table with same name causes StackOverflowError

2020-02-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30811. --- Fix Version/s: 2.4.6 Resolution: Fixed Issue resolved by pull request 27562 [https://

[jira] [Created] (SPARK-30870) catalyst inception of lateral view explode with struct raise a Catalyst error

2020-02-18 Thread Thomas Prelle (Jira)
Thomas Prelle created SPARK-30870: - Summary: catalyst inception of lateral view explode with struct raise a Catalyst error Key: SPARK-30870 URL: https://issues.apache.org/jira/browse/SPARK-30870 Proje

[jira] [Commented] (SPARK-24497) ANSI SQL: Recursive query

2020-02-18 Thread Daniel Mateus Pires (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039498#comment-17039498 ] Daniel Mateus Pires commented on SPARK-24497: - Hey! the PR linked to this is

[jira] [Comment Edited] (SPARK-30858) IntegralDivide's dataType should not depend on SQLConf.get

2020-02-18 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039433#comment-17039433 ] Maxim Gekk edited comment on SPARK-30858 at 2/18/20 8:29 PM: -

[jira] [Commented] (SPARK-30858) IntegralDivide's dataType should not depend on SQLConf.get

2020-02-18 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039433#comment-17039433 ] Maxim Gekk commented on SPARK-30858: The *div* function binds on this particular exp

[jira] [Reopened] (SPARK-29688) Support average with interval type values

2020-02-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-29688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reopened SPARK-29688: --- Assignee: (was: Kent Yao) This was reverted in  [https://github.com/apache/spa

[jira] [Assigned] (SPARK-29663) Support sum with interval type values

2020-02-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-29663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-29663: - Assignee: (was: Kent Yao) > Support sum with interval type values > ---

[jira] [Reopened] (SPARK-29663) Support sum with interval type values

2020-02-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-29663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reopened SPARK-29663: --- This was reverted in  [https://github.com/apache/spark/commit/1b67d546bd96412943de0c7a3b

[jira] [Commented] (SPARK-30858) IntegralDivide's dataType should not depend on SQLConf.get

2020-02-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-30858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039414#comment-17039414 ] Herman van Hövell commented on SPARK-30858: --- That would work. I would sort of

[jira] [Commented] (SPARK-30858) IntegralDivide's dataType should not depend on SQLConf.get

2020-02-18 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039410#comment-17039410 ] Maxim Gekk commented on SPARK-30858: > This is a problem because the configuration c

[jira] [Commented] (SPARK-28067) Incorrect results in decimal aggregation with whole-stage code gen enabled

2020-02-18 Thread Sunitha Kambhampati (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039403#comment-17039403 ] Sunitha Kambhampati commented on SPARK-28067: - I looked into this issue and

[jira] [Created] (SPARK-30869) Convert dates to/from timestamps in microseconds precision

2020-02-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30869: -- Summary: Convert dates to/from timestamps in microseconds precision Key: SPARK-30869 URL: https://issues.apache.org/jira/browse/SPARK-30869 Project: Spark Issue

[jira] [Resolved] (SPARK-30838) Add missing pages to documentation index

2020-02-18 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-30838. -- Resolution: Won't Fix > Add missing pages to documentation index > ---

[jira] [Commented] (SPARK-30838) Add missing pages to documentation index

2020-02-18 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039351#comment-17039351 ] Nicholas Chammas commented on SPARK-30838: -- Actually, it looks like the pages I

[jira] [Updated] (SPARK-30838) Add missing pages to documentation index

2020-02-18 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-30838: - Summary: Add missing pages to documentation index (was: Add missing pages to documentat

[jira] [Updated] (SPARK-30838) Add missing pages to documentation top navigation menu

2020-02-18 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-30838: - Description: There are a few pages tracked in `docs/` that are not linked to from the to

[jira] [Created] (SPARK-30868) Throw Exception if runHive(sql) failed

2020-02-18 Thread Jackey Lee (Jira)
Jackey Lee created SPARK-30868: -- Summary: Throw Exception if runHive(sql) failed Key: SPARK-30868 URL: https://issues.apache.org/jira/browse/SPARK-30868 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30867) add FValueRegressionTest

2020-02-18 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-30867: -- Summary: add FValueRegressionTest Key: SPARK-30867 URL: https://issues.apache.org/jira/browse/SPARK-30867 Project: Spark Issue Type: Sub-task Component

[jira] [Commented] (SPARK-26346) Upgrade parquet to 1.11.1

2020-02-18 Thread H. Vetinari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039254#comment-17039254 ] H. Vetinari commented on SPARK-26346: - Parquet has bumped it's Avro-dependency to 1.

[jira] [Updated] (SPARK-27733) Upgrade to Avro 1.9.2

2020-02-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-27733: - Description: Avro 1.9.2 was rel%ased with many nice features including reduced size (1MB less),

[jira] [Updated] (SPARK-27733) Upgrade to Avro 1.9.2

2020-02-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-27733: - Description: Avro 1.9.2 was released with many nice features including reduced size (1MB less),

[jira] [Resolved] (SPARK-30857) Wrong truncations of timestamps before the epoch to hours and days

2020-02-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30857. - Fix Version/s: 2.4.6 Resolution: Fixed Issue resolved by pull request 27612 [https://gith

[jira] [Assigned] (SPARK-30857) Wrong truncations of timestamps before the epoch to hours and days

2020-02-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30857: --- Assignee: Maxim Gekk > Wrong truncations of timestamps before the epoch to hours and days >

[jira] [Created] (SPARK-30866) FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-02-18 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-30866: Summary: FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files Key: SPARK-30866 URL: https://issues.apache.org/jira/browse/SPARK-30866

[jira] [Assigned] (SPARK-30812) Revise boolean config name according to new config naming policy

2020-02-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30812: --- Assignee: wuyi > Revise boolean config name according to new config naming policy > ---

[jira] [Resolved] (SPARK-30812) Revise boolean config name according to new config naming policy

2020-02-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30812. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27563 [https://gith

[jira] [Commented] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

2020-02-18 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039031#comment-17039031 ] Rakesh Raushan commented on SPARK-30852: Ahh. In that case we cannot allow long

[jira] [Commented] (SPARK-28883) Fix a flaky test: ThriftServerQueryTestSuite

2020-02-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039005#comment-17039005 ] Yuming Wang commented on SPARK-28883: - I think the issue has been fixed. > Fix a fl

[jira] [Commented] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

2020-02-18 Thread Gary Scott (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038983#comment-17038983 ] Gary Scott commented on SPARK-28990: [~fengchaoge] [~stephenwoo] [~xiaozhang] - I ha

[jira] [Assigned] (SPARK-30863) Distinguish Cast and AnsiCast in toString()

2020-02-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30863: --- Assignee: wuyi > Distinguish Cast and AnsiCast in toString() >

[jira] [Resolved] (SPARK-30863) Distinguish Cast and AnsiCast in toString()

2020-02-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30863. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27608 [https://gith

[jira] [Resolved] (SPARK-30851) Add 'path' field to the 'LoadInstanceEnd' ML listener event

2020-02-18 Thread Vladislav Glinskiy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladislav Glinskiy resolved SPARK-30851. Resolution: Workaround > Add 'path' field to the 'LoadInstanceEnd' ML listener eve

[jira] [Commented] (SPARK-30851) Add 'path' field to the 'LoadInstanceEnd' ML listener event

2020-02-18 Thread Vladislav Glinskiy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038917#comment-17038917 ] Vladislav Glinskiy commented on SPARK-30851: This issue can be bypassed by c

[jira] [Updated] (SPARK-27733) Upgrade to Avro 1.9.2

2020-02-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated SPARK-27733: - Summary: Upgrade to Avro 1.9.2 (was: Upgrade to Avro 1.9.x) > Upgrade to Avro 1.9.2 > -

[jira] [Updated] (SPARK-30666) Reliable single-stage accumulators

2020-02-18 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-30666: -- Description: This proposes a pragmatic improvement to allow for reliable single-stage accumul

[jira] [Updated] (SPARK-30666) Reliable single-stage accumulators

2020-02-18 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-30666: -- Description: This proposes a pragmatic improvement to allow for reliable single-stage accumul

[jira] [Updated] (SPARK-30666) Reliable single-stage accumulators

2020-02-18 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-30666: -- Description: This proposes a pragmatic improvement to allow for reliable single-stage accumul