[jira] [Resolved] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

2020-03-04 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-30784. -- Resolution: Not A Bug Resolving it because with Hive 2.3, using regular orc is required.  > Hive 2.3

[jira] [Deleted] (SPARK-30976) Improve Maven Install Logic in build/mvn

2020-02-27 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai deleted SPARK-30976: - > Improve Maven Install Logic in build/mvn > > >

[jira] [Updated] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

2020-02-10 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30784: - Description: Originally reported at

[jira] [Updated] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

2020-02-10 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30783: - Attachment: hive-service-rpc-2.3.6-classes

[jira] [Updated] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

2020-02-10 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30783: - Description: hive-service-rpc 2.3.6 and spark sql's thrift server module have duplicate classes.

[jira] [Created] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

2020-02-10 Thread Yin Huai (Jira)
Yin Huai created SPARK-30784: Summary: Hive 2.3 profile should still use orc-nohive Key: SPARK-30784 URL: https://issues.apache.org/jira/browse/SPARK-30784 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

2020-02-10 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-30783: Assignee: Yin Huai > Hive 2.3 profile should exclude hive-service-rpc >

[jira] [Created] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

2020-02-10 Thread Yin Huai (Jira)
Yin Huai created SPARK-30783: Summary: Hive 2.3 profile should exclude hive-service-rpc Key: SPARK-30783 URL: https://issues.apache.org/jira/browse/SPARK-30783 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30450) Exclude .git folder for python linter

2020-01-07 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30450: - Affects Version/s: (was: 2.4.4) 3.0.0 > Exclude .git folder for python

[jira] [Updated] (SPARK-30450) Exclude .git folder for python linter

2020-01-07 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30450: - Priority: Minor (was: Major) > Exclude .git folder for python linter >

[jira] [Assigned] (SPARK-30450) Exclude .git folder for python linter

2020-01-07 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-30450: Assignee: Eric Chang > Exclude .git folder for python linter >

[jira] [Resolved] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

2018-08-06 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-25019. -- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.4.0

[jira] [Commented] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

2018-08-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568554#comment-16568554 ] Yin Huai commented on SPARK-25019: -- [~dongjoon] can you help us fix this issue? Or there is a reason

[jira] [Created] (SPARK-25019) The published spark sql pom does not exclude the normal version of orc-core

2018-08-03 Thread Yin Huai (JIRA)
Yin Huai created SPARK-25019: Summary: The published spark sql pom does not exclude the normal version of orc-core Key: SPARK-25019 URL: https://issues.apache.org/jira/browse/SPARK-25019 Project: Spark

[jira] [Commented] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

2018-07-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559977#comment-16559977 ] Yin Huai commented on SPARK-24895: -- [https://github.com/spotbugs/spotbugs-maven-plugin/issues/21] has

[jira] [Commented] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

2018-07-24 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16554932#comment-16554932 ] Yin Huai commented on SPARK-24895: -- [~hyukjin.kwon] [~kiszk] seems this revert indeed fixed the problem

[jira] [Resolved] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

2018-07-24 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-24895. -- Resolution: Fixed Fix Version/s: 2.4.0 [https://github.com/apache/spark/pull/21865] has been

[jira] [Commented] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

2018-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553610#comment-16553610 ] Yin Huai commented on SPARK-24895: -- [~kiszk] [~hyukjin.kwon] since this thing is pretty tricky to test

[jira] [Commented] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

2018-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553568#comment-16553568 ] Yin Huai commented on SPARK-24895: --   [~kiszk] and [~hyukjin.kwon] we hit this issue today. Per

[jira] [Updated] (SPARK-24895) Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched filenames

2018-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-24895: - Target Version/s: 2.4.0 > Spark 2.4.0 Snapshot artifacts has broken metadata due to mismatched

[jira] [Commented] (SPARK-23310) Perf regression introduced by SPARK-21113

2018-02-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349679#comment-16349679 ] Yin Huai commented on SPARK-23310: -- [~sitalke...@gmail.com] We found that the commit for SPARK-21113

[jira] [Updated] (SPARK-23310) Perf regression introduced by SPARK-21113

2018-02-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-23310: - Description: While running all TPC-DS queries with SF set to 1000, we noticed that Q95

[jira] [Created] (SPARK-23310) Perf regression introduced by SPARK-21113

2018-02-01 Thread Yin Huai (JIRA)
Yin Huai created SPARK-23310: Summary: Perf regression introduced by SPARK-21113 Key: SPARK-23310 URL: https://issues.apache.org/jira/browse/SPARK-23310 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

2018-02-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349325#comment-16349325 ] Yin Huai commented on SPARK-12297: -- [~zi] has this issue got resolved in Hive? I see HIVE-12767 is still

[jira] [Updated] (SPARK-23292) python tests related to pandas are skipped

2018-02-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-23292: - Priority: Critical (was: Blocker) > python tests related to pandas are skipped >

[jira] [Commented] (SPARK-23292) python tests related to pandas are skipped

2018-02-01 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349040#comment-16349040 ] Yin Huai commented on SPARK-23292: -- So, jenkins does have the right version of pandas and pyarrow for

[jira] [Created] (SPARK-23292) python tests related to pandas are skipped

2018-01-31 Thread Yin Huai (JIRA)
Yin Huai created SPARK-23292: Summary: python tests related to pandas are skipped Key: SPARK-23292 URL: https://issues.apache.org/jira/browse/SPARK-23292 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4502) Spark SQL reads unneccesary nested fields from Parquet

2018-01-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340544#comment-16340544 ] Yin Huai commented on SPARK-4502: - I think it makes sense to target for 2.4.0. 2.3.1 is a maintenance

[jira] [Commented] (SPARK-22812) Failing cran-check on master

2017-12-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295532#comment-16295532 ] Yin Huai commented on SPARK-22812: -- Thank you guys! > Failing cran-check on master >

[jira] [Commented] (SPARK-21927) Spark pom.xml's dependency management is broken

2017-09-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154575#comment-16154575 ] Yin Huai commented on SPARK-21927: -- My worry is that it may mask actual issues related to dependencies.

[jira] [Updated] (SPARK-21258) Window result incorrect using complex object with spilling

2017-07-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-21258: - Fix Version/s: (was: 2.1.2) > Window result incorrect using complex object with spilling >

[jira] [Commented] (SPARK-21258) Window result incorrect using complex object with spilling

2017-07-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075055#comment-16075055 ] Yin Huai commented on SPARK-21258: -- Since this change is not in branch-2.1, I am removing 2.1.2 from the

[jira] [Resolved] (SPARK-21111) Fix test failure in 2.2

2017-06-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-2. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 18316

[jira] [Reopened] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

2017-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-20311: -- > SQL "range(N) as alias" or "range(N) alias" doesn't work >

[jira] [Commented] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

2017-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003626#comment-16003626 ] Yin Huai commented on SPARK-20311: -- It introduced a regression

[jira] [Updated] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

2017-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-20311: - Fix Version/s: (was: 2.2.1) (was: 2.3.0) > SQL "range(N) as alias" or

[jira] [Assigned] (SPARK-20661) SparkR tableNames() test fails

2017-05-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-20661: Assignee: Hossein Falaki > SparkR tableNames() test fails > -- > >

[jira] [Resolved] (SPARK-20661) SparkR tableNames() test fails

2017-05-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-20661. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17903

[jira] [Assigned] (SPARK-20358) Executors failing stage on interrupted exception thrown by cancelled tasks

2017-04-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-20358: Assignee: Eric Liang > Executors failing stage on interrupted exception thrown by cancelled tasks

[jira] [Resolved] (SPARK-20358) Executors failing stage on interrupted exception thrown by cancelled tasks

2017-04-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-20358. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17659

[jira] [Assigned] (SPARK-20217) Executor should not fail stage if killed task throws non-interrupted exception

2017-04-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-20217: Assignee: Eric Liang > Executor should not fail stage if killed task throws non-interrupted

[jira] [Resolved] (SPARK-20217) Executor should not fail stage if killed task throws non-interrupted exception

2017-04-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-20217. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17531

[jira] [Commented] (SPARK-14388) Create Table

2017-03-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932960#comment-15932960 ] Yin Huai commented on SPARK-14388: -- [~erlu] I see. Can you create a jira for this? Let's put an example

[jira] [Assigned] (SPARK-19620) Incorrect exchange coordinator Id in physical plan

2017-03-10 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-19620: Assignee: Carson Wang > Incorrect exchange coordinator Id in physical plan >

[jira] [Resolved] (SPARK-19620) Incorrect exchange coordinator Id in physical plan

2017-03-10 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-19620. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16952

[jira] [Updated] (SPARK-19816) DataFrameCallbackSuite doesn't recover the log level

2017-03-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-19816: - Fix Version/s: 2.1.1 > DataFrameCallbackSuite doesn't recover the log level >

[jira] [Commented] (SPARK-19604) Log the start of every Python test

2017-02-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869023#comment-15869023 ] Yin Huai commented on SPARK-19604: -- It has been resolved by https://github.com/apache/spark/pull/16935.

[jira] [Resolved] (SPARK-19604) Log the start of every Python test

2017-02-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-19604. -- Resolution: Fixed Fix Version/s: 2.1.1 2.0.3 > Log the start of every Python

[jira] [Assigned] (SPARK-19604) Log the start of every Python test

2017-02-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-19604: Assignee: Yin Huai > Log the start of every Python test > -- > >

[jira] [Created] (SPARK-19604) Log the start of every Python test

2017-02-14 Thread Yin Huai (JIRA)
Yin Huai created SPARK-19604: Summary: Log the start of every Python test Key: SPARK-19604 URL: https://issues.apache.org/jira/browse/SPARK-19604 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-19321) Support Hive 2.x's metastore

2017-01-20 Thread Yin Huai (JIRA)
Yin Huai created SPARK-19321: Summary: Support Hive 2.x's metastore Key: SPARK-19321 URL: https://issues.apache.org/jira/browse/SPARK-19321 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-19295) IsolatedClientLoader's downloadVersion should log the location of downloaded metastore client jars

2017-01-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-19295. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16649

[jira] [Updated] (SPARK-19295) IsolatedClientLoader's downloadVersion should log the location of downloaded metastore client jars

2017-01-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-19295: - Priority: Minor (was: Major) > IsolatedClientLoader's downloadVersion should log the location of

[jira] [Updated] (SPARK-19295) IsolatedClientLoader's downloadVersion should log the location of downloaded metastore client jars

2017-01-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-19295: - Issue Type: Improvement (was: Bug) > IsolatedClientLoader's downloadVersion should log the location of

[jira] [Created] (SPARK-19295) IsolatedClientLoader's downloadVersion should log the location of downloaded metastore client jars

2017-01-19 Thread Yin Huai (JIRA)
Yin Huai created SPARK-19295: Summary: IsolatedClientLoader's downloadVersion should log the location of downloaded metastore client jars Key: SPARK-19295 URL: https://issues.apache.org/jira/browse/SPARK-19295

[jira] [Resolved] (SPARK-18885) unify CREATE TABLE syntax for data source and hive serde tables

2017-01-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18885. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16296

[jira] [Resolved] (SPARK-19072) Catalyst's IN always returns false for infinity

2017-01-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-19072. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16469

[jira] [Updated] (SPARK-19072) Catalyst's IN always returns false for infinity

2017-01-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-19072: - Assignee: Wenchen Fan > Catalyst's IN always returns false for infinity >

[jira] [Resolved] (SPARK-18567) Simplify CreateDataSourceTableAsSelectCommand

2016-12-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18567. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 15996

[jira] [Commented] (SPARK-16552) Store the Inferred Schemas into External Catalog Tables when Creating Tables

2016-12-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783705#comment-15783705 ] Yin Huai commented on SPARK-16552: -- [~smilegator] [~cloud_fan] i think we will not do partitioning

[jira] [Updated] (SPARK-18990) make DatasetBenchmark fairer for Dataset

2016-12-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18990: - Fix Version/s: (was: 2.2.0) > make DatasetBenchmark fairer for Dataset >

[jira] [Reopened] (SPARK-18990) make DatasetBenchmark fairer for Dataset

2016-12-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-18990: -- > make DatasetBenchmark fairer for Dataset > > >

[jira] [Resolved] (SPARK-18951) Upgrade com.thoughtworks.paranamer/paranamer to 2.6

2016-12-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18951. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16359

[jira] [Updated] (SPARK-18928) FileScanRDD, JDBCRDD, and UnsafeSorter should support task cancellation

2016-12-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18928: - Fix Version/s: 2.0.3 > FileScanRDD, JDBCRDD, and UnsafeSorter should support task cancellation >

[jira] [Updated] (SPARK-18761) Uncancellable / unkillable tasks may starve jobs of resoures

2016-12-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18761: - Fix Version/s: 2.1.1 2.0.3 > Uncancellable / unkillable tasks may starve jobs of

[jira] [Created] (SPARK-18953) Do not show the link to a dead worker on the master page

2016-12-20 Thread Yin Huai (JIRA)
Yin Huai created SPARK-18953: Summary: Do not show the link to a dead worker on the master page Key: SPARK-18953 URL: https://issues.apache.org/jira/browse/SPARK-18953 Project: Spark Issue Type:

[jira] [Updated] (SPARK-18951) Upgrade com.thoughtworks.paranamer/paranamer to 2.6

2016-12-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18951: - Description: I recently hit a bug of com.thoughtworks.paranamer/paranamer, which causes jackson fail to

[jira] [Assigned] (SPARK-18951) Upgrade com.thoughtworks.paranamer/paranamer to 2.6

2016-12-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-18951: Assignee: Yin Huai > Upgrade com.thoughtworks.paranamer/paranamer to 2.6 >

[jira] [Created] (SPARK-18951) Upgrade com.thoughtworks.paranamer/paranamer

2016-12-20 Thread Yin Huai (JIRA)
Yin Huai created SPARK-18951: Summary: Upgrade com.thoughtworks.paranamer/paranamer Key: SPARK-18951 URL: https://issues.apache.org/jira/browse/SPARK-18951 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-18951) Upgrade com.thoughtworks.paranamer/paranamer to 2.6

2016-12-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18951: - Summary: Upgrade com.thoughtworks.paranamer/paranamer to 2.6 (was: Upgrade

[jira] [Resolved] (SPARK-18761) Uncancellable / unkillable tasks may starve jobs of resoures

2016-12-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18761. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16189

[jira] [Resolved] (SPARK-18921) check database existence with Hive.databaseExists instead of getDatabase

2016-12-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18921. -- Resolution: Fixed Fix Version/s: 2.1.1 Issue resolved by pull request 16332

[jira] [Resolved] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2016-12-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-13747. -- Resolution: Fixed Fix Version/s: (was: 2.0.2) (was: 2.1.0)

[jira] [Resolved] (SPARK-18675) CTAS for hive serde table should work for all hive versions

2016-12-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18675. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16104

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18816: - Assignee: Alex Bozarth > executor page fails to show log links if executors are added after an app is >

[jira] [Commented] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743298#comment-15743298 ] Yin Huai commented on SPARK-18816: -- Yea, log pages are still there. But, without those links on the

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18816: - Priority: Blocker (was: Major) > executor page fails to show log links if executors are added after an

[jira] [Commented] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743260#comment-15743260 ] Yin Huai commented on SPARK-18816: -- [~ajbozarth] Yea, please take a look. Thanks! The reasons that I

[jira] [Commented] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737254#comment-15737254 ] Yin Huai commented on SPARK-18816: -- btw, my testing was done with chrome. I then terminated the

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18816: - Attachment: screenshot-1.png > executor page fails to show log links if executors are added after an app

[jira] [Created] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-09 Thread Yin Huai (JIRA)
Yin Huai created SPARK-18816: Summary: executor page fails to show log links if executors are added after an app is launched Key: SPARK-18816 URL: https://issues.apache.org/jira/browse/SPARK-18816

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18816: - Description: How to reproduce with standalone mode: 1. Launch a spark master 2. Launch a spark shell. At

[jira] [Commented] (SPARK-18284) Scheme of DataFrame generated from RDD is diffrent between master and 2.0

2016-12-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723012#comment-15723012 ] Yin Huai commented on SPARK-18284: -- [~kiszk] btw, do we know what caused the nullable setting change in

[jira] [Created] (SPARK-18660) Parquet complains "Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl

2016-11-30 Thread Yin Huai (JIRA)
Yin Huai created SPARK-18660: Summary: Parquet complains "Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl " Key: SPARK-18660

[jira] [Resolved] (SPARK-18631) Avoid making data skew worse in ExchangeCoordinator

2016-11-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18631. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16065

[jira] [Updated] (SPARK-18468) Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column

2016-11-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18468: - Target Version/s: (was: 2.1.0) > Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757

[jira] [Assigned] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

2016-11-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-18602: Assignee: Yin Huai > Dependency list still shows that the version of >

[jira] [Resolved] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

2016-11-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18602. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 16025

[jira] [Created] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

2016-11-27 Thread Yin Huai (JIRA)
Yin Huai created SPARK-18602: Summary: Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6 Key: SPARK-18602 URL: https://issues.apache.org/jira/browse/SPARK-18602

[jira] [Updated] (SPARK-18544) Append with df.saveAsTable writes data to wrong location

2016-11-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18544: - Priority: Blocker (was: Major) > Append with df.saveAsTable writes data to wrong location >

[jira] [Resolved] (SPARK-15513) Bzip2Factory in Hadoop 2.7.1 is not thread safe

2016-11-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15513. -- Resolution: Won't Fix > Bzip2Factory in Hadoop 2.7.1 is not thread safe >

[jira] [Commented] (SPARK-15513) Bzip2Factory in Hadoop 2.7.1 is not thread safe

2016-11-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684302#comment-15684302 ] Yin Huai commented on SPARK-15513: -- I am closing this jira since the fix has been released with 2.7.2.

[jira] [Comment Edited] (SPARK-15513) Bzip2Factory in Hadoop 2.7.1 is not thread safe

2016-11-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684302#comment-15684302 ] Yin Huai edited comment on SPARK-15513 at 11/21/16 6:17 PM: I am closing this

[jira] [Resolved] (SPARK-18360) default table path of tables in default database should depend on the location of default database

2016-11-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18360. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15812

[jira] [Updated] (SPARK-18360) default table path of tables in default database should depend on the location of default database

2016-11-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18360: - Labels: release_notes releasenotes (was: ) > default table path of tables in default database should

[jira] [Updated] (SPARK-18468) Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column

2016-11-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18468: - Description:

[jira] [Updated] (SPARK-18468) Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column

2016-11-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18468: - Component/s: (was: SQL) Spark Core > Flaky test:

[jira] [Resolved] (SPARK-18186) Migrate HiveUDAFFunction to TypedImperativeAggregate for partial aggregation support

2016-11-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18186. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 15703

[jira] [Created] (SPARK-18468) Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column

2016-11-15 Thread Yin Huai (JIRA)
Yin Huai created SPARK-18468: Summary: Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column Key: SPARK-18468 URL:

[jira] [Commented] (SPARK-18464) Spark SQL fails to load tables created without providing a schema

2016-11-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669057#comment-15669057 ] Yin Huai commented on SPARK-18464: -- cc [~cloud_fan] > Spark SQL fails to load tables created without

  1   2   3   4   5   6   7   8   9   10   >