[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14531 Let me do it now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14873: [SPARK-17308]Improved the spark core code by replacing a...

2016-08-30 Thread shiv4nsh
Github user shiv4nsh commented on the issue: https://github.com/apache/spark/pull/14873 @srowen : We are good on merging on this Right? or do this PR require some additional changes ! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14868: [SPARK-16283][SQL][WIP] Implements percentile_approx agg...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14868 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64696/ Test PASSed. ---

[GitHub] spark issue #14868: [SPARK-16283][SQL][WIP] Implements percentile_approx agg...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14868 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14868: [SPARK-16283][SQL][WIP] Implements percentile_approx agg...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14868 **[Test build #64696 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64696/consoleFull)** for PR 14868 at commit

[GitHub] spark issue #14888: [SPARK-17324] [SQL] Remove Direct Usage of HiveClient in...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14888 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64694/ Test PASSed. ---

[GitHub] spark issue #14888: [SPARK-17324] [SQL] Remove Direct Usage of HiveClient in...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14888 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14888: [SPARK-17324] [SQL] Remove Direct Usage of HiveClient in...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14888 **[Test build #64694 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64694/consoleFull)** for PR 14888 at commit

[GitHub] spark issue #14868: [SPARK-16283][SQL][WIP] Implements percentile_approx agg...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14868 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14868: [SPARK-16283][SQL][WIP] Implements percentile_approx agg...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14868 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64695/ Test PASSed. ---

[GitHub] spark issue #14868: [SPARK-16283][SQL][WIP] Implements percentile_approx agg...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14868 **[Test build #64695 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64695/consoleFull)** for PR 14868 at commit

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76926260 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -168,6 +169,81 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76926133 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -401,6 +401,13 @@ private[spark] class

[GitHub] spark issue #13252: [SPARK-15473][SQL] CSV data source writes header for emp...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13252 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13252: [SPARK-15473][SQL] CSV data source writes header for emp...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13252 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64693/ Test PASSed. ---

[GitHub] spark issue #13252: [SPARK-15473][SQL] CSV data source writes header for emp...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13252 **[Test build #64693 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64693/consoleFull)** for PR 13252 at commit

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76924362 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -401,6 +401,13 @@ private[spark] class

[GitHub] spark issue #14883: [SPARK-17319] [SQL] Move addJar from HiveSessionState to...

2016-08-30 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14883 https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Cli#LanguageManualCli-HiveResources Looks like it is. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #14883: [SPARK-17319] [SQL] Move addJar from HiveSessionS...

2016-08-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14883#discussion_r76923998 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala --- @@ -171,6 +171,7 @@ private[sql] class SessionState(sparkSession:

[GitHub] spark pull request #13704: [SPARK-15985][SQL] Eliminate redundant cast from ...

2016-08-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13704 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13873: [SPARK-16167][SQL] RowEncoder should preserve array/map ...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13873 **[Test build #64698 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64698/consoleFull)** for PR 13873 at commit

[GitHub] spark pull request #10225: [SPARK-12196][Core] Store/retrieve blocks in diff...

2016-08-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/10225#discussion_r76923680 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala --- @@ -50,35 +50,98 @@ private[spark] class DiskBlockManager(conf: SparkConf,

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-08-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13704 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76923549 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeTableCommand.scala --- @@ -21,25 +21,55 @@ import

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76923392 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeTableCommand.scala --- @@ -21,25 +21,55 @@ import

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14531 can you resolve the conflicts? thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14883: [SPARK-17319] [SQL] Move addJar from HiveSessionState to...

2016-08-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14883 @gatorsmile is the `ADD JAR` command in hive session-scoped? Our current implementation may be wrong.. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #14883: [SPARK-17319] [SQL] Move addJar from HiveSessionS...

2016-08-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14883#discussion_r76922568 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala --- @@ -171,6 +171,7 @@ private[sql] class SessionState(sparkSession:

[GitHub] spark pull request #14883: [SPARK-17319] [SQL] Move addJar from HiveSessionS...

2016-08-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14883#discussion_r76922145 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/InMemoryCatalog.scala --- @@ -509,4 +509,10 @@ class InMemoryCatalog(

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14750 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14750 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64691/ Test PASSed. ---

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76922102 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -168,6 +169,81 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark issue #14750: [SPARK-17183][SQL] put hive serde table schema to table ...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14750 **[Test build #64691 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64691/consoleFull)** for PR 14750 at commit

[GitHub] spark pull request #10225: [SPARK-12196][Core] Store/retrieve blocks in diff...

2016-08-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/10225#discussion_r76922041 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala --- @@ -50,35 +50,98 @@ private[spark] class DiskBlockManager(conf: SparkConf,

[GitHub] spark issue #14783: SPARK-16785 R dapply doesn't return array or raw columns

2016-08-30 Thread sun-rui
Github user sun-rui commented on the issue: https://github.com/apache/spark/pull/14783 @clarkfitzg, your patch is for bug fix but not for performance improvement, right? If so, since there is no performance regression according to your benchmark, let's focus on the functionality. We

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76921850 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeTableCommand.scala --- @@ -88,15 +116,21 @@ case class

[GitHub] spark issue #14744: [SPARK-17178][SPARKR][SPARKSUBMIT] Allow to set sparkr s...

2016-08-30 Thread sun-rui
Github user sun-rui commented on the issue: https://github.com/apache/spark/pull/14744 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14887: [SPARK-17321][YARN] YARN shuffle service should use good...

2016-08-30 Thread SaintBacchus
Github user SaintBacchus commented on the issue: https://github.com/apache/spark/pull/14887 If there are some bad disk in local-dirs, `NodeManager` will not pass these bad disk to spark executor. So it's not necessary to check it. --- If your project is set up for it, you can reply

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76921588 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -168,6 +169,81 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark issue #14710: [SPARK-16533][CORE] resolve deadlocking in driver when e...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14710 **[Test build #64697 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64697/consoleFull)** for PR 14710 at commit

[GitHub] spark pull request #14883: [SPARK-17319] [SQL] Move addJar from HiveSessionS...

2016-08-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14883#discussion_r76921445 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/InMemoryCatalog.scala --- @@ -509,4 +509,10 @@ class InMemoryCatalog(

[GitHub] spark issue #14710: [SPARK-16533][CORE] resolve deadlocking in driver when e...

2016-08-30 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14710 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76921301 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala --- @@ -33,7 +33,8 @@ import org.apache.spark.util.Utils

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76921020 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -168,6 +169,81 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76920921 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -168,6 +169,81 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark issue #14710: [SPARK-16533][CORE] resolve deadlocking in driver when e...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14710 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14710: [SPARK-16533][CORE] resolve deadlocking in driver when e...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14710 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64692/ Test FAILed. ---

[GitHub] spark issue #14710: [SPARK-16533][CORE] resolve deadlocking in driver when e...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14710 **[Test build #64692 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64692/consoleFull)** for PR 14710 at commit

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76920817 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -168,6 +169,81 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76920785 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala --- @@ -33,7 +33,8 @@ import org.apache.spark.util.Utils

[GitHub] spark issue #14874: [SPARK-17180][SPARK-17309][SPARK-17323][SQL] create Alte...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14874 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64690/ Test PASSed. ---

[GitHub] spark issue #14874: [SPARK-17180][SPARK-17309][SPARK-17323][SQL] create Alte...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14874 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14874: [SPARK-17180][SPARK-17309][SPARK-17323][SQL] create Alte...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14874 **[Test build #64690 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64690/consoleFull)** for PR 14874 at commit

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76920593 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -168,6 +169,81 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76920340 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -168,6 +169,81 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76920328 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala --- @@ -33,7 +33,8 @@ import org.apache.spark.util.Utils

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76920300 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -168,6 +169,81 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76920234 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -168,6 +169,81 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark pull request #14859: [SPARK-17200][PROJECT INFRA][BUILD][SparkR] Autom...

2016-08-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/14859#discussion_r76920073 --- Diff: appveyor.yml --- @@ -0,0 +1,43 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76919947 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -235,14 +235,18 @@ class SessionCatalog( *

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76919518 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -401,6 +401,13 @@ private[spark] class HiveExternalCatalog(conf:

[GitHub] spark pull request #14868: [SPARK-16283][SQL][WIP] Implements percentile_app...

2016-08-30 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/14868#discussion_r76918794 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/ApproximatePercentile.scala --- @@ -0,0 +1,321 @@ +/* +

[GitHub] spark issue #14868: [SPARK-16283][SQL][WIP] Implements percentile_approx agg...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14868 **[Test build #64696 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64696/consoleFull)** for PR 14868 at commit

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76918381 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala --- @@ -33,7 +33,8 @@ import org.apache.spark.util.Utils

[GitHub] spark issue #14888: [SPARK-17324] [SQL] Remove Direct Usage of HiveClient in...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14888 **[Test build #64694 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64694/consoleFull)** for PR 14888 at commit

[GitHub] spark issue #14868: [SPARK-16283][SQL][WIP] Implements percentile_approx agg...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14868 **[Test build #64695 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64695/consoleFull)** for PR 14868 at commit

[GitHub] spark issue #14868: [SPARK-16283][SQL][WIP] Implements percentile_approx agg...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14868 **[Test build #64687 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64687/consoleFull)** for PR 14868 at commit

[GitHub] spark pull request #14888: [SPARK-17324] [SQL] Remove Direct Usage of HiveCl...

2016-08-30 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/14888 [SPARK-17324] [SQL] Remove Direct Usage of HiveClient in InsertIntoHiveTable ### What changes were proposed in this pull request? This is another step to get rid of HiveClient from

[GitHub] spark issue #13252: [SPARK-15473][SQL] CSV data source writes header for emp...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13252 **[Test build #64693 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64693/consoleFull)** for PR 13252 at commit

[GitHub] spark pull request #14712: [SPARK-17072] [SQL] support table-level statistic...

2016-08-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14712#discussion_r76917963 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -401,6 +401,13 @@ private[spark] class HiveExternalCatalog(conf:

[GitHub] spark pull request #14884: [SPARK-17318][Tests]Fix ReplSuite replicating blo...

2016-08-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14884 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14388: [SPARK-16362][SQL] Support ArrayType and StructType in v...

2016-08-30 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14388 @mallman Thanks! I promise not to share it with others. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14884: [SPARK-17318][Tests]Fix ReplSuite replicating blocks of ...

2016-08-30 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14884 Merging to master and 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14883: [SPARK-17319] [SQL] Move addJar from HiveSessionState to...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14883 cc @cloud-fan @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14855: [SPARK-17284] [SQL] Remove Statistics-related Table Prop...

2016-08-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14855 Will try it. My current solution is to first retrieve the table properties and fill these Hive-specific properties (if not set by the callers) before issuing the command to Hive. Will

[GitHub] spark issue #14854: [SPARK-17283][WIP][Core] Cancel job in RDD.take() as soo...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14854 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14854: [SPARK-17283][WIP][Core] Cancel job in RDD.take() as soo...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14854 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64686/ Test PASSed. ---

[GitHub] spark issue #14854: [SPARK-17283][WIP][Core] Cancel job in RDD.take() as soo...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14854 **[Test build #64686 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64686/consoleFull)** for PR 14854 at commit

[GitHub] spark issue #14744: [SPARK-17178][SPARKR][SPARKSUBMIT] Allow to set sparkr s...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14744 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14744: [SPARK-17178][SPARKR][SPARKSUBMIT] Allow to set sparkr s...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14744 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64685/ Test PASSed. ---

[GitHub] spark issue #14744: [SPARK-17178][SPARKR][SPARKSUBMIT] Allow to set sparkr s...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14744 **[Test build #64685 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64685/consoleFull)** for PR 14744 at commit

[GitHub] spark issue #14783: SPARK-16785 R dapply doesn't return array or raw columns

2016-08-30 Thread clarkfitzg
Github user clarkfitzg commented on the issue: https://github.com/apache/spark/pull/14783 @shivaram what do you think? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14882: [SPARK-17316][Core] Make CoarseGrainedSchedulerBackend.r...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14882 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14882: [SPARK-17316][Core] Make CoarseGrainedSchedulerBackend.r...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14882 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64684/ Test PASSed. ---

[GitHub] spark issue #14882: [SPARK-17316][Core] Make CoarseGrainedSchedulerBackend.r...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14882 **[Test build #64684 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64684/consoleFull)** for PR 14882 at commit

[GitHub] spark issue #14882: [SPARK-17316][Core] Make CoarseGrainedSchedulerBackend.r...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14882 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14882: [SPARK-17316][Core] Make CoarseGrainedSchedulerBackend.r...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14882 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64680/ Test PASSed. ---

[GitHub] spark issue #14882: [SPARK-17316][Core] Make CoarseGrainedSchedulerBackend.r...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14882 **[Test build #64680 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64680/consoleFull)** for PR 14882 at commit

[GitHub] spark issue #14826: [SPARK-17311] [MLLIB] Standardize Python-Java MLlib API ...

2016-08-30 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/14826 @srowen I like your decisions. Just the one issue as far as I can see. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14882: [SPARK-17316][Core] Make CoarseGrainedSchedulerBackend.r...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14882 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64679/ Test PASSed. ---

[GitHub] spark pull request #14826: [SPARK-17311] [MLLIB] Standardize Python-Java MLl...

2016-08-30 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/14826#discussion_r76914139 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/api/python/PythonMLLibAPI.scala --- @@ -126,13 +126,14 @@ private[python] class PythonMLLibAPI

[GitHub] spark issue #14882: [SPARK-17316][Core] Make CoarseGrainedSchedulerBackend.r...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14882 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14882: [SPARK-17316][Core] Make CoarseGrainedSchedulerBackend.r...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14882 **[Test build #64679 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64679/consoleFull)** for PR 14882 at commit

[GitHub] spark issue #14858: [SPARK-17219][ML] Add NaN value handling in Bucketizer

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14858 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64688/ Test PASSed. ---

[GitHub] spark issue #14858: [SPARK-17219][ML] Add NaN value handling in Bucketizer

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14858 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14858: [SPARK-17219][ML] Add NaN value handling in Bucketizer

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14858 **[Test build #64688 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64688/consoleFull)** for PR 14858 at commit

[GitHub] spark issue #14884: [SPARK-17318][Tests]Fix ReplSuite replicating blocks of ...

2016-08-30 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14884 Thanks @zsxwing --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #14710: [SPARK-16533][CORE] resolve deadlocking in driver when e...

2016-08-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14710 **[Test build #64692 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64692/consoleFull)** for PR 14710 at commit

[GitHub] spark issue #14882: [SPARK-17316][Core] Make CoarseGrainedSchedulerBackend.r...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14882 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14882: [SPARK-17316][Core] Make CoarseGrainedSchedulerBackend.r...

2016-08-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14882 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64677/ Test PASSed. ---

  1   2   3   4   5   6   >