[GitHub] spark issue #16720: [SPARK-19387][SPARKR] Tests do not run with SparkR sourc...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16720 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72103/ Test PASSed. ---

[GitHub] spark issue #16720: [SPARK-19387][SPARKR] Tests do not run with SparkR sourc...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16720 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16720: [SPARK-19387][SPARKR] Tests do not run with SparkR sourc...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16720 **[Test build #72103 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72103/testReport)** for PR 16720 at commit [`f51f504`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #16720: [SPARK-19387][SPARKR] Tests do not run with SparkR sourc...

2017-01-27 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16720 Sure, I've simplified it. Good point on the ordering - digging into it looks like it's just file system search order, which really is not reliable. We could certainly add a test

[GitHub] spark issue #16720: [SPARK-19387][SPARKR] Tests do not run with SparkR sourc...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16720 **[Test build #72103 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72103/testReport)** for PR 16720 at commit [`f51f504`](https://github.com/apache/spark/commit/f5

[GitHub] spark pull request #16721: [SPARKR][DOCS] update R API doc for subset/extrac...

2017-01-27 Thread felixcheung
GitHub user felixcheung reopened a pull request: https://github.com/apache/spark/pull/16721 [SPARKR][DOCS] update R API doc for subset/extract ## What changes were proposed in this pull request? With extract `[[` or replace `[[<-`, the parameter `i` is a column index, that

[GitHub] spark pull request #16721: [SPARKR][DOCS] update R API doc for subset/extrac...

2017-01-27 Thread felixcheung
Github user felixcheung closed the pull request at: https://github.com/apache/spark/pull/16721 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] spark issue #16636: [SPARK-19279] [SQL] Infer Schema for Hive Serde Tables a...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16636 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72101/ Test PASSed. ---

[GitHub] spark issue #16636: [SPARK-19279] [SQL] Infer Schema for Hive Serde Tables a...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16636 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16636: [SPARK-19279] [SQL] Infer Schema for Hive Serde Tables a...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16636 **[Test build #72101 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72101/testReport)** for PR 16636 at commit [`c5cfa1a`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #16726: [SPARK-19390][SQL] Replace the unnecessary usages of hiv...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16726 **[Test build #72102 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72102/testReport)** for PR 16726 at commit [`e9e7486`](https://github.com/apache/spark/commit/e9

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16724 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72100/ Test PASSed. ---

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16724 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16724 **[Test build #72100 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72100/testReport)** for PR 16724 at commit [`aaa3c3d`](https://github.com/apache/spark/commit/a

[GitHub] spark pull request #16726: [SPARK-19390][SQL] Replace the unnecessary usages...

2017-01-27 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/16726 [SPARK-19390][SQL] Replace the unnecessary usages of hiveQlTable ### What changes were proposed in this pull request? `catalogTable` is the native table metadata structure for Spark SQL. Thus

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98325754 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -899,6 +919,21 @@ private[spark] class HiveExternalCatalog(co

[GitHub] spark issue #13072: [SPARK-15288] [Mesos] Mesos dispatcher should handle gra...

2017-01-27 Thread devaraj-kavali
Github user devaraj-kavali commented on the issue: https://github.com/apache/spark/pull/13072 MesosClusterDispatcher also has multiple threads like Executor, when any one thread terminates in the MesosClusterDispatcher process due to some error/exception it keeps running without perfo

[GitHub] spark issue #16725: [SPARK-19377] [WEBUI] [CORE] Killed tasks should have th...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16725 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #16725: [SPARK-19377] [WEBUI] [CORE] Killed tasks should ...

2017-01-27 Thread devaraj-kavali
GitHub user devaraj-kavali opened a pull request: https://github.com/apache/spark/pull/16725 [SPARK-19377] [WEBUI] [CORE] Killed tasks should have the status as KILLED ## What changes were proposed in this pull request? Copying of the killed status was missing while getting

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-27 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98325213 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -899,6 +919,21 @@ private[spark] class HiveExternalCatalog(conf:

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98325110 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -899,6 +919,21 @@ private[spark] class HiveExternalCatalog(co

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16722 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72099/ Test FAILed. ---

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16722 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16722 **[Test build #72099 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72099/testReport)** for PR 16722 at commit [`2112720`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #16636: [SPARK-19279] [SQL] Infer Schema for Hive Serde T...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16636#discussion_r98324289 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala --- @@ -455,4 +462,133 @@ private[spark] object HiveUtils extends Logging {

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16724 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16724 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72097/ Test PASSed. ---

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16724 **[Test build #72097 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72097/testReport)** for PR 16724 at commit [`b84c08b`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #16636: [SPARK-19279] [SQL] Block Creating a Hive Table W...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16636#discussion_r98324106 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala --- @@ -455,4 +462,133 @@ private[spark] object HiveUtils extends Logging {

[GitHub] spark issue #16636: [SPARK-19279] [SQL] Block Creating a Hive Table With an ...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16636 **[Test build #72101 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72101/testReport)** for PR 16636 at commit [`c5cfa1a`](https://github.com/apache/spark/commit/c5

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16724 **[Test build #72100 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72100/testReport)** for PR 16724 at commit [`aaa3c3d`](https://github.com/apache/spark/commit/aa

[GitHub] spark pull request #16636: [SPARK-19279] [SQL] Block Creating a Hive Table W...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16636#discussion_r98323927 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala --- @@ -455,4 +462,133 @@ private[spark] object HiveUtils extends Logging {

[GitHub] spark pull request #16719: [SPARK-19385][SQL] During canonicalization, `NOT(...

2017-01-27 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/16719#discussion_r98322977 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Canonicalize.scala --- @@ -78,14 +78,18 @@ object Canonicalize extends {

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16724 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16724 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72096/ Test PASSed. ---

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16724 **[Test build #72096 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72096/testReport)** for PR 16724 at commit [`93d3806`](https://github.com/apache/spark/commit/9

[GitHub] spark pull request #16719: [SPARK-19385][SQL] During canonicalization, `NOT(...

2017-01-27 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/16719#discussion_r98322886 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionSetSuite.scala --- @@ -75,10 +107,14 @@ class ExpressionSetSuite ex

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16722 **[Test build #72099 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72099/testReport)** for PR 16722 at commit [`2112720`](https://github.com/apache/spark/commit/21

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-27 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98322377 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -899,6 +919,21 @@ private[spark] class HiveExternalCatalog(conf:

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16722 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72098/ Test FAILed. ---

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16722 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16722 **[Test build #72098 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72098/testReport)** for PR 16722 at commit [`8278724`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16722 **[Test build #72098 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72098/testReport)** for PR 16722 at commit [`8278724`](https://github.com/apache/spark/commit/82

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14725 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72092/ Test PASSed. ---

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14725 **[Test build #72092 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72092/testReport)** for PR 14725 at commit [`8b401ec`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16724 **[Test build #72097 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72097/testReport)** for PR 16724 at commit [`b84c08b`](https://github.com/apache/spark/commit/b8

[GitHub] spark issue #16700: [SPARK-19359][SQL]clear useless path after rename a part...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16700 Thanks! Merging it to master. You can fix the minor comments in your other PRs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark pull request #16716: [SPARK-19378][SS] Ensure continuity of stateOpera...

2017-01-27 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16716#discussion_r98320764 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryStatusAndProgressSuite.scala --- @@ -171,6 +174,42 @@ class StreamingQueryStatus

[GitHub] spark issue #16720: [SPARK-19387][SPARKR] Tests do not run with SparkR sourc...

2017-01-27 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16720 I am not sure tests are ever meant to run on a cluster (see the number of uses of LocalSparkContext in core/src/test/scala) -- The main reason I dont want to introduce the 'first test' approach is

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16699 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72095/ Test PASSed. ---

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16699 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16723: [SPARK-19389][ML][PYTHON][DOC] Minor doc fixes for ML Py...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16723 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72094/ Test PASSed. ---

[GitHub] spark issue #16723: [SPARK-19389][ML][PYTHON][DOC] Minor doc fixes for ML Py...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16723 **[Test build #72094 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72094/testReport)** for PR 16723 at commit [`fa522e6`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16699 **[Test build #72095 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72095/testReport)** for PR 16699 at commit [`52bc32b`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #16723: [SPARK-19389][ML][PYTHON][DOC] Minor doc fixes for ML Py...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16723 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72088/ Test PASSed. ---

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #72088 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72088/testReport)** for PR 16043 at commit [`91001fc`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #16650: [SPARK-16554][CORE] Automatically Kill Executors and Nod...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16650 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16650: [SPARK-16554][CORE] Automatically Kill Executors and Nod...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16650 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72087/ Test PASSed. ---

[GitHub] spark issue #16650: [SPARK-16554][CORE] Automatically Kill Executors and Nod...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16650 **[Test build #72087 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72087/testReport)** for PR 16650 at commit [`eed4112`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16700 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16724 cc @cloud-fan @rxin @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98317878 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -899,6 +919,21 @@ private[spark] class HiveExternalCatalog(co

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98317808 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -899,6 +919,21 @@ private[spark] class HiveExternalCatalog(co

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98317719 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -899,6 +919,21 @@ private[spark] class HiveExternalCatalog(co

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98317671 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -839,6 +839,26 @@ private[spark] class HiveExternalCatalog(co

[GitHub] spark pull request #16700: [SPARK-19359][SQL]clear useless path after rename...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16700#discussion_r98317696 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -839,6 +839,26 @@ private[spark] class HiveExternalCatalog(co

[GitHub] spark issue #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows after ex...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16724 **[Test build #72096 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72096/testReport)** for PR 16724 at commit [`93d3806`](https://github.com/apache/spark/commit/93

[GitHub] spark pull request #16724: [SPARK-19352][WIP][SQL] Keep sort order of rows a...

2017-01-27 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/16724 [SPARK-19352][WIP][SQL] Keep sort order of rows after external sorter when writing ## What changes were proposed in this pull request? WIP ## How was this patch tested? Wi

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16699 **[Test build #72095 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72095/testReport)** for PR 16699 at commit [`52bc32b`](https://github.com/apache/spark/commit/52

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-01-27 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16699 @zhengruifeng Thanks for the suggestions. Added casting and instrumentation. @imatiach-msft Thanks for the clarification! It is probably worth another PR to clean up all tests in GLM.

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16722 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72093/ Test FAILed. ---

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16722 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16722 **[Test build #72093 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72093/testReport)** for PR 16722 at commit [`2729a63`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #16723: [SPARK-19389][ML][PYTHON][DOC] Minor doc fixes for ML Py...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16723 **[Test build #72094 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72094/testReport)** for PR 16723 at commit [`fa522e6`](https://github.com/apache/spark/commit/fa

[GitHub] spark issue #16723: [SPARK-19389][ML][PYTHON][DOC] Minor doc fixes for ML Py...

2017-01-27 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/16723 @wangmiao1981 Would you mind checking this? It has small fixes I noticed when reviewing your PR for Python LinearSVC. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request #16723: [SPARK-19389][ML][PYTHON][DOC] Minor doc fixes fo...

2017-01-27 Thread jkbradley
GitHub user jkbradley opened a pull request: https://github.com/apache/spark/pull/16723 [SPARK-19389][ML][PYTHON][DOC] Minor doc fixes for ML Python Params and LinearSVC ## What changes were proposed in this pull request? * Removed Since tags in Python Params since they are

[GitHub] spark pull request #16636: [SPARK-19279] [SQL] Block Creating a Hive Table W...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16636#discussion_r98315149 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -1527,6 +1527,21 @@ class DDLSuite extends QueryTest with

[GitHub] spark issue #16636: [SPARK-19279] [SQL] Block Creating a Hive Table With an ...

2017-01-27 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16636 : ) Done. Found a solution to infer the schema of Hive Serde tables. Let me clean the code now. --- If your project is set up for it, you can reply to this email and have your reply appear on G

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16722 **[Test build #72093 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72093/testReport)** for PR 16722 at commit [`2729a63`](https://github.com/apache/spark/commit/27

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16722 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72091/ Test FAILed. ---

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16722 **[Test build #72091 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72091/testReport)** for PR 16722 at commit [`7dc1437`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #16694: [SPARK-19336][ML][Pyspark]: LinearSVC Python API

2017-01-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16694 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16694: [SPARK-19336][ML][Pyspark]: LinearSVC Python API

2017-01-27 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/16694 LGTM, thank you! Merging with master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16722 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16722 **[Test build #72091 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72091/testReport)** for PR 16722 at commit [`7dc1437`](https://github.com/apache/spark/commit/7d

[GitHub] spark issue #14725: [SPARK-17161] [PYSPARK][ML] Add PySpark-ML JavaWrapper c...

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14725 **[Test build #72092 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72092/testReport)** for PR 14725 at commit [`8b401ec`](https://github.com/apache/spark/commit/8b

[GitHub] spark issue #16722: [SPARK-9478][ML][MLlib] Add sample weights to decision t...

2017-01-27 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/16722 ping @jkbradley @imatiach-msft --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16722: [SPARK-9478][ML][MLlib] Add sample weights to dec...

2017-01-27 Thread sethah
GitHub user sethah opened a pull request: https://github.com/apache/spark/pull/16722 [SPARK-9478][ML][MLlib] Add sample weights to decision trees ## What changes were proposed in this pull request? This patch adds support for sample weights to `DecisionTreeRegressor` and `D

[GitHub] spark issue #16281: [SPARK-13127][SQL] Update Parquet to 1.9.0

2017-01-27 Thread julienledem
Github user julienledem commented on the issue: https://github.com/apache/spark/pull/16281 FYI: Parquet 1.8.2 vote thread passed: https://mail-archives.apache.org/mod_mbox/parquet-dev/201701.mbox/%3CCAO4re1mHLT%2BLYn8s1RTEDZK8-9WSVugY8-HQqAN%2BtU%3DBOi1L9w%40mail.gmail.com%3E --- If

[GitHub] spark issue #16721: [SPARKR][DOCS] update R API doc for subset/extract

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16721 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72090/ Test PASSed. ---

[GitHub] spark issue #16721: [SPARKR][DOCS] update R API doc for subset/extract

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16721 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16721: [SPARKR][DOCS] update R API doc for subset/extract

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16721 **[Test build #72090 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72090/testReport)** for PR 16721 at commit [`de56852`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #16721: [SPARKR][DOCS] update R API doc for subset/extract

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16721 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72089/ Test PASSed. ---

[GitHub] spark issue #16721: [SPARKR][DOCS] update R API doc for subset/extract

2017-01-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16721 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16721: [SPARKR][DOCS] update R API doc for subset/extract

2017-01-27 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16721 **[Test build #72089 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72089/testReport)** for PR 16721 at commit [`2c1f673`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #15768: [SPARK-18080][ML][PySpark] Locality Sensitive Hashing (L...

2017-01-27 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15768 Btw, @yanboliang and @Yunni did you sync? I'm fine with the takeover, but don't want to stomp on toes. Both can be listed as authors when this gets merged. Should we close this issue with the

[GitHub] spark pull request #16694: [SPARK-19336][ML][Pyspark]: LinearSVC Python API

2017-01-27 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16694#discussion_r98309772 --- Diff: python/pyspark/ml/classification.py --- @@ -60,6 +61,137 @@ def numClasses(self): @inherit_doc +class LinearSVC(JavaEstimator

  1   2   3   >