[GitHub] spark issue #14026: [SPARK-13569][STREAMING][KAFKA] pattern based topic subs...

2016-07-01 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/14026 @tdas @zsxwing This should be the last ConsumerStrategy implementation to have basic parity with what's offered by the kafka consumer, anything else should probably be handled by user subclasses.

[GitHub] spark issue #14026: [SPARK-13569][STREAMING][KAFKA] pattern based topic subs...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14026 **[Test build #61649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61649/consoleFull)** for PR 14026 at commit

[GitHub] spark pull request #14026: [SPARK-13569][STREAMING][KAFKA] pattern based top...

2016-07-01 Thread koeninger
GitHub user koeninger opened a pull request: https://github.com/apache/spark/pull/14026 [SPARK-13569][STREAMING][KAFKA] pattern based topic subscription ## What changes were proposed in this pull request? Allow for kafka topic subscriptions based on a regex pattern. ##

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69372870 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/UnsafeArrayDataBenchmark.scala --- @@ -0,0 +1,298 @@ +/* + * Licensed

[GitHub] spark issue #14025: [WIP][DOC] update out-of-date code snippets using SQLCon...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14025 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14025: [WIP][DOC] update out-of-date code snippets using SQLCon...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14025 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61648/ Test PASSed. ---

[GitHub] spark issue #14025: [WIP][DOC] update out-of-date code snippets using SQLCon...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14025 **[Test build #61648 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61648/consoleFull)** for PR 14025 at commit

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69372787 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/UnsafeArrayDataBenchmark.scala --- @@ -0,0 +1,298 @@ +/* + * Licensed

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69372697 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/UnsafeArrayDataBenchmark.scala --- @@ -0,0 +1,298 @@ +/* + * Licensed

[GitHub] spark issue #14025: [WIP][DOC] update out-of-date code snippets using SQLCon...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14025 **[Test build #61648 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61648/consoleFull)** for PR 14025 at commit

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69372615 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateUnsafeProjection.scala --- @@ -192,26 +192,30 @@ object

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69372604 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateUnsafeProjection.scala --- @@ -192,26 +192,30 @@ object

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69372533 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java --- @@ -126,11 +187,11 @@ public void

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69372522 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java --- @@ -33,91 +38,147 @@ // The

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69372511 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java --- @@ -33,91 +38,147 @@ // The

[GitHub] spark issue #14008: [SPARK-16281][SQL] Implement parse_url SQL function

2016-07-01 Thread janplus
Github user janplus commented on the issue: https://github.com/apache/spark/pull/14008 @dongjoon-hyun and @cloud-fan Thank you for review. I have add a new commit which does following things: 1. Cache the url and the key pattern use the similar approach of `XPathBoolean`

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69372493 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java --- @@ -33,91 +38,147 @@ // The

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69372472 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java --- @@ -33,91 +38,147 @@ // The

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69372467 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java --- @@ -33,91 +38,147 @@ // The

[GitHub] spark issue #13976: [SPARK-16288][SQL] Implement inline table generating fun...

2016-07-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13976 Thank you, @cloud-fan . `elementSchema` is simplified and the testcase name is updated. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #13976: [SPARK-16288][SQL] Implement inline table generating fun...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13976 **[Test build #61647 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61647/consoleFull)** for PR 13976 at commit

[GitHub] spark pull request #13976: [SPARK-16288][SQL] Implement inline table generat...

2016-07-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13976#discussion_r69372303 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/GeneratorFunctionSuite.scala --- @@ -89,4 +89,32 @@ class GeneratorFunctionSuite extends

[GitHub] spark pull request #13976: [SPARK-16288][SQL] Implement inline table generat...

2016-07-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13976#discussion_r69372281 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala --- @@ -195,3 +195,42 @@ case class Explode(child:

[GitHub] spark issue #14025: [WIP][DOC] update out-of-date code snippets using SQLCon...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14025 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61646/ Test PASSed. ---

[GitHub] spark issue #14025: [WIP][DOC] update out-of-date code snippets using SQLCon...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14025 **[Test build #61646 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61646/consoleFull)** for PR 14025 at commit

[GitHub] spark issue #14025: [WIP][DOC] update out-of-date code snippets using SQLCon...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14025 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14025: [WIP][DOC] update out-of-date code snippets using SQLCon...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14025 **[Test build #61646 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61646/consoleFull)** for PR 14025 at commit

[GitHub] spark pull request #14025: [WIP][DOC] update out-of-date code snippets using...

2016-07-01 Thread WeichenXu123
GitHub user WeichenXu123 opened a pull request: https://github.com/apache/spark/pull/14025 [WIP][DOC] update out-of-date code snippets using SQLContext in all documents. ## What changes were proposed in this pull request? I search the whole documents directory using

[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-01 Thread janplus
Github user janplus commented on a diff in the pull request: https://github.com/apache/spark/pull/14008#discussion_r69371935 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -652,6 +656,129 @@ case class

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69371928 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java --- @@ -19,9 +19,14 @@ import

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69371924 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -341,63 +324,113 @@ public UnsafeArrayData

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69371914 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -341,63 +324,113 @@ public UnsafeArrayData

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69371901 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -341,63 +324,113 @@ public UnsafeArrayData

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69371876 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -317,7 +301,6 @@ public boolean equals(Object

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r69371753 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -25,30 +25,36 @@ import

[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14008#discussion_r69371739 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -652,6 +656,129 @@ case class

[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-01 Thread janplus
Github user janplus commented on a diff in the pull request: https://github.com/apache/spark/pull/14008#discussion_r69371498 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -652,6 +656,129 @@ case class

[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-01 Thread janplus
Github user janplus commented on a diff in the pull request: https://github.com/apache/spark/pull/14008#discussion_r69371479 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -652,6 +656,129 @@ case class

[GitHub] spark pull request #13976: [SPARK-16288][SQL] Implement inline table generat...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13976#discussion_r69371427 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/GeneratorFunctionSuite.scala --- @@ -89,4 +89,32 @@ class GeneratorFunctionSuite extends QueryTest

[GitHub] spark pull request #13976: [SPARK-16288][SQL] Implement inline table generat...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13976#discussion_r69371397 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala --- @@ -195,3 +195,42 @@ case class Explode(child:

[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14008#discussion_r69371334 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -652,6 +656,129 @@ case class

[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14008#discussion_r69371328 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -652,6 +656,129 @@ case class

[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14008#discussion_r69371274 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -652,6 +656,129 @@ case class

[GitHub] spark issue #14020: [SPARK-16349][sql] Fall back to isolated class loader wh...

2016-07-01 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14020 Might be a legitimate test failure, will look later. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14020: [SPARK-16349][sql] Fall back to isolated class loader wh...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14020 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14020: [SPARK-16349][sql] Fall back to isolated class loader wh...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14020 **[Test build #61645 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61645/consoleFull)** for PR 14020 at commit

[GitHub] spark issue #14020: [SPARK-16349][sql] Fall back to isolated class loader wh...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14020 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61645/ Test FAILed. ---

[GitHub] spark issue #14024: [SPARK-15923][YARN] Spark Application rest api returns '...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14024 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14024: [SPARK-15923][YARN] Spark Application rest api re...

2016-07-01 Thread Sherry302
GitHub user Sherry302 opened a pull request: https://github.com/apache/spark/pull/14024 [SPARK-15923][YARN] Spark Application rest api returns 'no such app: … ## What changes were proposed in this pull request? 1. Updated the monitoring.md doc. 2. In

[GitHub] spark issue #14023: [SPARK-16348][ML][MLLIB][PYTHON] Use full classpaths for...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14023 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61644/ Test PASSed. ---

[GitHub] spark issue #14023: [SPARK-16348][ML][MLLIB][PYTHON] Use full classpaths for...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14023 **[Test build #61644 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61644/consoleFull)** for PR 14023 at commit

[GitHub] spark issue #14023: [SPARK-16348][ML][MLLIB][PYTHON] Use full classpaths for...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14023 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14022 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61643/ Test PASSed. ---

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14022 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14022 **[Test build #61643 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61643/consoleFull)** for PR 14022 at commit

[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-01 Thread janplus
Github user janplus commented on a diff in the pull request: https://github.com/apache/spark/pull/14008#discussion_r69370542 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/StringExpressionsSuite.scala --- @@ -725,4 +725,43 @@ class

[GitHub] spark issue #14020: [SPARK-16349][sql] Fall back to isolated class loader wh...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14020 **[Test build #61645 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61645/consoleFull)** for PR 14020 at commit

[GitHub] spark issue #13993: [SPARK-16144][SPARKR] update R API doc for mllib

2016-07-01 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/13993 CC @junyangq too --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14022 **[Test build #61643 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61643/consoleFull)** for PR 14022 at commit

[GitHub] spark issue #13981: [SPARK-16307] [ML] Add test to verify the predicted vari...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13981 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13981: [SPARK-16307] [ML] Add test to verify the predicted vari...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13981 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61641/ Test PASSed. ---

[GitHub] spark issue #13981: [SPARK-16307] [ML] Add test to verify the predicted vari...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13981 **[Test build #61641 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61641/consoleFull)** for PR 13981 at commit

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-01 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14022 Note this contains the code for #14020 also since I needed that to test the changes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #14022: [SPARK-16272][core] Allow config values to refere...

2016-07-01 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/14022 [SPARK-16272][core] Allow config values to reference conf, env, system props. This allows configuration to be more flexible when the cluster does not have a homogeneous configuration (e.g.

[GitHub] spark issue #14021: [SPARK-16260][ML][Example]:PySpark ML Example Improvemen...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14021 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61642/ Test PASSed. ---

[GitHub] spark issue #14021: [SPARK-16260][ML][Example]:PySpark ML Example Improvemen...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14021 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14021: [SPARK-16260][ML][Example]:PySpark ML Example Improvemen...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14021 **[Test build #61642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61642/consoleFull)** for PR 14021 at commit

[GitHub] spark issue #14020: [SPARK-16349][sql] Fall back to isolated class loader wh...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14020 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61640/ Test FAILed. ---

[GitHub] spark issue #14020: [SPARK-16349][sql] Fall back to isolated class loader wh...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14020 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14020: [SPARK-16349][sql] Fall back to isolated class loader wh...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14020 **[Test build #61640 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61640/consoleFull)** for PR 14020 at commit

[GitHub] spark issue #14021: [SPARK-16260][ML][Example]:PySpark ML Example Improvemen...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14021 **[Test build #61642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61642/consoleFull)** for PR 14021 at commit

[GitHub] spark pull request #14021: [SPARK-16260][ML][Example]:PySpark ML Example Imp...

2016-07-01 Thread wangmiao1981
GitHub user wangmiao1981 opened a pull request: https://github.com/apache/spark/pull/14021 [SPARK-16260][ML][Example]:PySpark ML Example Improvements and Cleanup ## What changes were proposed in this pull request? 1). Remove unused import in Scala example; 2). Move

[GitHub] spark pull request #13962: [SPARK-16095][YARN] Yarn cluster mode should repo...

2016-07-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13962 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13962: [SPARK-16095][YARN] Yarn cluster mode should report corr...

2016-07-01 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/13962 LGTM. Merging to master / 2.0 (fix is simple enough and I'd rather have the whole 2.x line behave the same here). --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #13981: [SPARK-16307] [ML] Add test to verify the predicted vari...

2016-07-01 Thread MechCoder
Github user MechCoder commented on the issue: https://github.com/apache/spark/pull/13981 I'm slightly in favour of keeping the original test because the impurity is set to "variance" explicitly by the `setImpurity` method, so it's a safe assumption that the `calculate` method returns

[GitHub] spark issue #14020: [SPARK-16349][sql] Fall back to isolated class loader wh...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14020 **[Test build #61640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61640/consoleFull)** for PR 14020 at commit

[GitHub] spark issue #13981: [SPARK-16307] [ML] Add test to verify the predicted vari...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13981 **[Test build #61641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61641/consoleFull)** for PR 13981 at commit

[GitHub] spark pull request #13957: [SPARK-16114] [SQL] structured streaming event ti...

2016-07-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13957#discussion_r69363852 --- Diff: examples/src/main/python/sql/streaming/structured_network_wordcount_windowed.py --- @@ -0,0 +1,103 @@ +# +# Licensed to the Apache Software

[GitHub] spark pull request #13957: [SPARK-16114] [SQL] structured streaming event ti...

2016-07-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13957#discussion_r69363771 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/TextSocketStreamSuite.scala --- @@ -85,6 +86,47 @@ class TextSocketStreamSuite

[GitHub] spark pull request #14020: [SPARK-16349][sql] Fall back to isolated class lo...

2016-07-01 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/14020 [SPARK-16349][sql] Fall back to isolated class loader when classes not found. Some Hadoop classes needed by the Hive metastore client jars are not present in Spark's packaging (for example,

[GitHub] spark pull request #13957: [SPARK-16114] [SQL] structured streaming event ti...

2016-07-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13957#discussion_r69363665 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/socket.scala --- @@ -136,7 +149,8 @@ class TextSocketSourceProvider extends

[GitHub] spark issue #13077: [SPARK-10748] [Mesos] Log error instead of crashing Spar...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13077 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13957: [SPARK-16114] [SQL] structured streaming event time wind...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13957 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13957: [SPARK-16114] [SQL] structured streaming event time wind...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13957 **[Test build #61639 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61639/consoleFull)** for PR 13957 at commit

[GitHub] spark issue #13957: [SPARK-16114] [SQL] structured streaming event time wind...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13957 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61639/ Test FAILed. ---

[GitHub] spark issue #14019: [SPARK-16233][R][TEST] ORC test should be enabled only w...

2016-07-01 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14019 @dongjoon-hyun I merged this into branch-2.0, so it should be present in the next RC. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #13957: [SPARK-16114] [SQL] structured streaming event ti...

2016-07-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13957#discussion_r69363332 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/socket.scala --- @@ -92,7 +102,11 @@ class TextSocketSource(host: String, port:

[GitHub] spark pull request #13981: [SPARK-16307] [ML] Add test to verify the predict...

2016-07-01 Thread MechCoder
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/13981#discussion_r69363260 --- Diff: mllib/src/test/scala/org/apache/spark/ml/regression/DecisionTreeRegressorSuite.scala --- @@ -96,6 +108,15 @@ class DecisionTreeRegressorSuite

[GitHub] spark issue #14019: [SPARK-16233][R][TEST] ORC test should be enabled only w...

2016-07-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14019 Oh, thank you for merging. @shivaram . This will be the my fastest merging experience! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #13957: [SPARK-16114] [SQL] structured streaming event time wind...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13957 **[Test build #61639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61639/consoleFull)** for PR 13957 at commit

[GitHub] spark pull request #14019: [SPARK-16233][R][TEST] ORC test should be enabled...

2016-07-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14019 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13957: [SPARK-16114] [SQL] structured streaming event ti...

2016-07-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13957#discussion_r69363245 --- Diff: examples/src/main/python/sql/streaming/structured_network_wordcount_windowed.py --- @@ -0,0 +1,103 @@ +# +# Licensed to the Apache Software

[GitHub] spark issue #14019: [SPARK-16233][R][TEST] ORC test should be enabled only w...

2016-07-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14019 Is this included in new 2.0 RC? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14019: [SPARK-16233][R][TEST] ORC test should be enabled only w...

2016-07-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14019 Thank you, @shivaram . It passed at Jenkins. As you see the log, Jenkins run the ORC tests. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14019: [SPARK-16233][R][TEST] ORC test should be enabled only w...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14019 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14019: [SPARK-16233][R][TEST] ORC test should be enabled only w...

2016-07-01 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14019 Thanks @dongjoon-hyun - I manually tested this as well and it works fine. LGTM. Will merge after Jenkins passes --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #14019: [SPARK-16233][R][TEST] ORC test should be enabled only w...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14019 **[Test build #61637 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61637/consoleFull)** for PR 14019 at commit

[GitHub] spark issue #14019: [SPARK-16233][R][TEST] ORC test should be enabled only w...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14019 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61637/ Test PASSed. ---

[GitHub] spark pull request #13957: [SPARK-16114] [SQL] structured streaming event ti...

2016-07-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13957#discussion_r69362821 --- Diff: examples/src/main/python/sql/streaming/structured_network_wordcount_windowed.py --- @@ -0,0 +1,103 @@ +# +# Licensed to the Apache Software

[GitHub] spark pull request #13957: [SPARK-16114] [SQL] structured streaming event ti...

2016-07-01 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/13957#discussion_r69362732 --- Diff: examples/src/main/java/org/apache/spark/examples/sql/streaming/JavaStructuredNetworkWordCountWindowed.java --- @@ -0,0 +1,116 @@ +/* + *

  1   2   3   4   5   >