[GitHub] spark issue #13834: [SPARK-16339] [CORE] ScriptTransform does not print stde...

2016-07-01 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/13834 @srowen : In case of exception, we `destroy()` the `proc` which cleans up all the associated streams :

[GitHub] spark pull request #13976: [SPARK-16288][SQL] Implement inline table generat...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13976#discussion_r69301324 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/GeneratorFunctionSuite.scala --- @@ -89,4 +91,30 @@ class GeneratorFunctionSuite extends QueryTest

[GitHub] spark pull request #13976: [SPARK-16288][SQL] Implement inline table generat...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13976#discussion_r69301056 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/GeneratorExpressionSuite.scala --- @@ -68,4 +69,23 @@ class

[GitHub] spark pull request #13976: [SPARK-16288][SQL] Implement inline table generat...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13976#discussion_r69301097 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/GeneratorExpressionSuite.scala --- @@ -68,4 +69,23 @@ class

[GitHub] spark pull request #13976: [SPARK-16288][SQL] Implement inline table generat...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13976#discussion_r69300935 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/GeneratorExpressionSuite.scala --- @@ -68,4 +69,23 @@ class

[GitHub] spark pull request #13976: [SPARK-16288][SQL] Implement inline table generat...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13976#discussion_r69300771 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala --- @@ -195,3 +195,42 @@ case class Explode(child:

[GitHub] spark pull request #13976: [SPARK-16288][SQL] Implement inline table generat...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13976#discussion_r69300727 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala --- @@ -195,3 +195,42 @@ case class Explode(child:

[GitHub] spark pull request #13976: [SPARK-16288][SQL] Implement inline table generat...

2016-07-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13976#discussion_r69300459 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala --- @@ -195,3 +195,42 @@ case class Explode(child:

[GitHub] spark issue #13981: [SPARK-16307] [ML] Add test to verify the predicted vari...

2016-07-01 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/13981 @MechCoder Thanks for adding this! I think it's a good test to protect against silent failures in the future. I just left a few small comments. --- If your project is set up for it, you can reply

[GitHub] spark pull request #13981: [SPARK-16307] [ML] Add test to verify the predict...

2016-07-01 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/13981#discussion_r69298953 --- Diff: mllib/src/test/scala/org/apache/spark/ml/regression/DecisionTreeRegressorSuite.scala --- @@ -96,6 +108,15 @@ class DecisionTreeRegressorSuite

[GitHub] spark pull request #13981: [SPARK-16307] [ML] Add test to verify the predict...

2016-07-01 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/13981#discussion_r69298648 --- Diff: mllib/src/test/scala/org/apache/spark/ml/regression/DecisionTreeRegressorSuite.scala --- @@ -96,6 +108,15 @@ class DecisionTreeRegressorSuite

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14010 @srowen Done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13976: [SPARK-16288][SQL] Implement inline table generating fun...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13976 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13976: [SPARK-16288][SQL] Implement inline table generating fun...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13976 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61615/ Test PASSed. ---

[GitHub] spark pull request #13981: [SPARK-16307] [ML] Add test to verify the predict...

2016-07-01 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/13981#discussion_r69298384 --- Diff: mllib/src/test/scala/org/apache/spark/ml/regression/DecisionTreeRegressorSuite.scala --- @@ -96,6 +108,15 @@ class DecisionTreeRegressorSuite

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14010 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61614/ Test PASSed. ---

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14010 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13976: [SPARK-16288][SQL] Implement inline table generating fun...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13976 **[Test build #61615 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61615/consoleFull)** for PR 13976 at commit

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14010 **[Test build #61614 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61614/consoleFull)** for PR 14010 at commit

[GitHub] spark issue #14014: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14014 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61616/ Test PASSed. ---

[GitHub] spark issue #14014: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14014 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14013: [SPARK-16344][SQL][BRANCH-1.6] Decoding Parquet array of...

2016-07-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14013 @rdblue Verified that parquet-avro also suffers from this issue. Filed [PARQUET-651][1] to track it. [1]: https://issues.apache.org/jira/browse/PARQUET-651 --- If your project is set up

[GitHub] spark issue #14015: [SPARK-16345][Documentation][Examples][GraphX] Extract g...

2016-07-01 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14015 @srowen Yes, the example code is exactly the same as those in graphx doc, and I test them all, can run normally. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #14014: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14014 **[Test build #61616 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61616/consoleFull)** for PR 14014 at commit

[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-01 Thread janplus
Github user janplus commented on a diff in the pull request: https://github.com/apache/spark/pull/14008#discussion_r69297640 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/StringExpressionsSuite.scala --- @@ -725,4 +725,43 @@ class

[GitHub] spark issue #14008: [SPARK-16281][SQL] Implement parse_url SQL function

2016-07-01 Thread janplus
Github user janplus commented on the issue: https://github.com/apache/spark/pull/14008 @rxin and @dongjoon-hyun Thanks for your review. I have add a new commit which does following things: 1. Put `parse_url` function in the right order. 2. Use `""" """` instead of `+`

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14010 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14010 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61613/ Test PASSed. ---

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14010 **[Test build #61613 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61613/consoleFull)** for PR 14010 at commit

[GitHub] spark pull request #13136: [SPARK-15350][mllib]add unit test function for Lo...

2016-07-01 Thread WeichenXu123
Github user WeichenXu123 closed the pull request at: https://github.com/apache/spark/pull/13136 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #14015: [SPARK-16345][Documentation][Examples][GraphX] Extract g...

2016-07-01 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14015 No changes to the code itself (except perhaps style fixes)? OK. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61610/ Test PASSed. ---

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14013: [SPARK-16344][SQL][BRANCH-1.6] Decoding Parquet array of...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14013 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61612/ Test PASSed. ---

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61610 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61610/consoleFull)** for PR 13494 at commit

[GitHub] spark issue #14013: [SPARK-16344][SQL][BRANCH-1.6] Decoding Parquet array of...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14013 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14013: [SPARK-16344][SQL][BRANCH-1.6] Decoding Parquet array of...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14013 **[Test build #61612 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61612/consoleFull)** for PR 14013 at commit

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-07-01 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/9207 @holden that's true for the fully generic approach. But `DataFrameWriter` for example exposes `json` as a shortcut (type-safe in a way) for `format("json")`. I think we can achieve something

[GitHub] spark issue #14015: [SPARK-16345][Documentation][Examples][GraphX] Extract g...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14015 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14015: [SPARK-16345][Documentation][Examples][GraphX] Extract g...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14015 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61618/ Test PASSed. ---

[GitHub] spark issue #14015: [SPARK-16345][Documentation][Examples][GraphX] Extract g...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14015 **[Test build #61618 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61618/consoleFull)** for PR 14015 at commit

[GitHub] spark issue #14015: [SPARK-16345][Documentation][Examples][GraphX] Extract g...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14015 **[Test build #61618 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61618/consoleFull)** for PR 14015 at commit

[GitHub] spark issue #14015: [SPARK-16345][Documentation][Examples][GraphX] Extract g...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14015 **[Test build #61617 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61617/consoleFull)** for PR 14015 at commit

[GitHub] spark issue #14015: [SPARK-16345][Documentation][Examples][GraphX] Extract g...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14015 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61617/ Test FAILed. ---

[GitHub] spark issue #14015: [SPARK-16345][Documentation][Examples][GraphX] Extract g...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14015 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14015: [SPARK-16345][Documentation][Examples][GraphX] Extract g...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14015 **[Test build #61617 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61617/consoleFull)** for PR 14015 at commit

[GitHub] spark pull request #14015: [SPARK-16345][Documentation][Examples][GraphX] Ex...

2016-07-01 Thread WeichenXu123
GitHub user WeichenXu123 opened a pull request: https://github.com/apache/spark/pull/14015 [SPARK-16345][Documentation][Examples][GraphX] Extract graphx programming guide example snippets from source files instead of hard code them ## What changes were proposed in this pull

[GitHub] spark issue #14013: [SPARK-16344][SQL][BRANCH-1.6] Decoding Parquet array of...

2016-07-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14013 @rdblue Would you mind to help review this one? My initial investigation suggested that parquet-avro probably suffers the same issue. Will file a parquet-mr JIRA ticket soon. --- If your

[GitHub] spark issue #14014: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14014 **[Test build #61616 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61616/consoleFull)** for PR 14014 at commit

[GitHub] spark issue #14014: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14014 cc @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #14014: [SPARK-16344][SQL] Decoding Parquet array of stru...

2016-07-01 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/14014 [SPARK-16344][SQL] Decoding Parquet array of struct with a single field named "element" ## What changes were proposed in this pull request? This PR ports #14013 to master and

[GitHub] spark issue #14004: [SPARK-16285][SQL] Implement sentences SQL functions

2016-07-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14004 cc @rxin and @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13976: [SPARK-16288][SQL] Implement inline table generating fun...

2016-07-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13976 Thank you, @cloud-fan . :) I've learn a lot in this PR again. The followings are applied. - Use `inputArray.getStruct(i, ncol)` - Keep the original field name - Fix

[GitHub] spark issue #13976: [SPARK-16288][SQL] Implement inline table generating fun...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13976 **[Test build #61615 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61615/consoleFull)** for PR 13976 at commit

[GitHub] spark issue #13925: [SPARK-16226][SQL]change the way of JDBC commit

2016-07-01 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13925 I think the important change regards the transaction isolation level that's in effect here, but yes that change is also a good one. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #14013: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14013 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14013: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14013 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61611/ Test FAILed. ---

[GitHub] spark issue #14013: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14013 **[Test build #61611 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61611/consoleFull)** for PR 14013 at commit

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14010 **[Test build #61614 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61614/consoleFull)** for PR 14010 at commit

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14010 **[Test build #61613 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61613/consoleFull)** for PR 14010 at commit

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14010 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14013: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14013 **[Test build #61612 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61612/consoleFull)** for PR 14013 at commit

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14010 Jenkins retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14013: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14013 **[Test build #61611 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61611/consoleFull)** for PR 14013 at commit

[GitHub] spark issue #14013: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14013 cc @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #14013: [SPARK-16344][SQL] Decoding Parquet array of stru...

2016-07-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14013#discussion_r69283877 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystRowConverter.scala --- @@ -481,13 +481,106 @@

[GitHub] spark pull request #13374: [SPARK-13638][SQL] Add escapeAll option to CSV Da...

2016-07-01 Thread jurriaan
Github user jurriaan commented on a diff in the pull request: https://github.com/apache/spark/pull/13374#discussion_r69283761 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -366,6 +366,32 @@ class CSVSuite extends QueryTest

[GitHub] spark pull request #14013: [SPARK-16344][SQL] Decoding Parquet array of stru...

2016-07-01 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/14013 [SPARK-16344][SQL] Decoding Parquet array of struct with a single field named "element" ## What changes were proposed in this pull request? Please refer to [SPARK-16344][1] for details

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14010 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14010 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61603/ Test FAILed. ---

[GitHub] spark issue #14010: [GRAPHX][EXAMPLES] move graphx test data directory and u...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14010 **[Test build #61603 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61603/consoleFull)** for PR 14010 at commit

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61607/ Test PASSed. ---

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61607 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61607/consoleFull)** for PR 13494 at commit

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61608/ Test PASSed. ---

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61608 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61608/consoleFull)** for PR 13494 at commit

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61609/ Test FAILed. ---

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13494 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61609 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61609/consoleFull)** for PR 13494 at commit

[GitHub] spark issue #13925: [SPARK-16226][SQL]change the way of JDBC commit

2016-07-01 Thread maver1ck
Github user maver1ck commented on the issue: https://github.com/apache/spark/pull/13925 @srowen Maybe we should change this condition to `conn.getMetaData().supportsTransactions()` ? I can prepare PR. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61610 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61610/consoleFull)** for PR 13494 at commit

[GitHub] spark pull request #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Vali...

2016-07-01 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/13894#discussion_r69281183 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tuning/CrossValidator.scala --- @@ -56,7 +56,10 @@ private[ml] trait CrossValidatorParams extends

[GitHub] spark pull request #13389: [SPARK-9876][SQL][FOLLOWUP] Enable string and bin...

2016-07-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/13389#discussion_r69280087 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystWriteSupport.scala --- @@ -150,7 +150,8 @@

[GitHub] spark pull request #13374: [SPARK-13638][SQL] Add quoteAll option to CSV Dat...

2016-07-01 Thread jurriaan
Github user jurriaan commented on a diff in the pull request: https://github.com/apache/spark/pull/13374#discussion_r69279736 --- Diff: python/pyspark/sql/readwriter.py --- @@ -745,6 +748,8 @@ def csv(self, path, mode=None, compression=None, sep=None, quote=None, escape=No

[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-01 Thread janplus
Github user janplus commented on a diff in the pull request: https://github.com/apache/spark/pull/14008#discussion_r69276506 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/StringExpressionsSuite.scala --- @@ -725,4 +725,43 @@ class

[GitHub] spark pull request #14008: [SPARK-16281][SQL] Implement parse_url SQL functi...

2016-07-01 Thread janplus
Github user janplus commented on a diff in the pull request: https://github.com/apache/spark/pull/14008#discussion_r69276469 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -653,6 +655,128 @@ case class

[GitHub] spark issue #14012: [SPARK-16343][SQL] Improve the PushDownPredicate rule to...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14012 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14012: [SPARK-16343][SQL] Improve the PushDownPredicate rule to...

2016-07-01 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/14012 cc @liancheng @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14012: [SPARK-16343][SQL] Improve the PushDownPredicate ...

2016-07-01 Thread jiangxb1987
GitHub user jiangxb1987 opened a pull request: https://github.com/apache/spark/pull/14012 [SPARK-16343][SQL] Improve the PushDownPredicate rule to pushdown pre… ## What changes were proposed in this pull request? Currently our Optimizer may reorder the predicates to run

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61609 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61609/consoleFull)** for PR 13494 at commit

[GitHub] spark issue #14002: [SPARK-16335][SQL] Structured streaming should fail if s...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14002 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61605/ Test PASSed. ---

[GitHub] spark issue #14002: [SPARK-16335][SQL] Structured streaming should fail if s...

2016-07-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14002 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread lianhuiwang
Github user lianhuiwang commented on the issue: https://github.com/apache/spark/pull/13494 @cloud-fan I have updated with your branch code. Thanks a lot. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14002: [SPARK-16335][SQL] Structured streaming should fail if s...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14002 **[Test build #61605 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61605/consoleFull)** for PR 14002 at commit

[GitHub] spark pull request #13919: [SPARK-16222] [SQL] JDBC Sources - Handling illeg...

2016-07-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13919 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13919: [SPARK-16222] [SQL] JDBC Sources - Handling illegal inpu...

2016-07-01 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13919 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61608/consoleFull)** for PR 13494 at commit

[GitHub] spark pull request #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work ...

2016-07-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12601#discussion_r69267676 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcRelationProvider.scala --- @@ -19,37 +19,105 @@ package

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61607 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61607/consoleFull)** for PR 13494 at commit

<    1   2   3   4   5   >