[GitHub] spark issue #14004: [SPARK-16285][SQL] Implement sentences SQL functions

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14004 **[Test build #61827 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61827/consoleFull)** for PR 14004 at commit

[GitHub] spark pull request #14038: [SPARK-16317][SQL] Add a new interface to filter ...

2016-07-06 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/14038#discussion_r69706249 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala --- @@ -30,6 +29,13 @@ import

[GitHub] spark pull request #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse...

2016-07-06 Thread gurvindersingh
Github user gurvindersingh commented on a diff in the pull request: https://github.com/apache/spark/pull/13950#discussion_r69706266 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -502,6 +502,9 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14067 Hi, @rxin @liancheng, I hope this is not missed to 2.0.. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14067 **[Test build #61842 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61842/consoleFull)** for PR 14067 at commit

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14067 Oh, @liancheng I just corrected some more. Please take another look.. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13969: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13969 By the way, could we change the expression name? I know the reason why you choose `JavaMethodReflect`, but we can call Scala functions, too. ``` select

[GitHub] spark pull request #14067: [SPARK-16371][SQL] Do not push down filters incor...

2016-07-06 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/14067#discussion_r69707869 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilters.scala --- @@ -188,7 +188,7 @@ private[sql] object

[GitHub] spark issue #14068: enhanced simulate multiply

2016-07-06 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14068 Please read https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14067 **[Test build #61843 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61843/consoleFull)** for PR 14067 at commit

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14067 Another question is when the inner field is not the same name, we still can push down the filter, right? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #14068: enhanced simulate multiply

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14068 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13969: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13969 I've done my first pass. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13969: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/13969 In general, the noticeable big difference from Hive seems to be the limitation on `first` and `second` arguments. Hive supports columns for them, too. IMHO, we can achieve that by putting

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14067 Hm... I though Spark does not support filter-push down for nested fields. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #14038: [SPARK-16317][SQL] Add a new interface to filter ...

2016-07-06 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/14038#discussion_r69713606 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala --- @@ -156,3 +162,10 @@ class ListingFileCatalog(

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2016-07-06 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/14038 okay, updated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #14066: [MINOR] [BUILD] Download Maven 3.3.9 instead of 3.3.3 be...

2016-07-06 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14066 Merging to 1.6 to unblock the branch --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14014: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14014 **[Test build #61837 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61837/consoleFull)** for PR 14014 at commit

[GitHub] spark issue #14014: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14014 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14014: [SPARK-16344][SQL] Decoding Parquet array of struct with...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14014 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61837/ Test PASSed. ---

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14043 **[Test build #61847 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61847/consoleFull)** for PR 14043 at commit

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14043 **[Test build #61849 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61849/consoleFull)** for PR 14043 at commit

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14043 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61849/ Test FAILed. ---

[GitHub] spark issue #14004: [SPARK-16285][SQL] Implement sentences SQL functions

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14004 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13969: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13969#discussion_r69706388 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/JavaMethodReflect.scala --- @@ -0,0 +1,153 @@ +/* + *

[GitHub] spark pull request #14038: [SPARK-16317][SQL] Add a new interface to filter ...

2016-07-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14038#discussion_r69706488 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala --- @@ -230,6 +229,15 @@ trait FileFormat {

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14067 cc @viirya as well. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14038: [SPARK-16317][SQL] Add a new interface to filter ...

2016-07-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14038#discussion_r69706413 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala --- @@ -156,3 +162,10 @@ class ListingFileCatalog(

[GitHub] spark pull request #14038: [SPARK-16317][SQL] Add a new interface to filter ...

2016-07-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14038#discussion_r69706379 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala --- @@ -30,6 +29,13 @@ import

[GitHub] spark issue #14004: [SPARK-16285][SQL] Implement sentences SQL functions

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14004 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61827/ Test PASSed. ---

[GitHub] spark issue #14004: [SPARK-16285][SQL] Implement sentences SQL functions

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14004 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61829/ Test PASSed. ---

[GitHub] spark issue #14004: [SPARK-16285][SQL] Implement sentences SQL functions

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14004 **[Test build #61829 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61829/consoleFull)** for PR 14004 at commit

[GitHub] spark issue #14004: [SPARK-16285][SQL] Implement sentences SQL functions

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14004 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14067 LGTM pending Jenkins. 2.0.0 RC2 has already been cut. We may have this in 2.0.0 if there was another RC. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request #14014: [SPARK-16344][SQL] Decoding Parquet array of stru...

2016-07-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14014#discussion_r69707873 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetRowConverter.scala --- @@ -482,13 +482,105 @@

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14067 yes it is, I just found I will correct them all. Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #14068: enhanced simulate multiply

2016-07-06 Thread uzadude
GitHub user uzadude opened a pull request: https://github.com/apache/spark/pull/14068 enhanced simulate multiply ## What changes were proposed in this pull request? We have a use case of multiplying very big sparse matrices. we have about 1000x1000 distributed block

[GitHub] spark issue #14004: [SPARK-16285][SQL] Implement sentences SQL functions

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14004 **[Test build #61832 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61832/consoleFull)** for PR 14004 at commit

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14067 If so, then this patch seems completely skip all such push down. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13990 **[Test build #61844 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61844/consoleFull)** for PR 13990 at commit

[GitHub] spark pull request #14069: [SPARK-16379] [CORE] [MESOS] Spark on mesos is br...

2016-07-06 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/14069 [SPARK-16379] [CORE] [MESOS] Spark on mesos is broken due to race condition in Logging ## What changes were proposed in this pull request? This reverts

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #61839 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61839/consoleFull)** for PR 13680 at commit

[GitHub] spark pull request #14067: [SPARK-16371][SQL] Do not push down filters incor...

2016-07-06 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/14067 [SPARK-16371][SQL] Do not push down filters incorrectly when inner name and outer name are the same in Parquet ## What changes were proposed in this pull request? Currently, if there

[GitHub] spark pull request #14038: [SPARK-16317][SQL] Add a new interface to filter ...

2016-07-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14038#discussion_r69706044 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala --- @@ -30,6 +29,13 @@ import

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14067 **[Test build #61840 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61840/consoleFull)** for PR 14067 at commit

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2016-07-06 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/14038 cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #14067: [SPARK-16371][SQL] Do not push down filters incor...

2016-07-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/14067#discussion_r69707725 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilters.scala --- @@ -188,7 +188,7 @@ private[sql] object

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14067 The description seems incorrect. It should be a StringType, instead of IntegerType? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #14004: [SPARK-16285][SQL] Implement sentences SQL functions

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14004 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14004: [SPARK-16285][SQL] Implement sentences SQL functions

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14004 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61832/ Test PASSed. ---

[GitHub] spark issue #14013: [SPARK-16344][SQL][BRANCH-1.6] Decoding Parquet array of...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14013 **[Test build #61838 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61838/consoleFull)** for PR 14013 at commit

[GitHub] spark issue #14013: [SPARK-16344][SQL][BRANCH-1.6] Decoding Parquet array of...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14013 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61838/ Test PASSed. ---

[GitHub] spark pull request #14038: [SPARK-16317][SQL] Add a new interface to filter ...

2016-07-06 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/14038#discussion_r69713543 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala --- @@ -30,6 +29,13 @@ import

[GitHub] spark pull request #14066: [MINOR] [BUILD] Download Maven 3.3.9 instead of 3...

2016-07-06 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/14066 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14038 **[Test build #61846 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61846/consoleFull)** for PR 14038 at commit

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13778 **[Test build #61836 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61836/consoleFull)** for PR 13778 at commit

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14043 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14043 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14043 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61847/ Test FAILed. ---

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14043 **[Test build #61847 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61847/consoleFull)** for PR 14043 at commit

[GitHub] spark pull request #13981: [SPARK-16307] [ML] Add test to verify the predict...

2016-07-06 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/13981#discussion_r69705146 --- Diff: mllib/src/test/scala/org/apache/spark/ml/regression/DecisionTreeRegressorSuite.scala --- @@ -96,6 +97,25 @@ class DecisionTreeRegressorSuite

[GitHub] spark pull request #13969: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/13969#discussion_r69706643 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/JavaMethodReflect.scala --- @@ -0,0 +1,153 @@ +/* + *

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14067 **[Test build #61841 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61841/consoleFull)** for PR 14067 at commit

[GitHub] spark issue #13765: [SPARK-16052][SQL] Improve `CollapseRepartition` optimiz...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13765 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14069: [SPARK-16379] [CORE] [MESOS] Spark on mesos is broken du...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14069 **[Test build #61845 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61845/consoleFull)** for PR 14069 at commit

[GitHub] spark issue #13765: [SPARK-16052][SQL] Improve `CollapseRepartition` optimiz...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13765 **[Test build #61834 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61834/consoleFull)** for PR 13765 at commit

[GitHub] spark issue #13765: [SPARK-16052][SQL] Improve `CollapseRepartition` optimiz...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13765 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61834/ Test PASSed. ---

[GitHub] spark issue #14013: [SPARK-16344][SQL][BRANCH-1.6] Decoding Parquet array of...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14013 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14028: [SPARK-16351][SQL] Avoid record-per type dispatch in JSO...

2016-07-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14028 Actually, I resembled your codes @liancheng here. Would this change be sensible maybe? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14066: [MINOR] [BUILD] Download Maven 3.3.9 instead of 3.3.3 be...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14066 **[Test build #61835 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61835/consoleFull)** for PR 14066 at commit

[GitHub] spark issue #14066: [MINOR] [BUILD] Download Maven 3.3.9 instead of 3.3.3 be...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14066 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14066: [MINOR] [BUILD] Download Maven 3.3.9 instead of 3.3.3 be...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14066 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61835/ Test PASSed. ---

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13778 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61836/ Test PASSed. ---

[GitHub] spark issue #13778: [SPARK-16062][SPARK-15989][SQL] Fix two bugs of Python-o...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13778 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14043 **[Test build #61848 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61848/consoleFull)** for PR 14043 at commit

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14043 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14043 **[Test build #61849 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61849/consoleFull)** for PR 14043 at commit

[GitHub] spark issue #14043: [Minor][Core][1.6-backport] Fix display wrong free memor...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14043 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14067 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14067 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61841/ Test PASSed. ---

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14067 **[Test build #61841 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61841/consoleFull)** for PR 14067 at commit

[GitHub] spark issue #13494: [SPARK-15752] [SQL] support optimization for metadata on...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61850 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61850/consoleFull)** for PR 13494 at commit

[GitHub] spark pull request #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor po...

2016-07-06 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11157#discussion_r69719860 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -356,4 +374,233 @@ private[mesos] trait

[GitHub] spark issue #13494: [SPARK-15752] [SQL] Optimize metadata only query that ha...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61851 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61851/consoleFull)** for PR 13494 at commit

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14067 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61842/ Test PASSed. ---

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14067 **[Test build #61843 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61843/consoleFull)** for PR 14067 at commit

[GitHub] spark pull request #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor po...

2016-07-06 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11157#discussion_r69723129 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -356,4 +374,233 @@ private[mesos] trait

[GitHub] spark issue #14069: [SPARK-16379] [CORE] [MESOS] Spark on mesos is broken du...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14069 **[Test build #61845 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61845/consoleFull)** for PR 14069 at commit

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14038 **[Test build #61846 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61846/consoleFull)** for PR 14038 at commit

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14038 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61846/ Test PASSed. ---

[GitHub] spark issue #14038: [SPARK-16317][SQL] Add a new interface to filter files i...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14038 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #61839 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61839/consoleFull)** for PR 13680 at commit

[GitHub] spark issue #13494: [SPARK-15752] [SQL] Optimize metadata only query that ha...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13494 **[Test build #61853 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61853/consoleFull)** for PR 13494 at commit

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14067 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14067: [SPARK-16371][SQL] Do not push down filters incorrectly ...

2016-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14067 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61843/ Test PASSed. ---

[GitHub] spark pull request #11157: [SPARK-11714][Mesos] Make Spark on Mesos honor po...

2016-07-06 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/11157#discussion_r69720686 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -356,4 +374,233 @@ private[mesos] trait

[GitHub] spark pull request #14025: [DOC][SQL] update out-of-date code snippets using...

2016-07-06 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/14025#discussion_r69720553 --- Diff: docs/streaming-programming-guide.md --- @@ -1546,9 +1546,9 @@ val words: DStream[String] = ... words.foreachRDD { rdd =>

[GitHub] spark issue #14025: [DOC][SQL] update out-of-date code snippets using SQLCon...

2016-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14025 **[Test build #61852 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61852/consoleFull)** for PR 14025 at commit

[GitHub] spark issue #11748: [SPARK-13921] Store serialized blocks as multiple chunks...

2016-07-06 Thread bonitao
Github user bonitao commented on the issue: https://github.com/apache/spark/pull/11748 Hi @JoshRosen , I am trying spark 2.0, and I believe I am hitting a bug that was introduced in this commit. In summary, the problem is that when kryo serialization is enabled and you have

  1   2   3   4   5   6   7   8   >