[GitHub] spark pull request #14012: [SPARK-16343][SQL] Improve the PushDownPredicate ...

2016-07-11 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/14012#discussion_r70370161 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1086,6 +1086,28 @@ object PruneFilters extends Rul

[GitHub] spark issue #14141: [SPARK-16375] [Web UI] Fixed misassigned var: numComplet...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14141 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62127/ Test PASSed. ---

[GitHub] spark issue #14141: [SPARK-16375] [Web UI] Fixed misassigned var: numComplet...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14141 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14141: [SPARK-16375] [Web UI] Fixed misassigned var: numComplet...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14141 **[Test build #62127 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62127/consoleFull)** for PR 14141 at commit [`5122a1a`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13494: [SPARK-15752] [SQL] Optimize metadata only query ...

2016-07-11 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/13494#discussion_r70369134 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlyQuery.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed to the A

[GitHub] spark pull request #13494: [SPARK-15752] [SQL] Optimize metadata only query ...

2016-07-11 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/13494#discussion_r70368905 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlyQuery.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed to the A

[GitHub] spark pull request #13494: [SPARK-15752] [SQL] Optimize metadata only query ...

2016-07-11 Thread lianhuiwang
Github user lianhuiwang commented on a diff in the pull request: https://github.com/apache/spark/pull/13494#discussion_r70368861 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlyQuery.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed to the A

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14139 **[Test build #62136 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62136/consoleFull)** for PR 14139 at commit [`b98ee09`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #13704: [SPARK-15985][SQL] Reduce runtime overhead of a p...

2016-07-11 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13704#discussion_r70368410 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala --- @@ -0,0 +1,78 @@ +/* + * Licensed to the Ap

[GitHub] spark issue #14144: [SPARK-16488] Fix codegen variable namespace collision i...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14144 **[Test build #62135 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62135/consoleFull)** for PR 14144 at commit [`8b2639f`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14144: [SPARK-16488] Fix codegen variable namespace collision i...

2016-07-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14144 LGTM pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #13704: [SPARK-15985][SQL] Reduce runtime overhead of a p...

2016-07-11 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13704#discussion_r70367470 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/PrimitiveArrayBenchmark.scala --- @@ -0,0 +1,84 @@ +/* + * Licensed to the

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #62134 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62134/consoleFull)** for PR 14079 at commit [`c22aaad`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-11 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/14079 discussed this offline with @vanzin, realized that actually with the latest design, it doesn't make sense to have so many maps inside one `BlacklistTracker` -- a lot of info is now intended to only b

[GitHub] spark pull request #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Vali...

2016-07-11 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/13894#discussion_r70367155 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tuning/CrossValidator.scala --- @@ -56,7 +56,10 @@ private[ml] trait CrossValidatorParams extends Valid

[GitHub] spark pull request #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-11 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/14138#discussion_r70366868 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/CallMethodViaReflection.scala --- @@ -0,0 +1,166 @@ +/* + * Lice

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14147 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62132/ Test FAILed. ---

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14147 **[Test build #62132 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62132/consoleFull)** for PR 14147 at commit [`f86ea5a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14147 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14143: [SPARK-16430][SQL][STREAMING] Fixed bug in the ma...

2016-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14143 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14138 **[Test build #62133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62133/consoleFull)** for PR 14138 at commit [`ccfb9c4`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14147 **[Test build #62132 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62132/consoleFull)** for PR 14147 at commit [`f86ea5a`](https://github.com/apache/spark/commit/f

[GitHub] spark pull request #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, De...

2016-07-11 Thread jkbradley
GitHub user jkbradley opened a pull request: https://github.com/apache/spark/pull/14147 [SPARK-14812][ML][MLLIB][PYTHON] Experimental, DeveloperApi annotation audit for ML ## What changes were proposed in this pull request? General decisions to follow, except where noted:

[GitHub] spark pull request #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-11 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14138#discussion_r70366108 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/CallMethodViaReflection.scala --- @@ -0,0 +1,166 @@ +/* + * Licens

[GitHub] spark pull request #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-11 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/14138#discussion_r70366065 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CallMethodViaReflectionSuite.scala --- @@ -0,0 +1,102 @@ +/* + *

[GitHub] spark pull request #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-11 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/14138#discussion_r70366073 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/CallMethodViaReflection.scala --- @@ -0,0 +1,166 @@ +/* + * Lice

[GitHub] spark issue #14143: [SPARK-16430][SQL][STREAMING] Fixed bug in the maxFilesP...

2016-07-11 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/14143 @zsxwing I am merging this critical bug fix to master and 2.0. Feel free to leave reviews and I will address them in follow up PRs. --- If your project is set up for it, you can reply to t

[GitHub] spark pull request #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-11 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14138#discussion_r70365738 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CallMethodViaReflectionSuite.scala --- @@ -0,0 +1,102 @@ +/* + * L

[GitHub] spark pull request #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-11 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14138#discussion_r70365507 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/CallMethodViaReflection.scala --- @@ -0,0 +1,166 @@ +/* + * Licens

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14088 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62128/ Test PASSed. ---

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14088 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14088 **[Test build #62128 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62128/consoleFull)** for PR 14088 at commit [`d86ac9c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14143: [SPARK-16430][SQL][STREAMING] Fixed bug in the maxFilesP...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14143 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62126/ Test PASSed. ---

[GitHub] spark issue #14143: [SPARK-16430][SQL][STREAMING] Fixed bug in the maxFilesP...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14143 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14143: [SPARK-16430][SQL][STREAMING] Fixed bug in the maxFilesP...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14143 **[Test build #62126 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62126/consoleFull)** for PR 14143 at commit [`a810dd4`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13704: [SPARK-15985][SQL] Reduce runtime overhead of a p...

2016-07-11 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13704#discussion_r70364606 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala --- @@ -0,0 +1,78 @@ +/* + * Licensed to th

[GitHub] spark pull request #13704: [SPARK-15985][SQL] Reduce runtime overhead of a p...

2016-07-11 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13704#discussion_r70364539 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/PrimitiveArrayBenchmark.scala --- @@ -0,0 +1,84 @@ +/* + * Licensed to

[GitHub] spark issue #14146: [SPARK-16489][SQL] Guard against variable reuse mistakes...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14146 **[Test build #3184 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3184/consoleFull)** for PR 14146 at commit [`0df6a99`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14146: [SPARK-16489][SQL] Guard against variable reuse mistakes...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14146 **[Test build #3183 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3183/consoleFull)** for PR 14146 at commit [`0df6a99`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14146: [SPARK-16489][SQL] Guard against variable reuse mistakes...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14146 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62131/ Test FAILed. ---

[GitHub] spark issue #14146: [SPARK-16489][SQL] Guard against variable reuse mistakes...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14146 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14100: [SPARK-16433][SQL]Improve StreamingQuery.explain ...

2016-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14100 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #13704: [SPARK-15985][SQL] Reduce runtime overhead of a p...

2016-07-11 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13704#discussion_r70364232 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala --- @@ -0,0 +1,78 @@ +/* + * Licensed to th

[GitHub] spark issue #14146: [SPARK-16489][SQL] checkEvaluation should fail if expres...

2016-07-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14146 This pr will fail until https://github.com/apache/spark/pull/14144 makes it in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #14144: [SPARK-16488] Fix codegen variable namespace coll...

2016-07-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14144#discussion_r70364188 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/DataFrameReaderWriterSuite.scala --- @@ -449,6 +449,20 @@ class DataFrameReaderWriterSuite extends

[GitHub] spark pull request #14097: [MINOR][Streaming][Docs] Minor changes on kinesis...

2016-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14097 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13704: [SPARK-15985][SQL] Reduce runtime overhead of a program ...

2016-07-11 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13704 @cloud-fan I added test cases. Could you review it again? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #14146: [SPARK-16489][SQL] checkEvaluation should fail if...

2016-07-11 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/14146 [SPARK-16489][SQL] checkEvaluation should fail if expression reuses variable names ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix)

[GitHub] spark issue #14100: [SPARK-16433][SQL]Improve StreamingQuery.explain when no...

2016-07-11 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/14100 LGTM. Merging to master and 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #14097: [MINOR][Streaming][Docs] Minor changes on kinesis integr...

2016-07-11 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/14097 LGTM. Merging to master and 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #14145: [SPARK-16487] [STREAMING] Fix some batches might not get...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14145 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14144: [SPARK-16488] Fix codegen variable namespace coll...

2016-07-11 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14144#discussion_r70363441 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -498,34 +498,35 @@ case class Pmod(left: Expression, ri

[GitHub] spark issue #14045: [SPARK-16362][SQL] Support ArrayType and StructType in v...

2016-07-11 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14045 ping @liancheng @yhuai @rxin I think this is ready now. Can you review this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request #13957: [SPARK-16114] [SQL] structured streaming event ti...

2016-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13957 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14144: [SPARK-16488] Fix codegen variable namespace collision i...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14144 **[Test build #62129 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62129/consoleFull)** for PR 14144 at commit [`8e7b05f`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14045: [SPARK-16362][SQL] Support ArrayType and StructType in v...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14045 **[Test build #62130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62130/consoleFull)** for PR 14045 at commit [`42f53de`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #14145: [SPARK-16487] [STREAMING] Fix some batches might ...

2016-07-11 Thread ahmed-mahran
GitHub user ahmed-mahran opened a pull request: https://github.com/apache/spark/pull/14145 [SPARK-16487] [STREAMING] Fix some batches might not get marked as fully processed in JobGenerator ## What changes were proposed in this pull request? In `JobGenerator`, the code read

[GitHub] spark issue #13957: [SPARK-16114] [SQL] structured streaming event time wind...

2016-07-11 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/13957 LGTM. Merging this to master and 2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark issue #14144: [SPARK-16488] Fix codegen variable namespace collision i...

2016-07-11 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/14144 cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14088 **[Test build #62128 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62128/consoleFull)** for PR 14088 at commit [`d86ac9c`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #14144: [SPARK-16488] Fix codegen variable namespace coll...

2016-07-11 Thread sameeragarwal
GitHub user sameeragarwal opened a pull request: https://github.com/apache/spark/pull/14144 [SPARK-16488] Fix codegen variable namespace collision in pmod and partitionBy ## What changes were proposed in this pull request? This patch fixes a variable namespace collision bug

[GitHub] spark pull request #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get us...

2016-07-11 Thread sharkdtu
Github user sharkdtu commented on a diff in the pull request: https://github.com/apache/spark/pull/14088#discussion_r70362297 --- Diff: yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala --- @@ -274,6 +288,37 @@ private object YarnClusterDriverWithFailure exten

[GitHub] spark pull request #13494: [SPARK-15752] [SQL] Optimize metadata only query ...

2016-07-11 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13494#discussion_r70362160 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlyQuery.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed to the Apa

[GitHub] spark pull request #13494: [SPARK-15752] [SQL] Optimize metadata only query ...

2016-07-11 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13494#discussion_r70361858 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlyQuery.scala --- @@ -0,0 +1,153 @@ +/* + * Licensed to the Apa

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14116 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62124/ Test FAILed. ---

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14116 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14116 **[Test build #62124 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62124/consoleFull)** for PR 14116 at commit [`550d69e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14141: [SPARK-16375] [Web UI] Fixed misassigned var: numComplet...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14141 **[Test build #62127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62127/consoleFull)** for PR 14141 at commit [`5122a1a`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #11317: [SPARK-12639] [SQL] Mark Filters Fully Handled By Source...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11317 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11317: [SPARK-12639] [SQL] Mark Filters Fully Handled By Source...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11317 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62122/ Test PASSed. ---

[GitHub] spark issue #11317: [SPARK-12639] [SQL] Mark Filters Fully Handled By Source...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11317 **[Test build #62122 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62122/consoleFull)** for PR 11317 at commit [`f0051c4`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14139 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62123/ Test FAILed. ---

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14139 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14139 **[Test build #62123 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62123/consoleFull)** for PR 14139 at commit [`6708e9b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14141: [SPARK-16375] [Web UI] Fixed misassigned var: numComplet...

2016-07-11 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/14141 apparently dev/run-tests didn't actually finish, I'll fix the test failures --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14141: [SPARK-16375] [Web UI] Fixed misassigned var: numComplet...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14141 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62120/ Test FAILed. ---

[GitHub] spark issue #14141: [SPARK-16375] [Web UI] Fixed misassigned var: numComplet...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14141 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14141: [SPARK-16375] [Web UI] Fixed misassigned var: numComplet...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14141 **[Test build #62120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62120/consoleFull)** for PR 14141 at commit [`7ac60de`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14112: [SPARK-16240][ML] Model loading backward compatibility f...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14112 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14112: [SPARK-16240][ML] Model loading backward compatibility f...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14112 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62125/ Test FAILed. ---

[GitHub] spark issue #14112: [SPARK-16240][ML] Model loading backward compatibility f...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14112 **[Test build #62125 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62125/consoleFull)** for PR 14112 at commit [`08e5b55`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14143: [SPARK-16430][SQL][STREAMING] Fixed bug in the maxFilesP...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14143 **[Test build #62126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62126/consoleFull)** for PR 14143 at commit [`a810dd4`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #14080: [SPARK-16405] Add metrics and source for external shuffl...

2016-07-11 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14080 There is a test failure ``` [error] Test org.apache.spark.network.sasl.SaslIntegrationSuite.testAppIsolation failed: java.lang.RuntimeException: java.lang.NullPointerException [error]

[GitHub] spark issue #14080: [SPARK-16405] Add metrics and source for external shuffl...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14080 **[Test build #3182 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3182/consoleFull)** for PR 14080 at commit [`258ed7a`](https://github.com/apache/spark/commit

[GitHub] spark issue #14035: [SPARK-16356][ML] Add testImplicits for ML unit tests an...

2016-07-11 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14035 Gentle ping @mengxr and @yanboliang --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request #14143: [SPARK-16430][SQL][STREAMING] Fixed bug in the ma...

2016-07-11 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/14143 [SPARK-16430][SQL][STREAMING] Fixed bug in the maxFilesPerTrigger in FileStreamSource ## What changes were proposed in this pull request? Incorrect list of files were being allocated to a bat

[GitHub] spark pull request #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHE...

2016-07-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14116#discussion_r70353227 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -502,20 +502,21 @@ test_that("jsonRDD() on a RDD with json string", { }) test

[GitHub] spark issue #14112: [SPARK-16240][ML] Model loading backward compatibility f...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14112 **[Test build #62125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62125/consoleFull)** for PR 14112 at commit [`08e5b55`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #14112: [SPARK-16240][ML] Model loading backward compatibility f...

2016-07-11 Thread GayathriMurali
Github user GayathriMurali commented on the issue: https://github.com/apache/spark/pull/14112 +1 for separate loading logic. The recent commit includes separate code paths depending on sparkVersion --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHE...

2016-07-11 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14116#discussion_r70352851 --- Diff: R/pkg/inst/tests/testthat/test_sparkSQL.R --- @@ -502,20 +502,21 @@ test_that("jsonRDD() on a RDD with json string", { }) test_t

[GitHub] spark issue #14142: [SPARK-16439] Fix number formatting in SQL UI

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14142 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14142: [SPARK-16439] Fix number formatting in SQL UI

2016-07-11 Thread maver1ck
GitHub user maver1ck opened a pull request: https://github.com/apache/spark/pull/14142 [SPARK-16439] Fix number formatting in SQL UI ## What changes were proposed in this pull request? Spark SQL UI display numbers greater than 1000 with u00A0 as grouping separator. Prob

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14116 **[Test build #62124 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62124/consoleFull)** for PR 14116 at commit [`550d69e`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14139 **[Test build #62123 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62123/consoleFull)** for PR 14139 at commit [`6708e9b`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #14112: [SPARK-16240][ML] Model loading backward compatibility f...

2016-07-11 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/14112 I agree that it will make thing easier to separate the loading logic here in LDA due to its extra complexity. Yet maybe we should not extend the pattern to previous changes about loading compatibilit

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14139 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14139 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62121/ Test FAILed. ---

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14139 **[Test build #62121 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62121/consoleFull)** for PR 14139 at commit [`308aef5`](https://github.com/apache/spark/commit/

[GitHub] spark issue #11317: [SPARK-12639] [SQL] Mark Filters Fully Handled By Source...

2016-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11317 **[Test build #62122 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62122/consoleFull)** for PR 11317 at commit [`f0051c4`](https://github.com/apache/spark/commit/f

[GitHub] spark pull request #14020: [SPARK-16349][sql] Fall back to isolated class lo...

2016-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14020 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

<    1   2   3   4   5   6   7   >