[GitHub] spark issue #14160: [SPARK-16502] update depreciated ParquetFileReader()

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14160 **[Test build #62188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62188/consoleFull)** for PR 14160 at commit

[GitHub] spark issue #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14138 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62183/ Test PASSed. ---

[GitHub] spark issue #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14138 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14138 **[Test build #62183 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62183/consoleFull)** for PR 14138 at commit

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70510298 --- Diff: docs/monitoring.md --- @@ -288,7 +288,11 @@ where `[base-app-id]` is the YARN application ID.

[GitHub] spark pull request #14160: [SPARK-16502] update depreciated ParquetFileReade...

2016-07-12 Thread keypointt
GitHub user keypointt opened a pull request: https://github.com/apache/spark/pull/14160 [SPARK-16502] update depreciated ParquetFileReader() https://issues.apache.org/jira/browse/SPARK-16502 ## What changes were proposed in this pull request? During code compile,

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70509851 --- Diff: core/src/main/scala/org/apache/spark/status/api/v1/AllExecutorListResource.scala --- @@ -0,0 +1,43 @@ +/* +* Licensed to the Apache

[GitHub] spark issue #14159: [PARQUET] Fix for Parquet filter pushdown

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14159 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #13831: [SPARK-16119][sql] Support PURGE option to drop t...

2016-07-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13831 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70508838 --- Diff: core/src/main/scala/org/apache/spark/status/api/v1/AllExecutorListResource.scala --- @@ -0,0 +1,43 @@ +/* +* Licensed to the Apache

[GitHub] spark pull request #14159: [PARQUET] Fix for Parquet filter pushdown

2016-07-12 Thread andreweduffy
GitHub user andreweduffy opened a pull request: https://github.com/apache/spark/pull/14159 [PARQUET] Fix for Parquet filter pushdown ## What changes were proposed in this pull request? Fix parquet filter pushdown from not reaching all the way down to the file level

[GitHub] spark issue #13831: [SPARK-16119][sql] Support PURGE option to drop table / ...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/13831 Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70508419 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14113: [SPARK-16457] [SQL] Fix Wrong Messages when CTAS with a ...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14113 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14113: [SPARK-16457] [SQL] Fix Wrong Messages when CTAS with a ...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14113 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62181/ Test PASSed. ---

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70507431 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14113: [SPARK-16457] [SQL] Fix Wrong Messages when CTAS with a ...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14113 **[Test build #62181 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62181/consoleFull)** for PR 14113 at commit

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70507279 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage-template.html --- @@ -0,0 +1,102 @@ + +

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70507194 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage-template.html --- @@ -0,0 +1,102 @@ + +

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13894 **[Test build #62187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62187/consoleFull)** for PR 13894 at commit

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70506931 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70506844 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70506386 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70506185 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14147 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14147 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62184/ Test FAILed. ---

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14147 **[Test build #62184 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62184/consoleFull)** for PR 14147 at commit

[GitHub] spark issue #12004: [SPARK-7481][build] [WIP] Add Hadoop 2.6+ spark-cloud mo...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12004 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12004: [SPARK-7481][build] [WIP] Add Hadoop 2.6+ spark-cloud mo...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12004 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62186/ Test FAILed. ---

[GitHub] spark issue #12004: [SPARK-7481][build] [WIP] Add Hadoop 2.6+ spark-cloud mo...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12004 **[Test build #62186 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62186/consoleFull)** for PR 12004 at commit

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70505486 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #12004: [SPARK-7481][build] [WIP] Add Hadoop 2.6+ spark-cloud mo...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12004 **[Test build #62186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62186/consoleFull)** for PR 12004 at commit

[GitHub] spark issue #14112: [SPARK-16240][ML] Model loading backward compatibility f...

2016-07-12 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/14112 @hhbyyh I agree about not changing the other models' loading code unless it becomes necessary. I hope we can design a better long-term solution during 2.1. We should definitely cover the

[GitHub] spark pull request #14112: [SPARK-16240][ML] Model loading backward compatib...

2016-07-12 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/14112#discussion_r70504864 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -566,26 +565,52 @@ object LocalLDAModel extends MLReadable[LocalLDAModel] {

[GitHub] spark issue #13756: [SPARK-16041][SQL] Disallow Duplicate Columns in partiti...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13756 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-12 Thread krishnakalyan3
Github user krishnakalyan3 commented on the issue: https://github.com/apache/spark/pull/13894 cc @holdenk @MLnick @jkbradley. Does the current state look good?. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13756: [SPARK-16041][SQL] Disallow Duplicate Columns in partiti...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13756 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62182/ Test PASSed. ---

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14147 **[Test build #62184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62184/consoleFull)** for PR 14147 at commit

[GitHub] spark issue #13894: [SPARK-15254][DOC] Improve ML pipeline Cross Validation ...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13894 **[Test build #62185 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62185/consoleFull)** for PR 13894 at commit

[GitHub] spark issue #13756: [SPARK-16041][SQL] Disallow Duplicate Columns in partiti...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13756 **[Test build #62182 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62182/consoleFull)** for PR 13756 at commit

[GitHub] spark pull request #14112: [SPARK-16240][ML] Model loading backward compatib...

2016-07-12 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/14112#discussion_r70504461 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -566,26 +565,52 @@ object LocalLDAModel extends MLReadable[LocalLDAModel] {

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70504183 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #14112: [SPARK-16240][ML] Model loading backward compatib...

2016-07-12 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/14112#discussion_r70504191 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -566,26 +565,52 @@ object LocalLDAModel extends MLReadable[LocalLDAModel] {

[GitHub] spark pull request #14112: [SPARK-16240][ML] Model loading backward compatib...

2016-07-12 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/14112#discussion_r70504176 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -121,7 +126,8 @@ private[clustering] trait LDAParams extends Params with

[GitHub] spark pull request #14112: [SPARK-16240][ML] Model loading backward compatib...

2016-07-12 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/14112#discussion_r70504163 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -80,7 +84,8 @@ private[clustering] trait LDAParams extends Params with

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70504077 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70504020 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14147: [SPARK-14812][ML][MLLIB][PYTHON] Experimental, Developer...

2016-07-12 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/14147 CC: @MLnick @yanboliang If you have a chance --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70503658 --- Diff: core/src/main/scala/org/apache/spark/ui/exec/ExecutorsPage.scala --- @@ -54,78 +53,16 @@ private[ui] class ExecutorsPage( // When

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70502730 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70502282 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web ...

2016-07-12 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/14158#discussion_r70501467 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/AllExecutionsPage.scala --- @@ -103,6 +104,9 @@ private[ui] abstract class

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70500868 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-12 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/14139 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70500759 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage.js --- @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14080: [SPARK-16405] Add metrics and source for external shuffl...

2016-07-12 Thread lovexi
Github user lovexi commented on the issue: https://github.com/apache/spark/pull/14080 @rxin Thank you for mentioning that. I even didn't notice that. Haha. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-12 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14139 cc @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70499206 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage-template.html --- @@ -0,0 +1,102 @@ + +

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14158 **[Test build #62180 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62180/consoleFull)** for PR 14158 at commit

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14158 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62180/ Test FAILed. ---

[GitHub] spark issue #14158: [SPARK-13547] [SQL] [WEBUI] Add SQL query in web UI's SQ...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14158 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #13670: [SPARK-15951] Change Executors Page to use datata...

2016-07-12 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/13670#discussion_r70498405 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage-template.html --- @@ -0,0 +1,102 @@ + +

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62178/ Test PASSed. ---

[GitHub] spark issue #13704: [SPARK-15985][SQL] Eliminate redundant cast from an arra...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13704 **[Test build #62178 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62178/consoleFull)** for PR 13704 at commit

[GitHub] spark pull request #14155: [SPARK-16498][SQL][WIP] move hive hack for data s...

2016-07-12 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14155#discussion_r70494401 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -327,6 +326,32 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark pull request #9875: [SPARK-11662] [YARN]. In Client mode, make sure we...

2016-07-12 Thread harishreedharan
Github user harishreedharan closed the pull request at: https://github.com/apache/spark/pull/9875 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #8760: [Spark-8426] [scheduler] enhance blacklist mechanism

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/8760 This is made obsolete by #14079; @mwws could you close the PR please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #13658: [SPARK-15937] [yarn] Improving the logic to wait for an ...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/13658 @subrotosanyal ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13990 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13990 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62174/ Test PASSed. ---

[GitHub] spark issue #13990: [SPARK-16287][SQL] Implement str_to_map SQL function

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13990 **[Test build #62174 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62174/consoleFull)** for PR 13990 at commit

[GitHub] spark issue #13824: [SPARK-16110][YARN][PYSPARK] Fix allowing python version...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/13824 ping @KevinGrealish? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #9875: [SPARK-11662] [YARN]. In Client mode, make sure we re-log...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/9875 ping @harishreedharan please close the PR if you don't intend to work on it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #7786: [SPARK-9468][Yarn][Core] Avoid scheduling tasks on preemp...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/7786 @jerryshao do you plan to implement either of the above suggestions? otherwise we should probably close this PR. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #12848: [SPARK-12344][CORE][YARN] Removal of SPARK_YARN_USER_ENV...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/12848 @amits83 could you close this PR if you're not going to address the comments? thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #14080: [SPARK-16405] Add metrics and source for external shuffl...

2016-07-12 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14080 @lovexi you should add your commit email to your github profile, so the commit will show proper attribution. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14139 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62175/ Test PASSed. ---

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14139 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14138: [SPARK-16284][SQL] Implement reflect SQL function

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14138 **[Test build #62183 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62183/consoleFull)** for PR 14138 at commit

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14139 **[Test build #62175 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62175/consoleFull)** for PR 14139 at commit

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14036 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14036 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62179/ Test FAILed. ---

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14036 **[Test build #62179 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62179/consoleFull)** for PR 14036 at commit

[GitHub] spark issue #14113: [SPARK-16457] [SQL] Fix Wrong Messages when CTAS with a ...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14113 **[Test build #62181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62181/consoleFull)** for PR 14113 at commit

[GitHub] spark issue #13756: [SPARK-16041][SQL] Disallow Duplicate Columns in partiti...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13756 **[Test build #62182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62182/consoleFull)** for PR 13756 at commit

[GitHub] spark issue #14113: [SPARK-16457] [SQL] Fix Wrong Messages when CTAS with a ...

2016-07-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14113 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13756: [SPARK-16041][SQL] Disallow Duplicate Columns in partiti...

2016-07-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13756 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as data source for SQL.

2016-07-12 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14151 BTW instead of a whole new format, I think this should just be an option in the existing text format. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14139: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14139 **[Test build #3187 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3187/consoleFull)** for PR 14139 at commit

[GitHub] spark pull request #14080: [SPARK-16405] Add metrics and source for external...

2016-07-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14080 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13494: [SPARK-15752] [SQL] Optimize metadata only query that ha...

2016-07-12 Thread lianhuiwang
Github user lianhuiwang commented on the issue: https://github.com/apache/spark/pull/13494 Thank you for review and merging. @rxin @hvanhovell @cloud-fan . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #14151: [SPARK-16496][SQL] Add wholetext as data source f...

2016-07-12 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14151#discussion_r70480438 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/HadoopFileWholeTextReader.scala --- @@ -0,0 +1,53 @@ +/* + * Licensed to

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14036 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14036 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62177/ Test FAILed. ---

[GitHub] spark issue #14036: [SPARK-16323] [SQL] Add IntegerDivide to avoid unnecessa...

2016-07-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14036 **[Test build #62177 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62177/consoleFull)** for PR 14036 at commit

[GitHub] spark issue #14080: [SPARK-16405] Add metrics and source for external shuffl...

2016-07-12 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14080 Merging in master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14088 Since this is so localized I'll also merge to 2.0 instead of waiting for 2.0.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get us...

2016-07-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14088 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14088: [SPARK-16414] [YARN] Fix bugs for "Can not get user conf...

2016-07-12 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14088 I'd have preferred `key` and `value` as different parameters, but I need to go clean up this test suite in any case, so merging to master. --- If your project is set up for it, you can reply to

<    1   2   3   4   5   6   >