[GitHub] spark issue #17417: [DOCS] Docs-only improvements

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17417 **[Test build #75388 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75388/testReport)** for PR 17417 at commit [`ae57b33`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2017-03-30 Thread Gauravshah
Github user Gauravshah commented on the issue: https://github.com/apache/spark/pull/16578 can I do something to help this pull request ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark issue #17450: [SPARK-20121][SQL] simplify NullPropagation with NullInt...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17450 **[Test build #75390 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75390/testReport)** for PR 17450 at commit [`63287ef`](https://github.com/apache/spark/commit/63

[GitHub] spark issue #17443: [DOCS][MINOR] Fixed a few typos in the Structured Stream...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17443 **[Test build #3620 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3620/testReport)** for PR 17443 at commit [`a2faf88`](https://github.com/apache/spark/commit/

[GitHub] spark issue #17443: [DOCS][MINOR] Fixed a few typos in the Structured Stream...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17443 **[Test build #3620 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3620/testReport)** for PR 17443 at commit [`a2faf88`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17443: [DOCS][MINOR] Fixed a few typos in the Structured Stream...

2017-03-30 Thread aseigneurin
Github user aseigneurin commented on the issue: https://github.com/apache/spark/pull/17443 @srowen does this mean I should open a JIRA for this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark issue #17458: [SPARK-20127][CORE] few warning have been fixed which In...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17458 **[Test build #3619 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3619/testReport)** for PR 17458 at commit [`4788bbe`](https://github.com/apache/spark/commit/

[GitHub] spark issue #17472: [SPARK-19999]: Workaround JDK-8165231 to identify PPC64 ...

2017-03-30 Thread samelamin
Github user samelamin commented on the issue: https://github.com/apache/spark/pull/17472 @gatorsmile @srowen how does it look now? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark issue #17430: [SPARK-20096][Spark Submit][Minor]Expose the right queue...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17430 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17430: [SPARK-20096][Spark Submit][Minor]Expose the right queue...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17430 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75387/ Test PASSed. ---

[GitHub] spark issue #17430: [SPARK-20096][Spark Submit][Minor]Expose the right queue...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17430 **[Test build #75387 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75387/testReport)** for PR 17430 at commit [`77dadfd`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #17472: [SPARK-19999]: Workaround JDK-8165231 to identify PPC64 ...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17472 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17472: [SPARK-19999]: Workaround JDK-8165231 to identify PPC64 ...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17472 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75386/ Test PASSed. ---

[GitHub] spark issue #17472: [SPARK-19999]: Workaround JDK-8165231 to identify PPC64 ...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17472 **[Test build #75386 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75386/testReport)** for PR 17472 at commit [`632161b`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #17477: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on J...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17477 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75385/ Test PASSed. ---

[GitHub] spark issue #17477: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on J...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17477 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17477: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on J...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17477 **[Test build #75385 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75385/testReport)** for PR 17477 at commit [`7a7cf04`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #17476: [SPARK-20151][SQL] Account for partition pruning ...

2017-03-30 Thread adrian-ionescu
Github user adrian-ionescu commented on a diff in the pull request: https://github.com/apache/spark/pull/17476#discussion_r108906608 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/CatalogFileIndex.scala --- @@ -111,7 +113,8 @@ private class PrunedInMe

[GitHub] spark issue #17416: [SPARK-20075][CORE][WIP] Support classifier, packaging i...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17416 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17416: [SPARK-20075][CORE][WIP] Support classifier, packaging i...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17416 **[Test build #75389 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75389/testReport)** for PR 17416 at commit [`dec7bfb`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17416: [SPARK-20075][CORE][WIP] Support classifier, packaging i...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17416 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75389/ Test FAILed. ---

[GitHub] spark issue #17416: [SPARK-20075][CORE][WIP] Support classifier, packaging i...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17416 **[Test build #75389 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75389/testReport)** for PR 17416 at commit [`dec7bfb`](https://github.com/apache/spark/commit/de

[GitHub] spark pull request #17329: [SPARK-19991]FileSegmentManagedBuffer performance...

2017-03-30 Thread witgo
Github user witgo closed the pull request at: https://github.com/apache/spark/pull/17329 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark issue #17416: [SPARK-20075][CORE][WIP] Support classifier, packaging i...

2017-03-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17416 Yeah, it clearly downloads the right models .jar file, puts it in the .ivy cache correctly (I can find it there as expected) but then `spark.jars` isn't set correctly: ``` ... (spar

[GitHub] spark issue #17417: [DOCS] Docs-only improvements

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17417 **[Test build #75388 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75388/testReport)** for PR 17417 at commit [`ae57b33`](https://github.com/apache/spark/commit/ae

[GitHub] spark pull request #17452: [SPARK-20123][build]$SPARK_HOME variable might ha...

2017-03-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17452#discussion_r108898852 --- Diff: dev/make-distribution.sh --- @@ -217,43 +217,43 @@ fi # Make R package - this is used for both CRAN release and packing R layout into distribu

[GitHub] spark pull request #17452: [SPARK-20123][build]$SPARK_HOME variable might ha...

2017-03-30 Thread zuotingbing
Github user zuotingbing commented on a diff in the pull request: https://github.com/apache/spark/pull/17452#discussion_r108898299 --- Diff: dev/make-distribution.sh --- @@ -217,43 +217,43 @@ fi # Make R package - this is used for both CRAN release and packing R layout into dis

[GitHub] spark issue #17458: [SPARK-20127][CORE] few warning have been fixed which In...

2017-03-30 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17458 It looks good to me too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #17458: [SPARK-20127][CORE] few warning have been fixed which In...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17458 **[Test build #3619 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3619/testReport)** for PR 17458 at commit [`4788bbe`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #17458: [SPARK-20127][CORE] few warning have been fixed which In...

2017-03-30 Thread dbolshak
Github user dbolshak commented on the issue: https://github.com/apache/spark/pull/17458 Corrected. Please take a look. There is only one change (in 2 places) related to calling toSeq which has comment, but it's not clear can I leave my change or not. --- If your project is se

[GitHub] spark pull request #17458: [SPARK-20127][CORE] few warning have been fixed w...

2017-03-30 Thread dbolshak
Github user dbolshak commented on a diff in the pull request: https://github.com/apache/spark/pull/17458#discussion_r108890304 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/AllStagesPage.scala --- @@ -34,9 +34,9 @@ private[ui] class AllStagesPage(parent: StagesTab) extend

[GitHub] spark issue #17430: [SPARK-20096][Spark Submit][Minor]Expose the right queue...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17430 **[Test build #75387 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75387/testReport)** for PR 17430 at commit [`77dadfd`](https://github.com/apache/spark/commit/77

[GitHub] spark issue #17477: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on J...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17477 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17477: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on J...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17477 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75381/ Test PASSed. ---

[GitHub] spark issue #17477: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on J...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17477 **[Test build #75381 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75381/testReport)** for PR 17477 at commit [`7ddb6eb`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #17443: typos

2017-03-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17443 @aseigneurin Please read http://spark.apache.org/contributing.html too. As you might imagine "typos" isn't useful as a title. Write "[MINOR]" too --- If your project is set up for it, you can reply

[GitHub] spark issue #17472: [SPARK-19999]: Workaround JDK-8165231 to identify PPC64 ...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17472 **[Test build #75386 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75386/testReport)** for PR 17472 at commit [`632161b`](https://github.com/apache/spark/commit/63

[GitHub] spark issue #17430: [SPARK-20096][Spark Submit][Minor]Expose the right queue...

2017-03-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17430 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark pull request #17452: [SPARK-20123][build]$SPARK_HOME variable might ha...

2017-03-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17452#discussion_r108885749 --- Diff: dev/make-distribution.sh --- @@ -217,43 +217,43 @@ fi # Make R package - this is used for both CRAN release and packing R layout into distribu

[GitHub] spark issue #17417: [DOCS] Docs-only improvements

2017-03-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17417 Looks good, just needs a rebase now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #17472: [SPARK-19999]: Accommodate a new architecture tha...

2017-03-30 Thread samelamin
Github user samelamin commented on a diff in the pull request: https://github.com/apache/spark/pull/17472#discussion_r108884506 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java --- @@ -46,18 +46,22 @@ private static final boolean unaligned;

[GitHub] spark pull request #17472: [SPARK-19999]: Accommodate a new architecture tha...

2017-03-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17472#discussion_r108884076 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java --- @@ -46,18 +46,22 @@ private static final boolean unaligned; sta

[GitHub] spark issue #17467: [SPARK-20140][DStream] Remove hardcoded kinesis retry wa...

2017-03-30 Thread yssharma
Github user yssharma commented on the issue: https://github.com/apache/spark/pull/17467 You're a gen @HyukjinKwon 💯 . I will wait for Tathagata and Burak's inputs then :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[GitHub] spark pull request #17442: [SPARK-20107][DOC] Add spark.hadoop.mapreduce.fil...

2017-03-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17442 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #17477: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on J...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17477 **[Test build #75385 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75385/testReport)** for PR 17477 at commit [`7a7cf04`](https://github.com/apache/spark/commit/7a

[GitHub] spark pull request #17477: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc bui...

2017-03-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17477#discussion_r108882566 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -704,12 +704,12 @@ private[spark] object TaskSchedulerImpl {

[GitHub] spark issue #17442: [SPARK-20107][DOC] Add spark.hadoop.mapreduce.fileoutput...

2017-03-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17442 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17251 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75384/ Test PASSed. ---

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17251 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17251 **[Test build #75384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75384/testReport)** for PR 17251 at commit [`2150ce5`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #17472: [SPARK-19999]: Accommodate a new architecture tha...

2017-03-30 Thread samelamin
Github user samelamin commented on a diff in the pull request: https://github.com/apache/spark/pull/17472#discussion_r108881923 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java --- @@ -46,18 +46,22 @@ private static final boolean unaligned;

[GitHub] spark pull request #17329: [SPARK-19991]FileSegmentManagedBuffer performance...

2017-03-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17329#discussion_r108881597 --- Diff: common/network-common/src/main/java/org/apache/spark/network/buffer/FileSegmentManagedBuffer.java --- @@ -37,13 +37,24 @@ * A {@link Managed

[GitHub] spark pull request #17472: [SPARK-19999]: Accommodate a new architecture tha...

2017-03-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17472#discussion_r108880865 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java --- @@ -46,18 +46,22 @@ private static final boolean unaligned; sta

[GitHub] spark pull request #17458: [SPARK-20127][CORE] few warning have been fixed w...

2017-03-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17458#discussion_r108880632 --- Diff: core/src/main/scala/org/apache/spark/ui/WebUI.scala --- @@ -116,15 +116,15 @@ private[spark] abstract class WebUI( * @param path Path in UI

[GitHub] spark issue #17479: [SPARK-20154][Web UI]In web ui,http://ip:4040/executors/...

2017-03-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17479 I don't think this is worth changing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark pull request #17324: [SPARK-19969] [ML] Imputer doc and example

2017-03-30 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/17324#discussion_r108880024 --- Diff: examples/src/main/python/ml/imputer_example.py --- @@ -0,0 +1,50 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] spark pull request #17479: [SPARK-20154][Web UI]In web ui,http://ip:4040/exe...

2017-03-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17479#discussion_r108879364 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage-template.html --- @@ -24,7 +24,7 @@ Summary RDD B

[GitHub] spark pull request #17472: [SPARK-19999]: Fix for flakey tests due to java.n...

2017-03-30 Thread samelamin
Github user samelamin commented on a diff in the pull request: https://github.com/apache/spark/pull/17472#discussion_r108879329 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java --- @@ -46,18 +46,22 @@ private static final boolean unaligned;

[GitHub] spark pull request #17472: [SPARK-19999]: Fix for flakey tests due to java.n...

2017-03-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17472#discussion_r108878462 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java --- @@ -46,18 +46,22 @@ private static final boolean unaligned; sta

[GitHub] spark pull request #17479: [SPARK-20154][Web UI]In web ui,http://ip:4040/exe...

2017-03-30 Thread guoxiaolongzte
Github user guoxiaolongzte commented on a diff in the pull request: https://github.com/apache/spark/pull/17479#discussion_r108876916 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage-template.html --- @@ -24,7 +24,7 @@ Summary RD

[GitHub] spark pull request #17479: [SPARK-20154][Web UI]In web ui,http://ip:4040/exe...

2017-03-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/17479#discussion_r108875608 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage-template.html --- @@ -24,7 +24,7 @@ Summary RDD Blo

[GitHub] spark pull request #17458: [SPARK-20127][CORE] few warning have been fixed w...

2017-03-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17458#discussion_r108874836 --- Diff: core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala --- @@ -42,7 +42,7 @@ private[ui] class RDDPage(parent: StorageTab) extends WebU

[GitHub] spark pull request #17458: [SPARK-20127][CORE] few warning have been fixed w...

2017-03-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17458#discussion_r108874623 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/UIData.scala --- @@ -180,8 +180,8 @@ private[spark] object UIData { speculative = tas

[GitHub] spark pull request #17458: [SPARK-20127][CORE] few warning have been fixed w...

2017-03-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17458#discussion_r108874489 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagesTab.scala --- @@ -35,7 +35,7 @@ private[ui] class StagesTab(parent: SparkUI) extends SparkU

[GitHub] spark issue #17472: [SPARK-19999]: Fix for flakey tests due to java.nio.Bits...

2017-03-30 Thread samelamin
Github user samelamin commented on the issue: https://github.com/apache/spark/pull/17472 Can someone guide me why the tests failed? is it another flakey test or? because the below message doesnt make sense to me :( > Traceback (most recent call last): > File "./dev/run-

[GitHub] spark issue #17472: [SPARK-19999]: Fix for flakey tests due to java.nio.Bits...

2017-03-30 Thread samelamin
Github user samelamin commented on the issue: https://github.com/apache/spark/pull/17472 jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #17458: [SPARK-20127][CORE] few warning have been fixed which In...

2017-03-30 Thread dbolshak
Github user dbolshak commented on the issue: https://github.com/apache/spark/pull/17458 @srowen, @HyukjinKwon could you please merge the PR if it's ok of course? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark issue #15326: [SPARK-17759] [CORE] Avoid adding duplicate schedulables

2017-03-30 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/15326 Hi @kayousterhout and @markhamstra, - This PR is ready for review in the light of first-added-wins (Schedulables: `Pool` / `TaskSetManager`) pattern. All feedback are welcome in a

[GitHub] spark issue #17324: [SPARK-19969] [ML] Imputer doc and example

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17324 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75383/ Test PASSed. ---

[GitHub] spark issue #17324: [SPARK-19969] [ML] Imputer doc and example

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17324 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17324: [SPARK-19969] [ML] Imputer doc and example

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17324 **[Test build #75383 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75383/testReport)** for PR 17324 at commit [`48a1361`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #17468: [SPARK-20143][SQL] DataType.fromJson should throw an exc...

2017-03-30 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17468 @gatorsmile, could you take a look please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #17478: [SPARK-18901][ML]:Require in LR LogisticAggregator is re...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17478 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17478: [SPARK-18901][ML]:Require in LR LogisticAggregator is re...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17478 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75382/ Test PASSed. ---

[GitHub] spark issue #17478: [SPARK-18901][ML]:Require in LR LogisticAggregator is re...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17478 **[Test build #75382 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75382/testReport)** for PR 17478 at commit [`44305bf`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #17479: [SPARK-20154][Web UI]In web ui,http://ip:4040/exe...

2017-03-30 Thread guoxiaolongzte
Github user guoxiaolongzte commented on a diff in the pull request: https://github.com/apache/spark/pull/17479#discussion_r108863264 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage-template.html --- @@ -24,7 +24,7 @@ Summary RD

[GitHub] spark pull request #17479: [SPARK-20154][Web UI]In web ui,http://ip:4040/exe...

2017-03-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/17479#discussion_r108862872 --- Diff: core/src/main/resources/org/apache/spark/ui/static/executorspage-template.html --- @@ -24,7 +24,7 @@ Summary RDD Blo

[GitHub] spark issue #17479: [SPARK-20154][Web UI]In web ui,http://ip:4040/executors/...

2017-03-30 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17479 I think UI change requires a screenshot as written above. It seems trivial though. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark issue #17479: [SPARK-20154][Web UI]In web ui,http://ip:4040/executors/...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17479 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #17479: [SPARK-20154][Web UI]In web ui,http://ip:4040/exe...

2017-03-30 Thread guoxiaolongzte
GitHub user guoxiaolongzte opened a pull request: https://github.com/apache/spark/pull/17479 [SPARK-20154][Web UI]In web ui,http://ip:4040/executors/,the title 'Storage Memory' should… … modify 'Storage Memory used/total' ## What changes were proposed in this pull reque

[GitHub] spark pull request #17419: [SPARK-19634][ML] Multivariate summarizer - dataf...

2017-03-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17419#discussion_r108858117 --- Diff: mllib/src/main/scala/org/apache/spark/ml/stat/Summarizer.scala --- @@ -0,0 +1,746 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] spark pull request #17477: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc bui...

2017-03-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17477#discussion_r108857749 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -704,12 +704,12 @@ private[spark] object TaskSchedulerImpl {

[GitHub] spark pull request #17419: [SPARK-19634][ML] Multivariate summarizer - dataf...

2017-03-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17419#discussion_r108856798 --- Diff: mllib/src/main/scala/org/apache/spark/ml/stat/Summarizer.scala --- @@ -0,0 +1,746 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17251 Thank you so much for review, @gatorsmile . I updated the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17251 **[Test build #75384 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75384/testReport)** for PR 17251 at commit [`2150ce5`](https://github.com/apache/spark/commit/21

[GitHub] spark issue #17324: [SPARK-19969] [ML] Imputer doc and example

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17324 **[Test build #75383 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75383/testReport)** for PR 17324 at commit [`48a1361`](https://github.com/apache/spark/commit/48

[GitHub] spark pull request #17251: [SPARK-19910][SQL] `stack` should not reject NULL...

2017-03-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/17251#discussion_r108855184 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -590,6 +591,21 @@ object TypeCoercion {

[GitHub] spark issue #17324: [SPARK-19969] [ML] Imputer doc and example

2017-03-30 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17324 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark pull request #17251: [SPARK-19910][SQL] `stack` should not reject NULL...

2017-03-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/17251#discussion_r108854836 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercionSuite.scala --- @@ -707,6 +707,36 @@ class TypeCoercionSuite

[GitHub] spark pull request #17251: [SPARK-19910][SQL] `stack` should not reject NULL...

2017-03-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/17251#discussion_r108854853 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/GeneratorFunctionSuite.scala --- @@ -39,9 +39,9 @@ class GeneratorFunctionSuite extends QueryTe

[GitHub] spark pull request #17251: [SPARK-19910][SQL] `stack` should not reject NULL...

2017-03-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/17251#discussion_r108854595 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/generators.scala --- @@ -156,9 +157,21 @@ case class Stack(children:

[GitHub] spark issue #17478: [SPARK-18901][ML]:Require in LR LogisticAggregator is re...

2017-03-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17478 **[Test build #75382 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75382/testReport)** for PR 17478 at commit [`44305bf`](https://github.com/apache/spark/commit/44

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17251 LGTM except a few comments cc @cloud-fan for the final sign off --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark issue #17375: [SPARK-19019][PYTHON][BRANCH-1.6] Fix hijacked `collecti...

2017-03-30 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17375 @holdenk At least some users have more control over Python environment than a whole cluster setup, and with Anaconda defaulting now to 3.6, it is an annoyance. Assuming there will be 1.6.4, it make

[GitHub] spark pull request #17478: [SPARK-18901][ML]:Require in LR LogisticAggregato...

2017-03-30 Thread wangmiao1981
GitHub user wangmiao1981 opened a pull request: https://github.com/apache/spark/pull/17478 [SPARK-18901][ML]:Require in LR LogisticAggregator is redundant ## What changes were proposed in this pull request? In MultivariateOnlineSummarizer, `add` and `merge` have ch

[GitHub] spark issue #17472: [SPARK-19999]: Fix for flakey tests due to java.nio.Bits...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17472 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75380/ Test FAILed. ---

[GitHub] spark issue #17472: [SPARK-19999]: Fix for flakey tests due to java.nio.Bits...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17472 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17476: [SPARK-20151][SQL] Account for partition pruning in scan...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17476 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17476: [SPARK-20151][SQL] Account for partition pruning in scan...

2017-03-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17476 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75379/ Test PASSed. ---

[GitHub] spark issue #17477: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on J...

2017-03-30 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17477 FYI, If I haven't missed something, all the cases are the instances with the ones previously fixed. cc @joshrosen, @srowen and @jkbradley. Could you take a look and see if it makes sense? ---

<    1   2   3   4   5   >