[GitHub] SparkQA commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
SparkQA commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448908512 **[Test build #100332 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100332/

[GitHub] SparkQA commented on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-20 Thread GitBox
SparkQA commented on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23243#issuecomment-448908515 **[Test build #100331 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100331/testReport)** for PR 232

[GitHub] AmplabJenkins commented on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23243#issuecomment-448908611 Merged build finished. Test FAILed. This is an automated message

[GitHub] AmplabJenkins commented on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23243#issuecomment-448908618 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenki

[GitHub] AmplabJenkins commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448908677 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] AmplabJenkins commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448908674 Merged build finished. Test FAILed. Thi

[GitHub] SparkQA removed a comment on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-20 Thread GitBox
SparkQA removed a comment on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23243#issuecomment-448878592 **[Test build #100331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100331/testReport)** for

[GitHub] SparkQA removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
SparkQA removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-44700 **[Test build #100332 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] AmplabJenkins removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448908674 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23243#issuecomment-448908611 Merged build finished. Test FAILed. This is an automated

[GitHub] AmplabJenkins removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448908677 Test FAILed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] AmplabJenkins removed a comment on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23243#issuecomment-448908618 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] HyukjinKwon commented on a change in pull request #23354: [SPARK-26415][SQL] Mark StreamSinkProvider and StreamSourceProvider as stable

2018-12-20 Thread GitBox
HyukjinKwon commented on a change in pull request #23354: [SPARK-26415][SQL] Mark StreamSinkProvider and StreamSourceProvider as stable URL: https://github.com/apache/spark/pull/23354#discussion_r243184107 ## File path: sql/core/src/main/scala/org/apache/spark/sql/sources/interface

[GitHub] HyukjinKwon commented on a change in pull request #23354: [SPARK-26415][SQL] Mark StreamSinkProvider and StreamSourceProvider as stable

2018-12-20 Thread GitBox
HyukjinKwon commented on a change in pull request #23354: [SPARK-26415][SQL] Mark StreamSinkProvider and StreamSourceProvider as stable URL: https://github.com/apache/spark/pull/23354#discussion_r243184066 ## File path: sql/core/src/main/scala/org/apache/spark/sql/sources/interface

[GitHub] wangshuo128 opened a new pull request #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2018-12-20 Thread GitBox
wangshuo128 opened a new pull request #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355 ## What changes were proposed in this pull request? In current code path, OneForOneStr

[GitHub] AmplabJenkins commented on issue #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355#issuecomment-448914161 Can one of the admins verify this patch? --

[GitHub] AmplabJenkins commented on issue #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355#issuecomment-448914591 Can one of the admins verify this patch? --

[GitHub] AmplabJenkins removed a comment on issue #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355#issuecomment-448914161 Can one of the admins verify this patch? --

[GitHub] AmplabJenkins commented on issue #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355#issuecomment-448915716 Can one of the admins verify this patch? --

[GitHub] AmplabJenkins removed a comment on issue #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23355: Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355#issuecomment-448914591 Can one of the admins verify this patch? --

[GitHub] bersprockets commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
bersprockets commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448923435 retest this please This is an automated

[GitHub] SparkQA commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
SparkQA commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448924536 **[Test build #100333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100333/t

[GitHub] cloud-fan commented on a change in pull request #23354: [SPARK-26415][SQL] Mark StreamSinkProvider and StreamSourceProvider as stable

2018-12-20 Thread GitBox
cloud-fan commented on a change in pull request #23354: [SPARK-26415][SQL] Mark StreamSinkProvider and StreamSourceProvider as stable URL: https://github.com/apache/spark/pull/23354#discussion_r243228086 ## File path: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.

[GitHub] ScrapCodes commented on issue #23339: [MINOR][SQL]Locality does not need to be implemented

2018-12-20 Thread GitBox
ScrapCodes commented on issue #23339: [MINOR][SQL]Locality does not need to be implemented URL: https://github.com/apache/spark/pull/23339#issuecomment-448955791 Hi @srowen, to be honest, this comment was originally introduced by @cloud-fan in HadoopFileLinesReader. I have just replicated

[GitHub] beliefer commented on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2018-12-20 Thread GitBox
beliefer commented on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355#issuecomment-448960858 If ExternalShuffleService only received a OpenBlocks mess

[GitHub] gengliangwang commented on a change in pull request #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions

2018-12-20 Thread GitBox
gengliangwang commented on a change in pull request #23352: [SPARK-26409][SQL][TESTS] SQLConf should be serializable in test sessions URL: https://github.com/apache/spark/pull/23352#discussion_r243235206 ## File path: sql/core/src/main/scala/org/apache/spark/sql/internal/BaseSessio

[GitHub] cloud-fan commented on a change in pull request #23339: [MINOR][SQL]Locality does not need to be implemented

2018-12-20 Thread GitBox
cloud-fan commented on a change in pull request #23339: [MINOR][SQL]Locality does not need to be implemented URL: https://github.com/apache/spark/pull/23339#discussion_r243237864 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/HadoopFileLinesReader.

[GitHub] weixiuli commented on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-20 Thread GitBox
weixiuli commented on issue #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23243#issuecomment-448969412 retest please This is an automated message from the Apache Git Servic

[GitHub] wangshuo128 commented on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2018-12-20 Thread GitBox
wangshuo128 commented on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355#issuecomment-448986131 Let me explain my problem in detail. We use `Ya

[GitHub] SparkQA commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
SparkQA commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448993627 **[Test build #100333 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100333/

[GitHub] SparkQA removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
SparkQA removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448924536 **[Test build #100333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] AmplabJenkins commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448994140 Merged build finished. Test PASSed. Thi

[GitHub] AmplabJenkins removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448994140 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448994143 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] AmplabJenkins commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23336: [SPARK-26378][SQL] Restore performance of queries against wide CSV tables URL: https://github.com/apache/spark/pull/23336#issuecomment-448994143 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] srowen commented on issue #21664: [SPARK-24687][CORE] Avoid job hanging when generate task binary causes fatal error

2018-12-20 Thread GitBox
srowen commented on issue #21664: [SPARK-24687][CORE] Avoid job hanging when generate task binary causes fatal error URL: https://github.com/apache/spark/pull/21664#issuecomment-449016699 Merged to master/2.4/2.3 This is an a

[GitHub] srowen closed pull request #21664: [SPARK-24687][CORE] Avoid job hanging when generate task binary causes fatal error

2018-12-20 Thread GitBox
srowen closed pull request #21664: [SPARK-24687][CORE] Avoid job hanging when generate task binary causes fatal error URL: https://github.com/apache/spark/pull/21664 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sak

[GitHub] SparkQA commented on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL

2018-12-20 Thread GitBox
SparkQA commented on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL URL: https://github.com/apache/spark/pull/23342#issuecomment-449017630 **[Test build #4482 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4482/testReport)

[GitHub] AmplabJenkins removed a comment on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL URL: https://github.com/apache/spark/pull/23342#issuecomment-448113476 Can one of the admins verify this patch?

[GitHub] srowen closed pull request #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL

2018-12-20 Thread GitBox
srowen closed pull request #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL URL: https://github.com/apache/spark/pull/23342 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[GitHub] AmplabJenkins commented on issue #20125: [SPARK-17967][SQL] Support for array as an option in SQL parser

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #20125: [SPARK-17967][SQL] Support for array as an option in SQL parser URL: https://github.com/apache/spark/pull/20125#issuecomment-449019483 Merged build finished. Test PASSed. This is an au

[GitHub] AmplabJenkins commented on issue #20125: [SPARK-17967][SQL] Support for array as an option in SQL parser

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #20125: [SPARK-17967][SQL] Support for array as an option in SQL parser URL: https://github.com/apache/spark/pull/20125#issuecomment-449019492 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] AmplabJenkins removed a comment on issue #20125: [SPARK-17967][SQL] Support for array as an option in SQL parser

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #20125: [SPARK-17967][SQL] Support for array as an option in SQL parser URL: https://github.com/apache/spark/pull/20125#issuecomment-449019483 Merged build finished. Test PASSed. This

[GitHub] AmplabJenkins removed a comment on issue #20125: [SPARK-17967][SQL] Support for array as an option in SQL parser

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #20125: [SPARK-17967][SQL] Support for array as an option in SQL parser URL: https://github.com/apache/spark/pull/20125#issuecomment-449019492 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] jomach commented on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL

2018-12-20 Thread GitBox
jomach commented on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL URL: https://github.com/apache/spark/pull/23342#issuecomment-449022083 @srowen Why did you not merge it ? This is an automate

[GitHub] jomach removed a comment on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL

2018-12-20 Thread GitBox
jomach removed a comment on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL URL: https://github.com/apache/spark/pull/23342#issuecomment-449022083 @srowen Why did you not merge it ? This is an

[GitHub] srowen commented on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL

2018-12-20 Thread GitBox
srowen commented on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL URL: https://github.com/apache/spark/pull/23342#issuecomment-449024976 It is merged to master. I missed running the tests so those are running now, but it's a doc change and shouldn't be a pr

[GitHub] jomach commented on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL

2018-12-20 Thread GitBox
jomach commented on issue #23342: [SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL URL: https://github.com/apache/spark/pull/23342#issuecomment-449025654 I saw it. I was just confused about the git symbol. Thx

[GitHub] srowen commented on a change in pull request #22764: [SPARK-25765][ML] Add training cost to BisectingKMeans summary

2018-12-20 Thread GitBox
srowen commented on a change in pull request #22764: [SPARK-25765][ML] Add training cost to BisectingKMeans summary URL: https://github.com/apache/spark/pull/22764#discussion_r243301364 ## File path: mllib/src/main/scala/org/apache/spark/mllib/clustering/BisectingKMeansModel.scala

[GitHub] tgravescs commented on a change in pull request #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table

2018-12-20 Thread GitBox
tgravescs commented on a change in pull request #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table URL: https://github.com/apache/spark/pull/23310#discussion_r243305626 ## File path: core/src/main/resources/org/apache/spark/ui/static/stagepage.js

[GitHub] tgravescs commented on a change in pull request #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table

2018-12-20 Thread GitBox
tgravescs commented on a change in pull request #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table URL: https://github.com/apache/spark/pull/23310#discussion_r243306108 ## File path: core/src/main/resources/org/apache/spark/ui/static/stagepage.js

[GitHub] srowen closed pull request #15622: [SPARK-18092][ML] Fix column prediction type error

2018-12-20 Thread GitBox
srowen closed pull request #15622: [SPARK-18092][ML] Fix column prediction type error URL: https://github.com/apache/spark/pull/15622 This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] tgravescs commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
tgravescs commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#discussion_r243312174 ## File path: resource-managers/yarn/src

[GitHub] tgravescs commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
tgravescs commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#discussion_r243312335 ## File path: resource-managers/yarn/src

[GitHub] tgravescs commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
tgravescs commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#discussion_r243312512 ## File path: resource-managers/yarn/src

[GitHub] tgravescs commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
tgravescs commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449038961 haven't been able to easily reproduce, will try again today ---

[GitHub] HyukjinKwon opened a new pull request #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork

2018-12-20 Thread GitBox
HyukjinKwon opened a new pull request #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork URL: https://github.com/apache/spark/pull/23356 ## What changes were proposed in this pull request? Currently, even if I explici

[GitHub] HyukjinKwon commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork

2018-12-20 Thread GitBox
HyukjinKwon commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork URL: https://github.com/apache/spark/pull/23356#issuecomment-449039586 cc @felixcheung. I was writing an R library but faced this :-) ..

[GitHub] SparkQA commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork

2018-12-20 Thread GitBox
SparkQA commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork URL: https://github.com/apache/spark/pull/23356#issuecomment-449040711 **[Test build #100334 has started](https://amplab.cs.berkeley.edu/jenkins/j

[GitHub] HyukjinKwon commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork

2018-12-20 Thread GitBox
HyukjinKwon commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork URL: https://github.com/apache/spark/pull/23356#issuecomment-449040813 BTW, we should backport this. Previous versions are affected. -

[GitHub] AmplabJenkins commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork URL: https://github.com/apache/spark/pull/23356#issuecomment-449041187 Merged build finished. Test PASSed. -

[GitHub] HyukjinKwon commented on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API

2018-12-20 Thread GitBox
HyukjinKwon commented on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API URL: https://github.com/apache/spark/pull/23184#issuecomment-449041205 Hey, @felixcheung, mind if I ask to take a look when you're available please? -

[GitHub] HyukjinKwon commented on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API

2018-12-20 Thread GitBox
HyukjinKwon commented on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API URL: https://github.com/apache/spark/pull/23184#issuecomment-449041094 retest this please This is an automate

[GitHub] AmplabJenkins commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork URL: https://github.com/apache/spark/pull/23356#issuecomment-449041190 Test PASSed. Refer to this link for build results (access rights to

[GitHub] AmplabJenkins removed a comment on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork URL: https://github.com/apache/spark/pull/23356#issuecomment-449041190 Test PASSed. Refer to this link for build results (access r

[GitHub] AmplabJenkins removed a comment on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork URL: https://github.com/apache/spark/pull/23356#issuecomment-449041187 Merged build finished. Test PASSed. -

[GitHub] HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2018-12-20 Thread GitBox
HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-449041752 Hey, @shaneknapp, mind if I ask to take a look please when you're available?

[GitHub] AmplabJenkins commented on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API URL: https://github.com/apache/spark/pull/23184#issuecomment-449042367 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API URL: https://github.com/apache/spark/pull/23184#issuecomment-449042375 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] SparkQA commented on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API

2018-12-20 Thread GitBox
SparkQA commented on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API URL: https://github.com/apache/spark/pull/23184#issuecomment-449042713 **[Test build #100335 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10033

[GitHub] mengxr commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline

2018-12-20 Thread GitBox
mengxr commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Pipeline URL: https://github.com/apache/spark/pull/23263#issuecomment-449042855 @HyukjinKwon Have we considered integrating with ML instrumentation? https://github.com/apache/spark/blob/master/mllib/src/main/sc

[GitHub] AmplabJenkins removed a comment on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API URL: https://github.com/apache/spark/pull/23184#issuecomment-449042367 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins removed a comment on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23184: [SPARK-26227][R] from_[csv|json] should accept schema_of_[csv|json] in R API URL: https://github.com/apache/spark/pull/23184#issuecomment-449042375 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] HyukjinKwon commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork

2018-12-20 Thread GitBox
HyukjinKwon commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork URL: https://github.com/apache/spark/pull/23356#issuecomment-449044619 Adding @srowen as well

[GitHub] gengliangwang commented on a change in pull request #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table

2018-12-20 Thread GitBox
gengliangwang commented on a change in pull request #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table URL: https://github.com/apache/spark/pull/23310#discussion_r243322702 ## File path: core/src/main/resources/org/apache/spark/ui/static/stagepage.js

[GitHub] Ngone51 commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
Ngone51 commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#discussion_r243329624 ## File path: resource-managers/yarn/src/m

[GitHub] Ngone51 commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
Ngone51 commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449051182 Thank you for your efforts. @tgravescs -

[GitHub] Ngone51 commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
Ngone51 commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#discussion_r243329624 ## File path: resource-managers/yarn/src/m

[GitHub] Ngone51 commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
Ngone51 commented on a change in pull request #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#discussion_r243330078 ## File path: resource-managers/yarn/src/m

[GitHub] SparkQA commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
SparkQA commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449054499 **[Test build #100336 has started](https://amplab.cs.berkeley.edu/jen

[GitHub] AmplabJenkins commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449054771 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449054783 Test PASSed. Refer to this link for build results (access ri

[GitHub] AmplabJenkins removed a comment on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449054783 Test PASSed. Refer to this link for build results (a

[GitHub] AmplabJenkins removed a comment on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449054771 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449061049 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins removed a comment on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449061058 Test PASSed. Refer to this link for build results (a

[GitHub] SparkQA removed a comment on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
SparkQA removed a comment on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449054499 **[Test build #100336 has started](https://amplab.cs.berkele

[GitHub] AmplabJenkins commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449061058 Test PASSed. Refer to this link for build results (access ri

[GitHub] SparkQA commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
SparkQA commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449060955 **[Test build #100336 has finished](https://amplab.cs.berkeley.edu/je

[GitHub] AmplabJenkins removed a comment on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-449061049 Merged build finished. Test PASSed. --

[GitHub] SparkQA commented on issue #22498: [SPARK-25642] : Adding two new metrics to record the number of registered connections as well as the number of active connections to YARN Shuffle Service

2018-12-20 Thread GitBox
SparkQA commented on issue #22498: [SPARK-25642] : Adding two new metrics to record the number of registered connections as well as the number of active connections to YARN Shuffle Service URL: https://github.com/apache/spark/pull/22498#issuecomment-449069492 **[Test build #100337 has sta

[GitHub] pgandhi999 commented on issue #22498: [SPARK-25642] : Adding two new metrics to record the number of registered connections as well as the number of active connections to YARN Shuffle Service

2018-12-20 Thread GitBox
pgandhi999 commented on issue #22498: [SPARK-25642] : Adding two new metrics to record the number of registered connections as well as the number of active connections to YARN Shuffle Service URL: https://github.com/apache/spark/pull/22498#issuecomment-449069613 Sorry, I was on vacation so

[GitHub] felixcheung commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork

2018-12-20 Thread GitBox
felixcheung commented on issue #23356: [SPARK-26422][R] Support to disable Hive support in SparkR even for Hadoop versions unsupported by Hive fork URL: https://github.com/apache/spark/pull/23356#issuecomment-449071329 I think this isn’t limited to R though. I recall that code is modeled on

[GitHub] SparkQA commented on issue #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table

2018-12-20 Thread GitBox
SparkQA commented on issue #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table URL: https://github.com/apache/spark/pull/23310#issuecomment-449071361 **[Test build #100338 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100338/testR

[GitHub] AmplabJenkins commented on issue #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table URL: https://github.com/apache/spark/pull/23310#issuecomment-449071721 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] AmplabJenkins commented on issue #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table URL: https://github.com/apache/spark/pull/23310#issuecomment-449071718 Merged build finished. Test FAILed. This is

[GitHub] AmplabJenkins removed a comment on issue #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table

2018-12-20 Thread GitBox
AmplabJenkins removed a comment on issue #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table URL: https://github.com/apache/spark/pull/23310#issuecomment-449071718 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins commented on issue #22498: [SPARK-25642] : Adding two new metrics to record the number of registered connections as well as the number of active connections to YARN Shuffle Serv

2018-12-20 Thread GitBox
AmplabJenkins commented on issue #22498: [SPARK-25642] : Adding two new metrics to record the number of registered connections as well as the number of active connections to YARN Shuffle Service URL: https://github.com/apache/spark/pull/22498#issuecomment-449073144 Test FAILed. Refer to

[GitHub] SparkQA commented on issue #22498: [SPARK-25642] : Adding two new metrics to record the number of registered connections as well as the number of active connections to YARN Shuffle Service

2018-12-20 Thread GitBox
SparkQA commented on issue #22498: [SPARK-25642] : Adding two new metrics to record the number of registered connections as well as the number of active connections to YARN Shuffle Service URL: https://github.com/apache/spark/pull/22498#issuecomment-449073117 **[Test build #100337 has fin

[GitHub] SparkQA commented on issue #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table

2018-12-20 Thread GitBox
SparkQA commented on issue #23310: [SPARK-26363][WebUI] Avoid duplicated KV store lookups for task table URL: https://github.com/apache/spark/pull/23310#issuecomment-449073300 **[Test build #100339 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100339/testR

  1   2   3   4   5   >