[GitHub] [spark] AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494569773 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494569765 Merged build finished. Test PASSed. This i

[GitHub] [spark] AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494569765 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494569773 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] SparkQA commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
SparkQA commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494570338 **[Test build #105642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105642/test

[GitHub] [spark] AmplabJenkins commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal URL: https://github.com/apache/spark/pull/24297#issuecomment-494572119 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal URL: https://github.com/apache/spark/pull/24297#issuecomment-494572111 Build finished. Test PASSed. This is an automated messa

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#discussion_r286238871 ## File path: dev/create-release/spark-rm/Dockerfile ## @@ -43,7 +43,7 @@ ARG PIP_PKGS="pyop

[GitHub] [spark] AmplabJenkins removed a comment on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal URL: https://github.com/apache/spark/pull/24297#issuecomment-494572111 Build finished. Test PASSed. This is an automat

[GitHub] [spark] AmplabJenkins removed a comment on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal URL: https://github.com/apache/spark/pull/24297#issuecomment-494572119 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] SparkQA commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal

2019-05-21 Thread GitBox
SparkQA commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal URL: https://github.com/apache/spark/pull/24297#issuecomment-494572730 **[Test build #105643 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105643/testReport)** fo

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#discussion_r286238871 ## File path: dev/create-release/spark-rm/Dockerfile ## @@ -43,7 +43,7 @@ ARG PIP_PKGS="pyop

[GitHub] [spark] AmplabJenkins commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal URL: https://github.com/apache/spark/pull/24297#issuecomment-494573122 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal URL: https://github.com/apache/spark/pull/24297#issuecomment-494573116 Build finished. Test FAILed. This is an automated messa

[GitHub] [spark] SparkQA commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal

2019-05-21 Thread GitBox
SparkQA commented on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal URL: https://github.com/apache/spark/pull/24297#issuecomment-494573101 **[Test build #105643 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105643/testReport)** f

[GitHub] [spark] SparkQA removed a comment on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal URL: https://github.com/apache/spark/pull/24297#issuecomment-494572730 **[Test build #105643 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105643/testRepor

[GitHub] [spark] AmplabJenkins removed a comment on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal URL: https://github.com/apache/spark/pull/24297#issuecomment-494573116 Build finished. Test FAILed. This is an automat

[GitHub] [spark] AmplabJenkins removed a comment on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24297: [SPARK-27299][GRAPH][WIP] Spark Graph API design proposal URL: https://github.com/apache/spark/pull/24297#issuecomment-494573122 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494576704 **[Test build #105639 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494576847 Merged build finished. Test FAILed. ---

[GitHub] [spark] SparkQA removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494552701 **[Test build #105639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494576847 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494576856 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494576856 Test FAILed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] mengxr commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-21 Thread GitBox
mengxr commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-494580663 @tgravescs About the conf utilities, I think it hurts readability because we didn't have the abstraction at resource level.

[GitHub] [spark] srowen commented on a change in pull request #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
srowen commented on a change in pull request #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#discussion_r286249327 ## File path: dev/create-release/spark-rm/Dockerfile ## @@ -43,7 +43,7 @@ ARG PIP_PKGS="pyopenssl p

[GitHub] [spark] vanzin commented on a change in pull request #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation

2019-05-21 Thread GitBox
vanzin commented on a change in pull request #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation URL: https://github.com/apache/spark/pull/24499#discussion_r286245116 ## File path: common/network-shuf

[GitHub] [spark] vanzin commented on a change in pull request #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation

2019-05-21 Thread GitBox
vanzin commented on a change in pull request #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation URL: https://github.com/apache/spark/pull/24499#discussion_r286247232 ## File path: common/network-shuf

[GitHub] [spark] vanzin commented on a change in pull request #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation

2019-05-21 Thread GitBox
vanzin commented on a change in pull request #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation URL: https://github.com/apache/spark/pull/24499#discussion_r286249296 ## File path: core/src/test/scala/

[GitHub] [spark] vanzin commented on a change in pull request #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation

2019-05-21 Thread GitBox
vanzin commented on a change in pull request #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation URL: https://github.com/apache/spark/pull/24499#discussion_r286246312 ## File path: common/network-shuf

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#discussion_r286250127 ## File path: dev/create-release/spark-rm/Dockerfile ## @@ -43,7 +43,7 @@ ARG PIP_PKGS="pyop

[GitHub] [spark] SparkQA commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
SparkQA commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494583034 **[Test build #105644 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105644/testReport)** for PR 24

[GitHub] [spark] SparkQA commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-21 Thread GitBox
SparkQA commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-494583245 **[Test build #105637 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105637/testReport)*

[GitHub] [spark] SparkQA removed a comment on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-494541994 **[Test build #105637 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105637/testR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-494583698 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-494583694 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-494583694 Merged build finished. Test PASSed. This is an auto

[GitHub] [spark] AmplabJenkins commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24615: [SPARK-27488][CORE] Driver interface to support GPU resources URL: https://github.com/apache/spark/pull/24615#issuecomment-494583698 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] AmplabJenkins commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494584345 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] AmplabJenkins commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494584359 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494584359 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkele

[GitHub] [spark] AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494584345 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] SparkQA commented on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation

2019-05-21 Thread GitBox
SparkQA commented on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation URL: https://github.com/apache/spark/pull/24499#issuecomment-494586954 **[Test build #105638 has finished](https://amplab.cs.berk

[GitHub] [spark] joshrosen-stripe commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
joshrosen-stripe commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494586890 That most recent CI run has some legitimate looking test failures: ``` org.apac

[GitHub] [spark] SparkQA removed a comment on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation URL: https://github.com/apache/spark/pull/24499#issuecomment-494542031 **[Test build #105638 has started](https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation URL: https://github.com/apache/spark/pull/24499#issuecomment-494587530 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation URL: https://github.com/apache/spark/pull/24499#issuecomment-494587530 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins removed a comment on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation URL: https://github.com/apache/spark/pull/24499#issuecomment-494587525 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24499: [SPARK-27677][Core] Serve local disk persisted blocks by the external service after releasing executor by dynamic allocation URL: https://github.com/apache/spark/pull/24499#issuecomment-494587525 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
SparkQA commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494594371 **[Test build #105642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105642/tes

[GitHub] [spark] AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494594530 Merged build finished. Test FAILed. This i

[GitHub] [spark] AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494594534 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494594530 Merged build finished. Test FAILed. ---

[GitHub] [spark] SparkQA removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494570338 **[Test build #105642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105

[GitHub] [spark] AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494594534 Test FAILed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] SparkQA commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

2019-05-21 Thread GitBox
SparkQA commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-494595370 **[Test build #105641 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] SparkQA removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-494560601 **[Test build #105641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] JoshRosen commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
JoshRosen commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494595508 It looks like this change is breaking the ability to drop a catalog table whose underlying file

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-494595748 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-494595755 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-494595748 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE]Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#issuecomment-494595755 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] SparkQA commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
SparkQA commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494598249 **[Test build #105645 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105645/test

[GitHub] [spark] AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494599313 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494599305 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494599305 Merged build finished. Test PASSed. This i

[GitHub] [spark] AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494599313 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] LantaoJin commented on issue #24659: [SPARK-27788][SQL] Session aware event log for Spark thrift server

2019-05-21 Thread GitBox
LantaoJin commented on issue #24659: [SPARK-27788][SQL] Session aware event log for Spark thrift server URL: https://github.com/apache/spark/pull/24659#issuecomment-494599844 Gentle ping @gatorsmile @cloud-fan @jiangxb1987 @HyukjinKwon @dongjoon-hyun --

[GitHub] [spark] SparkQA commented on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler

2019-05-21 Thread GitBox
SparkQA commented on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler URL: https://github.com/apache/spark/pull/24653#issuecomment-494604763 **[Test build #105640 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105640/testReport)** for

[GitHub] [spark] BryanCutler commented on a change in pull request #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
BryanCutler commented on a change in pull request #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#discussion_r286271216 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scal

[GitHub] [spark] BryanCutler commented on a change in pull request #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
BryanCutler commented on a change in pull request #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#discussion_r286269838 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scal

[GitHub] [spark] AmplabJenkins commented on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler URL: https://github.com/apache/spark/pull/24653#issuecomment-494605152 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] AmplabJenkins commented on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler URL: https://github.com/apache/spark/pull/24653#issuecomment-494605159 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu

[GitHub] [spark] AmplabJenkins removed a comment on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler URL: https://github.com/apache/spark/pull/24653#issuecomment-494605159 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] SparkQA removed a comment on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler URL: https://github.com/apache/spark/pull/24653#issuecomment-494560581 **[Test build #105640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105640/testReport)*

[GitHub] [spark] AmplabJenkins removed a comment on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24653: [SPARK-27783][SQL] Add customizable hint error handler URL: https://github.com/apache/spark/pull/24653#issuecomment-494605152 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494607489 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494607485 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494607489 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494607485 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494607827 **[Test build #105646 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494608130 Merged build finished. Test FAILed. ---

[GitHub] [spark] SparkQA removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494583034 **[Test build #105644 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105644/testReport)** f

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494608123 **[Test build #105646 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494608134 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
SparkQA commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494607968 **[Test build #105644 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105644/testReport)** for PR 2

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494608130 Merged build finished. Test FAILed. ---

[GitHub] [spark] SparkQA removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494607827 **[Test build #105646 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] [spark] AmplabJenkins commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494608319 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] AmplabJenkins commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494608326 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494608326 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494608134 Test FAILed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24664: [SPARK-27794][R][DOCS] Use https URL for CRAN repo URL: https://github.com/apache/spark/pull/24664#issuecomment-494608319 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] dvogelbacher commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
dvogelbacher commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494608872 of course, I addressed the comments @BryanCutler -

[GitHub] [spark] SparkQA commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
SparkQA commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494609115 **[Test build #105647 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] AmplabJenkins commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494610021 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494610026 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494610026 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins removed a comment on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494610021 Merged build finished. Test PASSed. --

[GitHub] [spark] melin commented on issue #24632: [SPARK-27755][BUILD] Update zstd-jni to 1.4.0-1

2019-05-21 Thread GitBox
melin commented on issue #24632: [SPARK-27755][BUILD] Update zstd-jni to 1.4.0-1 URL: https://github.com/apache/spark/pull/24632#issuecomment-494610239 ![image](https://user-images.githubusercontent.com/1145830/58139649-3d684080-7c6e-11e9-9b59-9054638f7bdb.png)

<    3   4   5   6   7   8   9   10   11   >