[GitHub] maropu commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-17 Thread GitBox
maropu commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-455161097 I filed a jira: https://issues.apache.org/jira/browse/SPARK-26644 Since we don't have so many metrics now, IMO we can document them in a s

[GitHub] SparkQA commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
SparkQA commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455161493 **[Test build #101363 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101363/testRe

[GitHub] AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455161752 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455161748 Merged build finished. Test FAILed. This is a

[GitHub] SparkQA removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455111648 **[Test build #101363 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101363

[GitHub] AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455161748 Merged build finished. Test FAILed. T

[GitHub] purijatin commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel

2019-01-17 Thread GitBox
purijatin commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel URL: https://github.com/apache/spark/pull/23549#issuecomment-455162286 Sure. Thanks for the long message. Will revert the changes shortly. And I did learn a few things :). PS: One tiny

[GitHub] AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455161752 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] SparkQA commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-17 Thread GitBox
SparkQA commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories. URL: https://github.com/apache/spark/pull/23550#issuecomment-455162744 **[Test build #101360 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] SparkQA removed a comment on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories. URL: https://github.com/apache/spark/pull/23550#issuecomment-455083795 **[Test build #101360 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] AmplabJenkins commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories. URL: https://github.com/apache/spark/pull/23550#issuecomment-455163339 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories. URL: https://github.com/apache/spark/pull/23550#issuecomment-455163342 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] AmplabJenkins removed a comment on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories. URL: https://github.com/apache/spark/pull/23550#issuecomment-455163339 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins removed a comment on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories. URL: https://github.com/apache/spark/pull/23550#issuecomment-455163342 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] HyukjinKwon commented on a change in pull request #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
HyukjinKwon commented on a change in pull request #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#discussion_r248660227 ## File path: mllib/src/main/scala/org/apache/spark/ml/Pipeline.scala ## @@ -197,10 +20

[GitHub] HyukjinKwon commented on a change in pull request #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
HyukjinKwon commented on a change in pull request #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#discussion_r248663006 ## File path: mllib/src/main/scala/org/apache/spark/ml/Pipeline.scala ## @@ -197,10 +20

[GitHub] ipwright commented on issue #23567: [MINOR][BUILD] ensure call to translate_component has correct number of arguments

2019-01-17 Thread GitBox
ipwright commented on issue #23567: [MINOR][BUILD] ensure call to translate_component has correct number of arguments URL: https://github.com/apache/spark/pull/23567#issuecomment-455169011 Thanks @srowen, and thanks for fixing those issues. If you have the time, could you point me to

[GitHub] AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455170387 Merged build finished. Test PASSed. This is an automate

[GitHub] SparkQA commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
SparkQA commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455170528 **[Test build #101371 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101371/testReport)** fo

[GitHub] AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455170393 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455170393 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455170387 Merged build finished. Test PASSed. This is an

[GitHub] jerryshao commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S.

2019-01-17 Thread GitBox
jerryshao commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S. URL: https://github.com/apache/spark/pull/23573#issuecomment-455171389 ok to test. This is an automated mess

[GitHub] AmplabJenkins removed a comment on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S.

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S. URL: https://github.com/apache/spark/pull/23573#issuecomment-455117704 Can one of the admins verify this patch? -

[GitHub] SparkQA commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S.

2019-01-17 Thread GitBox
SparkQA commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S. URL: https://github.com/apache/spark/pull/23573#issuecomment-455172263 **[Test build #101372 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] SparkQA commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
SparkQA commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455172261 **[Test build #101373 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101373/testReport)** fo

[GitHub] HyukjinKwon commented on a change in pull request #23571: [SPARK-26640][CORE][ML][SQL][STREAMING][PYSPARK] Code cleanup from lgtm.com analysis

2019-01-17 Thread GitBox
HyukjinKwon commented on a change in pull request #23571: [SPARK-26640][CORE][ML][SQL][STREAMING][PYSPARK] Code cleanup from lgtm.com analysis URL: https://github.com/apache/spark/pull/23571#discussion_r248670883 ## File path: python/pyspark/mllib/classification.py ## @@

[GitHub] HyukjinKwon commented on a change in pull request #23571: [SPARK-26640][CORE][ML][SQL][STREAMING][PYSPARK] Code cleanup from lgtm.com analysis

2019-01-17 Thread GitBox
HyukjinKwon commented on a change in pull request #23571: [SPARK-26640][CORE][ML][SQL][STREAMING][PYSPARK] Code cleanup from lgtm.com analysis URL: https://github.com/apache/spark/pull/23571#discussion_r248670883 ## File path: python/pyspark/mllib/classification.py ## @@

[GitHub] AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455174240 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455174240 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455174235 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455174235 Merged build finished. Test PASSed. This is an automate

[GitHub] SparkQA commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S.

2019-01-17 Thread GitBox
SparkQA commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S. URL: https://github.com/apache/spark/pull/23573#issuecomment-455175014 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-

[GitHub] purijatin commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel

2019-01-17 Thread GitBox
purijatin commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel URL: https://github.com/apache/spark/pull/23549#issuecomment-455178128 @srowen I have reverted the changes. Thanks. This is an a

[GitHub] SparkQA commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S.

2019-01-17 Thread GitBox
SparkQA commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S. URL: https://github.com/apache/spark/pull/23573#issuecomment-455178691 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8

[GitHub] AmplabJenkins commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S.

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S. URL: https://github.com/apache/spark/pull/23573#issuecomment-455178707 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins removed a comment on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S.

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S. URL: https://github.com/apache/spark/pull/23573#issuecomment-455178712 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S.

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S. URL: https://github.com/apache/spark/pull/23573#issuecomment-455178712 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] AmplabJenkins removed a comment on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S.

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23573: [SPARK-26642][K8S] Add --num-executors option to spark-submit for Spark on K8S. URL: https://github.com/apache/spark/pull/23573#issuecomment-455178707 Merged build finished. Test PASSed. --

[GitHub] srowen commented on issue #23567: [MINOR][BUILD] ensure call to translate_component has correct number of arguments

2019-01-17 Thread GitBox
srowen commented on issue #23567: [MINOR][BUILD] ensure call to translate_component has correct number of arguments URL: https://github.com/apache/spark/pull/23567#issuecomment-455182949 @ipwright as an example, in https://lgtm.com/projects/g/apache/spark/snapshot/eabef9f5294181257dc2d5bc3

[GitHub] SparkQA commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
SparkQA commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455184204 **[Test build #101369 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101369/testRep

[GitHub] AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455184433 Merged build finished. Test FAILed. This is an

[GitHub] AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455184438 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455184433 Merged build finished. Test FAILed. Th

[GitHub] SparkQA removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455158371 **[Test build #101369 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101369/

[GitHub] AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455184438 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] SparkQA commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
SparkQA commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455192622 **[Test build #101371 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101371/testReport)** f

[GitHub] SparkQA removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455170528 **[Test build #101371 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101371/testRepor

[GitHub] AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455192981 Merged build finished. Test PASSed. This is an automate

[GitHub] AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455192987 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455192981 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455192987 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] SparkQA commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
SparkQA commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455194715 **[Test build #101373 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101373/testReport)** f

[GitHub] SparkQA removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455172261 **[Test build #101373 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101373/testRepor

[GitHub] AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455195068 Merged build finished. Test PASSed. This is an automate

[GitHub] AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455195073 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455195068 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23263: [SPARK-23674][ML] Adds Spark ML Events to Instrumentation URL: https://github.com/apache/spark/pull/23263#issuecomment-455195073 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] mgaido91 opened a new pull request #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
mgaido91 opened a new pull request #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575 ## What changes were proposed in this pull request? When parsing datatypes from the json internal representation

[GitHub] mgaido91 commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
mgaido91 commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455196872 cc @BryanCutler @HyukjinKwon This is

[GitHub] AmplabJenkins commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455198012 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455198019 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] SparkQA commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
SparkQA commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455198404 **[Test build #101374 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] AmplabJenkins removed a comment on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455198019 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455198012 Merged build finished. Test PASSed. -

[GitHub] SparkQA commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
SparkQA commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455199689 **[Test build #101366 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101366/testRe

[GitHub] AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455200033 Merged build finished. Test FAILed. This is a

[GitHub] SparkQA removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455145513 **[Test build #101366 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101366

[GitHub] AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455200050 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455200033 Merged build finished. Test FAILed. T

[GitHub] AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455200050 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] pgandhi999 commented on issue #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched

2019-01-17 Thread GitBox
pgandhi999 commented on issue #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched URL: https://github.com/apache/spark/pull/22806#issuecomment-455203730 Retest this please

[GitHub] SparkQA commented on issue #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched

2019-01-17 Thread GitBox
SparkQA commented on issue #22806: [SPARK-25250][CORE] : Late zombie task completions handled correctly even before new taskset launched URL: https://github.com/apache/spark/pull/22806#issuecomment-455205273 **[Test build #101375 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spar

[GitHub] SparkQA commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
SparkQA commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455205944 **[Test build #101367 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101367/testRe

[GitHub] AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455206277 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] SparkQA removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455152031 **[Test build #101367 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101367

[GitHub] AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455206262 Merged build finished. Test FAILed. This is a

[GitHub] AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455206262 Merged build finished. Test FAILed. T

[GitHub] AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#issuecomment-455206277 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] SparkQA commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
SparkQA commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455208507 **[Test build #101374 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] AmplabJenkins removed a comment on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455208868 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455208861 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455208861 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455208868 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] SparkQA removed a comment on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23575: [SPARK-26645][PYTHON] Support decimals with negative scale when parsing datatype URL: https://github.com/apache/spark/pull/23575#issuecomment-455198404 **[Test build #101374 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] SparkQA commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-01-17 Thread GitBox
SparkQA commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-455210914 **[Test build #101364 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] SparkQA removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-455140914 **[Test build #101364 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-455211641 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-455211654 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-455211654 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-455211641 Merged build finished. Test PASSed. --

[GitHub] cloud-fan commented on a change in pull request #23383: [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path

2019-01-17 Thread GitBox
cloud-fan commented on a change in pull request #23383: [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path URL: https://github.com/apache/spark/pull/23383#discussion_r248717465 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasource

[GitHub] cloud-fan commented on issue #23383: [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path

2019-01-17 Thread GitBox
cloud-fan commented on issue #23383: [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path URL: https://github.com/apache/spark/pull/23383#issuecomment-455214675 LGTM, merging to master! This is an auto

[GitHub] cloud-fan closed pull request #23383: [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path

2019-01-17 Thread GitBox
cloud-fan closed pull request #23383: [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path URL: https://github.com/apache/spark/pull/23383 This is an automated message from the Apache Git Service. To

[GitHub] gengliangwang commented on a change in pull request #23383: [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path

2019-01-17 Thread GitBox
gengliangwang commented on a change in pull request #23383: [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path URL: https://github.com/apache/spark/pull/23383#discussion_r248721128 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/dataso

[GitHub] HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455230929 retest this please This is a

[GitHub] SparkQA commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
SparkQA commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455232870 **[Test build #101376 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] gengliangwang commented on issue #23383: [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path

2019-01-17 Thread GitBox
gengliangwang commented on issue #23383: [SPARK-23817][SQL] Create file source V2 framework and migrate ORC read path URL: https://github.com/apache/spark/pull/23383#issuecomment-455232738 @cloud-fan @dongjoon-hyun @gatorsmile Thanks for the review. I will come up with the file write path

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455233480 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455233462 Merged build finished. Test PASSed. ---

<    1   2   3   4   5   6   7   >