[GitHub] [spark] vanzin commented on a change in pull request #23951: [SPARK-27038][CORE][YARN] Re-implement RackResolver to reduce resolving time

2019-03-07 Thread GitBox
vanzin commented on a change in pull request #23951: [SPARK-27038][CORE][YARN] Re-implement RackResolver to reduce resolving time URL: https://github.com/apache/spark/pull/23951#discussion_r263582038 ## File path: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470705868 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470705860 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470705860 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470705868 Test FAILed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] vanzin commented on a change in pull request #23951: [SPARK-27038][CORE][YARN] Re-implement RackResolver to reduce resolving time

2019-03-07 Thread GitBox
vanzin commented on a change in pull request #23951: [SPARK-27038][CORE][YARN] Re-implement RackResolver to reduce resolving time URL: https://github.com/apache/spark/pull/23951#discussion_r263580128 ## File path: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/S

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470705610 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/je

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470704700 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] srowen commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor

2019-03-07 Thread GitBox
srowen commented on issue #24004: [SPARK-27084][SQL] Add function alias for bitand/bitnot/bitor/bitxor URL: https://github.com/apache/spark/pull/24004#issuecomment-470704481 Are those standard SQL or Oracle/Teradata variants? they're kind of niche in any event. Is there a common use case f

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470700852 **[Test build #103170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] vanzin commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
vanzin commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470700148 looks good pending tests This is an au

[GitHub] [spark] vanzin commented on issue #24011: [SPARK-27071][CORE] Expose additional metrics in status.api.v1.StageData

2019-03-07 Thread GitBox
vanzin commented on issue #24011: [SPARK-27071][CORE] Expose additional metrics in status.api.v1.StageData URL: https://github.com/apache/spark/pull/24011#issuecomment-470699082 @attilapiros I don't see any change that would affect the event log at all here? (Haven't looked at every

[GitHub] [spark] AmplabJenkins removed a comment on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014#issuecomment-470697436 Can one of the admins verify this patch? --

[GitHub] [spark] holdenk commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
holdenk commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470698359 Jenkins retest this please.

[GitHub] [spark] SparkQA commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

2019-03-07 Thread GitBox
SparkQA commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014#issuecomment-470698242 **[Test build #103169 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPu

[GitHub] [spark] AmplabJenkins removed a comment on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014#issuecomment-470697173 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014#issuecomment-470697436 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014#issuecomment-470697173 Can one of the admins verify this patch? --

[GitHub] [spark] dilipbiswal commented on issue #23982: [SQL][MINOR] Reconcile the join types between data frame and sql interface

2019-03-07 Thread GitBox
dilipbiswal commented on issue #23982: [SQL][MINOR] Reconcile the join types between data frame and sql interface URL: https://github.com/apache/spark/pull/23982#issuecomment-470696960 @dongjoon-hyun Yeah :-) I got confused too at first. Upon double checking, i saw that @maropu was respond

[GitHub] [spark] HeartSaVioR opened a new pull request #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder

2019-03-07 Thread GitBox
HeartSaVioR opened a new pull request #24014: [SPARK-27092][SQL] Apply refactored pattern in ScalaReflection and JavaTypeInference to RowEncoder URL: https://github.com/apache/spark/pull/24014 ## What changes were proposed in this pull request? This patch proposes similar refactor we

[GitHub] [spark] holdenk commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
holdenk commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470695632 SparkR failure seems likely unrelated. Jenkins retest this please. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470693959 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470693959 Test FAILed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470693937 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470693937 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470693857 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/je

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470692983 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] SparkQA commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
SparkQA commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470692821 **[Test build #103168 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] AmplabJenkins removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470692135 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #22830: [SPARK-25838][ML] Remove formatVersion from Saveable

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #22830: [SPARK-25838][ML] Remove formatVersion from Saveable URL: https://github.com/apache/spark/pull/22830#issuecomment-470692138 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] AmplabJenkins removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470692139 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins removed a comment on issue #22830: [SPARK-25838][ML] Remove formatVersion from Saveable

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #22830: [SPARK-25838][ML] Remove formatVersion from Saveable URL: https://github.com/apache/spark/pull/22830#issuecomment-470692146 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] AmplabJenkins commented on issue #22830: [SPARK-25838][ML] Remove formatVersion from Saveable

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #22830: [SPARK-25838][ML] Remove formatVersion from Saveable URL: https://github.com/apache/spark/pull/22830#issuecomment-470692146 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] [spark] AmplabJenkins commented on issue #22830: [SPARK-25838][ML] Remove formatVersion from Saveable

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #22830: [SPARK-25838][ML] Remove formatVersion from Saveable URL: https://github.com/apache/spark/pull/22830#issuecomment-470692138 Merged build finished. Test PASSed. This is an automated mes

[GitHub] [spark] AmplabJenkins commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470692135 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470692139 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] holdenk commented on a change in pull request #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

2019-03-07 Thread GitBox
holdenk commented on a change in pull request #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#discussion_r263564514 ## File path: resource-managers/kubernetes/integration-tests/scripts/setup

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470691003 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470690966 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470690987 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470690987 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470691003 Test FAILed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470687632 Can one of the admins verify this patch? --

[GitHub] [spark] vanzin commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
vanzin commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470690453 ok to test This is an automated messag

[GitHub] [spark] vanzin closed pull request #23994: [SPARK-27075] Remove duplicate execution tag parameters from the url, when accessing the execution table in the SQL page

2019-03-07 Thread GitBox
vanzin closed pull request #23994: [SPARK-27075] Remove duplicate execution tag parameters from the url, when accessing the execution table in the SQL page URL: https://github.com/apache/spark/pull/23994 This is an automated

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470690329 **[Test build #103167 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] SparkQA commented on issue #22830: [SPARK-25838][ML] Remove formatVersion from Saveable

2019-03-07 Thread GitBox
SparkQA commented on issue #22830: [SPARK-25838][ML] Remove formatVersion from Saveable URL: https://github.com/apache/spark/pull/22830#issuecomment-470690267 **[Test build #103166 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103166/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470690297 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] vanzin commented on issue #23994: [SPARK-27075] Remove duplicate execution tag parameters from the url, when accessing the execution table in the SQL page

2019-03-07 Thread GitBox
vanzin commented on issue #23994: [SPARK-27075] Remove duplicate execution tag parameters from the url, when accessing the execution table in the SQL page URL: https://github.com/apache/spark/pull/23994#issuecomment-470689314 Merging to master. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs URL: https://github.com/apache/spark/pull/23797#issuecomment-470688598 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs URL: https://github.com/apache/spark/pull/23797#issuecomment-470688605 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs URL: https://github.com/apache/spark/pull/23797#issuecomment-470688598 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs URL: https://github.com/apache/spark/pull/23797#issuecomment-470688605 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] abellina removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
abellina removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470687732 I've tested this with a hack in `TransportRequestHandler` to force `ChunkFetchRequest` to get

[GitHub] [spark] SparkQA removed a comment on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs

2019-03-07 Thread GitBox
SparkQA removed a comment on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs URL: https://github.com/apache/spark/pull/23797#issuecomment-470586487 **[Test build #103147 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10314

[GitHub] [spark] SparkQA commented on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs

2019-03-07 Thread GitBox
SparkQA commented on issue #23797: [SPARK-26856][PYSPARK] Python support for from_avro and to_avro APIs URL: https://github.com/apache/spark/pull/23797#issuecomment-470687845 **[Test build #103147 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103147/testR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470686920 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470687632 Can one of the admins verify this patch? ---

[GitHub] [spark] abellina commented on issue #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
abellina commented on issue #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/23521#issuecomment-470687865 https://github.com/apache/spark/pull/24013 This is

[GitHub] [spark] abellina commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
abellina commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470687732 I've tested this with a hack in `TransportRequestHandler` to force `ChunkFetchRequest` to get dropped

[GitHub] [spark] SparkQA commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

2019-03-07 Thread GitBox
SparkQA commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470687712 **[Test build #103165 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103165/testReport)** for PR 23915

[GitHub] [spark] AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470687031 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470687074 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470687070 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470686568 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470687034 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] vanzin commented on a change in pull request #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

2019-03-07 Thread GitBox
vanzin commented on a change in pull request #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#discussion_r263559800 ## File path: resource-managers/kubernetes/integration-tests/scripts/setup-

[GitHub] [spark] SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

2019-03-07 Thread GitBox
SparkQA commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470687008 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/testing

[GitHub] [spark] AmplabJenkins removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470686698 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470687031 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470686559 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470687074 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470687070 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470687034 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenki

[GitHub] [spark] AmplabJenkins commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470686920 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013#issuecomment-470686698 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470686559 Merged build finished. Test FAILed. --

[GitHub] [spark] abellina opened a new pull request #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager

2019-03-07 Thread GitBox
abellina opened a new pull request #24013: [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/24013 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470686568 Test FAILed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470686506 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/je

[GitHub] [spark] srowen commented on issue #24001: [SPARK-27080][SQL]bug fix: mergeWithMetastoreSchema with uniform lower case comparison

2019-03-07 Thread GitBox
srowen commented on issue #24001: [SPARK-27080][SQL]bug fix: mergeWithMetastoreSchema with uniform lower case comparison URL: https://github.com/apache/spark/pull/24001#issuecomment-470686528 Looks plausible, given the map keys are definitely lower-case. This doesn't modify the names that

[GitHub] [spark] AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470685085 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] rdblue commented on a change in pull request #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

2019-03-07 Thread GitBox
rdblue commented on a change in pull request #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#discussion_r263558253 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalog/v2/Catalogs.java ## @@ -0,0 +1,

[GitHub] [spark] SparkQA removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-07 Thread GitBox
SparkQA removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470682446 **[Test build #103160 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103160/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470684951 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470685076 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] SparkQA commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-07 Thread GitBox
SparkQA commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470685045 **[Test build #103160 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103160/testReport)** for PR 2401

[GitHub] [spark] AmplabJenkins commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470685076 Merged build finished. Test FAILed. This is an automated message

[GitHub] [spark] SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-03-07 Thread GitBox
SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-470685039 **[Test build #103163 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103163/testReport

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470685103 **[Test build #103164 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] AmplabJenkins commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470685085 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] SparkQA commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-07 Thread GitBox
SparkQA commented on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470684998 **[Test build #103161 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103161/testReport)** for PR 24012

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470684951 Test FAILed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] SparkQA commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system

2019-03-07 Thread GitBox
SparkQA commented on issue #23915: [SPARK-24252][SQL] Add v2 catalog plugin system URL: https://github.com/apache/spark/pull/23915#issuecomment-470684991 **[Test build #103162 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103162/testReport)** for PR 23915

[GitHub] [spark] AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470684945 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
AmplabJenkins commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470684945 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown

2019-03-07 Thread GitBox
SparkQA commented on issue #19045: [WIP][SPARK-20628][CORE][K8S] Keep track of nodes (/ spot instances) which are going to be shutdown URL: https://github.com/apache/spark/pull/19045#issuecomment-470684920 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470684339 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table

2019-03-07 Thread GitBox
AmplabJenkins removed a comment on issue #24012: [SPARK-26811][SQL] Add capabilities to v2.Table URL: https://github.com/apache/spark/pull/24012#issuecomment-470684327 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests

2019-03-07 Thread GitBox
SparkQA removed a comment on issue #23380: [WIP][SPARK-26343][KUBERNETES] Try to speed up running local k8s integration tests URL: https://github.com/apache/spark/pull/23380#issuecomment-470680036 **[Test build #103159 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

<    1   2   3   4   5   6   7   8   9   10   >