[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-18 Thread GitBox
dongjoon-hyun commented on a change in pull request #28853: URL: https://github.com/apache/spark/pull/28853#discussion_r442529228 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala ## @@ -528,6 +528,18 @@ class FileSo

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28840: [SPARK-31999][SQL] Add refresh function command

2020-06-18 Thread GitBox
dongjoon-hyun commented on a change in pull request #28840: URL: https://github.com/apache/spark/pull/28840#discussion_r442528050 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2SQLSuite.scala ## @@ -2166,7 +2166,7 @@ class DataSourceV2SQLSuite

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28840: [SPARK-31999][SQL] Add refresh function command

2020-06-18 Thread GitBox
dongjoon-hyun commented on a change in pull request #28840: URL: https://github.com/apache/spark/pull/28840#discussion_r442525992 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ## @@ -229,6 +229,7 @@ statement comment=(STRIN

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28840: [SPARK-31999][SQL] Add refresh function command

2020-06-18 Thread GitBox
dongjoon-hyun commented on a change in pull request #28840: URL: https://github.com/apache/spark/pull/28840#discussion_r442524739 ## File path: docs/sql-ref-syntax-aux-refresh-function.md ## @@ -0,0 +1,60 @@ +--- +layout: global +title: REFRESH FUNCTION +displayTitle: REFRESH F

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28840: [SPARK-31999][SQL] Add refresh function command

2020-06-18 Thread GitBox
dongjoon-hyun commented on a change in pull request #28840: URL: https://github.com/apache/spark/pull/28840#discussion_r442524344 ## File path: docs/sql-ref-syntax-aux-refresh-function.md ## @@ -0,0 +1,60 @@ +--- +layout: global +title: REFRESH FUNCTION +displayTitle: REFRESH F

[GitHub] [spark] dongjoon-hyun commented on pull request #28855: [SPARK-31871][CORE][WEBUI][2.3] History page and Executors tab page show the correct sort icons

2020-06-18 Thread GitBox
dongjoon-hyun commented on pull request #28855: URL: https://github.com/apache/spark/pull/28855#issuecomment-646319722 Yes. , @liucht-inspur . Please see `Maintenance Releases and EOL` section of https://spark.apache.org/versioning-policy.html . +1 for @sarutak 's advice (closing this PR

[GitHub] [spark] dongjoon-hyun closed pull request #28862: [MINOR][DOCS] Update running-on-kubernetes.md

2020-06-18 Thread GitBox
dongjoon-hyun closed pull request #28862: URL: https://github.com/apache/spark/pull/28862 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] srowen commented on pull request #28857: [SPARK-32023][Streaming]Generate spark streaming test jar with maven plugin maven-jar-plugin

2020-06-18 Thread GitBox
srowen commented on pull request #28857: URL: https://github.com/apache/spark/pull/28857#issuecomment-646316112 Oh I see. Do you have to remove the shade plugin config though? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646313980 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28863: URL: https://github.com/apache/spark/pull/28863#issuecomment-646314228 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28863: URL: https://github.com/apache/spark/pull/28863#issuecomment-646314228 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
SparkQA commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646313955 **[Test build #124236 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124236/testReport)** for PR 28864 at commit [`0064eb6`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
SparkQA removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646309462 **[Test build #124236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124236/testReport)** for PR 28864 at commit [`0064eb6`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646313975 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646313975 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-18 Thread GitBox
SparkQA removed a comment on pull request #28863: URL: https://github.com/apache/spark/pull/28863#issuecomment-646235703 **[Test build #124231 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124231/testReport)** for PR 28863 at commit [`5cc3d0a`](https://gi

[GitHub] [spark] holdenk commented on a change in pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
holdenk commented on a change in pull request #28864: URL: https://github.com/apache/spark/pull/28864#discussion_r442511282 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -2273,7 +2273,7 @@ private[scheduler] class DAGSchedulerEventProces

[GitHub] [spark] SparkQA commented on pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-18 Thread GitBox
SparkQA commented on pull request #28863: URL: https://github.com/apache/spark/pull/28863#issuecomment-646313232 **[Test build #124231 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124231/testReport)** for PR 28863 at commit [`5cc3d0a`](https://github.co

[GitHub] [spark] holdenk commented on pull request #28818: [WIP][SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

2020-06-18 Thread GitBox
holdenk commented on pull request #28818: URL: https://github.com/apache/spark/pull/28818#issuecomment-646310567 To be clear this a WIP PR and not yet ready for review. I created it to give additional context after talking with @agrawaldevesh about our respective goals. I'll try and get a

[GitHub] [spark] holdenk commented on pull request #28817: [WIP][SPARK-31197][CORE] Exit the executor once all tasks and migrations are finished built on top of on top of spark20629

2020-06-18 Thread GitBox
holdenk commented on pull request #28817: URL: https://github.com/apache/spark/pull/28817#issuecomment-646310432 To be clear this a WIP PR and not yet ready for review. I created it to give additional context after talking with @agrawaldevesh about our respective goals. I'll try and get a

[GitHub] [spark] rxin commented on a change in pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
rxin commented on a change in pull request #28864: URL: https://github.com/apache/spark/pull/28864#discussion_r442507536 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -2273,7 +2273,7 @@ private[scheduler] class DAGSchedulerEventProcessLo

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646309842 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] holdenk commented on a change in pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
holdenk commented on a change in pull request #28864: URL: https://github.com/apache/spark/pull/28864#discussion_r442507074 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -2273,7 +2273,7 @@ private[scheduler] class DAGSchedulerEventProces

[GitHub] [spark] AmplabJenkins commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646309842 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
SparkQA commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646309462 **[Test build #124236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124236/testReport)** for PR 28864 at commit [`0064eb6`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #27617: [SPARK-30865][SQL][SS] Refactor DateTimeUtils

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646306947 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27617: [SPARK-30865][SQL][SS] Refactor DateTimeUtils

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646306947 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #27617: [SPARK-30865][SQL][SS] Refactor DateTimeUtils

2020-06-18 Thread GitBox
SparkQA commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646306268 **[Test build #124235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124235/testReport)** for PR 27617 at commit [`863d747`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28852: URL: https://github.com/apache/spark/pull/28852#issuecomment-646305742 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28852: URL: https://github.com/apache/spark/pull/28852#issuecomment-646305742 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-06-18 Thread GitBox
SparkQA removed a comment on pull request #28852: URL: https://github.com/apache/spark/pull/28852#issuecomment-646152933 **[Test build #124224 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124224/testReport)** for PR 28852 at commit [`f409366`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-06-18 Thread GitBox
SparkQA commented on pull request #28852: URL: https://github.com/apache/spark/pull/28852#issuecomment-646304858 **[Test build #124224 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124224/testReport)** for PR 28852 at commit [`f409366`](https://github.co

[GitHub] [spark] rxin commented on a change in pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
rxin commented on a change in pull request #28864: URL: https://github.com/apache/spark/pull/28864#discussion_r442499267 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -2273,7 +2273,7 @@ private[scheduler] class DAGSchedulerEventProcessLo

[GitHub] [spark] wypoon commented on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

2020-06-18 Thread GitBox
wypoon commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-646302350 @jiangxb1987 @squito can you please review? This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] holdenk commented on a change in pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
holdenk commented on a change in pull request #28864: URL: https://github.com/apache/spark/pull/28864#discussion_r442496068 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -2273,7 +2273,7 @@ private[scheduler] class DAGSchedulerEventProces

[GitHub] [spark] AmplabJenkins commented on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP] Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646291225 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP] Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646291225 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] rxin commented on a change in pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
rxin commented on a change in pull request #28864: URL: https://github.com/apache/spark/pull/28864#discussion_r442486466 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -2273,7 +2273,7 @@ private[scheduler] class DAGSchedulerEventProcessLo

[GitHub] [spark] SparkQA commented on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP] Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-18 Thread GitBox
SparkQA commented on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646290147 **[Test build #124228 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124228/testReport)** for PR 28835 at commit [`e409f9a`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28835: [SPARK-31926][SQL][TESTS][FOLLOWUP] Fix concurrency issue for ThriftCLIService to getPortNumber

2020-06-18 Thread GitBox
SparkQA removed a comment on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-646199933 **[Test build #124228 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124228/testReport)** for PR 28835 at commit [`e409f9a`](https://gi

[GitHub] [spark] dongjoon-hyun commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
dongjoon-hyun commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646278114 Thanks for this kind of effort, @holdenk . This is an automated message from the Apache Git Service. To re

[GitHub] [spark] holdenk commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
holdenk commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646276159 Non-breaking is the goal for now. I can add alternatives and put in a deprecation though for the scripts, thanks for noticing them.

[GitHub] [spark] holdenk commented on a change in pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
holdenk commented on a change in pull request #28864: URL: https://github.com/apache/spark/pull/28864#discussion_r442470535 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -2273,7 +2273,7 @@ private[scheduler] class DAGSchedulerEventProces

[GitHub] [spark] dongjoon-hyun commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
dongjoon-hyun commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646275145 Since this aims to be a non-breaking change, we are not going to rename the following user-facing script. Did I understand correctly? ``` $ ls sbin/*slave* sbin/de

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
dongjoon-hyun edited a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646275145 Since this aims to be a non-breaking change, we are not going to rename the following user-facing scripts. Did I understand correctly? ``` $ ls sbin/*slave*

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-646271764 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-646271764 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

2020-06-18 Thread GitBox
SparkQA removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-646173660 **[Test build #124226 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124226/testReport)** for PR 28848 at commit [`4b18369`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

2020-06-18 Thread GitBox
SparkQA commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-646270339 **[Test build #124226 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124226/testReport)** for PR 28848 at commit [`4b18369`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-646270163 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-646270163 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-18 Thread GitBox
SparkQA removed a comment on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-646185707 **[Test build #124227 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124227/testReport)** for PR 28710 at commit [`ead6da2`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-18 Thread GitBox
SparkQA commented on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-646269317 **[Test build #124227 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124227/testReport)** for PR 28710 at commit [`ead6da2`](https://github.co

[GitHub] [spark] rxin commented on a change in pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
rxin commented on a change in pull request #28864: URL: https://github.com/apache/spark/pull/28864#discussion_r442454741 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -2273,7 +2273,7 @@ private[scheduler] class DAGSchedulerEventProcessLo

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646258298 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] SparkQA removed a comment on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-18 Thread GitBox
SparkQA removed a comment on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646256690 **[Test build #124234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124234/testReport)** for PR 27617 at commit [`025ea80`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646258289 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646258289 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-18 Thread GitBox
SparkQA commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646258277 **[Test build #124234 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124234/testReport)** for PR 27617 at commit [`025ea80`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646257222 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646257222 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-18 Thread GitBox
SparkQA commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-646256690 **[Test build #124234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124234/testReport)** for PR 27617 at commit [`025ea80`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646253276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins removed a comment on pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #23531: URL: https://github.com/apache/spark/pull/23531#issuecomment-646253611 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
SparkQA removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646249714 **[Test build #124232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124232/testReport)** for PR 28864 at commit [`f526e02`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #23531: URL: https://github.com/apache/spark/pull/23531#issuecomment-646253611 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646253263 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
SparkQA commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646253240 **[Test build #124232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124232/testReport)** for PR 28864 at commit [`f526e02`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646253263 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2020-06-18 Thread GitBox
SparkQA commented on pull request #23531: URL: https://github.com/apache/spark/pull/23531#issuecomment-646252989 **[Test build #124233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124233/testReport)** for PR 23531 at commit [`adf120c`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646250270 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646250270 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
SparkQA commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646249714 **[Test build #124232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124232/testReport)** for PR 28864 at commit [`f526e02`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-646248061 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-646248036 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

2020-06-18 Thread GitBox
SparkQA removed a comment on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-646095659 **[Test build #124221 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124221/testReport)** for PR 28645 at commit [`3e97fa5`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-646248036 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

2020-06-18 Thread GitBox
SparkQA commented on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-646247592 **[Test build #124221 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124221/testReport)** for PR 28645 at commit [`3e97fa5`](https://github.co

[GitHub] [spark] holdenk commented on a change in pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
holdenk commented on a change in pull request #28864: URL: https://github.com/apache/spark/pull/28864#discussion_r442434806 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManager.scala ## @@ -226,9 +226,9 @@ private[spark] class BlockManager( private val max

[GitHub] [spark] gaborgsomogyi commented on pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-18 Thread GitBox
gaborgsomogyi commented on pull request #28863: URL: https://github.com/apache/spark/pull/28863#issuecomment-646244722 cc @HeartSaVioR This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [spark] holdenk commented on a change in pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
holdenk commented on a change in pull request #28864: URL: https://github.com/apache/spark/pull/28864#discussion_r442433885 ## File path: core/src/main/scala/org/apache/spark/deploy/JsonProtocol.scala ## @@ -102,8 +102,8 @@ private[deploy] object JsonProtocol { ("name" ->

[GitHub] [spark] dongjoon-hyun commented on pull request #28857: [SPARK-32023][Streaming]Generate spark streaming test jar with maven plugin maven-jar-plugin

2020-06-18 Thread GitBox
dongjoon-hyun commented on pull request #28857: URL: https://github.com/apache/spark/pull/28857#issuecomment-646242041 It seems that he meant `22 bytes`, the size of tests jar. ``` -rw-r--r-- 1 kun.wan staff 22 Jun 18 19:46 spark-streaming_2.12-3.0.0-tests.jar ``` --

[GitHub] [spark] viirya edited a comment on pull request #28846: [SPARK-32012][SQL] Incrementally create and materialize query stage to avoid unnecessary local shuffle

2020-06-18 Thread GitBox
viirya edited a comment on pull request #28846: URL: https://github.com/apache/spark/pull/28846#issuecomment-646241038 Does triggering all stages of a join, mean they are running at the same time actually? I think it means they are put into scheduler. When the stages are put to running dep

[GitHub] [spark] viirya commented on pull request #28846: [SPARK-32012][SQL] Incrementally create and materialize query stage to avoid unnecessary local shuffle

2020-06-18 Thread GitBox
viirya commented on pull request #28846: URL: https://github.com/apache/spark/pull/28846#issuecomment-646241038 Does triggering all stages of a join, mean they are running at the same time actually? I think it means they are put into scheduler. When the stages are put to running depends on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646236738 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646236728 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28863: URL: https://github.com/apache/spark/pull/28863#issuecomment-646236455 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
SparkQA removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646235687 **[Test build #124230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124230/testReport)** for PR 28864 at commit [`a366d38`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646236248 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
SparkQA commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646236718 **[Test build #124230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124230/testReport)** for PR 28864 at commit [`a366d38`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28863: URL: https://github.com/apache/spark/pull/28863#issuecomment-646236455 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646236728 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646236248 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
SparkQA commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646235687 **[Test build #124230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124230/testReport)** for PR 28864 at commit [`a366d38`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-18 Thread GitBox
SparkQA commented on pull request #28863: URL: https://github.com/apache/spark/pull/28863#issuecomment-646235703 **[Test build #124231 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124231/testReport)** for PR 28863 at commit [`5cc3d0a`](https://github.com

[GitHub] [spark] maryannxue commented on pull request #28846: [SPARK-32012][SQL] Incrementally create and materialize query stage to avoid unnecessary local shuffle

2020-06-18 Thread GitBox
maryannxue commented on pull request #28846: URL: https://github.com/apache/spark/pull/28846#issuecomment-646235383 The question is: This means you hold off the other stage, right? Shouldn't it cause any regressions? If this is eventually a SMJ instead of a BHJ, one of the stages will be d

[GitHub] [spark] gaborgsomogyi removed a comment on pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-18 Thread GitBox
gaborgsomogyi removed a comment on pull request #28863: URL: https://github.com/apache/spark/pull/28863#issuecomment-646127287 retest it please This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [spark] gaborgsomogyi commented on pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-18 Thread GitBox
gaborgsomogyi commented on pull request #28863: URL: https://github.com/apache/spark/pull/28863#issuecomment-646235227 retest this please This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
AmplabJenkins removed a comment on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646222380 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] holdenk commented on pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-18 Thread GitBox
holdenk commented on pull request #28864: URL: https://github.com/apache/spark/pull/28864#issuecomment-646233160 Jenkins retest this please This is an automated message from the Apache Git Service. To respond to the message,

<    1   2   3   4   5   6   7   8   >