[GitHub] [spark] AmplabJenkins removed a comment on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632524539 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632524539 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28608: [SPARK-31612][SQL][DOCS][FOLLOW-UP] Fix a few issues in SQL ref

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28608: URL: https://github.com/apache/spark/pull/28608#issuecomment-632523790 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28608: [SPARK-31612][SQL][DOCS][FOLLOW-UP] Fix a few issues in SQL ref

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28608: URL: https://github.com/apache/spark/pull/28608#issuecomment-632523790 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632523837 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632462754 **[Test build #122962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122962/testReport)** for PR 28596 at commit [`021c0a5`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632523837 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
SparkQA commented on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632523587 **[Test build #122962 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122962/testReport)** for PR 28596 at commit [`021c0a5`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #28608: [SPARK-31612][SQL][DOCS][FOLLOW-UP] Fix a few issues in SQL ref

2020-05-21 Thread GitBox
SparkQA commented on pull request #28608: URL: https://github.com/apache/spark/pull/28608#issuecomment-632523334 **[Test build #122970 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122970/testReport)** for PR 28608 at commit [`6668a1f`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
SparkQA commented on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632523332 **[Test build #122971 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122971/testReport)** for PR 28607 at commit [`10d8d56`](https://github.com

[GitHub] [spark] TJX2014 commented on a change in pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-21 Thread GitBox
TJX2014 commented on a change in pull request #28534: URL: https://github.com/apache/spark/pull/28534#discussion_r429072668 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -1146,4 +1146,25 @@ class DateExpres

[GitHub] [spark] cloud-fan commented on a change in pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
cloud-fan commented on a change in pull request #28592: URL: https://github.com/apache/spark/pull/28592#discussion_r429071977 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateFormatter.scala ## @@ -33,6 +34,8 @@ sealed trait DateFormatter extend

[GitHub] [spark] huaxingao opened a new pull request #28608: [SPARK-31612][SQL][DOCS][FOLLOW-UP] Fix a few issues in SQL ref

2020-05-21 Thread GitBox
huaxingao opened a new pull request #28608: URL: https://github.com/apache/spark/pull/28608 ### What changes were proposed in this pull request? Fix a few issues in SQL Reference ### Why are the changes needed? To make SQL Reference look better ### Does this PR in

[GitHub] [spark] cloud-fan commented on a change in pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
cloud-fan commented on a change in pull request #28592: URL: https://github.com/apache/spark/pull/28592#discussion_r429071489 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -86,6 +86,33 @@ trait DateTimeFormatte

[GitHub] [spark] cloud-fan commented on a change in pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
cloud-fan commented on a change in pull request #28592: URL: https://github.com/apache/spark/pull/28592#discussion_r429070818 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateFormatter.scala ## @@ -33,6 +34,8 @@ sealed trait DateFormatter extend

[GitHub] [spark] AmplabJenkins commented on pull request #27019: [SPARK-30027][SQL] Support codegen for aggregate filters in HashAggregateExec

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #27019: URL: https://github.com/apache/spark/pull/27019#issuecomment-632517905 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27019: [SPARK-30027][SQL] Support codegen for aggregate filters in HashAggregateExec

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #27019: URL: https://github.com/apache/spark/pull/27019#issuecomment-632517905 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] TJX2014 commented on a change in pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-21 Thread GitBox
TJX2014 commented on a change in pull request #28534: URL: https://github.com/apache/spark/pull/28534#discussion_r429068688 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -1146,4 +1146,25 @@ class DateExpres

[GitHub] [spark] SparkQA removed a comment on pull request #27019: [SPARK-30027][SQL] Support codegen for aggregate filters in HashAggregateExec

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #27019: URL: https://github.com/apache/spark/pull/27019#issuecomment-632421118 **[Test build #122957 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122957/testReport)** for PR 27019 at commit [`b0884dc`](https://gi

[GitHub] [spark] SparkQA commented on pull request #27019: [SPARK-30027][SQL] Support codegen for aggregate filters in HashAggregateExec

2020-05-21 Thread GitBox
SparkQA commented on pull request #27019: URL: https://github.com/apache/spark/pull/27019#issuecomment-632517045 **[Test build #122957 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122957/testReport)** for PR 27019 at commit [`b0884dc`](https://github.co

[GitHub] [spark] jiangxb1987 closed pull request #28579: [SPARK-31757][CORE] Improve HistoryServerDiskManager.updateAccessTime()

2020-05-21 Thread GitBox
jiangxb1987 closed pull request #28579: URL: https://github.com/apache/spark/pull/28579 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on a change in pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-21 Thread GitBox
cloud-fan commented on a change in pull request #28534: URL: https://github.com/apache/spark/pull/28534#discussion_r429067875 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -1146,4 +1146,25 @@ class DateExpr

[GitHub] [spark] jiangxb1987 commented on pull request #28579: [SPARK-31757][CORE] Improve HistoryServerDiskManager.updateAccessTime()

2020-05-21 Thread GitBox
jiangxb1987 commented on pull request #28579: URL: https://github.com/apache/spark/pull/28579#issuecomment-632516801 Thanks, merged to master! This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [spark] cloud-fan commented on a change in pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-21 Thread GitBox
cloud-fan commented on a change in pull request #28534: URL: https://github.com/apache/spark/pull/28534#discussion_r429067648 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -1146,4 +1146,25 @@ class DateExpr

[GitHub] [spark] cloud-fan commented on a change in pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-21 Thread GitBox
cloud-fan commented on a change in pull request #28534: URL: https://github.com/apache/spark/pull/28534#discussion_r429067349 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -1146,4 +1146,25 @@ class DateExpr

[GitHub] [spark] jiangxb1987 commented on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
jiangxb1987 commented on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632515872 Thanks, merged to master/3.0 ! This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [spark] jiangxb1987 closed pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
jiangxb1987 closed pull request #28596: URL: https://github.com/apache/spark/pull/28596 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on a change in pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-21 Thread GitBox
cloud-fan commented on a change in pull request #28534: URL: https://github.com/apache/spark/pull/28534#discussion_r429066959 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -1146,4 +1146,25 @@ class DateExpr

[GitHub] [spark] AmplabJenkins commented on pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28600: URL: https://github.com/apache/spark/pull/28600#issuecomment-632510690 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28600: URL: https://github.com/apache/spark/pull/28600#issuecomment-632510690 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
SparkQA commented on pull request #28600: URL: https://github.com/apache/spark/pull/28600#issuecomment-632510289 **[Test build #122969 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122969/testReport)** for PR 28600 at commit [`b2eea1f`](https://github.com

[GitHub] [spark] viirya commented on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-21 Thread GitBox
viirya commented on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-632510298 cc @cloud-fan This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632508761 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122

[GitHub] [spark] SparkQA removed a comment on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632503711 **[Test build #122967 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122967/testReport)** for PR 28607 at commit [`9cc0443`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632508754 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
SparkQA commented on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632508729 **[Test build #122967 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122967/testReport)** for PR 28607 at commit [`9cc0443`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632508754 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-632507372 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-632507372 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-632417352 **[Test build #122954 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122954/testReport)** for PR 28560 at commit [`b2e56d5`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-21 Thread GitBox
SparkQA commented on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-632506187 **[Test build #122954 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122954/testReport)** for PR 28560 at commit [`b2e56d5`](https://github.co

[GitHub] [spark] cloud-fan commented on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
cloud-fan commented on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632505971 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] HeartSaVioR commented on pull request #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

2020-05-21 Thread GitBox
HeartSaVioR commented on pull request #24936: URL: https://github.com/apache/spark/pull/24936#issuecomment-632505151 I just revived #21617 via #28607 and added some explanation regarding the definition of "input" which was pointed out in reviewing. Given it's pretty much simpler, I'd think

[GitHub] [spark] HeartSaVioR closed pull request #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

2020-05-21 Thread GitBox
HeartSaVioR closed pull request #24936: URL: https://github.com/apache/spark/pull/24936 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632504374 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632504184 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632504374 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632504184 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
SparkQA commented on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632503711 **[Test build #122967 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122967/testReport)** for PR 28607 at commit [`9cc0443`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28534: [SPARK-31710][SQL] Adds TIMESTAMP_SECONDS, TIMESTAMP_MILLIS and TIMESTAMP_MICROS functions

2020-05-21 Thread GitBox
SparkQA commented on pull request #28534: URL: https://github.com/apache/spark/pull/28534#issuecomment-632503725 **[Test build #122968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122968/testReport)** for PR 28534 at commit [`764b1ee`](https://github.com

[GitHub] [spark] HeartSaVioR commented on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
HeartSaVioR commented on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-632503485 I just revive #21617 (instead of pushing forward on #24936) because this approach is straightforward and pretty much simpler compared to #24936, though #24936 provides exact

[GitHub] [spark] HeartSaVioR opened a new pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-21 Thread GitBox
HeartSaVioR opened a new pull request #28607: URL: https://github.com/apache/spark/pull/28607 ### What changes were proposed in this pull request? Please refer https://issues.apache.org/jira/browse/SPARK-24634 to see rationalization of the issue. This patch adds a new metric t

[GitHub] [spark] AmplabJenkins commented on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632498700 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632498700 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632444893 **[Test build #122959 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122959/testReport)** for PR 28596 at commit [`2be2ca7`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
SparkQA commented on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632497810 **[Test build #122959 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122959/testReport)** for PR 28596 at commit [`2be2ca7`](https://github.co

[GitHub] [spark] GuoPhilipse commented on pull request #28605: [SPARK-31790][DOCS] cast(long as timestamp) show different result between Hive and Spark

2020-05-21 Thread GitBox
GuoPhilipse commented on pull request #28605: URL: https://github.com/apache/spark/pull/28605#issuecomment-632494495 :) have corrected and added examples in JIRA This is an automated message from the Apache Git Service. To re

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28556: URL: https://github.com/apache/spark/pull/28556#issuecomment-632492175 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28556: URL: https://github.com/apache/spark/pull/28556#issuecomment-632492175 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

2020-05-21 Thread GitBox
SparkQA commented on pull request #28556: URL: https://github.com/apache/spark/pull/28556#issuecomment-632491833 **[Test build #122966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122966/testReport)** for PR 28556 at commit [`f720bdf`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28604: [SPARK-29854][SQL][TESTS] Add tests to check lpad/rpad throw an exception for invalid length input

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28604: URL: https://github.com/apache/spark/pull/28604#issuecomment-632490453 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28604: [SPARK-29854][SQL][TESTS] Add tests to check lpad/rpad throw an exception for invalid length input

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28604: URL: https://github.com/apache/spark/pull/28604#issuecomment-632490453 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28604: [SPARK-29854][SQL][TESTS] Add tests to check lpad/rpad throw an exception for invalid length input

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28604: URL: https://github.com/apache/spark/pull/28604#issuecomment-632408912 **[Test build #122953 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122953/testReport)** for PR 28604 at commit [`4615923`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28604: [SPARK-29854][SQL][TESTS] Add tests to check lpad/rpad throw an exception for invalid length input

2020-05-21 Thread GitBox
SparkQA commented on pull request #28604: URL: https://github.com/apache/spark/pull/28604#issuecomment-632489847 **[Test build #122953 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122953/testReport)** for PR 28604 at commit [`4615923`](https://github.co

[GitHub] [spark] viirya commented on a change in pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

2020-05-21 Thread GitBox
viirya commented on a change in pull request #28556: URL: https://github.com/apache/spark/pull/28556#discussion_r429048929 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/SchemaPruningSuite.scala ## @@ -338,6 +349,93 @@ abstract class SchemaPru

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28606: [MINOR][YARN]False report isAllNodeBlacklisted when RM is having issue

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28606: URL: https://github.com/apache/spark/pull/28606#issuecomment-632486456 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins commented on pull request #28606: [MINOR][YARN]False report isAllNodeBlacklisted when RM is having issue

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28606: URL: https://github.com/apache/spark/pull/28606#issuecomment-632486820 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] AmplabJenkins commented on pull request #28606: [MINOR][YARN]False report isAllNodeBlacklisted when RM is having issue

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28606: URL: https://github.com/apache/spark/pull/28606#issuecomment-632486456 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] cnZach opened a new pull request #28606: [MINOR][YARN]False report isAllNodeBlacklisted when RM is having issue

2020-05-21 Thread GitBox
cnZach opened a new pull request #28606: URL: https://github.com/apache/spark/pull/28606 ### What changes were proposed in this pull request? Improve the check logic on if all node managers are really being backlisted. ### Why are the changes needed? I observed w

[GitHub] [spark] AmplabJenkins commented on pull request #28604: [SPARK-29854][SQL][TESTS] Add tests to check lpad/rpad throw an exception for invalid length input

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28604: URL: https://github.com/apache/spark/pull/28604#issuecomment-632481978 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28604: [SPARK-29854][SQL][TESTS] Add tests to check lpad/rpad throw an exception for invalid length input

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28604: URL: https://github.com/apache/spark/pull/28604#issuecomment-632481978 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28604: [SPARK-29854][SQL][TESTS] Add tests to check lpad/rpad throw an exception for invalid length input

2020-05-21 Thread GitBox
SparkQA commented on pull request #28604: URL: https://github.com/apache/spark/pull/28604#issuecomment-632481523 **[Test build #122965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122965/testReport)** for PR 28604 at commit [`ea9a527`](https://github.com

[GitHub] [spark] maropu commented on a change in pull request #28604: [SPARK-29854][SQL][TESTS] Add tests to check lpad/rpad throw an exception for invalid length input

2020-05-21 Thread GitBox
maropu commented on a change in pull request #28604: URL: https://github.com/apache/spark/pull/28604#discussion_r429042439 ## File path: sql/core/src/test/resources/sql-tests/inputs/string-functions.sql ## @@ -48,4 +48,8 @@ SELECT trim(LEADING 'xyz' FROM 'zzzytestxyz'); SELECT

[GitHub] [spark] cloud-fan commented on a change in pull request #28604: [SPARK-29854][SQL][TESTS] Add tests to check lpad/rpad throw an exception for invalid length input

2020-05-21 Thread GitBox
cloud-fan commented on a change in pull request #28604: URL: https://github.com/apache/spark/pull/28604#discussion_r429040810 ## File path: sql/core/src/test/resources/sql-tests/inputs/string-functions.sql ## @@ -48,4 +48,8 @@ SELECT trim(LEADING 'xyz' FROM 'zzzytestxyz'); SEL

[GitHub] [spark] cloud-fan commented on a change in pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
cloud-fan commented on a change in pull request #28600: URL: https://github.com/apache/spark/pull/28600#discussion_r429039911 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala ## @@ -423,13 +434,21 @@ case class IntegralDivide

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28601: [SPARK-31786][K8S][BUILD] Upgrade kubernetes-client to 4.9.2

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28601: URL: https://github.com/apache/spark/pull/28601#issuecomment-632474789 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28601: [SPARK-31786][K8S][BUILD] Upgrade kubernetes-client to 4.9.2

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28601: URL: https://github.com/apache/spark/pull/28601#issuecomment-632474789 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28601: [SPARK-31786][K8S][BUILD] Upgrade kubernetes-client to 4.9.2

2020-05-21 Thread GitBox
SparkQA commented on pull request #28601: URL: https://github.com/apache/spark/pull/28601#issuecomment-632474270 **[Test build #122956 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122956/testReport)** for PR 28601 at commit [`4327940`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28601: [SPARK-31786][K8S][BUILD] Upgrade kubernetes-client to 4.9.2

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28601: URL: https://github.com/apache/spark/pull/28601#issuecomment-632421071 **[Test build #122956 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122956/testReport)** for PR 28601 at commit [`4327940`](https://gi

[GitHub] [spark] sandeep-katta commented on a change in pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
sandeep-katta commented on a change in pull request #28600: URL: https://github.com/apache/spark/pull/28600#discussion_r429034719 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala ## @@ -337,11 +340,19 @@ trait DivModLike exte

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
HyukjinKwon commented on a change in pull request #28600: URL: https://github.com/apache/spark/pull/28600#discussion_r429034529 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala ## @@ -337,11 +340,19 @@ trait DivModLike extend

[GitHub] [spark] sandeep-katta commented on a change in pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
sandeep-katta commented on a change in pull request #28600: URL: https://github.com/apache/spark/pull/28600#discussion_r429034382 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala ## @@ -337,11 +340,19 @@ trait DivModLike exte

[GitHub] [spark] sandeep-katta commented on a change in pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
sandeep-katta commented on a change in pull request #28600: URL: https://github.com/apache/spark/pull/28600#discussion_r429033795 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala ## @@ -337,11 +340,19 @@ trait DivModLike exte

[GitHub] [spark] HyukjinKwon commented on pull request #28605: [SPARK-31790][DOCS] Document cast(ts as long) difference between Hive and Spark

2020-05-21 Thread GitBox
HyukjinKwon commented on pull request #28605: URL: https://github.com/apache/spark/pull/28605#issuecomment-632467539 @GuoPhilipse, feel free to fix the PR title and PR description with examples. It's your PR :-) This is an a

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #28601: [SPARK-31786][K8S][BUILD] Upgrade kubernetes-client to 4.9.2

2020-05-21 Thread GitBox
dongjoon-hyun edited a comment on pull request #28601: URL: https://github.com/apache/spark/pull/28601#issuecomment-632467085 `WorkerDecommissionSuite` seems to be a flaky test which is irrelevant to this PR. ``` org.apache.spark.scheduler.WorkerDecommissionSuite.verify a task with al

[GitHub] [spark] dongjoon-hyun commented on pull request #28601: [SPARK-31786][K8S][BUILD] Upgrade kubernetes-client to 4.9.2

2020-05-21 Thread GitBox
dongjoon-hyun commented on pull request #28601: URL: https://github.com/apache/spark/pull/28601#issuecomment-632467085 `WorkerDecommissionSuite` is irrelevant to this PR. ``` org.apache.spark.scheduler.WorkerDecommissionSuite.verify a task with all workers decommissioned succeeds `

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632465011 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] ms-lolo commented on pull request #17455: [Spark-20044][Web UI] Support Spark UI behind front-end reverse proxy using a path prefix

2020-05-21 Thread GitBox
ms-lolo commented on pull request #17455: URL: https://github.com/apache/spark/pull/17455#issuecomment-632465049 So I'm definitely confused by the spark docs everywhere… is this still not possible? I have a single domain with many spark clusters sitting behind it and I would like to reach

[GitHub] [spark] AmplabJenkins commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632465011 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
SparkQA commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632464712 **[Test build #122964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122964/testReport)** for PR 28592 at commit [`8141ef9`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632463076 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632463093 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632463093 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632463076 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
SparkQA commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632462808 **[Test build #122963 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122963/testReport)** for PR 28592 at commit [`052bfad`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28596: [SPARK-31784][CORE][TEST] Fix test BarrierTaskContextSuite."share messages with allGather() call"

2020-05-21 Thread GitBox
SparkQA commented on pull request #28596: URL: https://github.com/apache/spark/pull/28596#issuecomment-632462754 **[Test build #122962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122962/testReport)** for PR 28596 at commit [`021c0a5`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-05-21 Thread GitBox
SparkQA commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-632459220 **[Test build #122961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122961/testReport)** for PR 28363 at commit [`fb4ce2c`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28579: [SPARK-31757][CORE] Improve HistoryServerDiskManager.updateAccessTime()

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28579: URL: https://github.com/apache/spark/pull/28579#issuecomment-632458377 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28579: [SPARK-31757][CORE] Improve HistoryServerDiskManager.updateAccessTime()

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28579: URL: https://github.com/apache/spark/pull/28579#issuecomment-632458377 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-632457402 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

  1   2   3   4   5   6   >