[GitHub] [spark] AmplabJenkins removed a comment on pull request #28704: [SPARK-31777][ML][PySpark] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637996673 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28704: [SPARK-31777][ML][PySpark] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637996673 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28704: [SPARK-31777][ML][PySpark] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
SparkQA commented on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637996117 **[Test build #123464 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123464/testReport)** for PR 28704 at commit [`9c8658b`](https://github.com

[GitHub] [spark] dongjoon-hyun closed pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
dongjoon-hyun closed pull request #28712: URL: https://github.com/apache/spark/pull/28712 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun closed pull request #28714: [WIP][K8S][TESTS][3.0] K8S IT Health Check

2020-06-02 Thread GitBox
dongjoon-hyun closed pull request #28714: URL: https://github.com/apache/spark/pull/28714 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] cloud-fan closed pull request #28706: [SPARK-31892][SQL] Disable week-based date filed for parsing

2020-06-02 Thread GitBox
cloud-fan closed pull request #28706: URL: https://github.com/apache/spark/pull/28706 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] cloud-fan closed pull request #28674: [SPARK-31868][SQL] Restore the parsing behaviour week-based-year for 2.4

2020-06-02 Thread GitBox
cloud-fan closed pull request #28674: URL: https://github.com/apache/spark/pull/28674 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] cloud-fan commented on pull request #28706: [SPARK-31892][SQL] Disable week-based date filed for parsing

2020-06-02 Thread GitBox
cloud-fan commented on pull request #28706: URL: https://github.com/apache/spark/pull/28706#issuecomment-637994829 thanks, merging to master/3.0! This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [spark] viirya commented on pull request #28704: [SPARK-31777][ML][PySpark] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
viirya commented on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637994040 Python change was added. This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] cloud-fan edited a comment on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-02 Thread GitBox
cloud-fan edited a comment on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-637992953 I think this PR and SPARK-27237 are orthogonal, and we should have both. SPARK-27237 is a bit hard to be merged as it changes the checkpoint. We may need more reviews t

[GitHub] [spark] cloud-fan commented on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-02 Thread GitBox
cloud-fan commented on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-637992953 I think this PR and SPARK-27237 are orthogonal, and we should have both. SPARK-27237 is a bit hard to be merged as it changes the checkpoint. We may need more reviews to see i

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28706: [SPARK-31892][SQL] Disable week-based date filed for parsing

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28706: URL: https://github.com/apache/spark/pull/28706#issuecomment-637992239 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-02 Thread GitBox
cloud-fan commented on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-637991937 @skambha it doesn't fix the issue, it gives a better error message when we hit the issue. This is an automat

[GitHub] [spark] AmplabJenkins commented on pull request #28706: [SPARK-31892][SQL] Disable week-based date filed for parsing

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28706: URL: https://github.com/apache/spark/pull/28706#issuecomment-637992239 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28706: [SPARK-31892][SQL] Disable week-based date filed for parsing

2020-06-02 Thread GitBox
SparkQA removed a comment on pull request #28706: URL: https://github.com/apache/spark/pull/28706#issuecomment-637908543 **[Test build #123455 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123455/testReport)** for PR 28706 at commit [`419a685`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28704: [SPARK-31777][ML][PySpark] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637990461 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123

[GitHub] [spark] SparkQA commented on pull request #28706: [SPARK-31892][SQL] Disable week-based date filed for parsing

2020-06-02 Thread GitBox
SparkQA commented on pull request #28706: URL: https://github.com/apache/spark/pull/28706#issuecomment-637991213 **[Test build #123455 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123455/testReport)** for PR 28706 at commit [`419a685`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28704: [SPARK-31777][ML][PySpark] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637990448 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28704: [SPARK-31777][ML][PySpark] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
SparkQA removed a comment on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637989205 **[Test build #123463 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123463/testReport)** for PR 28704 at commit [`244befc`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28704: [SPARK-31777][ML][PySpark] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637990448 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28704: [SPARK-31777][ML][PySpark] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
SparkQA commented on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637990434 **[Test build #123463 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123463/testReport)** for PR 28704 at commit [`244befc`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28704: [SPARK-31777][ML] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637989881 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28704: [SPARK-31777][ML] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637989881 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28704: [SPARK-31777][ML] Add user-specified fold column to CrossValidator

2020-06-02 Thread GitBox
SparkQA commented on pull request #28704: URL: https://github.com/apache/spark/pull/28704#issuecomment-637989205 **[Test build #123463 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123463/testReport)** for PR 28704 at commit [`244befc`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28585: [SPARK-31765][WEBUI][test-maven] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637984508 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123

[GitHub] [spark] SparkQA commented on pull request #28585: [SPARK-31765][WEBUI][test-maven] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
SparkQA commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637984475 **[Test build #123462 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123462/testReport)** for PR 28585 at commit [`d950b42`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28585: [SPARK-31765][WEBUI][test-maven] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637984501 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28585: [SPARK-31765][WEBUI][test-maven] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637984501 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28585: [SPARK-31765][WEBUI][test-maven] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
SparkQA removed a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637962309 **[Test build #123462 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123462/testReport)** for PR 28585 at commit [`d950b42`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637983201 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637983201 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637983182 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28081/ ---

[GitHub] [spark] yaooqinn commented on pull request #27943: [SPARK-31179] Fast fail the connection while last connection failed in fast fail time window

2020-06-02 Thread GitBox
yaooqinn commented on pull request #27943: URL: https://github.com/apache/spark/pull/27943#issuecomment-637980383 Thanks for your sharing @tgravescs, These configs you offer give me more ways to optimize such kinds of jobs with heavy shuffle loads.

[GitHub] [spark] yaooqinn commented on pull request #28713: [SPARK-31896][SQL] Handle am-pm timestamp parsing when hour is missing

2020-06-02 Thread GitBox
yaooqinn commented on pull request #28713: URL: https://github.com/apache/spark/pull/28713#issuecomment-637977012 cc @cloud-fan @maropu @MaxGekk thanks This is an automated message from the Apache Git Service. To respond to t

[GitHub] [spark] cloud-fan closed pull request #28692: [SPARK-31879][SQL] Using GB as default Locale for datetime formatters

2020-06-02 Thread GitBox
cloud-fan closed pull request #28692: URL: https://github.com/apache/spark/pull/28692 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] cloud-fan commented on pull request #28692: [SPARK-31879][SQL] Using GB as default Locale for datetime formatters

2020-06-02 Thread GitBox
cloud-fan commented on pull request #28692: URL: https://github.com/apache/spark/pull/28692#issuecomment-637975864 @yaooqinn please also create a PR to explain what gets changed in the meaning of `u` in the migration guide. I'm merging this PR to master/3.0 first, thanks! ---

[GitHub] [spark] SparkQA commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637975182 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28081/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637964568 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
SparkQA removed a comment on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637959974 **[Test build #123461 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123461/testReport)** for PR 28712 at commit [`ee7b56d`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637964568 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637964463 **[Test build #123461 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123461/testReport)** for PR 28712 at commit [`ee7b56d`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28585: [SPARK-31765][WEBUI][test-maven] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637962754 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28585: [SPARK-31765][WEBUI][test-maven] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637962754 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28585: [SPARK-31765][WEBUI][test-maven] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
SparkQA commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637962309 **[Test build #123462 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123462/testReport)** for PR 28585 at commit [`d950b42`](https://github.com

[GitHub] [spark] sarutak opened a new pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
sarutak opened a new pull request #28585: URL: https://github.com/apache/spark/pull/28585 ### What changes were proposed in this pull request? This PR upgrades HtmlUnit. Selenium and Jetty also upgraded because of dependency. ### Why are the changes needed? Recently, a se

[GitHub] [spark] dongjoon-hyun commented on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
dongjoon-hyun commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637961404 Thanks, @sarutak . This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [spark] sarutak edited a comment on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
sarutak edited a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637960955 Thanks @dongjoon-hyun , @HyukjinKwon . I don't know why sbt passes the tests but I'll investigate it the reason anyway. --

[GitHub] [spark] sarutak edited a comment on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
sarutak edited a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637960955 Thanks @dongjoon-hyun , @HyukjinKwon . I don't know why sbt passes the tests but I'll investigate the reason anyway. --

[GitHub] [spark] sarutak commented on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
sarutak commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637960955 Thanks @dongjoon-hyun , @HyukjinKwon . I don't know why sbt pass the tests but I'll investigate it the reason anyway. ---

[GitHub] [spark] dongjoon-hyun commented on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
dongjoon-hyun commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637958875 +1 for that. Thanks! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon commented on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
HyukjinKwon commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637958862 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] SparkQA commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637959974 **[Test build #123461 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123461/testReport)** for PR 28712 at commit [`ee7b56d`](https://github.com

[GitHub] [spark] dongjoon-hyun commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
dongjoon-hyun commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637959237 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] HyukjinKwon commented on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
HyukjinKwon commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637958205 Let's revert for now since it broke the tests. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28715: [SPARK-31897][SQL]Enable codegen for GenerateExec

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28715: URL: https://github.com/apache/spark/pull/28715#issuecomment-637957469 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] karuppayya commented on pull request #28715: [SPARK-31897][SQL]Enable codegen for GenerateExec

2020-06-02 Thread GitBox
karuppayya commented on pull request #28715: URL: https://github.com/apache/spark/pull/28715#issuecomment-637958350 @rxin The codegen was disabled in https://github.com/apache/spark/commit/b5c5bd98ea5e8dbfebcf86c5459bdf765f5ceb53. If you happen to remember the scenario for workload breakin

[GitHub] [spark] AmplabJenkins commented on pull request #28715: [SPARK-31897][SQL]Enable codegen for GenerateExec

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28715: URL: https://github.com/apache/spark/pull/28715#issuecomment-637957851 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] AmplabJenkins commented on pull request #28714: [WIP][K8S][TESTS][3.0] K8S IT Health Check

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28714: URL: https://github.com/apache/spark/pull/28714#issuecomment-637957357 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28715: [SPARK-31897][SQL]Enable codegen for GenerateExec

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28715: URL: https://github.com/apache/spark/pull/28715#issuecomment-637957469 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28714: [WIP][K8S][TESTS][3.0] K8S IT Health Check

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28714: URL: https://github.com/apache/spark/pull/28714#issuecomment-637957357 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28714: [WIP][K8S][TESTS][3.0] K8S IT Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28714: URL: https://github.com/apache/spark/pull/28714#issuecomment-637957332 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28079/ ---

[GitHub] [spark] karuppayya opened a new pull request #28715: [SPARK-31897][SQL]Enable codegen for GenerateExec

2020-06-02 Thread GitBox
karuppayya opened a new pull request #28715: URL: https://github.com/apache/spark/pull/28715 ### What changes were proposed in this pull request? Enabling codegen for GenerateExec ### Why are the changes needed? To leverage code geneartion for Generators ### Does this

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
dongjoon-hyun edited a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637953772 Hi, All. This seems to break all Maven tests. Could you take a look at them? The followings are the first failure after merging this PR. - https://amplab.cs.b

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
dongjoon-hyun edited a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637953772 Hi, All. This seems to break all Maven test. Could you take a look at them? The followings are the first failure after merging this PR. - https://amplab.cs.be

[GitHub] [spark] dongjoon-hyun commented on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-06-02 Thread GitBox
dongjoon-hyun commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-637953772 Hi, All. This seems to break all Maven test. Could you take a look at them? This is an automated me

[GitHub] [spark] cloud-fan commented on a change in pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-02 Thread GitBox
cloud-fan commented on a change in pull request #28593: URL: https://github.com/apache/spark/pull/28593#discussion_r434306487 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DateFunctionsSuite.scala ## @@ -32,9 +34,17 @@ import org.apache.spark.sql.test.SharedSparkSe

[GitHub] [spark] cloud-fan commented on a change in pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-02 Thread GitBox
cloud-fan commented on a change in pull request #28593: URL: https://github.com/apache/spark/pull/28593#discussion_r434305851 ## File path: python/pyspark/sql/tests/test_dataframe.py ## @@ -632,7 +633,8 @@ def test_to_pandas_from_null_dataframe(self): @unittest.skipIf(no

[GitHub] [spark] cloud-fan commented on a change in pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-02 Thread GitBox
cloud-fan commented on a change in pull request #28593: URL: https://github.com/apache/spark/pull/28593#discussion_r434305501 ## File path: python/pyspark/sql/tests/test_dataframe.py ## @@ -604,7 +604,8 @@ def test_to_pandas_from_empty_dataframe(self): @unittest.skipIf(n

[GitHub] [spark] cloud-fan commented on a change in pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-02 Thread GitBox
cloud-fan commented on a change in pull request #28593: URL: https://github.com/apache/spark/pull/28593#discussion_r434305260 ## File path: python/pyspark/sql/dataframe.py ## @@ -521,7 +521,7 @@ def withWatermark(self, eventTime, delayThreshold): .. note:: Evolving

[GitHub] [spark] cloud-fan commented on a change in pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-02 Thread GitBox
cloud-fan commented on a change in pull request #28593: URL: https://github.com/apache/spark/pull/28593#discussion_r434305068 ## File path: docs/sql-migration-guide.md ## @@ -27,7 +27,9 @@ license: | - In Spark 3.1, grouping_id() returns long values. In Spark version 3.0 and

[GitHub] [spark] SparkQA commented on pull request #28714: [WIP][K8S][TESTS][3.0] K8S IT Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28714: URL: https://github.com/apache/spark/pull/28714#issuecomment-637948723 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28079/ -

[GitHub] [spark] cloud-fan commented on a change in pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-02 Thread GitBox
cloud-fan commented on a change in pull request #28593: URL: https://github.com/apache/spark/pull/28593#discussion_r434303578 ## File path: docs/sql-migration-guide.md ## @@ -27,7 +27,9 @@ license: | - In Spark 3.1, grouping_id() returns long values. In Spark version 3.0 and

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637947144 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637947140 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637947134 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28078/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637947140 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637945852 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28078/ -

[GitHub] [spark] SparkQA removed a comment on pull request #28714: [WIP][K8S][TESTS][3.0] K8S IT Health Check

2020-06-02 Thread GitBox
SparkQA removed a comment on pull request #28714: URL: https://github.com/apache/spark/pull/28714#issuecomment-637938800 **[Test build #123459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123459/testReport)** for PR 28714 at commit [`2ab8d3b`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28714: [WIP][K8S][TESTS][3.0] K8S IT Health Check

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28714: URL: https://github.com/apache/spark/pull/28714#issuecomment-637942241 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28714: [WIP][K8S][TESTS][3.0] K8S IT Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28714: URL: https://github.com/apache/spark/pull/28714#issuecomment-637942155 **[Test build #123459 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123459/testReport)** for PR 28714 at commit [`2ab8d3b`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28714: [WIP][K8S][TESTS][3.0] K8S IT Health Check

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28714: URL: https://github.com/apache/spark/pull/28714#issuecomment-637942241 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637940899 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637940814 **[Test build #123458 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123458/testReport)** for PR 28712 at commit [`ee7b56d`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
SparkQA removed a comment on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637937134 **[Test build #123458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123458/testReport)** for PR 28712 at commit [`ee7b56d`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637940899 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28713: [SPARK-31896][SQL] Handle am-pm timestamp parsing when hour is missing

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28713: URL: https://github.com/apache/spark/pull/28713#issuecomment-637939101 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28713: [SPARK-31896][SQL] Handle am-pm timestamp parsing when hour is missing

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28713: URL: https://github.com/apache/spark/pull/28713#issuecomment-637939101 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28713: [SPARK-31896][SQL] Handle am-pm timestamp parsing when hour is missing

2020-06-02 Thread GitBox
SparkQA commented on pull request #28713: URL: https://github.com/apache/spark/pull/28713#issuecomment-637938747 **[Test build #123460 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123460/testReport)** for PR 28713 at commit [`81eb751`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28714: [WIP][K8S][TESTS][3.0] K8S IT Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28714: URL: https://github.com/apache/spark/pull/28714#issuecomment-637938800 **[Test build #123459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123459/testReport)** for PR 28714 at commit [`2ab8d3b`](https://github.com

[GitHub] [spark] dongjoon-hyun opened a new pull request #28714: [K8S][TESTS][3.0] K8S IT Health Check

2020-06-02 Thread GitBox
dongjoon-hyun opened a new pull request #28714: URL: https://github.com/apache/spark/pull/28714 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### H

[GitHub] [spark] HeartSaVioR edited a comment on pull request #27627: [SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by returning null on decimal overflow

2020-06-02 Thread GitBox
HeartSaVioR edited a comment on pull request #27627: URL: https://github.com/apache/spark/pull/27627#issuecomment-637937197 Actually, Spark 3.0.0 is the better place to land if we only concern about backward compatibility, but even for the major version update we also don't want to scare e

[GitHub] [spark] yaooqinn opened a new pull request #28713: [SPARK-31896][SQL] Handle am-pm timestamp parsing when hour is missing

2020-06-02 Thread GitBox
yaooqinn opened a new pull request #28713: URL: https://github.com/apache/spark/pull/28713 ### What changes were proposed in this pull request? This PR set the hour to 12/0 when the AMPM_OF_DAY field exists ### Why are the changes needed? When the hour is abs

[GitHub] [spark] HeartSaVioR edited a comment on pull request #27627: [SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by returning null on decimal overflow

2020-06-02 Thread GitBox
HeartSaVioR edited a comment on pull request #27627: URL: https://github.com/apache/spark/pull/27627#issuecomment-637937197 Actually, Spark 3.0.0 is the better place to land if we only concern about backward compatibility, but even for the major version update we also don't want to scare e

[GitHub] [spark] HeartSaVioR commented on pull request #27627: [SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by returning null on decimal overflow

2020-06-02 Thread GitBox
HeartSaVioR commented on pull request #27627: URL: https://github.com/apache/spark/pull/27627#issuecomment-637937197 Actually, Spark 3.0.0 is the better place to land if we only concern about backward compatibility, but even for the major version update we also don't want to scare end user

[GitHub] [spark] SparkQA commented on pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
SparkQA commented on pull request #28712: URL: https://github.com/apache/spark/pull/28712#issuecomment-637937134 **[Test build #123458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123458/testReport)** for PR 28712 at commit [`ee7b56d`](https://github.com

[GitHub] [spark] dongjoon-hyun opened a new pull request #28712: [WIP][K8S][TESTS] Health Check

2020-06-02 Thread GitBox
dongjoon-hyun opened a new pull request #28712: URL: https://github.com/apache/spark/pull/28712 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### H

[GitHub] [spark] maropu commented on pull request #28711: [SPARK-31895][PYTHON][SQL] Support DataFrame.explain(extended: str) case to be consistent with Scala side

2020-06-02 Thread GitBox
maropu commented on pull request #28711: URL: https://github.com/apache/spark/pull/28711#issuecomment-637930643 hahaha, I see. This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-02 Thread GitBox
AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-637929460 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-02 Thread GitBox
AmplabJenkins commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-637929460 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-02 Thread GitBox
SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-637928830 **[Test build #123452 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123452/testReport)** for PR 28708 at commit [`7fb4356`](https://github.co

  1   2   3   4   5   6   >