[spark] branch master updated (05069ff -> d758210)

2021-02-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 05069ff [SPARK-34353][SQL] CollectLimitExec avoid shuffle if input rdd has 0/1 partition add d758210

[spark] branch master updated (56e664c -> 05069ff)

2021-02-26 Thread yamamuro
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 56e664c [SPARK-34392][SQL] Support ZoneOffset +h:mm in DateTimeUtils. getZoneId add 05069ff

[GitHub] [spark-website] srowen closed pull request #317: Add a SQL Metrics section to the sql documentation.

2021-02-26 Thread GitBox
srowen closed pull request #317: URL: https://github.com/apache/spark-website/pull/317 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark-website] sririshindra commented on pull request #317: Add a SQL Metrics section to the sql documentation.

2021-02-26 Thread GitBox
sririshindra commented on pull request #317: URL: https://github.com/apache/spark-website/pull/317#issuecomment-786987835 > Could you make a PR for the spark codebase `https://github.com/apache/spark/tree/master/docs`? The documents are automatically generated from there. Sorry, I

[GitHub] [spark-website] maropu commented on pull request #317: Add a SQL Metrics section to the sql documentation.

2021-02-26 Thread GitBox
maropu commented on pull request #317: URL: https://github.com/apache/spark-website/pull/317#issuecomment-786986786 Could you make a PR for the spark codebase `https://github.com/apache/spark/tree/master/docs`? The documents are automatically generated from there.

[GitHub] [spark-website] sririshindra opened a new pull request #317: Add a SQL Metrics section to the sql documentation.

2021-02-26 Thread GitBox
sririshindra opened a new pull request #317: URL: https://github.com/apache/spark-website/pull/317 This [PR](https://github.com/apache/spark/pull/31477) adds a new metric to the SQL UI named "number of matched rows". During the review process @maropu pointed out that there is no

[GitHub] [spark-website] srowen closed pull request #316: Capture Jekyll document generation errors in the github action

2021-02-26 Thread GitBox
srowen closed pull request #316: URL: https://github.com/apache/spark-website/pull/316 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[spark-website] branch asf-site updated: Capture Jekyll document generation errors in the github action

2021-02-26 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 6f878f5 Capture Jekyll document

[GitHub] [spark-website] attilapiros commented on pull request #316: Capture Jekyll document generation errors in the github action

2021-02-26 Thread GitBox
attilapiros commented on pull request #316: URL: https://github.com/apache/spark-website/pull/316#issuecomment-786894595 @srowen now we are good to go This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark-website] attilapiros commented on a change in pull request #316: Capture Jekyll document generation errors in the github action

2021-02-26 Thread GitBox
attilapiros commented on a change in pull request #316: URL: https://github.com/apache/spark-website/pull/316#discussion_r583917977 ## File path: .github/workflows/doc_gen.yml ## @@ -27,7 +27,15 @@ jobs: run: | export LC_ALL=C.UTF-8 export LANG=C.UTF-8

[GitHub] [spark-website] attilapiros commented on pull request #316: [WIP] Capture Jekyll document generation errors in the github action

2021-02-26 Thread GitBox
attilapiros commented on pull request #316: URL: https://github.com/apache/spark-website/pull/316#issuecomment-786889537 Expected [failure](https://github.com/apache/spark-website/pull/316/checks?check_run_id=1990605260): ``` Error during document generation:

[GitHub] [spark-website] attilapiros removed a comment on pull request #316: [WIP] Capture Jekyll document generation errors in the github action

2021-02-26 Thread GitBox
attilapiros removed a comment on pull request #316: URL: https://github.com/apache/spark-website/pull/316#issuecomment-786877923 This failed as expected (for details please check this[ action's log](https://github.com/apache/spark-website/pull/316/checks?check_run_id=1990436454)): ```

[GitHub] [spark-website] attilapiros commented on pull request #316: [WIP] Capture Jekyll document generation errors in the github action

2021-02-26 Thread GitBox
attilapiros commented on pull request #316: URL: https://github.com/apache/spark-website/pull/316#issuecomment-786877923 This failed as expected (for details please check this[ action's log](https://github.com/apache/spark-website/pull/316/checks?check_run_id=1990436454)): ``` Error

[GitHub] [spark-website] attilapiros commented on pull request #316: [WIP] Capture Jekyll document generation errors in the github action

2021-02-26 Thread GitBox
attilapiros commented on pull request #316: URL: https://github.com/apache/spark-website/pull/316#issuecomment-786873629 Retesting the second solution: not using temp file storing the stderr of the generation (as it will be used for generating a doc from it + detected by the 2nd check)

[spark] branch branch-3.0 updated: Revert "[SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1 `SET LOCATION`"

2021-02-26 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new baa2e6d Revert "[SPARK-34543][SQL]

[GitHub] [spark-website] attilapiros removed a comment on pull request #316: [WIP] Capture Jekyll document generation errors in the github action

2021-02-26 Thread GitBox
attilapiros removed a comment on pull request #316: URL: https://github.com/apache/spark-website/pull/316#issuecomment-786846340 First it failed as expected (for details check [the full logs](https://github.com/apache/spark-website/pull/316/checks?check_run_id=1990080765)): ``` Error

[GitHub] [spark-website] attilapiros commented on pull request #316: [WIP] Capture Jekyll document generation errors in the github action

2021-02-26 Thread GitBox
attilapiros commented on pull request #316: URL: https://github.com/apache/spark-website/pull/316#issuecomment-786846340 First it failed as expected (for details check [the full logs](https://github.com/apache/spark-website/pull/316/checks?check_run_id=1990080765)): ``` Error during

[GitHub] [spark-website] attilapiros opened a new pull request #316: [WIP] Capture Jekyll document generation errors in the github action

2021-02-26 Thread GitBox
attilapiros opened a new pull request #316: URL: https://github.com/apache/spark-website/pull/316 For testing purpose I have reverted a fix just for temporary. This is an automated message from the Apache Git Service. To

[spark] branch master updated (8d68f3f -> 56e664c)

2021-02-26 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 8d68f3f [MINOR] Add more known translations of contributors add 56e664c [SPARK-34392][SQL] Support ZoneOffset

[spark] branch master updated (67ec4f7 -> 8d68f3f)

2021-02-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 67ec4f7 [SPARK-33971][SQL] Eliminate distinct from more aggregates add 8d68f3f [MINOR] Add more known

[GitHub] [spark-website] Yikun commented on pull request #312: [SPARK-34539][DOC] Cleanup Zinc description in developer-tools

2021-02-26 Thread GitBox
Yikun commented on pull request #312: URL: https://github.com/apache/spark-website/pull/312#issuecomment-786668876 @srowen OK, thanks for your suggestion, done. and I also delete the description in Spark doc. [1]

[GitHub] [spark-website] HyukjinKwon closed pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
HyukjinKwon closed pull request #314: URL: https://github.com/apache/spark-website/pull/314 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[spark-website] branch asf-site updated: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 6f828ad Fix confict warning on

[spark] branch master updated: [SPARK-33971][SQL] Eliminate distinct from more aggregates

2021-02-26 Thread yamamuro
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 67ec4f7 [SPARK-33971][SQL] Eliminate distinct

[spark] branch master updated: [SPARK-34554][SQL] Implement the copy() method in ColumnarMap

2021-02-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c1beb16 [SPARK-34554][SQL] Implement the

[GitHub] [spark-website] HyukjinKwon commented on pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
HyukjinKwon commented on pull request #314: URL: https://github.com/apache/spark-website/pull/314#issuecomment-786620385 Yeah sounds good This is an automated message from the Apache Git Service. To respond to the message,

[spark] branch master updated (82267ac -> a9e8e05)

2021-02-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 82267ac [SPARK-34550][SQL] Skip InSet null value during push filter to Hive metastore add a9e8e05

[spark] branch branch-3.1 updated: [SPARK-34550][SQL] Skip InSet null value during push filter to Hive metastore

2021-02-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 6ee00a9 [SPARK-34550][SQL] Skip

[spark] branch master updated (7d5021f -> 82267ac)

2021-02-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 7d5021f [SPARK-34533][SQL] Eliminate LEFT ANTI join to empty relation in AQE add 82267ac

[GitHub] [spark-website] attilapiros commented on pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
attilapiros commented on pull request #314: URL: https://github.com/apache/spark-website/pull/314#issuecomment-786616610 @srowen @HyukjinKwon what about extending the github workflow action by checking the stderr of the generation is empty?

[GitHub] [spark-website] attilapiros commented on pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
attilapiros commented on pull request #314: URL: https://github.com/apache/spark-website/pull/314#issuecomment-786614466 Thanks for fixing this! I have not realized this bug as I was really focused on picking up the right version of Jekyll.

[GitHub] [spark-website] HyukjinKwon commented on pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
HyukjinKwon commented on pull request #314: URL: https://github.com/apache/spark-website/pull/314#issuecomment-786603974 cc @attilapiros FYI This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark-website] HyukjinKwon closed pull request #315: Change `jekyll build` to `bundle exec jekyll build`

2021-02-26 Thread GitBox
HyukjinKwon closed pull request #315: URL: https://github.com/apache/spark-website/pull/315 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[spark-website] branch asf-site updated: Change `jekyll build` to `bundle exec jekyll build`

2021-02-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 2a01090 Change `jekyll build` to

[spark] branch master updated: [SPARK-34533][SQL] Eliminate LEFT ANTI join to empty relation in AQE

2021-02-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7d5021f [SPARK-34533][SQL] Eliminate LEFT ANTI

[spark] branch master updated: [SPARK-34524][SQL] Simplify v2 partition commands resolution

2021-02-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 73857cd [SPARK-34524][SQL] Simplify v2

[spark] branch master updated (5b92531 -> ac774ec)

2021-02-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 5b92531 [SPARK-34551][INFRA] Fix credit related scripts to recover, drop Python 2 and work with Python 3

[spark] branch branch-3.1 updated: [SPARK-34551][INFRA] Fix credit related scripts to recover, drop Python 2 and work with Python 3

2021-02-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new a6240d6 [SPARK-34551][INFRA] Fix

[spark] branch master updated (5c7d019 -> 5b92531)

2021-02-26 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 5c7d019 [SPARK-34543][SQL] Respect the `spark.sql.caseSensitive` config while resolving partition spec in v1

[GitHub] [spark-website] srowen commented on pull request #312: [SPARK-34539][DOC] Update the Zinc description in developer-tools doc

2021-02-26 Thread GitBox
srowen commented on pull request #312: URL: https://github.com/apache/spark-website/pull/312#issuecomment-786549951 I would say just delete it, unless anyone else chimes in now with an objection. This is an automated

[GitHub] [spark-website] srowen commented on pull request #315: Change `jekyll build` to `bundle exec jekyll build`

2021-02-26 Thread GitBox
srowen commented on pull request #315: URL: https://github.com/apache/spark-website/pull/315#issuecomment-786549182 Good catch, right. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark-website] Yikun commented on pull request #312: [SPARK-34539][DOC] Update the Zinc description in developer-tools doc

2021-02-26 Thread GitBox
Yikun commented on pull request #312: URL: https://github.com/apache/spark-website/pull/312#issuecomment-786543293 @srowen yep, sounds reasonable. And there are only one reason to keep it left, from this doc, the developer can undertand the mechanism of scala-maven-plugin with Zinc

[GitHub] [spark-website] Yikun edited a comment on pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
Yikun edited a comment on pull request #314: URL: https://github.com/apache/spark-website/pull/314#issuecomment-786528933 @srowen Actually, the error is output from `bundle exec jekyll build`, you could have a try, and the commit msg was just shortening cmd, ~emm, I should write

[GitHub] [spark-website] Yikun opened a new pull request #315: Change `jekyll build` to `bundle exec jekyll build`

2021-02-26 Thread GitBox
Yikun opened a new pull request #315: URL: https://github.com/apache/spark-website/pull/315 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [spark-website] Yikun edited a comment on pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
Yikun edited a comment on pull request #314: URL: https://github.com/apache/spark-website/pull/314#issuecomment-786528933 @srowen Actually, the error is output from `bundle exec jekyll build`, you could have a try, and the commit msg was just shortening cmd, ~emm, I should write

[GitHub] [spark-website] Yikun edited a comment on pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
Yikun edited a comment on pull request #314: URL: https://github.com/apache/spark-website/pull/314#issuecomment-786528933 @srowen Actually, the error is output from `bundle exec jekyll build`, you could have a try, and the commit msg is just shortening cmd, ~emm, I should write

[GitHub] [spark-website] Yikun edited a comment on pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
Yikun edited a comment on pull request #314: URL: https://github.com/apache/spark-website/pull/314#issuecomment-786528933 @srowen Actually, the error is output from `bundle exec jekyll build`, you could have a try, and the commit msg is just short cmd, ~emm, I should write all cmd

[GitHub] [spark-website] Yikun commented on pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
Yikun commented on pull request #314: URL: https://github.com/apache/spark-website/pull/314#issuecomment-786528933 @srowen Actually, the error is output from `bundle exec jekyll build`, you could have a try, and the commit msg is just short cmd, emm, looks like I should write all cmd in

[GitHub] [spark-website] Yikun commented on pull request #313: [SPARK-34539][DOC] Cleanup Zinc security issue

2021-02-26 Thread GitBox
Yikun commented on pull request #313: URL: https://github.com/apache/spark-website/pull/313#issuecomment-786527751 @srowen OK, thanks for explanation. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark-website] srowen commented on pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
srowen commented on pull request #314: URL: https://github.com/apache/spark-website/pull/314#issuecomment-786527253 That should be fine yes. I think we now generate with "bundle exec jekyll build" - it probably results in the same output if you use jekyll 4.2.0 but just checking. (And our

[GitHub] [spark-website] srowen closed pull request #313: [SPARK-34539][DOC] Cleanup Zinc security issue

2021-02-26 Thread GitBox
srowen closed pull request #313: URL: https://github.com/apache/spark-website/pull/313 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark-website] srowen commented on pull request #313: [SPARK-34539][DOC] Cleanup Zinc security issue

2021-02-26 Thread GitBox
srowen commented on pull request #313: URL: https://github.com/apache/spark-website/pull/313#issuecomment-786526153 No, don't delete this. It's still important historical info even though it was indeed already mitigated, and not an issue in active branches.

[GitHub] [spark-website] Yikun opened a new pull request #314: Fix confict warning on spark-summit-east-agenda-posted

2021-02-26 Thread GitBox
Yikun opened a new pull request #314: URL: https://github.com/apache/spark-website/pull/314 When use `jekyll build` to generate the htmls, the below error is raised: ``` Conflict: The following destination is shared by multiple files. The written file may end up with unexpected

[GitHub] [spark-website] Yikun commented on pull request #312: [SPARK-34539][DOC] Update the Zinc description in developer-tools doc

2021-02-26 Thread GitBox
Yikun commented on pull request #312: URL: https://github.com/apache/spark-website/pull/312#issuecomment-786494351 @HyukjinKwon Yes, thanks for your reminder, and would you mind give some suggestion on the doc? I will adress all problems in next PS.