[spark] branch master updated (1530876 -> 6c0c617)
This is an automated email from the ASF dual-hosted git repository. viirya pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 1530876 [SPARK-35495][R] Change SparkR maintainer for CRAN add 6c0c617 [SPARK-35449][SQL] Only extract common expressions from CaseWhen values if elseValue is set No new revisions were added by this update. Summary of changes: .../catalyst/expressions/EquivalentExpressions.scala | 8 +++- .../expressions/SubexpressionEliminationSuite.scala | 20 ++-- .../scala/org/apache/spark/sql/DataFrameSuite.scala | 6 -- 3 files changed, 29 insertions(+), 5 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (6c0c617 -> c709efc)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 6c0c617 [SPARK-35449][SQL] Only extract common expressions from CaseWhen values if elseValue is set add c709efc [SPARK-34981][SQL][FOLLOWUP] Use SpecificInternalRow in ApplyFunctionExpression No new revisions were added by this update. Summary of changes: .../expressions/ApplyFunctionExpression.scala | 2 +- .../V2FunctionBenchmark-jdk11-results.txt | 56 +++--- .../benchmarks/V2FunctionBenchmark-results.txt | 48 +-- 3 files changed, 53 insertions(+), 53 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (c709efc -> d4fb983)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c709efc [SPARK-34981][SQL][FOLLOWUP] Use SpecificInternalRow in ApplyFunctionExpression add d4fb983 [SPARK-35287][SQL] Allow RemoveRedundantProjects to preserve ProjectExec which generates UnsafeRow for DataSourceV2ScanRelation No new revisions were added by this update. Summary of changes: .../sql/execution/RemoveRedundantProjects.scala | 1 + .../sql/execution/RemoveRedundantProjectsSuite.scala | 20 2 files changed, 21 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.1 updated (7f3b750 -> ba18a23)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git. from 7f3b750 Preparing development version 3.1.3-SNAPSHOT add ba18a23 [SPARK-35287][SQL] Allow RemoveRedundantProjects to preserve ProjectExec which generates UnsafeRow for DataSourceV2ScanRelation No new revisions were added by this update. Summary of changes: .../sql/execution/RemoveRedundantProjects.scala | 1 + .../sql/execution/RemoveRedundantProjectsSuite.scala | 20 2 files changed, 21 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] gengliangwang opened a new pull request #344: Add new section "Update the version index of DocSearch" in release process
gengliangwang opened a new pull request #344: URL: https://github.com/apache/spark-website/pull/344 *Make sure that you generate site HTML with `bundle exec jekyll build`, and include the changes to the HTML in your pull request also. See README.md for more information. Please remove this message.* Since Spark 3.1.1 release, the documentation site supports online searching via DocSearch. For the documentation sites which are not the latest one, the search results will point to themself as well, instead of showing results from https://spark.apache.org/docs/latest/. For example, after we release Spark 3.1.2, the search result of https://spark.apache.org/docs/3.1.1 will point to itself instead of the latest version. This requires extra steps. We need to update the version index in both algolia/docsearch-configs and apache/spark for every release. This PR is to add the steps in the release process. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun commented on pull request #344: Add new section "Update the version index of DocSearch" in release process
dongjoon-hyun commented on pull request #344: URL: https://github.com/apache/spark-website/pull/344#issuecomment-847224113 Thank you, @gengliangwang . Do you think we can fix `dev/create-release/release-tag.sh` to help the future releases? Although there is a documentation for the manual update, it would be greatly helpful. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] gengliangwang commented on pull request #344: Add new section "Update the version index of DocSearch" in release process
gengliangwang commented on pull request #344: URL: https://github.com/apache/spark-website/pull/344#issuecomment-847224940 Cc @HyukjinKwon @dongjoon-hyun since you are the release manager of 3.1.1 and 3.1.2. Actually, I am not sure if it is worth updating the version index for every release. Let me know your suggestions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] gengliangwang commented on pull request #344: Add new section "Update the version index of DocSearch" in release process
gengliangwang commented on pull request #344: URL: https://github.com/apache/spark-website/pull/344#issuecomment-847226935 @dongjoon-hyun Yes we can update `docs/_config.yml` via the release script. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.1 updated (ba18a23 -> de482f8)
This is an automated email from the ASF dual-hosted git repository. viirya pushed a change to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git. from ba18a23 [SPARK-35287][SQL] Allow RemoveRedundantProjects to preserve ProjectExec which generates UnsafeRow for DataSourceV2ScanRelation add de482f8 [SPARK-35449][SQL][3.1] Only extract common expressions from CaseWhen values if elseValue is set No new revisions were added by this update. Summary of changes: .../catalyst/expressions/EquivalentExpressions.scala | 8 +++- .../expressions/SubexpressionEliminationSuite.scala| 18 +- 2 files changed, 24 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] HyukjinKwon commented on pull request #344: Add new section "Update the version index of DocSearch" in release process
HyukjinKwon commented on pull request #344: URL: https://github.com/apache/spark-website/pull/344#issuecomment-847440190 Yeah, maybe we should better update the release script if possible. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (d4fb983 -> fdd7ca5)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from d4fb983 [SPARK-35287][SQL] Allow RemoveRedundantProjects to preserve ProjectExec which generates UnsafeRow for DataSourceV2ScanRelation add fdd7ca5 [SPARK-35498][PYTHON] Add thread target wrapper API for pyspark pin thread mode No new revisions were added by this update. Summary of changes: python/pyspark/util.py | 118 + 1 file changed, 80 insertions(+), 38 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (fdd7ca5 -> 548e37b)
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from fdd7ca5 [SPARK-35498][PYTHON] Add thread target wrapper API for pyspark pin thread mode add 548e37b [SPARK-33122][SQL][FOLLOWUP] Extend RemoveRedundantAggregates optimizer rule to apply to more cases No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/optimizer/Optimizer.scala | 43 + .../optimizer/RemoveRedundantAggregates.scala | 70 ++ .../optimizer/RemoveRedundantAggregatesSuite.scala | 16 - 3 files changed, 86 insertions(+), 43 deletions(-) create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RemoveRedundantAggregates.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (548e37b -> 4a6d844)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 548e37b [SPARK-33122][SQL][FOLLOWUP] Extend RemoveRedundantAggregates optimizer rule to apply to more cases add 4a6d844 [SPARK-35497][PYTHON] Enable plotly tests in pandas-on-Spark No new revisions were added by this update. Summary of changes: .github/workflows/build_and_test.yml| 2 +- python/pyspark/pandas/tests/plot/test_frame_plot_plotly.py | 6 +++--- python/pyspark/pandas/tests/plot/test_series_plot_plotly.py | 6 +++--- 3 files changed, 7 insertions(+), 7 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
