This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 3728d3973 Publish built docs triggered by
1345a53f33294f86019e355748c1ffaa253839d5
3728d3973 is described below
commit 3728d3973de80d2d607a69ace6650ea6fb412b68
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Sun Nov 9 20:37:40 2025 +0000
Publish built docs triggered by 1345a53f33294f86019e355748c1ffaa253839d5
---
_sources/user-guide/latest/compatibility.md.txt | 5 ++++
_sources/user-guide/latest/expressions.md.txt | 17 ++++++++++++
_sources/user-guide/latest/operators.md.txt | 5 ++--
searchindex.js | 2 +-
user-guide/latest/compatibility.html | 5 ++++
user-guide/latest/expressions.html | 36 +++++++++++++++++++++++++
user-guide/latest/operators.html | 24 ++++++++++-------
7 files changed, 81 insertions(+), 13 deletions(-)
diff --git a/_sources/user-guide/latest/compatibility.md.txt
b/_sources/user-guide/latest/compatibility.md.txt
index 7a18e3b4a..7e4760e0f 100644
--- a/_sources/user-guide/latest/compatibility.md.txt
+++ b/_sources/user-guide/latest/compatibility.md.txt
@@ -68,6 +68,11 @@ Comet uses the Rust regexp crate for evaluating regular
expressions, and this ha
regular expression engine. Comet will fall back to Spark for patterns that are
known to produce different results, but
this can be overridden by setting `spark.comet.regexp.allowIncompatible=true`.
+## Window Functions
+
+Comet's support for window functions is incomplete and known to be incorrect.
It is disabled by default and
+should not be used in production. The feature will be enabled in a future
release. Tracking issue:
[#2721](https://github.com/apache/datafusion-comet/issues/2721).
+
## Cast
Cast operations in Comet fall into three levels of support:
diff --git a/_sources/user-guide/latest/expressions.md.txt
b/_sources/user-guide/latest/expressions.md.txt
index fe42f49a4..548941f7a 100644
--- a/_sources/user-guide/latest/expressions.md.txt
+++ b/_sources/user-guide/latest/expressions.md.txt
@@ -202,6 +202,23 @@ incompatible expressions.
| VariancePop | | Yes |
|
| VarianceSamp | | Yes |
|
+## Window Functions
+
+```{warning}
+Window support is disabled by default due to known correctness issues.
Tracking issue: [#2721](https://github.com/apache/datafusion-comet/issues/2721).
+```
+
+Comet supports using the following aggregate functions within window contexts
with PARTITION BY and ORDER BY clauses.
+
+| Expression | Spark-Compatible? | Compatibility Notes
|
+| ---------- | ----------------- |
-------------------------------------------- |
+| Count | Yes | |
+| Max | Yes | |
+| Min | Yes | |
+| Sum | Yes | |
+
+**Note:** Dedicated window functions such as `rank`, `dense_rank`,
`row_number`, `lag`, `lead`, `ntile`, `cume_dist`, `percent_rank`, and
`nth_value` are not currently supported and will fall back to Spark.
+
## Array Expressions
| Expression | Spark-Compatible? | Compatibility Notes
|
diff --git a/_sources/user-guide/latest/operators.md.txt
b/_sources/user-guide/latest/operators.md.txt
index 066daf4b9..b1b9ecb5a 100644
--- a/_sources/user-guide/latest/operators.md.txt
+++ b/_sources/user-guide/latest/operators.md.txt
@@ -23,7 +23,7 @@ The following Spark operators are currently replaced with
native versions. Query
not supported by Comet will fall back to regular Spark execution.
| Operator | Spark-Compatible? | Compatibility Notes
|
-| ----------------------- | ----------------- |
------------------------------------------------------------------------------------------------------------------
|
+|-------------------------|-------------------|--------------------------------------------------------------------------------------------------------------------|
| BatchScanExec | Yes | Supports Parquet files and
Apache Iceberg Parquet scans. See the [Comet Compatibility Guide] for more
information. |
| BroadcastExchangeExec | Yes |
|
| BroadcastHashJoinExec | Yes |
|
@@ -33,6 +33,7 @@ not supported by Comet will fall back to regular Spark
execution.
| GlobalLimitExec | Yes |
|
| HashAggregateExec | Yes |
|
| LocalLimitExec | Yes |
|
+| LocalTableScanExec | No | Experimental and disabled by
default.
|
| ObjectHashAggregateExec | Yes | Supports a limited number of
aggregates, such as `bloom_filter_agg`.
|
| ProjectExec | Yes |
|
| ShuffleExchangeExec | Yes |
|
@@ -40,6 +41,6 @@ not supported by Comet will fall back to regular Spark
execution.
| SortExec | Yes |
|
| SortMergeJoinExec | Yes |
|
| UnionExec | Yes |
|
-| WindowExec | Yes |
|
+| WindowExec | No | Disabled by default due to
known correctness issues.
|
[Comet Compatibility Guide]: compatibility.md
diff --git a/searchindex.js b/searchindex.js
index bd6559839..13ee9baa7 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"1. Install Comet": [[18, "install-comet"]],
"2. Clone Spark and Apply Diff": [[18, "clone-spark-and-apply-diff"]], "3. Run
Spark SQL Tests": [[18, "run-spark-sql-tests"]], "ANSI Mode": [[21,
"ansi-mode"], [34, "ansi-mode"], [74, "ansi-mode"]], "ANSI mode": [[47,
"ansi-mode"], [60, "ansi-mode"]], "API Differences Between Spark Versions":
[[3, "api-differences-between-spark-versions"]], "ASF Links": [[2, null], [2,
null]], "Accelerating Apache Iceberg Parque [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"1. Install Comet": [[18, "install-comet"]],
"2. Clone Spark and Apply Diff": [[18, "clone-spark-and-apply-diff"]], "3. Run
Spark SQL Tests": [[18, "run-spark-sql-tests"]], "ANSI Mode": [[21,
"ansi-mode"], [34, "ansi-mode"], [74, "ansi-mode"]], "ANSI mode": [[47,
"ansi-mode"], [60, "ansi-mode"]], "API Differences Between Spark Versions":
[[3, "api-differences-between-spark-versions"]], "ASF Links": [[2, null], [2,
null]], "Accelerating Apache Iceberg Parque [...]
\ No newline at end of file
diff --git a/user-guide/latest/compatibility.html
b/user-guide/latest/compatibility.html
index 5903394bd..92ea51a74 100644
--- a/user-guide/latest/compatibility.html
+++ b/user-guide/latest/compatibility.html
@@ -506,6 +506,11 @@ incompatible expressions.</p>
regular expression engine. Comet will fall back to Spark for patterns that are
known to produce different results, but
this can be overridden by setting <code class="docutils literal
notranslate"><span
class="pre">spark.comet.regexp.allowIncompatible=true</span></code>.</p>
</section>
+<section id="window-functions">
+<h2>Window Functions<a class="headerlink" href="#window-functions" title="Link
to this heading">#</a></h2>
+<p>Comet’s support for window functions is incomplete and known to be
incorrect. It is disabled by default and
+should not be used in production. The feature will be enabled in a future
release. Tracking issue: <a class="reference external"
href="https://github.com/apache/datafusion-comet/issues/2721";>#2721</a>.</p>
+</section>
<section id="cast">
<h2>Cast<a class="headerlink" href="#cast" title="Link to this
heading">#</a></h2>
<p>Cast operations in Comet fall into three levels of support:</p>
diff --git a/user-guide/latest/expressions.html
b/user-guide/latest/expressions.html
index fecb4ccf8..320af86c1 100644
--- a/user-guide/latest/expressions.html
+++ b/user-guide/latest/expressions.html
@@ -1166,6 +1166,42 @@ incompatible expressions.</p>
</table>
</div>
</section>
+<section id="window-functions">
+<h2>Window Functions<a class="headerlink" href="#window-functions" title="Link
to this heading">#</a></h2>
+<div class="admonition warning">
+<p class="admonition-title">Warning</p>
+<p>Window support is disabled by default due to known correctness issues.
Tracking issue: <a class="reference external"
href="https://github.com/apache/datafusion-comet/issues/2721";>#2721</a>.</p>
+</div>
+<p>Comet supports using the following aggregate functions within window
contexts with PARTITION BY and ORDER BY clauses.</p>
+<div class="pst-scrollable-table-container"><table class="table">
+<thead>
+<tr class="row-odd"><th class="head"><p>Expression</p></th>
+<th class="head"><p>Spark-Compatible?</p></th>
+<th class="head"><p>Compatibility Notes</p></th>
+</tr>
+</thead>
+<tbody>
+<tr class="row-even"><td><p>Count</p></td>
+<td><p>Yes</p></td>
+<td><p></p></td>
+</tr>
+<tr class="row-odd"><td><p>Max</p></td>
+<td><p>Yes</p></td>
+<td><p></p></td>
+</tr>
+<tr class="row-even"><td><p>Min</p></td>
+<td><p>Yes</p></td>
+<td><p></p></td>
+</tr>
+<tr class="row-odd"><td><p>Sum</p></td>
+<td><p>Yes</p></td>
+<td><p></p></td>
+</tr>
+</tbody>
+</table>
+</div>
+<p><strong>Note:</strong> Dedicated window functions such as <code
class="docutils literal notranslate"><span class="pre">rank</span></code>,
<code class="docutils literal notranslate"><span
class="pre">dense_rank</span></code>, <code class="docutils literal
notranslate"><span class="pre">row_number</span></code>, <code class="docutils
literal notranslate"><span class="pre">lag</span></code>, <code class="docutils
literal notranslate"><span class="pre">lead</span></code>, <code class="do [...]
+</section>
<section id="array-expressions">
<h2>Array Expressions<a class="headerlink" href="#array-expressions"
title="Link to this heading">#</a></h2>
<div class="pst-scrollable-table-container"><table class="table">
diff --git a/user-guide/latest/operators.html b/user-guide/latest/operators.html
index 7c3f925f0..f189fd32e 100644
--- a/user-guide/latest/operators.html
+++ b/user-guide/latest/operators.html
@@ -506,37 +506,41 @@ not supported by Comet will fall back to regular Spark
execution.</p>
<td><p>Yes</p></td>
<td><p></p></td>
</tr>
-<tr class="row-odd"><td><p>ObjectHashAggregateExec</p></td>
+<tr class="row-odd"><td><p>LocalTableScanExec</p></td>
+<td><p>No</p></td>
+<td><p>Experimental and disabled by default.</p></td>
+</tr>
+<tr class="row-even"><td><p>ObjectHashAggregateExec</p></td>
<td><p>Yes</p></td>
<td><p>Supports a limited number of aggregates, such as <code class="docutils
literal notranslate"><span class="pre">bloom_filter_agg</span></code>.</p></td>
</tr>
-<tr class="row-even"><td><p>ProjectExec</p></td>
+<tr class="row-odd"><td><p>ProjectExec</p></td>
<td><p>Yes</p></td>
<td><p></p></td>
</tr>
-<tr class="row-odd"><td><p>ShuffleExchangeExec</p></td>
+<tr class="row-even"><td><p>ShuffleExchangeExec</p></td>
<td><p>Yes</p></td>
<td><p></p></td>
</tr>
-<tr class="row-even"><td><p>ShuffledHashJoinExec</p></td>
+<tr class="row-odd"><td><p>ShuffledHashJoinExec</p></td>
<td><p>Yes</p></td>
<td><p></p></td>
</tr>
-<tr class="row-odd"><td><p>SortExec</p></td>
+<tr class="row-even"><td><p>SortExec</p></td>
<td><p>Yes</p></td>
<td><p></p></td>
</tr>
-<tr class="row-even"><td><p>SortMergeJoinExec</p></td>
+<tr class="row-odd"><td><p>SortMergeJoinExec</p></td>
<td><p>Yes</p></td>
<td><p></p></td>
</tr>
-<tr class="row-odd"><td><p>UnionExec</p></td>
+<tr class="row-even"><td><p>UnionExec</p></td>
<td><p>Yes</p></td>
<td><p></p></td>
</tr>
-<tr class="row-even"><td><p>WindowExec</p></td>
-<td><p>Yes</p></td>
-<td><p></p></td>
+<tr class="row-odd"><td><p>WindowExec</p></td>
+<td><p>No</p></td>
+<td><p>Disabled by default due to known correctness issues.</p></td>
</tr>
</tbody>
</table>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
