This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 0453b89c1e Publish built docs triggered by
36e823f0618283b77627714a5a1628392f92acc9
0453b89c1e is described below
commit 0453b89c1e224817b9bd393f01517279e18edef1
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Mon Jun 16 11:24:43 2025 +0000
Publish built docs triggered by 36e823f0618283b77627714a5a1628392f92acc9
---
_sources/library-user-guide/upgrading.md.txt | 33 +++++++++++++++++++++-
library-user-guide/upgrading.html | 41 +++++++++++++++++++++++++---
searchindex.js | 2 +-
3 files changed, 70 insertions(+), 6 deletions(-)
diff --git a/_sources/library-user-guide/upgrading.md.txt
b/_sources/library-user-guide/upgrading.md.txt
index 1128b74d92..8821d61857 100644
--- a/_sources/library-user-guide/upgrading.md.txt
+++ b/_sources/library-user-guide/upgrading.md.txt
@@ -21,6 +21,37 @@
## DataFusion `48.0.0`
+### `Expr::Literal` has optional metadata
+
+The [`Expr::Literal`] variant now includes optional metadata, which allows for
+carrying through Arrow field metadata to support extension types and other
uses.
+
+This means code such as
+
+```rust
+match expr {
+...
+ Expr::Literal(scalar) => ...
+...
+}
+```
+
+Should be updated to:
+
+```rust
+match expr {
+...
+ Expr::Literal(scalar, _metadata) => ...
+...
+}
+```
+
+Likewise constructing `Expr::Literal` requires metadata as well. The [`lit`]
function
+has not changed and returns an `Expr::Literal` with no metadata.
+
+[`expr::literal`]:
https://docs.rs/datafusion/latest/datafusion/logical_expr/enum.Expr.html#variant.Literal
+[`lit`]: https://docs.rs/datafusion/latest/datafusion/logical_expr/fn.lit.html
+
### `Expr::WindowFunction` is now `Box`ed
`Expr::WindowFunction` is now a `Box<WindowFunction>` instead of a
`WindowFunction` directly.
@@ -194,7 +225,7 @@ working but no one knows due to lack of test coverage).
[api deprecation guidelines]:
https://datafusion.apache.org/contributor-guide/api-health.html#deprecation-guidelines
-### `PartitionedFile` added as an arguement to the `FileOpener` trait
+### `PartitionedFile` added as an argument to the `FileOpener` trait
This is necessary to properly fix filter pushdown for filters that combine
partition
columns and file columns (e.g. `day = username['dob']`).
diff --git a/library-user-guide/upgrading.html
b/library-user-guide/upgrading.html
index b00bf5cfb4..70ed5d3b08 100644
--- a/library-user-guide/upgrading.html
+++ b/library-user-guide/upgrading.html
@@ -559,6 +559,16 @@
</code>
</a>
<ul class="nav section-nav flex-column">
+ <li class="toc-h3 nav-item toc-entry">
+ <a class="reference internal nav-link"
href="#expr-literal-has-optional-metadata">
+ <code class="docutils literal notranslate">
+ <span class="pre">
+ Expr::Literal
+ </span>
+ </code>
+ has optional metadata
+ </a>
+ </li>
<li class="toc-h3 nav-item toc-entry">
<a class="reference internal nav-link"
href="#expr-windowfunction-is-now-boxed">
<code class="docutils literal notranslate">
@@ -690,13 +700,13 @@
</a>
</li>
<li class="toc-h3 nav-item toc-entry">
- <a class="reference internal nav-link"
href="#partitionedfile-added-as-an-arguement-to-the-fileopener-trait">
+ <a class="reference internal nav-link"
href="#partitionedfile-added-as-an-argument-to-the-fileopener-trait">
<code class="docutils literal notranslate">
<span class="pre">
PartitionedFile
</span>
</code>
- added as an arguement to the
+ added as an argument to the
<code class="docutils literal notranslate">
<span class="pre">
FileOpener
@@ -918,6 +928,29 @@
<h1>Upgrade Guides<a class="headerlink" href="#upgrade-guides" title="Link to
this heading">¶</a></h1>
<section id="datafusion-48-0-0">
<h2>DataFusion <code class="docutils literal notranslate"><span
class="pre">48.0.0</span></code><a class="headerlink" href="#datafusion-48-0-0"
title="Link to this heading">¶</a></h2>
+<section id="expr-literal-has-optional-metadata">
+<h3><code class="docutils literal notranslate"><span
class="pre">Expr::Literal</span></code> has optional metadata<a
class="headerlink" href="#expr-literal-has-optional-metadata" title="Link to
this heading">¶</a></h3>
+<p>The <a class="reference external"
href="https://docs.rs/datafusion/latest/datafusion/logical_expr/enum.Expr.html#variant.Literal";><code
class="docutils literal notranslate"><span
class="pre">Expr::Literal</span></code></a> variant now includes optional
metadata, which allows for
+carrying through Arrow field metadata to support extension types and other
uses.</p>
+<p>This means code such as</p>
+<div class="highlight-rust notranslate"><div
class="highlight"><pre><span></span><span class="k">match</span><span
class="w"> </span><span class="n">expr</span><span class="w"> </span><span
class="p">{</span>
+<span class="o">..</span><span class="p">.</span>
+<span class="w"> </span><span class="n">Expr</span><span
class="p">::</span><span class="n">Literal</span><span class="p">(</span><span
class="n">scalar</span><span class="p">)</span><span class="w"> </span><span
class="o">=></span><span class="w"> </span><span class="o">..</span><span
class="p">.</span>
+<span class="o">..</span><span class="p">.</span>
+<span class="p">}</span>
+</pre></div>
+</div>
+<p>Should be updated to:</p>
+<div class="highlight-rust notranslate"><div
class="highlight"><pre><span></span><span class="k">match</span><span
class="w"> </span><span class="n">expr</span><span class="w"> </span><span
class="p">{</span>
+<span class="o">..</span><span class="p">.</span>
+<span class="w"> </span><span class="n">Expr</span><span
class="p">::</span><span class="n">Literal</span><span class="p">(</span><span
class="n">scalar</span><span class="p">,</span><span class="w"> </span><span
class="n">_metadata</span><span class="p">)</span><span class="w"> </span><span
class="o">=></span><span class="w"> </span><span class="o">..</span><span
class="p">.</span>
+<span class="o">..</span><span class="p">.</span>
+<span class="p">}</span>
+</pre></div>
+</div>
+<p>Likewise constructing <code class="docutils literal notranslate"><span
class="pre">Expr::Literal</span></code> requires metadata as well. The <a
class="reference external"
href="https://docs.rs/datafusion/latest/datafusion/logical_expr/fn.lit.html";><code
class="docutils literal notranslate"><span class="pre">lit</span></code></a>
function
+has not changed and returns an <code class="docutils literal
notranslate"><span class="pre">Expr::Literal</span></code> with no metadata.</p>
+</section>
<section id="expr-windowfunction-is-now-boxed">
<h3><code class="docutils literal notranslate"><span
class="pre">Expr::WindowFunction</span></code> is now <code class="docutils
literal notranslate"><span class="pre">Box</span></code>ed<a class="headerlink"
href="#expr-windowfunction-is-now-boxed" title="Link to this heading">¶</a></h3>
<p><code class="docutils literal notranslate"><span
class="pre">Expr::WindowFunction</span></code> is now a <code class="docutils
literal notranslate"><span class="pre">Box<WindowFunction></span></code>
instead of a <code class="docutils literal notranslate"><span
class="pre">WindowFunction</span></code> directly.
@@ -1070,8 +1103,8 @@ cover the new <code class="docutils literal
notranslate"><span class="pre">DataS
<code class="docutils literal notranslate"><span
class="pre">DataSource</span></code>, the old structures began to show signs of
“bit rotting” (not
working but no one knows due to lack of test coverage).</p>
</section>
-<section id="partitionedfile-added-as-an-arguement-to-the-fileopener-trait">
-<h3><code class="docutils literal notranslate"><span
class="pre">PartitionedFile</span></code> added as an arguement to the <code
class="docutils literal notranslate"><span class="pre">FileOpener</span></code>
trait<a class="headerlink"
href="#partitionedfile-added-as-an-arguement-to-the-fileopener-trait"
title="Link to this heading">¶</a></h3>
+<section id="partitionedfile-added-as-an-argument-to-the-fileopener-trait">
+<h3><code class="docutils literal notranslate"><span
class="pre">PartitionedFile</span></code> added as an argument to the <code
class="docutils literal notranslate"><span class="pre">FileOpener</span></code>
trait<a class="headerlink"
href="#partitionedfile-added-as-an-argument-to-the-fileopener-trait"
title="Link to this heading">¶</a></h3>
<p>This is necessary to properly fix filter pushdown for filters that combine
partition
columns and file columns (e.g. <code class="docutils literal
notranslate"><span class="pre">day</span> <span class="pre">=</span> <span
class="pre">username['dob']</span></code>).</p>
<p>If you implemented a custom <code class="docutils literal
notranslate"><span class="pre">FileOpener</span></code> you will need to add
the <code class="docutils literal notranslate"><span
class="pre">PartitionedFile</span></code> argument
diff --git a/searchindex.js b/searchindex.js
index 75225ddb15..219cb2827e 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles":{"!=":[[57,"op-neq"]],"!~":[[57,"op-re-not-match"]],"!~*":[[57,"op-re-not-match-i"]],"!~~":[[57,"id19"]],"!~~*":[[57,"id20"]],"#":[[57,"op-bit-xor"]],"%":[[57,"op-modulo"]],"&":[[57,"op-bit-and"]],"(relation,
name) tuples in logical fields and logical columns are
unique":[[12,"relation-name-tuples-in-logical-fields-and-logical-columns-are-unique"]],"*":[[57,"op-multiply"]],"+":[[57,"op-plus"]],"-":[[57,"op-minus"]],"/":[[57,"op-divide"]],"2022
Q2":[[10,"q2"]] [...]
\ No newline at end of file
+Search.setIndex({"alltitles":{"!=":[[57,"op-neq"]],"!~":[[57,"op-re-not-match"]],"!~*":[[57,"op-re-not-match-i"]],"!~~":[[57,"id19"]],"!~~*":[[57,"id20"]],"#":[[57,"op-bit-xor"]],"%":[[57,"op-modulo"]],"&":[[57,"op-bit-and"]],"(relation,
name) tuples in logical fields and logical columns are
unique":[[12,"relation-name-tuples-in-logical-fields-and-logical-columns-are-unique"]],"*":[[57,"op-multiply"]],"+":[[57,"op-plus"]],"-":[[57,"op-minus"]],"/":[[57,"op-divide"]],"2022
Q2":[[10,"q2"]] [...]
\ No newline at end of file
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
