This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/drill-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 59532fb Automatic Site Publish by Buildbot
59532fb is described below
commit 59532fb178545bf6f25821554cf9f6ad9139ef3f
Author: buildbot <[email protected]>
AuthorDate: Wed Feb 23 11:43:19 2022 +0000
Automatic Site Publish by Buildbot
---
output/docs/parquet-format/index.html | 17 +++++++++++++++++
output/feed.xml | 4 ++--
output/zh/docs/parquet-format/index.html | 17 +++++++++++++++++
output/zh/feed.xml | 4 ++--
4 files changed, 38 insertions(+), 4 deletions(-)
diff --git a/output/docs/parquet-format/index.html
b/output/docs/parquet-format/index.html
index 865f8a5..ad17199 100644
--- a/output/docs/parquet-format/index.html
+++ b/output/docs/parquet-format/index.html
@@ -1551,6 +1551,23 @@
<p><code class="language-plaintext highlighter-rouge">ALTER SYSTEM|SESSION SET
`store.format` = 'parquet';</code></p>
+<p><strong>Introduced in release:</strong> 1.20.</p>
+
+<p>Optionally, set the Parquet format version. Parquet v2 introduced new data
encodings which may affect file size and read/write performance. Run
benchmarks with your own data to establish which works best in your environment
and, if you require interoperable Parquet files, be aware that at the time of
writing Parquet v1 has much wider support than does v2.</p>
+
+<p><code class="language-plaintext highlighter-rouge">ALTER SYSTEM|SESSION SET
`store.parquet.writer.format_version` = 'v2';</code></p>
+
+<p>Also new in Drill 1.20 is an expanded set of compression codec choices as
listed in the config option description. These can also have a significant
impact on file size and read/write performance. If interoperability is a
concern, Snappy and gzip codecs have the widest support at the time of
writing.</p>
+
+<p><code class="language-plaintext highlighter-rouge">ALTER SYSTEM|SESSION SET
`store.parquet.compression` = 'zstd';</code></p>
+
+<div class="admonition note">
+ <p class="first admonition-title">Note</p>
+ <p class="last">
+Because of a mismatch between Drill's set of target platforms and those for
which a suitable open source Brotli library is available, a Brotli codec is not
bundled and must be separately installed into the jars/3rdparty subdirectory if
you want to work with Parquet files that use Brotli. On Linux and macOS on
amd64, the
[com.github.rdblue:brotli-codec](https://github.com/rdblue/brotli-codec/) is
supported.
+ </p>
+</div>
+
<h3 id="configuring-the-size-of-parquet-files">Configuring the Size of Parquet
Files</h3>
<p>Configuring the size of Parquet files by setting the <code
class="language-plaintext highlighter-rouge">store.parquet.block-size</code>
can improve write performance. The block size is the size of MFS, HDFS, or the
file system.</p>
diff --git a/output/feed.xml b/output/feed.xml
index a3f38d6..a923a66 100644
--- a/output/feed.xml
+++ b/output/feed.xml
@@ -6,8 +6,8 @@
</description>
<link>/</link>
<atom:link href="/feed.xml" rel="self" type="application/rss+xml"/>
- <pubDate>Tue, 22 Feb 2022 09:56:22 +0000</pubDate>
- <lastBuildDate>Tue, 22 Feb 2022 09:56:22 +0000</lastBuildDate>
+ <pubDate>Wed, 23 Feb 2022 11:40:53 +0000</pubDate>
+ <lastBuildDate>Wed, 23 Feb 2022 11:40:53 +0000</lastBuildDate>
<generator>Jekyll v3.9.1</generator>
<item>
diff --git a/output/zh/docs/parquet-format/index.html
b/output/zh/docs/parquet-format/index.html
index 4d92ebe..feb9c6c 100644
--- a/output/zh/docs/parquet-format/index.html
+++ b/output/zh/docs/parquet-format/index.html
@@ -1551,6 +1551,23 @@
<p><code class="language-plaintext highlighter-rouge">ALTER SYSTEM|SESSION SET
`store.format` = 'parquet';</code></p>
+<p><strong>Introduced in release:</strong> 1.20.</p>
+
+<p>Optionally, set the Parquet format version. Parquet v2 introduced new data
encodings which may affect file size and read/write performance. Run
benchmarks with your own data to establish which works best in your environment
and, if you require interoperable Parquet files, be aware that at the time of
writing Parquet v1 has much wider support than does v2.</p>
+
+<p><code class="language-plaintext highlighter-rouge">ALTER SYSTEM|SESSION SET
`store.parquet.writer.format_version` = 'v2';</code></p>
+
+<p>Also new in Drill 1.20 is an expanded set of compression codec choices as
listed in the config option description. These can also have a significant
impact on file size and read/write performance. If interoperability is a
concern, Snappy and gzip codecs have the widest support at the time of
writing.</p>
+
+<p><code class="language-plaintext highlighter-rouge">ALTER SYSTEM|SESSION SET
`store.parquet.compression` = 'zstd';</code></p>
+
+<div class="admonition note">
+ <p class="first admonition-title">Note</p>
+ <p class="last">
+Because of a mismatch between Drill's set of target platforms and those for
which a suitable open source Brotli library is available, a Brotli codec is not
bundled and must be separately installed into the jars/3rdparty subdirectory if
you want to work with Parquet files that use Brotli. On Linux and macOS on
amd64, the
[com.github.rdblue:brotli-codec](https://github.com/rdblue/brotli-codec/) is
supported.
+ </p>
+</div>
+
<h3 id="configuring-the-size-of-parquet-files">Configuring the Size of Parquet
Files</h3>
<p>Configuring the size of Parquet files by setting the <code
class="language-plaintext highlighter-rouge">store.parquet.block-size</code>
can improve write performance. The block size is the size of MFS, HDFS, or the
file system.</p>
diff --git a/output/zh/feed.xml b/output/zh/feed.xml
index 4fb8b2e..8364a7b 100644
--- a/output/zh/feed.xml
+++ b/output/zh/feed.xml
@@ -6,8 +6,8 @@
</description>
<link>/</link>
<atom:link href="/zh/feed.xml" rel="self" type="application/rss+xml"/>
- <pubDate>Tue, 22 Feb 2022 09:56:22 +0000</pubDate>
- <lastBuildDate>Tue, 22 Feb 2022 09:56:22 +0000</lastBuildDate>
+ <pubDate>Wed, 23 Feb 2022 11:40:53 +0000</pubDate>
+ <lastBuildDate>Wed, 23 Feb 2022 11:40:53 +0000</lastBuildDate>
<generator>Jekyll v3.9.1</generator>
<item>
