This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 5505e632d0 Publish built docs triggered by
ed85abbb878ef3d60e43797376cb9a40955cd89a
5505e632d0 is described below
commit 5505e632d0761af87799d0276ef95cc263c621fc
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Sun Aug 13 11:12:34 2023 +0000
Publish built docs triggered by ed85abbb878ef3d60e43797376cb9a40955cd89a
---
_sources/user-guide/configs.md.txt | 104 +++++++++++++++++++++----------------
searchindex.js | 2 +-
user-guide/configs.html | 64 +++++++++++++++++++++++
3 files changed, 125 insertions(+), 45 deletions(-)
diff --git a/_sources/user-guide/configs.md.txt
b/_sources/user-guide/configs.md.txt
index 63c9c064bc..50d9cb7c8b 100644
--- a/_sources/user-guide/configs.md.txt
+++ b/_sources/user-guide/configs.md.txt
@@ -35,47 +35,63 @@ Values are parsed according to the [same rules used in
casts from Utf8](https://
If the value in the environment variable cannot be cast to the type of the
configuration option, the default value will be used instead and a warning
emitted.
Environment variables are read during `SessionConfig` initialisation so they
must be set beforehand and will not affect running sessions.
-| key | default |
description
[...]
-| ---------------------------------------------------------- | ---------- |
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[...]
-| datafusion.catalog.create_default_catalog_and_schema | true |
Whether the default catalog and schema should be created automatically.
[...]
-| datafusion.catalog.default_catalog | datafusion |
The default catalog name - this impacts what SQL queries use if not specified
[...]
-| datafusion.catalog.default_schema | public |
The default schema name - this impacts what SQL queries use if not specified
[...]
-| datafusion.catalog.information_schema | false |
Should DataFusion provide access to `information_schema` virtual tables for
displaying schema information
[...]
-| datafusion.catalog.location | NULL |
Location scanned to load tables for `default` schema
[...]
-| datafusion.catalog.format | NULL |
Type of `TableProvider` to use when loading `default` schema
[...]
-| datafusion.catalog.has_header | false | If
the file has a header
[...]
-| datafusion.execution.batch_size | 8192 |
Default batch size while creating new batches, it's especially useful for
buffer-in-memory batches since creating tiny batches would result in too much
metadata memory consumption
[...]
-| datafusion.execution.coalesce_batches | true |
When set to true, record batches will be examined between each operator and
small batches will be coalesced into larger batches. This is helpful when there
are highly selective filters or joins that could produce tiny output batches.
The target batch size is determined by the configuration setting
[...]
-| datafusion.execution.collect_statistics | false |
Should DataFusion collect statistics after listing files
[...]
-| datafusion.execution.target_partitions | 0 |
Number of partitions for query execution. Increasing partitions can increase
concurrency. Defaults to the number of CPU cores on the system
[...]
-| datafusion.execution.time_zone | +00:00 |
The default time zone Some functions, e.g. `EXTRACT(HOUR from SOME_TIME)`,
shift the underlying datetime according to this time zone, and then extract the
hour
[...]
-| datafusion.execution.parquet.enable_page_index | true | If
true, reads the Parquet data page level metadata (the Page Index), if present,
to reduce the I/O and number of rows decoded.
[...]
-| datafusion.execution.parquet.pruning | true | If
true, the parquet reader attempts to skip entire row groups based on the
predicate in the query and the metadata (min/max values) stored in the parquet
file
[...]
-| datafusion.execution.parquet.skip_metadata | true | If
true, the parquet reader skip the optional embedded metadata that may be in the
file Schema. This setting can help avoid schema conflicts when querying
multiple parquet files with schemas containing compatible types but different
metadata
[...]
-| datafusion.execution.parquet.metadata_size_hint | NULL | If
specified, the parquet reader will try and fetch the last `size_hint` bytes of
the parquet file optimistically. If not specified, two reads are required: One
read to fetch the 8-byte parquet footer and another to fetch the metadata
length encoded in the footer
[...]
-| datafusion.execution.parquet.pushdown_filters | false | If
true, filter expressions are be applied during the parquet decoding operation
to reduce the number of rows decoded
[...]
-| datafusion.execution.parquet.reorder_filters | false | If
true, filter expressions evaluated during the parquet decoding operation will
be reordered heuristically to minimize the cost of evaluation. If false, the
filters are applied in the same order as written in the query
[...]
-| datafusion.execution.aggregate.scalar_update_factor | 10 |
Specifies the threshold for using `ScalarValue`s to update accumulators during
high-cardinality aggregations for each input batch. The aggregation is
considered high-cardinality if the number of affected groups is greater than or
equal to `batch_size / scalar_update_factor`. In such cases, `ScalarValue`s are
utilized for updating accumulators, rather than the default batch-slice
approach. This can lead to perform [...]
-| datafusion.execution.planning_concurrency | 0 |
Fan-out during initial physical planning. This is mostly use to plan `UNION`
children in parallel. Defaults to the number of CPU cores on the system
[...]
-| datafusion.execution.sort_spill_reservation_bytes | 10485760 |
Specifies the reserved memory for each spillable sort operation to facilitate
an in-memory merge. When a sort operation spills to disk, the in-memory data
must be sorted and merged before being written to a file. This setting reserves
a specific amount of memory for that in-memory sort/merge process. Note: This
setting is irrelevant if the sort operation cannot spill (i.e., if there's no
`DiskManager` configured) [...]
-| datafusion.execution.sort_in_place_threshold_bytes | 1048576 |
When sorting, below what size should data be concatenated and sorted in a
single RecordBatch rather than sorted in batches and merged.
[...]
-| datafusion.optimizer.enable_round_robin_repartition | true |
When set to true, the physical plan optimizer will try to add round robin
repartitioning to increase parallelism to leverage more CPU cores
[...]
-| datafusion.optimizer.filter_null_join_keys | false |
When set to true, the optimizer will insert filters before a join between a
nullable and non-nullable column to filter out nulls on the nullable side. This
filter can add additional overhead when the file format does not fully support
predicate push down.
[...]
-| datafusion.optimizer.repartition_aggregations | true |
Should DataFusion repartition data using the aggregate keys to execute
aggregates in parallel using the provided `target_partitions` level
[...]
-| datafusion.optimizer.repartition_file_min_size | 10485760 |
Minimum total files size in bytes to perform file scan repartitioning.
[...]
-| datafusion.optimizer.repartition_joins | true |
Should DataFusion repartition data using the join keys to execute joins in
parallel using the provided `target_partitions` level
[...]
-| datafusion.optimizer.allow_symmetric_joins_without_pruning | true |
Should DataFusion allow symmetric hash joins for unbounded data sources even
when its inputs do not have any ordering or filtering If the flag is not
enabled, the SymmetricHashJoin operator will be unable to prune its internal
buffers, resulting in certain join types - such as Full, Left, LeftAnti,
LeftSemi, Right, RightAnti, and RightSemi - being produced only at the end of
the execution. This is not typical in [...]
-| datafusion.optimizer.repartition_file_scans | true |
When set to `true`, file groups will be repartitioned to achieve maximum
parallelism. Currently Parquet and CSV formats are supported. If set to `true`,
all files will be repartitioned evenly (i.e., a single large file might be
partitioned into smaller chunks) for parallel scanning. If set to `false`,
different files will be read in parallel, but repartitioning won't happen
within a single file. [...]
-| datafusion.optimizer.repartition_windows | true |
Should DataFusion repartition data using the partitions keys to execute window
functions in parallel using the provided `target_partitions` level
[...]
-| datafusion.optimizer.repartition_sorts | true |
Should DataFusion execute sorts in a per-partition fashion and merge afterwards
instead of coalescing first and sorting globally. With this flag is enabled,
plans in the form below `text "SortExec: [a@0 ASC]", " CoalescePartitionsExec",
" RepartitionExec: partitioning=RoundRobinBatch(8), input_partitions=1", `
would turn into the plan below which performs better in multithreaded
environments `text "SortPreserving [...]
-| datafusion.optimizer.bounded_order_preserving_variants | false |
When true, DataFusion will opportunistically remove sorts by replacing
`RepartitionExec` with `SortPreservingRepartitionExec`, and
`CoalescePartitionsExec` with `SortPreservingMergeExec`, even when the query is
bounded.
[...]
-| datafusion.optimizer.skip_failed_rules | false |
When set to true, the logical plan optimizer will produce warning messages if
any optimization rules produce errors and then proceed to the next rule. When
set to false, any rules that produce errors will cause the query to fail
[...]
-| datafusion.optimizer.max_passes | 3 |
Number of times that the optimizer will attempt to optimize the plan
[...]
-| datafusion.optimizer.top_down_join_key_reordering | true |
When set to true, the physical plan optimizer will run a top down process to
reorder the join keys
[...]
-| datafusion.optimizer.prefer_hash_join | true |
When set to true, the physical plan optimizer will prefer HashJoin over
SortMergeJoin. HashJoin can work more efficiently than SortMergeJoin but
consumes more memory
[...]
-| datafusion.optimizer.hash_join_single_partition_threshold | 1048576 |
The maximum estimated size in bytes for one input side of a HashJoin will be
collected into a single partition
[...]
-| datafusion.explain.logical_plan_only | false |
When set to true, the explain statement will only print logical plans
[...]
-| datafusion.explain.physical_plan_only | false |
When set to true, the explain statement will only print physical plans
[...]
-| datafusion.sql_parser.parse_float_as_decimal | false |
When set to true, SQL parser will parse float as decimal type
[...]
-| datafusion.sql_parser.enable_ident_normalization | true |
When set to true, SQL parser will normalize ident (convert ident to lowercase
when not quoted)
[...]
-| datafusion.sql_parser.dialect | generic |
Configure the SQL dialect used by DataFusion's parser; supported values
include: Generic, MySQL, PostgreSQL, Hive, SQLite, Snowflake, Redshift, MsSQL,
ClickHouse, BigQuery, and Ansi.
[...]
+| key | default
| description
[...]
+| ---------------------------------------------------------- |
------------------------- |
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[...]
+| datafusion.catalog.create_default_catalog_and_schema | true
| Whether the default catalog and schema should be created
automatically.
[...]
+| datafusion.catalog.default_catalog | datafusion
| The default catalog name - this impacts what SQL queries use if not
specified
[...]
+| datafusion.catalog.default_schema | public
| The default schema name - this impacts what SQL queries use if not
specified
[...]
+| datafusion.catalog.information_schema | false
| Should DataFusion provide access to `information_schema` virtual
tables for displaying schema information
[...]
+| datafusion.catalog.location | NULL
| Location scanned to load tables for `default` schema
[...]
+| datafusion.catalog.format | NULL
| Type of `TableProvider` to use when loading `default` schema
[...]
+| datafusion.catalog.has_header | false
| If the file has a header
[...]
+| datafusion.execution.batch_size | 8192
| Default batch size while creating new batches, it's especially
useful for buffer-in-memory batches since creating tiny batches would result in
too much metadata memory consumption
[...]
+| datafusion.execution.coalesce_batches | true
| When set to true, record batches will be examined between each
operator and small batches will be coalesced into larger batches. This is
helpful when there are highly selective filters or joins that could produce
tiny output batches. The target batch size is determined by the configuration
setting
[...]
+| datafusion.execution.collect_statistics | false
| Should DataFusion collect statistics after listing files
[...]
+| datafusion.execution.target_partitions | 0
| Number of partitions for query execution. Increasing partitions can
increase concurrency. Defaults to the number of CPU cores on the system
[...]
+| datafusion.execution.time_zone | +00:00
| The default time zone Some functions, e.g. `EXTRACT(HOUR from
SOME_TIME)`, shift the underlying datetime according to this time zone, and
then extract the hour
[...]
+| datafusion.execution.parquet.enable_page_index | true
| If true, reads the Parquet data page level metadata (the Page
Index), if present, to reduce the I/O and number of rows decoded.
[...]
+| datafusion.execution.parquet.pruning | true
| If true, the parquet reader attempts to skip entire row groups
based on the predicate in the query and the metadata (min/max values) stored in
the parquet file
[...]
+| datafusion.execution.parquet.skip_metadata | true
| If true, the parquet reader skip the optional embedded metadata
that may be in the file Schema. This setting can help avoid schema conflicts
when querying multiple parquet files with schemas containing compatible types
but different metadata
[...]
+| datafusion.execution.parquet.metadata_size_hint | NULL
| If specified, the parquet reader will try and fetch the last
`size_hint` bytes of the parquet file optimistically. If not specified, two
reads are required: One read to fetch the 8-byte parquet footer and another to
fetch the metadata length encoded in the footer
[...]
+| datafusion.execution.parquet.pushdown_filters | false
| If true, filter expressions are be applied during the parquet
decoding operation to reduce the number of rows decoded
[...]
+| datafusion.execution.parquet.reorder_filters | false
| If true, filter expressions evaluated during the parquet decoding
operation will be reordered heuristically to minimize the cost of evaluation.
If false, the filters are applied in the same order as written in the query
[...]
+| datafusion.execution.parquet.data_pagesize_limit | 1048576
| Sets best effort maximum size of data page in bytes
[...]
+| datafusion.execution.parquet.write_batch_size | 1024
| Sets write_batch_size in bytes
[...]
+| datafusion.execution.parquet.writer_version | 1.0
| Sets parquet writer version valid values are "1.0" and "2.0"
[...]
+| datafusion.execution.parquet.compression | snappy
| Sets default parquet compression codec Valid values are:
uncompressed, snappy, gzip(level), lzo, brotli(level), lz4, zstd(level), and
lz4_raw. These values are not case sensitive.
[...]
+| datafusion.execution.parquet.dictionary_enabled | true
| Sets if dictionary encoding is enabled
[...]
+| datafusion.execution.parquet.dictionary_page_size_limit | 1048576
| Sets best effort maximum dictionary page size, in bytes
[...]
+| datafusion.execution.parquet.statistics_enabled | page
| Sets if statistics are enabled for any column Valid values are:
"none", "chunk", and "page" These values are not case sensitive.
[...]
+| datafusion.execution.parquet.max_statistics_size | 4096
| Sets max statistics size for any column
[...]
+| datafusion.execution.parquet.max_row_group_size | 1048576
| Sets maximum number of rows in a row group
[...]
+| datafusion.execution.parquet.created_by | datafusion
version 28.0.0 | Sets "created by" property
[...]
+| datafusion.execution.parquet.column_index_truncate_length | NULL
| Sets column index trucate length
[...]
+| datafusion.execution.parquet.data_page_row_count_limit |
18446744073709551615 | Sets best effort maximum number of rows in data
page
[...]
+| datafusion.execution.parquet.encoding | plain
| Sets default encoding for any column Valid values are: plain,
plain_dictionary, rle, bit_packed, delta_binary_packed,
delta_length_byte_array, delta_byte_array, rle_dictionary, and
byte_stream_split. These values are not case sensitive.
[...]
+| datafusion.execution.parquet.bloom_filter_enabled | false
| Sets if bloom filter is enabled for any column
[...]
+| datafusion.execution.parquet.bloom_filter_fpp | 0.05
| Sets bloom filter false positive probability
[...]
+| datafusion.execution.parquet.bloom_filter_ndv | 1000000
| Sets bloom filter number of distinct values
[...]
+| datafusion.execution.aggregate.scalar_update_factor | 10
| Specifies the threshold for using `ScalarValue`s to update
accumulators during high-cardinality aggregations for each input batch. The
aggregation is considered high-cardinality if the number of affected groups is
greater than or equal to `batch_size / scalar_update_factor`. In such cases,
`ScalarValue`s are utilized for updating accumulators, rather than the default
batch-slice approach. This can [...]
+| datafusion.execution.planning_concurrency | 0
| Fan-out during initial physical planning. This is mostly use to
plan `UNION` children in parallel. Defaults to the number of CPU cores on the
system
[...]
+| datafusion.execution.sort_spill_reservation_bytes | 10485760
| Specifies the reserved memory for each spillable sort operation to
facilitate an in-memory merge. When a sort operation spills to disk, the
in-memory data must be sorted and merged before being written to a file. This
setting reserves a specific amount of memory for that in-memory sort/merge
process. Note: This setting is irrelevant if the sort operation cannot spill
(i.e., if there's no `DiskManag [...]
+| datafusion.execution.sort_in_place_threshold_bytes | 1048576
| When sorting, below what size should data be concatenated and
sorted in a single RecordBatch rather than sorted in batches and merged.
[...]
+| datafusion.optimizer.enable_round_robin_repartition | true
| When set to true, the physical plan optimizer will try to add round
robin repartitioning to increase parallelism to leverage more CPU cores
[...]
+| datafusion.optimizer.filter_null_join_keys | false
| When set to true, the optimizer will insert filters before a join
between a nullable and non-nullable column to filter out nulls on the nullable
side. This filter can add additional overhead when the file format does not
fully support predicate push down.
[...]
+| datafusion.optimizer.repartition_aggregations | true
| Should DataFusion repartition data using the aggregate keys to
execute aggregates in parallel using the provided `target_partitions` level
[...]
+| datafusion.optimizer.repartition_file_min_size | 10485760
| Minimum total files size in bytes to perform file scan
repartitioning.
[...]
+| datafusion.optimizer.repartition_joins | true
| Should DataFusion repartition data using the join keys to execute
joins in parallel using the provided `target_partitions` level
[...]
+| datafusion.optimizer.allow_symmetric_joins_without_pruning | true
| Should DataFusion allow symmetric hash joins for unbounded data
sources even when its inputs do not have any ordering or filtering If the flag
is not enabled, the SymmetricHashJoin operator will be unable to prune its
internal buffers, resulting in certain join types - such as Full, Left,
LeftAnti, LeftSemi, Right, RightAnti, and RightSemi - being produced only at
the end of the execution. This is [...]
+| datafusion.optimizer.repartition_file_scans | true
| When set to `true`, file groups will be repartitioned to achieve
maximum parallelism. Currently Parquet and CSV formats are supported. If set to
`true`, all files will be repartitioned evenly (i.e., a single large file might
be partitioned into smaller chunks) for parallel scanning. If set to `false`,
different files will be read in parallel, but repartitioning won't happen
within a single file. [...]
+| datafusion.optimizer.repartition_windows | true
| Should DataFusion repartition data using the partitions keys to
execute window functions in parallel using the provided `target_partitions`
level
[...]
+| datafusion.optimizer.repartition_sorts | true
| Should DataFusion execute sorts in a per-partition fashion and
merge afterwards instead of coalescing first and sorting globally. With this
flag is enabled, plans in the form below `text "SortExec: [a@0 ASC]", "
CoalescePartitionsExec", " RepartitionExec: partitioning=RoundRobinBatch(8),
input_partitions=1", ` would turn into the plan below which performs better in
multithreaded environments `text [...]
+| datafusion.optimizer.bounded_order_preserving_variants | false
| When true, DataFusion will opportunistically remove sorts by
replacing `RepartitionExec` with `SortPreservingRepartitionExec`, and
`CoalescePartitionsExec` with `SortPreservingMergeExec`, even when the query is
bounded.
[...]
+| datafusion.optimizer.skip_failed_rules | false
| When set to true, the logical plan optimizer will produce warning
messages if any optimization rules produce errors and then proceed to the next
rule. When set to false, any rules that produce errors will cause the query to
fail
[...]
+| datafusion.optimizer.max_passes | 3
| Number of times that the optimizer will attempt to optimize the
plan
[...]
+| datafusion.optimizer.top_down_join_key_reordering | true
| When set to true, the physical plan optimizer will run a top down
process to reorder the join keys
[...]
+| datafusion.optimizer.prefer_hash_join | true
| When set to true, the physical plan optimizer will prefer HashJoin
over SortMergeJoin. HashJoin can work more efficiently than SortMergeJoin but
consumes more memory
[...]
+| datafusion.optimizer.hash_join_single_partition_threshold | 1048576
| The maximum estimated size in bytes for one input side of a
HashJoin will be collected into a single partition
[...]
+| datafusion.explain.logical_plan_only | false
| When set to true, the explain statement will only print logical
plans
[...]
+| datafusion.explain.physical_plan_only | false
| When set to true, the explain statement will only print physical
plans
[...]
+| datafusion.sql_parser.parse_float_as_decimal | false
| When set to true, SQL parser will parse float as decimal type
[...]
+| datafusion.sql_parser.enable_ident_normalization | true
| When set to true, SQL parser will normalize ident (convert ident to
lowercase when not quoted)
[...]
+| datafusion.sql_parser.dialect | generic
| Configure the SQL dialect used by DataFusion's parser; supported
values include: Generic, MySQL, PostgreSQL, Hive, SQLite, Snowflake, Redshift,
MsSQL, ClickHouse, BigQuery, and Ansi.
[...]
diff --git a/searchindex.js b/searchindex.js
index b1e23bba1f..fa03eeb346 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"docnames": ["contributor-guide/architecture",
"contributor-guide/communication", "contributor-guide/index",
"contributor-guide/quarterly_roadmap", "contributor-guide/roadmap",
"contributor-guide/specification/index",
"contributor-guide/specification/invariants",
"contributor-guide/specification/output-field-name-semantic", "index",
"user-guide/cli", "user-guide/configs", "user-guide/dataframe",
"user-guide/example-usage", "user-guide/expressions", "user-guide/faq", "use
[...]
\ No newline at end of file
+Search.setIndex({"docnames": ["contributor-guide/architecture",
"contributor-guide/communication", "contributor-guide/index",
"contributor-guide/quarterly_roadmap", "contributor-guide/roadmap",
"contributor-guide/specification/index",
"contributor-guide/specification/invariants",
"contributor-guide/specification/output-field-name-semantic", "index",
"user-guide/cli", "user-guide/configs", "user-guide/dataframe",
"user-guide/example-usage", "user-guide/expressions", "user-guide/faq", "use
[...]
\ No newline at end of file
diff --git a/user-guide/configs.html b/user-guide/configs.html
index 0962850732..e03cb5c244 100644
--- a/user-guide/configs.html
+++ b/user-guide/configs.html
@@ -414,6 +414,70 @@ Environment variables are read during <code
class="docutils literal notranslate"
<td><p>false</p></td>
<td><p>If true, filter expressions evaluated during the parquet decoding
operation will be reordered heuristically to minimize the cost of evaluation.
If false, the filters are applied in the same order as written in the
query</p></td>
</tr>
+<tr
class="row-even"><td><p>datafusion.execution.parquet.data_pagesize_limit</p></td>
+<td><p>1048576</p></td>
+<td><p>Sets best effort maximum size of data page in bytes</p></td>
+</tr>
+<tr
class="row-odd"><td><p>datafusion.execution.parquet.write_batch_size</p></td>
+<td><p>1024</p></td>
+<td><p>Sets write_batch_size in bytes</p></td>
+</tr>
+<tr
class="row-even"><td><p>datafusion.execution.parquet.writer_version</p></td>
+<td><p>1.0</p></td>
+<td><p>Sets parquet writer version valid values are “1.0” and “2.0”</p></td>
+</tr>
+<tr class="row-odd"><td><p>datafusion.execution.parquet.compression</p></td>
+<td><p>snappy</p></td>
+<td><p>Sets default parquet compression codec Valid values are: uncompressed,
snappy, gzip(level), lzo, brotli(level), lz4, zstd(level), and lz4_raw. These
values are not case sensitive.</p></td>
+</tr>
+<tr
class="row-even"><td><p>datafusion.execution.parquet.dictionary_enabled</p></td>
+<td><p>true</p></td>
+<td><p>Sets if dictionary encoding is enabled</p></td>
+</tr>
+<tr
class="row-odd"><td><p>datafusion.execution.parquet.dictionary_page_size_limit</p></td>
+<td><p>1048576</p></td>
+<td><p>Sets best effort maximum dictionary page size, in bytes</p></td>
+</tr>
+<tr
class="row-even"><td><p>datafusion.execution.parquet.statistics_enabled</p></td>
+<td><p>page</p></td>
+<td><p>Sets if statistics are enabled for any column Valid values are: “none”,
“chunk”, and “page” These values are not case sensitive.</p></td>
+</tr>
+<tr
class="row-odd"><td><p>datafusion.execution.parquet.max_statistics_size</p></td>
+<td><p>4096</p></td>
+<td><p>Sets max statistics size for any column</p></td>
+</tr>
+<tr
class="row-even"><td><p>datafusion.execution.parquet.max_row_group_size</p></td>
+<td><p>1048576</p></td>
+<td><p>Sets maximum number of rows in a row group</p></td>
+</tr>
+<tr class="row-odd"><td><p>datafusion.execution.parquet.created_by</p></td>
+<td><p>datafusion version 28.0.0</p></td>
+<td><p>Sets “created by” property</p></td>
+</tr>
+<tr
class="row-even"><td><p>datafusion.execution.parquet.column_index_truncate_length</p></td>
+<td><p>NULL</p></td>
+<td><p>Sets column index trucate length</p></td>
+</tr>
+<tr
class="row-odd"><td><p>datafusion.execution.parquet.data_page_row_count_limit</p></td>
+<td><p>18446744073709551615</p></td>
+<td><p>Sets best effort maximum number of rows in data page</p></td>
+</tr>
+<tr class="row-even"><td><p>datafusion.execution.parquet.encoding</p></td>
+<td><p>plain</p></td>
+<td><p>Sets default encoding for any column Valid values are: plain,
plain_dictionary, rle, bit_packed, delta_binary_packed,
delta_length_byte_array, delta_byte_array, rle_dictionary, and
byte_stream_split. These values are not case sensitive.</p></td>
+</tr>
+<tr
class="row-odd"><td><p>datafusion.execution.parquet.bloom_filter_enabled</p></td>
+<td><p>false</p></td>
+<td><p>Sets if bloom filter is enabled for any column</p></td>
+</tr>
+<tr
class="row-even"><td><p>datafusion.execution.parquet.bloom_filter_fpp</p></td>
+<td><p>0.05</p></td>
+<td><p>Sets bloom filter false positive probability</p></td>
+</tr>
+<tr
class="row-odd"><td><p>datafusion.execution.parquet.bloom_filter_ndv</p></td>
+<td><p>1000000</p></td>
+<td><p>Sets bloom filter number of distinct values</p></td>
+</tr>
<tr
class="row-even"><td><p>datafusion.execution.aggregate.scalar_update_factor</p></td>
<td><p>10</p></td>
<td><p>Specifies the threshold for using <code class="docutils literal
notranslate"><span class="pre">ScalarValue</span></code>s to update
accumulators during high-cardinality aggregations for each input batch. The
aggregation is considered high-cardinality if the number of affected groups is
greater than or equal to <code class="docutils literal notranslate"><span
class="pre">batch_size</span> <span class="pre">/</span> <span
class="pre">scalar_update_factor</span></code>. In such cases [...]
