This is an automated email from the ASF dual-hosted git repository.
lzljs3620320 pushed a change to branch release-1.3
in repository https://gitbox.apache.org/repos/asf/paimon.git
from a7500e4700 [flink] Incremental Clustering support specify partitions
(#6449)
new 4c1408e939 [Python] parallel read manifest entries (#6451)
new 08ff9ba223 [Python] max_workers at least 8 for
manifest_file_manager.read_entries_paralle
new bfbefe8ec0 [Python] Fix bug comparing string and int in
row_key_extractor (#6448)
new 80c08765db [rest] Add more hint message when commit failed because of
NoSuchResourceException(#6456)
new cddedd0341 [Python] Support schema evolution read for changing column
position (#6458)
new 53fbc2d8f3 [python] Introduce schema cache in SchemaManager
new d09c4f1d9c [python] Split read should discard predicate for other
fields
new f58f0f5e99 [python] Use _try_to_pad_batch_by_schema in TableRead
new 8152dda1ba [core] disable dv mode for incremental clustering table
(#6461)
new df2c5acdb8 [Python] Add basic tests for schema evolution read (#6463)
new 1d3e5e5e98 [Python] Blob read supports with_shard (#6465)
new 0a657b324e [doc] Supplementary the document of python REST API (#6466)
new 25d2bdd6f7 [doc] Refactor names in python-api
new edda9f0412 [arrow] Fix java.lang.IllegalArgumentException in
ArrowFormatCWriter. (#6459)
The 14 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docs/content/concepts/rest/dlf.md | 10 +-
docs/content/program-api/python-api.md | 61 +--
.../java/org/apache/paimon/arrow/ArrowUtils.java | 6 +-
.../paimon/arrow/vector/ArrowFormatCWriter.java | 3 +-
.../paimon/arrow/vector/ArrowFormatWriterTest.java | 19 +
.../java/org/apache/paimon/rest/RESTCatalog.java | 2 +-
.../org/apache/paimon/schema/SchemaValidation.java | 3 +
paimon-python/pypaimon/common/core_options.py | 1 +
.../pypaimon/manifest/manifest_file_manager.py | 58 ++-
.../pypaimon/manifest/simple_stats_evolutions.py | 10 +-
.../pypaimon/read/scanner/full_starting_scanner.py | 110 ++++--
.../read/scanner/incremental_starting_scanner.py | 4 +-
paimon-python/pypaimon/read/split_read.py | 56 ++-
paimon-python/pypaimon/read/table_read.py | 29 +-
paimon-python/pypaimon/schema/schema_manager.py | 22 +-
paimon-python/pypaimon/tests/blob_table_test.py | 62 +++
.../pypaimon/tests/data_evolution_test.py | 52 +++
paimon-python/pypaimon/tests/pvfs_test.py | 3 +-
.../pypaimon/tests/reader_append_only_test.py | 2 +-
paimon-python/pypaimon/tests/rest/rest_server.py | 7 +-
.../pypaimon/tests/rest/rest_simple_test.py | 53 ++-
.../pypaimon/tests/schema_evolution_read_test.py | 431 +++++++++++++++++++++
paimon-python/pypaimon/write/row_key_extractor.py | 4 +-
23 files changed, 889 insertions(+), 119 deletions(-)
create mode 100644 paimon-python/pypaimon/tests/schema_evolution_read_test.py
