This is an automated email from the ASF dual-hosted git repository.
suxiaogang223 pushed a change to branch refact_reader_branch
in repository https://gitbox.apache.org/repos/asf/doris.git
from c7e07bf0f43 clone function context (#64079)
add d6487e83cd9 [refactor](be) Simplify new parquet complex reader
assembly (#64078)
No new revisions were added by this update.
Summary of changes:
be/src/format/new_parquet/parquet_reader.cpp | 94 ---
be/src/format/new_parquet/parquet_reader.h | 6 -
.../reader/arrow_leaf_reader_adapter.cpp | 41 +-
be/src/format/new_parquet/reader/column_reader.cpp | 5 +-
.../new_parquet/reader/list_column_reader.cpp | 358 ++++++++--
.../new_parquet/reader/map_column_reader.cpp | 784 ++++++++++++++++-----
.../new_parquet/reader/nested_column_reader.cpp | 20 +-
.../new_parquet/reader/nested_column_reader.h | 524 ++------------
...n_reader.cpp => row_position_column_reader.cpp} | 51 +-
...olumn_reader.h => row_position_column_reader.h} | 20 -
.../new_parquet/reader/struct_column_reader.cpp | 12 +-
be/src/format/reader/column_mapper.cpp | 48 +-
be/src/format/reader/file_reader.h | 1 -
be/src/format/reader/schema_projection.cpp | 73 ++
.../reader/schema_projection.h} | 30 +-
be/src/format/reader/table_reader.h | 100 ++-
.../new_parquet/parquet_column_reader_test.cpp | 186 ++++-
...complex-column-predicate-and-stats-filtering.md | 201 ++++++
docs/doris-new-parquet-reader-internal-layering.md | 552 ---------------
docs/observability-profile-plan.md | 100 +++
docs/page-level-skip-plan.md | 111 +++
docs/ut-coverage-plan.md | 92 +++
22 files changed, 1798 insertions(+), 1611 deletions(-)
rename be/src/format/new_parquet/reader/{shape_only_column_reader.cpp =>
row_position_column_reader.cpp} (61%)
rename be/src/format/new_parquet/reader/{shape_only_column_reader.h =>
row_position_column_reader.h} (67%)
create mode 100644 be/src/format/reader/schema_projection.cpp
copy be/src/{service/brpc_service.h => format/reader/schema_projection.h} (68%)
create mode 100644 docs/complex-column-predicate-and-stats-filtering.md
delete mode 100644 docs/doris-new-parquet-reader-internal-layering.md
create mode 100644 docs/observability-profile-plan.md
create mode 100644 docs/page-level-skip-plan.md
create mode 100644 docs/ut-coverage-plan.md
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
