This is an automated email from the ASF dual-hosted git repository.
Gabriel39 pushed a change to branch refact_reader_branch
in repository https://gitbox.apache.org/repos/asf/doris.git
from 11034c4d794 Fix 0611 (#64388)
add bbdc0f287c7 [refactor](be) Support recursive parquet complex readers
(#64357)
No new revisions were added by this update.
Summary of changes:
be/src/format_v2/column_mapper.cpp | 455 ++++++++--
be/src/format_v2/column_mapper.h | 4 +
be/src/format_v2/file_reader.cpp | 94 ++-
be/src/format_v2/file_reader.h | 55 +-
be/src/format_v2/parquet/parquet_column_schema.cpp | 20 +-
be/src/format_v2/parquet/parquet_column_schema.h | 6 +
be/src/format_v2/parquet/parquet_reader.cpp | 2 +-
be/src/format_v2/parquet/parquet_statistics.cpp | 8 +-
.../parquet/reader/arrow_leaf_reader_adapter.h | 77 --
be/src/format_v2/parquet/reader/column_reader.cpp | 64 +-
be/src/format_v2/parquet/reader/column_reader.h | 21 +
.../parquet/reader/list_column_reader.cpp | 471 +++--------
.../format_v2/parquet/reader/list_column_reader.h | 10 +-
.../format_v2/parquet/reader/map_column_reader.cpp | 782 ++++--------------
.../format_v2/parquet/reader/map_column_reader.h | 16 +-
.../parquet/reader/nested_column_materializer.cpp | 72 ++
.../nested_column_materializer.h} | 29 +-
.../parquet/reader/nested_column_reader.cpp | 433 ----------
.../parquet/reader/nested_column_reader.h | 390 ---------
..._reader_adapter.cpp => parquet_leaf_reader.cpp} | 398 +++++----
.../format_v2/parquet/reader/parquet_leaf_reader.h | 134 +++
.../parquet/reader/scalar_column_reader.cpp | 170 +++-
.../parquet/reader/scalar_column_reader.h | 19 +-
.../parquet/reader/struct_column_reader.cpp | 424 ++++------
.../parquet/reader/struct_column_reader.h | 8 +-
be/src/format_v2/schema_projection.cpp | 11 +-
be/src/format_v2/table_reader.h | 41 +-
.../parquet/parquet_column_reader_test.cpp | 915 ++++++++++++++++++++-
be/test/format_v2/parquet/parquet_reader_test.cpp | 412 +++++++++-
be/test/format_v2/table_reader_test.cpp | 198 +++++
...complex-column-predicate-and-stats-filtering.md | 277 -------
31 files changed, 3251 insertions(+), 2765 deletions(-)
delete mode 100644 be/src/format_v2/parquet/reader/arrow_leaf_reader_adapter.h
create mode 100644
be/src/format_v2/parquet/reader/nested_column_materializer.cpp
copy be/src/format_v2/parquet/{parquet_file_context.h =>
reader/nested_column_materializer.h} (58%)
delete mode 100644 be/src/format_v2/parquet/reader/nested_column_reader.cpp
delete mode 100644 be/src/format_v2/parquet/reader/nested_column_reader.h
rename be/src/format_v2/parquet/reader/{arrow_leaf_reader_adapter.cpp =>
parquet_leaf_reader.cpp} (54%)
create mode 100644 be/src/format_v2/parquet/reader/parquet_leaf_reader.h
delete mode 100644 docs/complex-column-predicate-and-stats-filtering.md
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
