This is an automated email from the ASF dual-hosted git repository.
Gabriel39 pushed a change to branch refact_reader_branch
in repository https://gitbox.apache.org/repos/asf/doris.git
from 33c3d95e39c update format with in prepare_split (#64936)
add 0230c99720c Dev 0629 (#64927)
No new revisions were added by this update.
Summary of changes:
be/src/exec/scan/file_scanner_v2.cpp | 89 ++++++++
be/src/exec/scan/file_scanner_v2.h | 12 ++
be/src/format_v2/file_reader.h | 32 +--
be/src/format_v2/jni/jni_table_reader.cpp | 4 +-
be/src/format_v2/jni/jni_table_reader.h | 1 -
be/src/format_v2/parquet/parquet_column_schema.cpp | 21 +-
be/src/format_v2/parquet/parquet_column_schema.h | 47 +----
be/src/format_v2/parquet/parquet_file_context.cpp | 9 -
be/src/format_v2/parquet/parquet_file_context.h | 22 +-
be/src/format_v2/parquet/parquet_profile.h | 54 ++---
be/src/format_v2/parquet/parquet_reader.cpp | 111 +++++++++-
be/src/format_v2/parquet/parquet_reader.h | 39 +---
be/src/format_v2/parquet/parquet_scan.cpp | 25 +--
be/src/format_v2/parquet/parquet_scan.h | 91 +++------
be/src/format_v2/parquet/parquet_statistics.cpp | 32 +--
be/src/format_v2/parquet/parquet_statistics.h | 78 ++-----
be/src/format_v2/parquet/parquet_type.h | 67 ++----
be/src/format_v2/parquet/reader/column_reader.cpp | 103 +++++++---
be/src/format_v2/parquet/reader/column_reader.h | 146 ++++---------
.../parquet/reader/global_rowid_column_reader.cpp | 3 -
.../parquet/reader/global_rowid_column_reader.h | 17 +-
.../parquet/reader/list_column_reader.cpp | 13 --
.../format_v2/parquet/reader/list_column_reader.h | 18 +-
.../format_v2/parquet/reader/map_column_reader.cpp | 15 --
.../format_v2/parquet/reader/map_column_reader.h | 26 +--
.../parquet/reader/nested_column_materializer.cpp | 13 +-
.../parquet/reader/nested_column_materializer.h | 22 +-
.../parquet/reader/parquet_leaf_reader.cpp | 226 +++++++++++----------
.../format_v2/parquet/reader/parquet_leaf_reader.h | 118 +++--------
.../parquet/reader/row_position_column_reader.cpp | 4 -
.../parquet/reader/row_position_column_reader.h | 13 +-
.../parquet/reader/scalar_column_reader.cpp | 28 +--
.../parquet/reader/scalar_column_reader.h | 38 +---
.../parquet/reader/struct_column_reader.cpp | 21 --
.../parquet/reader/struct_column_reader.h | 20 +-
be/src/format_v2/parquet/selection_vector.h | 13 --
be/src/format_v2/table_reader.cpp | 3 +
be/src/format_v2/table_reader.h | 30 +++
be/test/format_v2/parquet/parquet_reader_test.cpp | 226 +++++++++++++++++++++
.../format_v2/table/remote_doris_reader_test.cpp | 36 +++-
.../data/external_table_p0/tvf/test_http_tvf.out | 2 +-
.../test_remote_doris_agg_table_select.groovy | 4 +-
.../test_remote_doris_unique_table_select.groovy | 4 +-
.../test_remote_doris_variant_select.groovy | 2 +-
.../tvf/test_hdfs_parquet_group0.groovy | 2 +-
45 files changed, 937 insertions(+), 963 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
