This is an automated email from the ASF dual-hosted git repository.
suxiaogang223 pushed a change to branch refact_reader_branch
in repository https://gitbox.apache.org/repos/asf/doris.git
from f8c4689eb49 fix by_index column mapper with struct type (#64567)
add f21fc29f38e [refactor](be) Unify new parquet profile definitions
add 7db9584ba86 [refactor](be) Move format v2 implementations under format
namespace
add 3a625c45b30 [test](regression) Update timestamp regression outputs
add a66cad53410 [fix](be) Support parquet timestamp nanos in new reader
No new revisions were added by this update.
Summary of changes:
.../data_type_serde/data_type_datetimev2_serde.cpp | 13 +-
be/src/exec/scan/file_scanner_v2.cpp | 8 +-
be/src/format_v2/expr/cast.cpp | 4 +-
be/src/format_v2/expr/cast.h | 4 +-
be/src/format_v2/expr/delete_predicate.cpp | 4 +-
be/src/format_v2/expr/delete_predicate.h | 4 +-
.../format_v2/expr/equality_delete_predicate.cpp | 4 +-
be/src/format_v2/expr/equality_delete_predicate.h | 4 +-
be/src/format_v2/jni/jdbc_reader.cpp | 4 +-
be/src/format_v2/jni/jdbc_reader.h | 4 +-
be/src/format_v2/parquet/parquet_column_schema.cpp | 4 +-
be/src/format_v2/parquet/parquet_column_schema.h | 4 +-
be/src/format_v2/parquet/parquet_file_context.cpp | 4 +-
be/src/format_v2/parquet/parquet_file_context.h | 4 +-
be/src/format_v2/parquet/parquet_profile.cpp | 191 +++++++++++++++++++++
be/src/format_v2/parquet/parquet_profile.h | 94 +++++++++-
be/src/format_v2/parquet/parquet_reader.cpp | 172 +------------------
be/src/format_v2/parquet/parquet_reader.h | 65 +------
be/src/format_v2/parquet/parquet_scan.cpp | 4 +-
be/src/format_v2/parquet/parquet_scan.h | 17 +-
be/src/format_v2/parquet/parquet_statistics.cpp | 4 +-
be/src/format_v2/parquet/parquet_statistics.h | 4 +-
be/src/format_v2/parquet/parquet_type.cpp | 8 +-
be/src/format_v2/parquet/parquet_type.h | 4 +-
be/src/format_v2/parquet/reader/column_reader.cpp | 4 +-
be/src/format_v2/parquet/reader/column_reader.h | 11 +-
.../parquet/reader/global_rowid_column_reader.cpp | 4 +-
.../parquet/reader/global_rowid_column_reader.h | 4 +-
.../parquet/reader/list_column_reader.cpp | 4 +-
.../format_v2/parquet/reader/list_column_reader.h | 4 +-
.../format_v2/parquet/reader/map_column_reader.cpp | 4 +-
.../format_v2/parquet/reader/map_column_reader.h | 4 +-
.../parquet/reader/nested_column_materializer.cpp | 4 +-
.../parquet/reader/nested_column_materializer.h | 4 +-
.../parquet/reader/parquet_leaf_reader.cpp | 4 +-
.../format_v2/parquet/reader/parquet_leaf_reader.h | 4 +-
.../parquet/reader/row_position_column_reader.cpp | 4 +-
.../parquet/reader/row_position_column_reader.h | 4 +-
.../parquet/reader/scalar_column_reader.cpp | 4 +-
.../parquet/reader/scalar_column_reader.h | 4 +-
.../parquet/reader/struct_column_reader.cpp | 4 +-
.../parquet/reader/struct_column_reader.h | 4 +-
be/src/format_v2/parquet/selection_vector.h | 4 +-
be/src/format_v2/table/hive_reader.cpp | 4 +-
be/src/format_v2/table/hive_reader.h | 4 +-
be/src/format_v2/table/iceberg_reader.cpp | 10 +-
be/src/format_v2/table/iceberg_reader.h | 4 +-
be/src/format_v2/table/paimon_reader.cpp | 4 +-
be/src/format_v2/table/paimon_reader.h | 4 +-
be/src/format_v2/table_reader.cpp | 2 +-
.../data_type_serde_decoded_values_test.cpp | 14 ++
be/test/format_v2/expr/cast_test.cpp | 4 +-
be/test/format_v2/expr/delete_predicate_test.cpp | 4 +-
.../expr/equality_delete_predicate_test.cpp | 4 +-
.../parquet/parquet_column_reader_test.cpp | 4 +-
be/test/format_v2/parquet/parquet_reader_test.cpp | 131 +++++++-------
be/test/format_v2/table_reader_test.cpp | 53 +++---
.../hive/test_hive_compress_type.out | 2 +-
.../hive/test_hive_get_schema_from_table.out | 40 ++---
.../write/test_iceberg_insert_overwrite.out | 2 +-
.../iceberg/write/test_iceberg_write_insert.out | 2 +-
.../paimon/paimon_timestamp_types.out | 2 +-
.../tvf/test_hdfs_parquet_group4.out | 8 +-
.../tvf/test_hdfs_parquet_group5.out | 4 +-
.../tvf/test_hdfs_parquet_group6.out | 2 +-
.../data/external_table_p0/tvf/test_http_tvf.out | 2 +-
66 files changed, 553 insertions(+), 472 deletions(-)
create mode 100644 be/src/format_v2/parquet/parquet_profile.cpp
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
