This is an automated email from the ASF dual-hosted git repository.
aokolnychyi pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git
from 5e25f2bb76 Python: Add more expression classes (#5258)
add 2a6d17f86b Spark: Support _deleted metadata column in vectorized reads
(#4888)
No new revisions were added by this update.
Summary of changes:
.../iceberg/arrow/vectorized/VectorHolder.java | 17 ++++
.../arrow/vectorized/VectorizedArrowReader.java | 27 +++++++
.../arrow/vectorized/VectorizedReaderBuilder.java | 2 +-
.../data/TestSparkParquetReadMetadataColumns.java | 4 +-
.../data/TestSparkParquetReadMetadataColumns.java | 4 +-
.../data/TestSparkParquetReadMetadataColumns.java | 4 +-
.../spark/source/IcebergSourceBenchmark.java | 5 ++
.../spark/source/IcebergSourceDeleteBenchmark.java | 49 +++++++++---
.../spark/data/vectorized/ColumnVectorBuilder.java | 53 +++++++++++++
.../data/vectorized/ColumnVectorWithFilter.java | 9 ---
.../spark/data/vectorized/ColumnarBatchReader.java | 90 ++++++++++++++--------
.../data/vectorized/DeletedColumnVector.java} | 19 ++---
.../data/vectorized/IcebergArrowColumnVector.java | 8 --
.../data/TestSparkParquetReadMetadataColumns.java | 36 +++++----
.../spark/source/TestSparkReaderDeletes.java | 11 ---
.../spark/source/IcebergSourceBenchmark.java | 5 ++
.../spark/source/IcebergSourceDeleteBenchmark.java | 49 +++++++++---
.../spark/data/vectorized/ColumnVectorBuilder.java | 53 +++++++++++++
.../data/vectorized/ColumnVectorWithFilter.java | 9 ---
.../spark/data/vectorized/ColumnarBatchReader.java | 90 ++++++++++++++--------
.../data/vectorized/DeletedColumnVector.java} | 19 ++---
.../data/vectorized/IcebergArrowColumnVector.java | 8 --
.../data/TestSparkParquetReadMetadataColumns.java | 36 +++++----
.../spark/source/TestSparkReaderDeletes.java | 11 ---
24 files changed, 416 insertions(+), 202 deletions(-)
create mode 100644
spark/v3.2/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/ColumnVectorBuilder.java
copy
spark/{v3.0/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/RowPositionColumnVector.java
=>
v3.2/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/DeletedColumnVector.java}
(85%)
create mode 100644
spark/v3.3/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/ColumnVectorBuilder.java
copy
spark/{v3.0/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/RowPositionColumnVector.java
=>
v3.3/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/DeletedColumnVector.java}
(85%)
