This is an automated email from the ASF dual-hosted git repository.
jackylee-ch pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/gluten.git
from fb646bedb9 [CH] Support skewness aggregate function (#12294)
add 66876d12cd [VL] Add lazy per-column deserialization for Columnar Table
Cache (#12211)
No new revisions were added by this update.
Summary of changes:
.../execution/ColumnarCachedBatchSerializer.scala | 356 ++++++++++++++---
.../ColumnarCachedBatchBuildFilterPruneSuite.scala | 50 +++
.../execution/ColumnarCachedBatchE2ESuite.scala | 61 ++-
.../ColumnarCachedBatchFramedBytesSuite.scala | 277 +++++++++++++
.../ColumnarCachedBatchLazySerdeTest.scala | 287 +++++++++++++
.../ColumnarCachedBatchSerializerHelperSuite.scala | 103 ++++-
.../ColumnarTableCacheLazyDeserBenchmark.scala | 366 +++++++++++++++++
cpp/core/jni/JniWrapper.cc | 90 ++++-
.../operators/serializer/ColumnarBatchSerializer.h | 31 +-
.../serializer/VeloxColumnarBatchSerializer.cc | 444 ++++++++++++++++++++-
.../serializer/VeloxColumnarBatchSerializer.h | 26 +-
.../tests/VeloxColumnarBatchSerializerTest.cc | 381 +++++++++++++++++-
docs/Configuration.md | 192 ++++-----
.../ColumnarBatchSerializerJniWrapper.java | 15 +-
.../org/apache/gluten/config/GlutenConfig.scala | 8 +-
.../apache/spark/sql/GlutenCachedTableSuite.scala | 4 +-
.../apache/spark/sql/GlutenCachedTableSuite.scala | 4 +-
.../apache/spark/sql/GlutenCachedTableSuite.scala | 4 +-
.../apache/spark/sql/GlutenCachedTableSuite.scala | 4 +-
.../apache/spark/sql/GlutenCachedTableSuite.scala | 4 +-
20 files changed, 2483 insertions(+), 224 deletions(-)
create mode 100644
backends-velox/src/test/scala/org/apache/spark/sql/execution/ColumnarCachedBatchLazySerdeTest.scala
create mode 100644
backends-velox/src/test/scala/org/apache/spark/sql/execution/benchmark/ColumnarTableCacheLazyDeserBenchmark.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
