>From Ritik Raj <ritik....@couchbase.com>:
Attention is currently required from: Ritik Raj.
Hello Peeyush Gupta, Jenkins, Anon. E. Moose #1000171,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19865
to look at the new patch set (#8).
Change subject: [ASTERIXDB-3617][STO] Supporting sparse page zero writer
......................................................................
[ASTERIXDB-3617][STO] Supporting sparse page zero writer
- user model changes: no
- storage format changes: yes
- interface changes: yes
Details:
Introducing sparse pageZero writer for
fitting columns offset + filter more efficiently
in case the batch of documents contains only
a subset of columns.
Ext-ref: MB-66306
Change-Id: I151d376cc94ea858a25fe8396c53775125ef7de6
---
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/metadata/schema/AbstractSchemaNode.java
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/writers/SparseColumnPageZeroWriter.java
A
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/IColumnPageZeroWriter.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/metadata/schema/collection/AbstractCollectionSchemaNode.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/tuple/QueryColumnTupleReference.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC535339.xml.json
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/api/AbstractColumnTupleWriter.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC545044.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC545053.xml.json
M
asterixdb/asterix-column/src/test/java/org/apache/asterix/column/test/bytes/AbstractBytesTest.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC548145.xml.json
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/readers/DefaultColumnPageZeroReader.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/metadata/schema/primitive/PrimitiveSchemaNode.java
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/PageZeroWriterFlavorSelector.java
M
asterixdb/asterix-app/src/test/resources/runtimets/testsuite_single_partition_sqlpp.xml
A
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/IColumnPageZeroReader.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC524032.xml.json
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/api/AbstractColumnTupleReader.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/lsm/flush/FlushColumnTupleWithMetaWriter.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC544882.xml.json
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/column/sparse-columns/001/001.002.update.sqlpp
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/lsm/flush/FlushColumnMetadata.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/metadata/schema/visitor/SchemaBuilderFromIATypeVisitor.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/metadata/schema/ObjectSchemaNode.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/metadata/schema/UnionSchemaNode.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC529439.xml.json
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/metadata/schema/AbstractSchemaNestedNode.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/tuple/MergeColumnTupleReference.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC549190.xml.json
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/writers/DefaultColumnPageZeroWriter.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/lsm/flush/NoWriteColumnTransformer.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/tuple/QueryColumnWithMetaTupleReference.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC544859.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC544195.xml.json
A
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/IColumnPageZeroWriterFlavorSelector.java
M
hyracks-fullstack/hyracks/hyracks-storage-common/src/main/java/org/apache/hyracks/storage/common/buffercache/CachedPage.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/lsm/flush/FlushColumnTupleWriter.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC520756.xml.json
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/column/sparse-columns/001/001.001.ddl.sqlpp
M
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/column/io/merge/ASTERIXDB-3597/ASTERIXDB-3597.004.query.sqlpp
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/values/writer/filters/AbstractColumnFilterWriter.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/ColumnBTreeWriteLeafFrame.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC534108.xml.json
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/cloud/ColumnRanges.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/filter/FilterAccessorProvider.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC517494.xml.json
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/readers/SparseColumnPageZeroReader.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC539059.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC549079.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC517714.xml.json
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/lsm/flush/NoWriteFlushColumnMetadata.java
A
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/IValuesWriter.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/lsm/tuples/ColumnMultiBufferProvider.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/lsm/merge/MergeColumnTupleWriter.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC545201.xml.json
A
asterixdb/asterix-app/src/test/resources/runtimets/results/column/sparse-columns/001/001.003.adm
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/values/IColumnValuesWriter.java
M
asterixdb/asterix-column/src/test/java/org/apache/asterix/column/test/dummy/AbstractDummyTest.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/ColumnBTreeReadLeafFrame.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/lsm/merge/MergeColumnTupleReader.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/bytes/stream/out/ByteBufferOutputStream.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/values/IColumnBatchWriter.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/lsm/tuples/AbstractColumnTupleReference.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/query/QueryColumnTupleReader.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/lsm/flush/BatchFinalizerVisitor.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC538260.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC545063.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC518965.xml.json
M asterixdb/asterix-app/src/test/resources/runtimets/sqlpp_queries.xml
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/values/writer/ColumnBatchWriter.java
A
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/column/sparse-columns/001/001.003.query.sqlpp
M
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/column/io/flush/ASTERIXDB-3597/ASTERIXDB-3597.003.query.sqlpp
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC539063.xml.json
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/lsm/flush/ColumnTransformer.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC529455.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC546205.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC261870.xml.json
M
asterixdb/asterix-column/src/test/java/org/apache/asterix/column/values/writer/NoOpColumnBatchWriter.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/AbstractColumnBTreeLeafFrame.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/ColumnBTreeBulkloader.java
80 files changed, 58,049 insertions(+), 209 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb
refs/changes/65/19865/8
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19865
To unsubscribe, or for help writing mail filters, visit
https://asterix-gerrit.ics.uci.edu/settings
Gerrit-Project: asterixdb
Gerrit-Branch: ionic
Gerrit-Change-Id: I151d376cc94ea858a25fe8396c53775125ef7de6
Gerrit-Change-Number: 19865
Gerrit-PatchSet: 8
Gerrit-Owner: Ritik Raj <ritik....@couchbase.com>
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins <jenk...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Peeyush Gupta <peeyush.gu...@couchbase.com>
Gerrit-Attention: Ritik Raj <ritik....@couchbase.com>
Gerrit-MessageType: newpatchset
