>From Ritik Raj <ritik....@couchbase.com>:
Attention is currently required from: Wail Alkowaileet, Ritik Raj.
Hello Peeyush Gupta, Jenkins, Anon. E. Moose #1000171,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19944
to look at the new patch set (#8).
Change subject: [ASTERIXDB-3601][STO] Supporting multi-page zeroes
......................................................................
[ASTERIXDB-3601][STO] Supporting multi-page zeroes
- user model changes: no
- storage format changes: yes
- interface changes: yes
Details:
This patch introduces writers which can span upto
multiple pageZeroes, which can theoretically help
to achieve a very large number of columns.
Ext-ref: MB-66306
Change-Id: I8e54f0e6a8cb9f17a38394833f1c8990ce29676e
---
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/writers/SparseColumnPageZeroWriter.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/cloud/sweep/ColumnSweepPlanner.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/IColumnPageZeroWriter.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1149493.xml.json
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/bytes/stream/out/MultiPersistentPageZeroBufferBytesOutputStream.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/api/AbstractColumnTupleWriter.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1090557.xml.json
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/cloud/buffercache/IColumnReadContext.java
M
asterixdb/asterix-column/src/test/java/org/apache/asterix/column/test/bytes/AbstractBytesTest.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1087510.xml.json
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/readers/DefaultColumnPageZeroReader.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC549598.xml.json
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/PageZeroWriterFlavorSelector.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/ColumnBTreeRangeSearchCursor.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC554982.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1090578.xml.json
M
hyracks-fullstack/hyracks/hyracks-storage-common/src/main/java/org/apache/hyracks/storage/common/buffercache/BufferCache.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC549583.xml.json
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/IColumnPageZeroReader.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1156866.xml.json
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/bytes/stream/out/AbstractMultiBufferBytesOutputStream.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1156889.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC552331.xml.json
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/cloud/buffercache/read/CloudColumnReadContext.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/tuple/MergeColumnTupleReference.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1156954.xml.json
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/writers/DefaultColumnPageZeroWriter.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1084353.xml.json
R
asterixdb/asterix-app/src/test/resources/runtimets/results/column/sparse-columns/001/001.003.regexjson
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/writers/multipage/SparseColumnMultiPageZeroWriter.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/IColumnPageZeroWriterFlavorSelector.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1084330.xml.json
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/api/IColumnWriteMultiPageOp.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC549520.xml.json
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/lsm/flush/FlushColumnTupleWriter.java
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/writers/multipage/SparseColumnMultiPageZeroReader.java
M
asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/column/sparse-columns/001/001.001.ddl.sqlpp
M
asterixdb/asterix-column/src/test/java/org/apache/asterix/column/common/buffer/NoOpWriteMultiPageOp.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/ColumnBTreeWriteLeafFrame.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC552329.xml.json
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/writers/multipage/DefaultColumnMultiPageZeroWriter.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/cloud/ColumnRanges.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC555555.xml.json
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/filter/FilterAccessorProvider.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/readers/SparseColumnPageZeroReader.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1065064.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1140948.xml.json
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/lsm/tuples/ColumnMultiBufferProvider.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/operation/lsm/merge/MergeColumnTupleWriter.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/cloud/buffercache/read/DefaultColumnReadContext.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1156932.xml.json
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/ColumnBTreeReadLeafFrame.java
A
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/lsm/tuples/ColumnMultiPageZeroBufferProvider.java
M
hyracks-fullstack/hyracks/hyracks-cloud/src/main/java/org/apache/hyracks/cloud/sweeper/SweepContext.java
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/writers/multipage/AbstractColumnMultiPageZeroReader.java
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/values/IColumnBatchWriter.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/lsm/tuples/AbstractColumnTupleReference.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1110908.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC549591.xml.json
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/lsm/tuples/ColumnSingleBufferProvider.java
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/bytes/stream/in/MultiPageZeroByteBuffersReader.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1110910.xml.json
M
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/values/writer/ColumnBatchWriter.java
M
asterixdb/asterix-column/src/test/java/org/apache/asterix/column/common/buffer/TestWriteMultiPageOp.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/cloud/sweep/ColumnSweeper.java
A
asterixdb/asterix-column/src/main/java/org/apache/asterix/column/zero/writers/multipage/DefaultColumnMultiPageZeroReader.java
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1127111.xml.json
A asterixdb/asterix-app/data/big-sparse-columns-object/PMC1054884.xml.json
M
asterixdb/asterix-column/src/test/java/org/apache/asterix/column/values/writer/NoOpColumnBatchWriter.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/AbstractColumnBTreeLeafFrame.java
M
hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree-column/src/main/java/org/apache/hyracks/storage/am/lsm/btree/column/impls/btree/ColumnBTreeBulkloader.java
71 files changed, 54,246 insertions(+), 251 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb
refs/changes/44/19944/8
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19944
To unsubscribe, or for help writing mail filters, visit
https://asterix-gerrit.ics.uci.edu/settings
Gerrit-Project: asterixdb
Gerrit-Branch: ionic
Gerrit-Change-Id: I8e54f0e6a8cb9f17a38394833f1c8990ce29676e
Gerrit-Change-Number: 19944
Gerrit-PatchSet: 8
Gerrit-Owner: Ritik Raj <ritik....@couchbase.com>
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins <jenk...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Peeyush Gupta <peeyush.gu...@couchbase.com>
Gerrit-CC: Wail Alkowaileet <wael....@gmail.com>
Gerrit-Attention: Wail Alkowaileet <wael....@gmail.com>
Gerrit-Attention: Ritik Raj <ritik....@couchbase.com>
Gerrit-MessageType: newpatchset
