Hi Dong,
In case the requirement is fine-grained DataMap, then it is in the future
roadmap and coming soon, where you can save the RowId which will be helpful for
your spatial data. In between you can start your implementation on Blocklet
level pruning (coarse-grained) and later use the fine-g
Hi Sounak,
The biggest problem is not about how to implement my own DataMap but on the API
design itself. According to the current API, `prune` function will provide a
list of `Blocklet` rather than tuples. Note that the concept of Blocket is
closer to partition in Spark. As a result, `DataMap`
Hi Dong,
Embedded are the answers.
> - Datamap only support partition level (more precisely blocklet level
> pruning), Specifically, the `prune()` function in DataMap interface will
> consume a filter and produce a list of Blocklets. Then, it seems that
> building sophisticated data structur
Hi Carbon Team,
Recently, I am considering working on implementing a secondary index over the
DataMap API. After a careful look on the design, there are some questions and
concerns I want to raise here:
- Datamap only support partition level (more precisely blocklet level pruning),
Specificall
