Jackie-Jiang commented on a change in pull request #7513:
URL: https://github.com/apache/pinot/pull/7513#discussion_r721738360
##########
File path:
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/index/readers/BitSlicedRangeIndexReader.java
##########
@@ -45,30 +50,34 @@ public BitSlicedRangeIndexReader(PinotDataBuffer
dataBuffer) {
_min = dataBuffer.getLong(offset);
offset += Long.BYTES;
_offset = offset;
+ _max = metadata.hasDictionary()
Review comment:
Suggest making them part of the header so that the index is
self-contained. It will be a backward-incompatible change, but since we haven't
released it yet, it should be fine.
##########
File path:
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/index/readers/BitSlicedRangeIndexReader.java
##########
@@ -97,12 +106,22 @@ public ImmutableRoaringBitmap
getPartiallyMatchingDocIds(double min, double max)
return null;
}
- private ImmutableRoaringBitmap queryRangeBitmap(long min, long max) {
+ private ImmutableRoaringBitmap queryRangeBitmap(long min, long max, long
columnMax) {
RangeBitmap rangeBitmap = mapRangeBitmap();
- RoaringBitmap lte = rangeBitmap.lte(max);
- RoaringBitmap gte = rangeBitmap.gte(min);
- lte.and(gte);
- return lte.toMutableRoaringBitmap();
+ if (Long.compareUnsigned(max, columnMax) < 0) {
+ RoaringBitmap lte = rangeBitmap.lte(max);
+ if (Long.compareUnsigned(min, 0) > 0) {
Review comment:
Is this equivalent to `min != 0` (faster)?
##########
File path:
pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/index/readers/BitSlicedRangeIndexReader.java
##########
@@ -23,20 +23,25 @@
import javax.annotation.Nullable;
import
org.apache.pinot.segment.local.segment.creator.impl.inv.BitSlicedRangeIndexCreator;
import org.apache.pinot.segment.local.utils.FPOrdering;
+import org.apache.pinot.segment.spi.ColumnMetadata;
import org.apache.pinot.segment.spi.index.reader.RangeIndexReader;
import org.apache.pinot.segment.spi.memory.PinotDataBuffer;
import org.roaringbitmap.RangeBitmap;
import org.roaringbitmap.RoaringBitmap;
import org.roaringbitmap.buffer.ImmutableRoaringBitmap;
+import org.roaringbitmap.buffer.MutableRoaringBitmap;
public class BitSlicedRangeIndexReader implements
RangeIndexReader<ImmutableRoaringBitmap> {
private final PinotDataBuffer _dataBuffer;
private final long _offset;
private final long _min;
+ private final long _max;
+ private final long _maxRid;
Review comment:
(nit) We usually use `_numDocs`. It is currently exclusive, which can
possibly cause confusion
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]