[GitHub] [pinot] nizarhejazi opened a new issue, #9770: Sorted index on a non-dictionary-encoded column results in full segment scan

[GitBox]

nizarhejazi opened a new issue, #9770:
URL: https://github.com/apache/pinot/issues/9770

   Defining a `sorted index` on a `non-dictionary-encoded` column causes Pinot 
to fully scan the content of segments (no inverted index is utilized).
   
   `user` table config:
   ```
         "noDictionaryColumns": [
           "id",
         ],
         "sortedColumn": [
           "id"
         ],
   ```
   
   Example query: 
   `EXPLAIN PLAN FOR select id, "home.state" from user where id IN ('some_id')`
   
   Output:
   <img width="1137" alt="image" 
src="https://user-images.githubusercontent.com/96436550/200915630-691efbcc-6f65-4172-8759-893fadf25aff.png";>
   
   Created another user table with a _sorted index_ defined over id which is 
_dictionary-encoded_.
   
   `user_id_dict_encoded` table config:
   ```
         "noDictionaryColumns": [
         ],
         "sortedColumn": [
           "id"
         ],
   ```
   
   Example query: 
   `EXPLAIN PLAN FOR select id, "home.state" from user_id_dict_encoded where id 
IN ('some_id')`
   
   Output:
   <img width="1139" alt="image" 
src="https://user-images.githubusercontent.com/96436550/200916480-672d0d0c-493d-46c7-8894-6cc040486be3.png";>
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org