[jira] [Created] (CARBONDATA-4330) Incremental‌ ‌Dataload‌ ‌of Average aggregate in ‌MV‌‌

Mon, 04 Apr 2022 22:24:05 -0700 

SHREELEKHYA GAMPA created CARBONDATA-4330:
---------------------------------------------

             Summary:  Incremental‌ ‌Dataload‌ ‌of Average aggregate in ‌MV‌‌
                 Key: CARBONDATA-4330
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4330
             Project: CarbonData
          Issue Type: Improvement
            Reporter: SHREELEKHYA GAMPA


Currently, whenever MV is created with average aggregate, a full refresh is 
done meaning it reloads the whole MV for any newly added segments. This will 
slow down the loading. With incremental data load, only the segments that are 
newly added can be loaded to the MV.
If avg is present, rewrite the query with the sum and count of the columns to 
create MV and use them to derive avg.
Refer: 
https://docs.google.com/document/d/1kPEMCX50FLZcmyzm6kcIQtUH9KXWDIqh-Hco7NkTp80/edit




--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to