yupeng9 commented on PR #10639:
URL: https://github.com/apache/pinot/pull/10639#issuecomment-1529828906

   > > @Jackie-Jiang The serialization that we are using is simple enough to 
not add significant overhead. It will probably cost 100 or so CPU cycles per 
record. Moreover, this overhead happens only during ingestion time and does not 
affect query performance. Keeping the LocalKeyValueStore pluggable will make it 
reusable in other places as well.
   > 
   > It is not that trivial comparing to other operations when updating a 
record. Adding a record to KV store could be much cheaper than serializing a 
primary key, meaning this change could cause several times performance 
degradation. Also, certain operation requires reference comparison, and should 
be handled differently if reference comparison is not possible
   
   @raghavgautam maybe we can have some quick benchmark to see how much 
overhead it adds, and it can be helpful to decide which layer we shall do the 
abstraction


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to