Jackie-Jiang commented on issue #10712: URL: https://github.com/apache/pinot/issues/10712#issuecomment-1736408878
@mcvsubbu I'm not planning to change the ingestion flow at least for the first stage. The destination of the ingestion should remain the physical table (OFFLINE or REALTIME), and logical table is just a routing concept, which is managed on the broker. With current Pinot, we can think of the raw table as the logical table, and the mapping is implicit: - If only OFFLINE physical table exist: myTable -> myTable_OFFLINE - If only REALTIME physical table exist: myTable -> myTable_REALTIME - If both OFFLINE and REALTIME physical table exist: myTable -> [myTable_OFFLINE, myTable_REALTIME, time boundary] The proposed logical table is a mapping from a logical table name to multiple physical tables plus an optional time boundary. In the future we may loose this constrain to allow logical table mapping to another logical table. All the change should be on the broker side, and there should be no change needed on ingestion flow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
