bxji opened a new pull request #4894: [TE] [WIP] Dimension Exploration Prefetch optimizations URL: https://github.com/apache/incubator-pinot/pull/4894 This PR aims to solve a couple problems: - For dimension exploration jobs, prefetch based on the time granularity of the data. Currently we are pulling 90 days worth of data every time, which is a lot of data for minute-level granularity. - Utilize earlyStop() to make sure that we don't bother pre-fetching data when we know the detection will fail anyways.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
