#general
@anirudhananda: @anirudhananda has joined the channel
@kewei.shang: @kewei.shang has joined the channel
#random
@anirudhananda: @anirudhananda has joined the channel
@kewei.shang: @kewei.shang has joined the channel
#troubleshooting
@anirudhananda: @anirudhananda has joined the channel
@kewei.shang: @kewei.shang has joined the channel
#minion-improvements
@laxman: Trying to recollect all the observations and notes I made while moving this to production. So, will keep adding them here in this thread. • Decouple the tasks for the tables: Right now controller schedules conversion tasks of tables as a single table. If one table conversion is slow, then other tables conversion tasks will not be scheduled till slowest one gets completed. Instead, we can schedule individual task for each table. In our case, 5 out of 7 tables are taking under 10 minutes to convert each bucket. But the other 2 takes nearly an hour. Because of coupling all tables, other tables conversion is not able to proceed till the slowest ones gets completed. • Workflow status is SUCCEEDED even when one of the sub task fails or times out..
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org For additional commands, e-mail: dev-h...@pinot.apache.org
