shubhransh-eb commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1732210613
So we had an incident in morning, where `analyze` command didnt help as well. We had to run following commands to bring back the table ``` ALTER TABLE task_instance STATS_SAMPLE_PAGES=256; analyze ``` Our hunch is since trigger_id is set to `null` when work is done, and by default mysql value of STATS_SAMPLE_PAGES is 20, stats calculation is affected. When you have huge table (in our case 5M rows in task_instance) and it run analyze command with such low STATS_SAMPLE_PAGES (with a lot of them having null), it caches cardinality in wrong way. we have updated the value in our table and will analyze it, but this could be a solution to set page_size for this table to be higher so that it can handle this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
