wjddn279 commented on issue #63786: URL: https://github.com/apache/airflow/issues/63786#issuecomment-4073985696
I have resolved the same issue before. https://github.com/apache/airflow/pull/55589 The root cause is that when large-sized data is involved in the query, the sort_buffer becomes full. We confirmed that the "Out of sort memory" error occurs not only when selecting the data, but also simply by including it in the WHERE clause. I changed the query so that the large data column is not included in the query, and the final sorting is performed in Python. Confirmed that the error no longer occurs. I tested this and confirmed that [this PR](https://github.com/apache/airflow/pull/63797), which adds an index, still produces the error. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
