[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845988#comment-16845988 ]
Nandor Kollar commented on SPARK-27714: --------------------------------------- Is this something similar that is implemented [in Postgres|https://www.postgresql.org/docs/current/geqo.html]? I'm curious about the use case where GA could outperforms the current join reorder logic in Spark. I tried to find benchmark results about the Postgres implementation, but couldn't find any. Do you know any success story about applying GA in this field? > Support Join Reorder based on Genetic Algorithm when the # of joined tables > > 12 > -------------------------------------------------------------------------------- > > Key: SPARK-27714 > URL: https://issues.apache.org/jira/browse/SPARK-27714 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 2.4.3 > Reporter: Xianyin Xin > Priority: Major > > Now the join reorder logic is based on dynamic planning which can find the > most optimized plan theoretically, but the searching cost grows rapidly with > the # of joined tables grows. It would be better to introduce Genetic > algorithm (GA) to overcome this problem. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org