mjohns-databricks commented on pull request #558: URL: https://github.com/apache/incubator-sedona/pull/558#issuecomment-953058020
@jiayuasu Here is the exception thrown in performing SQL joins on DBR 8+: `java.lang.NoSuchMethodError: org.apache.spark.sql.execution.BinaryExecNode.children$(Lorg/apache/spark/sql/execution/BinaryExecNode;)Lscala/collection/Seq;` Preliminary work on our side indicates that perhaps BinaryExecNode assumes binary compatibility between OSS Spark 3.1 and DBR version of Spark 3.1. Databricks doesn't guarantee binary compatibility between DBR and OSS though DBR 7 / Spark 3.0 did not hit this issue. Do you see a way to modify the use of BinaryExecNode to ensure this works in Databricks? If you like, we can work with you on our side to help troubleshoot and test. ### OSS BinaryExecNode  ### DBR BinaryExecNode  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
