Re: Issue Upgrading to 3.2

2021-11-02 Thread Linhong Liu
Hello Adam, I just made a PR that should fix your issue. Would you like to give it a try? PR Link: https://github.com/apache/spark/pull/34473 Thanks, Linhong On Tue, Nov 2, 2021 at 1:16 AM Adam Binford wrote: > Sorry yeah good question. It happens on the call to spark.table("pixels") > > On

Re: Issue Upgrading to 3.2

2021-11-01 Thread Adam Binford
Sorry yeah good question. It happens on the call to spark.table("pixels") On Mon, Nov 1, 2021 at 12:36 PM Wenchen Fan wrote: > To confirm: Does the error happen during view creation, or when we read > the view later? > > On Mon, Nov 1, 2021 at 11:28 PM Adam Binford wrote: > >> I don't have a

Re: Issue Upgrading to 3.2

2021-11-01 Thread Wenchen Fan
To confirm: Does the error happen during view creation, or when we read the view later? On Mon, Nov 1, 2021 at 11:28 PM Adam Binford wrote: > I don't have a minimal reproduction right now but here's more relevant > code snippets. > > Stacktrace: > org.apache.spark.sql.AnalysisException:

Re: Issue Upgrading to 3.2

2021-11-01 Thread Adam Binford
I don't have a minimal reproduction right now but here's more relevant code snippets. Stacktrace: org.apache.spark.sql.AnalysisException: Undefined function: 'ST_PolygonFromEnvelope'. This function is neither a registered temporary function nor a permanent function registered in the database

Re: Issue Upgrading to 3.2

2021-11-01 Thread Wenchen Fan
Hi Adam, Thanks for reporting this issue! Do you have the full stacktrace or a code snippet to reproduce the issue at Spark side? It looks like a bug, but it's not obvious to me how this bug can happen. Thanks, Wenchen On Sat, Oct 30, 2021 at 1:08 AM Adam Binford wrote: > Hi devs, > > I'm

Issue Upgrading to 3.2

2021-10-29 Thread Adam Binford
Hi devs, I'm working on getting Apache Sedona upgraded to work with Spark 3.2, and ran into a weird issue I wanted to get some feedback on. The PR and current discussion can be found here: https://github.com/apache/incubator-sedona/pull/557 To try to sum up in a quick way, this library defines