Re: Spatial join performances

2021-08-02 Thread pietro greselin
(polygons_df).alias('polygons'), f.expr('ST_Contains(polygons.polygonshape, points.pointshape)')) Attached you can find the pseudo code we used to test broadcast join. Looking forward to hearing from you. Kind regards, Pietro Greselin On Wed, 28 Jul 2021 at 00:46, Jia Yu wrote: > Hi Pie

Spatial join performances

2021-07-27 Thread pietro greselin
-code we are running. Looking forward to hearing from you. Kind regards, Pietro Greselin def toSpatialPoints(df, lat_column_name, lon_column_name): df.createOrReplaceTempView("points_df") return ( spark.sql("SELECT *, ST_Point({}, {}) AS point FROM points_df".fo