(polygons_df).alias('polygons'),
f.expr('ST_Contains(polygons.polygonshape, points.pointshape)'))
Attached you can find the pseudo code we used to test broadcast join.
Looking forward to hearing from you.
Kind regards,
Pietro Greselin
On Wed, 28 Jul 2021 at 00:46, Jia Yu wrote:
> Hi Pie
-code we are running.
Looking forward to hearing from you.
Kind regards,
Pietro Greselin
def toSpatialPoints(df, lat_column_name, lon_column_name):
df.createOrReplaceTempView("points_df")
return (
spark.sql("SELECT *, ST_Point({}, {}) AS point FROM
points_df".fo