Re: Stream-stream join in structured streaming

2021-02-01 Thread Felix Cheung
This could be highly interesting! From: Youngwoo Kim (김영우) Sent: Monday, February 1, 2021 7:03:36 PM To: Jia Yu Cc: dev@sedona.apache.org Subject: Re: Stream-stream join in structured streaming Got it, thank you Jia for noticing that! Youngwoo On Tue, Feb 2

Re: Stream-stream join in structured streaming

2021-02-01 Thread 김영우
Got it, thank you Jia for noticing that! Youngwoo On Tue, Feb 2, 2021 at 11:56 AM Jia Yu wrote: > Hi Youngwoo, > > We are aware that the current SQL spatial join does not support streaming > tables. The Sedona support of Spark structured streaming is on our roadmap > but it won't be available

Re: Stream-stream join in structured streaming

2021-02-01 Thread Jia Yu
Hi Youngwoo, We are aware that the current SQL spatial join does not support streaming tables. The Sedona support of Spark structured streaming is on our roadmap but it won't be available soon. Thanks, Jia On Sun, Jan 31, 2021 at 9:31 PM Youngwoo Kim (김영우) wrote: > Hi, > > I'm looking into

Stream-stream join in structured streaming

2021-01-31 Thread 김영우
Hi, I'm looking into spatial range query using Apache Sedona in spark structured streaming. In my test code, I joined two streams using `st_contains` like following: Dataset fenced = spark.sql( > "SELECT * FROM poly, pts WHERE > ST_Contains(ST_PolygonFromText(poly.value,','), >