Hi Mridul, Just wanted to add that we intent to work with the Apache Sedona community anyways going forward.
- Menelaos > On May 6, 2025, at 6:45 AM, Wenchen Fan <[email protected]> wrote: > > Hi Mridul, > > The conclusion is that we will standardize the basic geo data types in Spark, > which allows third-party data sources and user-defined functions to support > geo data types natively when integrating with Spark. The majority of geo > processing functions will still be in Apache Sedona (or other Spark plugin > projects) instead of Spark itself. @Jia Yu <mailto:[email protected]> feel > free to correct me if I missed anything. > > On Tue, May 6, 2025 at 11:51 AM Mridul Muralidharan <[email protected] > <mailto:[email protected]>> wrote: >> Hi, >> >> What was the conclusion of the discussion with Apache Sedona project ? >> Are they aligned with leveraging the support being built here ? >> >> Regards, >> Mridul >> >> On Mon, May 5, 2025 at 10:22 PM Gengliang Wang <[email protected] >> <mailto:[email protected]>> wrote: >>> +1 >>> >>> On Mon, May 5, 2025 at 6:54 PM Ruifeng Zheng <[email protected] >>> <mailto:[email protected]>> wrote: >>>> +1 >>>> >>>> On Tue, May 6, 2025 at 9:51 AM Xiao Li <[email protected] >>>> <mailto:[email protected]>> wrote: >>>>> +1 >>>>> >>>>> On Mon, May 5, 2025 at 18:35 Yuming Wang <[email protected] >>>>> <mailto:[email protected]>> wrote: >>>>>> +1 >>>>>> >>>>>> On Tue, May 6, 2025 at 9:12 AM Denny Lee <[email protected] >>>>>> <mailto:[email protected]>> wrote: >>>>>>> +1 (non-binding) >>>>>>> >>>>>>> On Mon, May 5, 2025 at 18:03 Wenchen Fan <[email protected] >>>>>>> <mailto:[email protected]>> wrote: >>>>>>>> +1 >>>>>>>> >>>>>>>> On Tue, May 6, 2025 at 3:40 AM Reynold Xin >>>>>>>> <[email protected]> wrote: >>>>>>>>> +1 >>>>>>>>> >>>>>>>>> >>>>>>>>> On Mon, May 5, 2025 at 12:37 PM Bjørn Jørgensen >>>>>>>>> <[email protected] <mailto:[email protected]>> wrote: >>>>>>>>>> +1 >>>>>>>>>> >>>>>>>>>> man. 5. mai 2025 kl. 21:28 skrev Milan Stefanovic >>>>>>>>>> <[email protected] <mailto:[email protected]>>: >>>>>>>>>>> +1 (non-binding) >>>>>>>>>>> >>>>>>>>>>> Thanks, >>>>>>>>>>> Milan >>>>>>>>>>> >>>>>>>>>>> On Mon, 5 May 2025 at 21:25, Jia Yu <[email protected] >>>>>>>>>>> <mailto:[email protected]>> wrote: >>>>>>>>>>>> Thanks for putting this together. >>>>>>>>>>>> >>>>>>>>>>>> +0 (non-binding) from my side. Happy to see geospatial data is >>>>>>>>>>>> getting attention but we need to make it right. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Jia Yu >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Mon, May 5, 2025 at 12:15 PM Szehon Ho <[email protected] >>>>>>>>>>>> <mailto:[email protected]>> wrote: >>>>>>>>>>>>> +1 (non binding) >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks >>>>>>>>>>>>> Szehon >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, May 5, 2025 at 11:17 AM DB Tsai <[email protected] >>>>>>>>>>>>> <mailto:[email protected]>> wrote: >>>>>>>>>>>>>> +1, geospatial types will be a great feature for Spark. Thanks >>>>>>>>>>>>>> for working on it. >>>>>>>>>>>>>> >>>>>>>>>>>>>>> On May 5, 2025, at 11:04 AM, Menelaos Karavelas >>>>>>>>>>>>>>> <[email protected] >>>>>>>>>>>>>>> <mailto:[email protected]>> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I started the discussion on adding geospatial types to Spark >>>>>>>>>>>>>>> on March 28th. >>>>>>>>>>>>>>> Since then there has been some discussion in the dev mailing >>>>>>>>>>>>>>> list, as well as in the SPIP doc. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> At this point I would like to move to a formal vote on adding >>>>>>>>>>>>>>> support for geospatial types to Spark. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> *Discussion thread:* >>>>>>>>>>>>>>> https://lists.apache.org/thread/07ozv8ccfddd5tnfl8t74dr4tvnjdkpg >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> *SPIP:* >>>>>>>>>>>>>>> https://docs.google.com/document/d/1cYSNPGh95OjnpS0k_KDHGM9Ae3j-_0Wnc_eGBZL4D3w/edit?tab=t.0 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> *JIRA:* >>>>>>>>>>>>>>> https://issues.apache.org/jira/browse/SPARK-51658 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Please vote on the SPIP for the next 72 hours: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> [ ] +1: Accept the proposal as an official SPIP >>>>>>>>>>>>>>> [ ] +0 >>>>>>>>>>>>>>> [ ] -1: I don’t think this is a good idea because >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Menelaos Karavelas >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Bjørn Jørgensen >>>>>>>>>> Vestre Aspehaug 4, 6010 Ålesund >>>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>>> Norge >>>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>>> >>>>>>>>>> +47 480 94 297
