Shantanu, As Jim alludes to, we'd definitely be interested in collaborating over this capability rather than creating competing solutions. There are more technical challenges to solving this problem than people to solve them! RasterFrames <https://rasterframes.io/> already has map algebra ops (an many other) available as > 200 PySpark functions <https://rasterframes.io/reference.html>. Would definitely be interested in getting your opinion on what you think is missing, and where you could contribute!
Best, Simeon On Mon, Apr 19, 2021 at 11:01 AM Jim Hughes <jhug...@ccri.com> wrote: > Hi Shantanu, > > I'd be interested to know how your work would compare to existing > projects which provide raster support in Spark. LocationTech GeoTrellis > has existed for several years and provides that support already. Also, > LocationTech RasterFrames builds on top of GeoTrellis to provide PySpark > and Spark SQL support for data science with respect to raster-based > dataframes. > > Cheers, > > Jim > > On 4/18/21 1:25 PM, Shantanu Aggarwal wrote: > > Hello All, > > > > I am a current graduate student at Arizona State University and wanted to > > propose raster data frames written in Pyspark that can be incorporated in > > Apache Sedona to load satellite images and be able to perform various map > > algebra operations on it. > > > > How can I add my constructors as a part of the Python folder? Is there a > > separate guide on how to contribute? > > > > Hope to hear from you soon! > > > > > > Very Respectfully > > Shantanu Aggarwal > > Masters In Science > > Arizona State University > > > > -- Simeon Fitch Co-founder & VP of R&D Astraea, Inc.
