[I] Error reading file greater 2GB [sedona]

[via GitHub]

chitra-psg opened a new issue, #1149:
URL: https://github.com/apache/sedona/issues/1149

   ## Expected behavior
   Expecting files of all size to be readable 
   
   sample_raster = sedona.read.format("binaryFile").load(vFilePath)\
                       .withColumn("raster", expr("RS_FromGeoTiff(content)"))
   
   sample_raster .createOrReplaceTempView("sample_raster")
   
   ## Actual behavior
   
   Error while reading file dbfs:/mnt/XYZ/sample.tif.
   Caused by: SparkException: The length of dbfs:/mnt/XYZ/sample.tif is 
11894624583, which exceeds the max length allowed: 2147483647.
   
   ## Steps to reproduce the problem
   User files of size greater than 2GB as source
   
   ## Settings
   
   Sedona version = 1.5.0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@sedona.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org