Kunal-Mishra10 opened a new issue, #1617:
URL: https://github.com/apache/sedona/issues/1617
## Expected behavior
I am trying to execute the following code in Databricks as mentioned in the
Sedona Official Doc
df = sedona.read.format("geojson").option("multiLine",
"true").load("PATH/TO/MYFILE.json")
.selectExpr("explode(features) as features") # Explode the envelope to get
one feature per row.
.select("features.*") # Unpack the features struct.
.withColumn("prop0",
f.expr("properties['prop0']")).drop("properties").drop("type")
df.show()
df.printSchema()
Ref : https://sedona.apache.org/latest-snapshot/tutorial/sql/#__tabbed_14_3
I am getting the following error
Caused by: java.lang.NoSuchMethodError:
org.apache.spark.sql.execution.datasources.json.JsonDataSource.readFile(Lorg/apache/hadoop/conf/Configuration;Lorg/apache/spark/sql/execution/datasources/PartitionedFile;Lorg/apache/spark/sql/catalyst/json/JacksonParser;Lorg/apache/spark/sql/types/StructType;)Lscala/collection/Iterator;
## Actual behavior
geojson file should be loaded into the dataframe
## Steps to reproduce the problem
I have installed the following jar files
- geotools-wrapper-1.6.1-28.2.jar
- sedona-spark-shaded-3.4_2.12-1.6.1.jar
I have installed the following libraries
- apache-sedona==1.6.1
- geopandas==0.11.1
- keplergl==0.3.2
- pydeck==0.8.0
## Settings
Sedona version = 1.6.1
Apache Spark version = 3.5.0 (Not working with Spark 3.4 Version as well)
Apache Flink version = NA
API type = Scala, Java, Python? Python
Scala version = 2.11, 2.12, 2.13? 2.12
JRE version = 1.8, 1.11? 1.8
Python version = ?
Environment = Standalone, AWS EC2, EMR, Azure, Databricks?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
