Hello Team,
I am currently working on initializing a Spark session using Spark
Structure Streaming within a Kubernetes deployment managed by the Spark
Operator. During the initialization process, I encountered an error message
indicating the necessity to set a master URL:
*"Caused by: org.apache.spark.SparkException: A master URL must be set in
your configuration."*
Could you kindly confirm if specifying the master URL is mandatory in this
context of using Spark Structure Streaming programming with the Spark
Operator for Kubernetes deployments?
Below is the code snippet I am using for Spark session initialization:
SparkSession sparkSession = SparkSession.builder()
.appName(AppConstants.APPLICATION_NAME)
.getOrCreate()
Thank you!
Regards,
Atul
