Hi all,
I am facing issues with a Spark Connect application running on a Spark standalone cluster (without YARN and HDFS). After executing the start-connect-server.sh script with the specified packages, I observe a process ID for a short period but am unable to see the corresponding port (default 15002) associated with that PID. The process automatically stops after around 10 minutes. Since the Spark History server is not enabled, I am unable to locate the relevant logs or error messages. The logs for currently running Spark applications are accessible from the Spark UI, but I am unsure where to find the logs for the Spark Connect application and service. Could you please advise on where to find the logs or error messages related to Spark Connect? Thanks, Elango