The spark connect startup prints the log location. Is that not feasible for you? For me log comes to $SPARK_HOME/logs
On Mon, 29 Jul, 2024, 15:30 Ilango, <elango...@gmail.com> wrote: > > Hi all, > > > I am facing issues with a Spark Connect application running on a Spark > standalone cluster (without YARN and HDFS). After executing the > start-connect-server.sh script with the specified packages, I observe a > process ID for a short period but am unable to see the corresponding port > (default 15002) associated with that PID. The process automatically stops > after around 10 minutes. > > Since the Spark History server is not enabled, I am unable to locate the > relevant logs or error messages. The logs for currently running Spark > applications are accessible from the Spark UI, but I am unsure where to > find the logs for the Spark Connect application and service. > > Could you please advise on where to find the logs or error messages > related to Spark Connect? > > > > > Thanks, > Elango >
