[ https://issues.apache.org/jira/browse/SPARK-39998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576265#comment-17576265 ]
Mario Grgic commented on SPARK-39998: ------------------------------------- It turns out this is related to https://issues.apache.org/jira/browse/LOG4J2-1890 By removing spaces this works: {{logger.pyspark.name=org.apache.spark.api.python.PythonGatewayServer}} {{logger.pyspark.level=error}} > Can't set pyspark log level in log4j2.properties > ------------------------------------------------ > > Key: SPARK-39998 > URL: https://issues.apache.org/jira/browse/SPARK-39998 > Project: Spark > Issue Type: Question > Components: PySpark > Affects Versions: 3.3.0 > Reporter: Mario Grgic > Priority: Trivial > > In previous versions of Apache Spark it was possible to configure pyspark log > level by adding following line to log4j.properties: > > {{log4j.logger.org.apache.spark.api.python.PythonGatewayServer=ERROR}} > > With the move to log4j2.properties format, this no longer works. I have tried > modifying the above line to: > {{logger.pyspark.name = org.apache.spark.api.python.PythonGatewayServer}} > {{logger.pyspark.level = error}} > > but that does not work either. > I would appreciate any help with the correct syntax. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org