[ https://issues.apache.org/jira/browse/SPARK-47796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahima Khatri updated SPARK-47796: ---------------------------------- Priority: Blocker (was: Critical) > Spark Session is not created for spark-2.1.1 when log4j is migrated from 1.* > to 2.17.1 to fix the security issue > ---------------------------------------------------------------------------------------------------------------- > > Key: SPARK-47796 > URL: https://issues.apache.org/jira/browse/SPARK-47796 > Project: Spark > Issue Type: Bug > Components: Spark Shell, Spark Submit > Affects Versions: 2.1.1 > Reporter: Mahima Khatri > Priority: Blocker > Fix For: 2.1.1 > > Attachments: 1.exception.png, 2.log4j1.png, 3.log4j-2.png > > > Spark Download Link: > [https://archive.apache.org/dist/spark/spark-2.1.1/spark-2.1.1-bin-hadoop2.7.tgz] > log4j Migration: > [https://logging.apache.org/log4j/2.x/manual/migration.html] > The spark creation is not happening . > Below is the exception: > *{color:#4c9aff}1.exception.png (Attached){color}* > When analyzed further found that the class file “RendererMap“ is not at all > present in the bridge jar. > *log4j-1.2.17* > *{color:#4c9aff}2.log4j1.png (Attached){color}* > ** *log4j-1.2-api-2.17.1.jar (Bridge jar)* > *{color:#4c9aff}3.log4j-2.png (Attached){color}* > Following the migration steps in > [https://logging.apache.org/log4j/2.x/manual/migration.html] > We are simply replacing the > Jar: */usr/local/spark/jars/log4j-1.2.17.jar* > With: > * log4j-1.2-api-2.17.1.jar > * log4j-api-2.17.1.jar > * log4j-core-2.17.1.jar > similar to what we had done 2 years back for version spark 2.1.3 version for > which we were not downloading the spark zip on fly ,but we already had a > downloaded zip on which we applied the patching changes. That seemed to work > for 2.1.3 but for an older version where we are downloading the tar.gz now > i.e 2.1.1, there seems to be an issue. > Looking for a right resolution in this regard. Kindly let us know if any > further information is required. > FYI, Some of the various things tried: > # Upgrading the bridge ,api ,core jar to 1.17.2 and even to the latest > # Replaced the two slf4j jars with higher version : ex. slf4j-api-1.7.25.jar > slf4j-log4j12-1.7.25.jar > # Adding a log4j.properties file from the template available. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org