[
https://issues.apache.org/jira/browse/SPARK-47796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837057#comment-17837057
]
Mahima Khatri commented on SPARK-47796:
---------------------------------------
Found a workaround by removing the conflicting jar
/apache-log4j-extras-1.2.17.jar from the jars folder .in addition to the steps
applied above.
The bridge seems to be working now.
There is no exception and the Spark session is also created successfully.
> Spark Session is not created for spark-2.1.1 when log4j is migrated from 1.*
> to 2.17.1 to fix the security issue
> ----------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-47796
> URL: https://issues.apache.org/jira/browse/SPARK-47796
> Project: Spark
> Issue Type: Bug
> Components: Spark Shell, Spark Submit
> Affects Versions: 2.1.1
> Reporter: Mahima Khatri
> Priority: Blocker
> Fix For: 2.1.1
>
> Attachments: 1.exception.png, 2.log4j1.png, 3.log4j-2.png
>
>
> Spark Download Link:
> [https://archive.apache.org/dist/spark/spark-2.1.1/spark-2.1.1-bin-hadoop2.7.tgz]
> log4j Migration:
> [https://logging.apache.org/log4j/2.x/manual/migration.html]
> The spark creation is not happening .
> Below is the exception:
> *{color:#4c9aff}1.exception.png (Attached){color}*
> When analyzed further found that the class file “RendererMap“ is not at all
> present in the bridge jar.
> *log4j-1.2.17*
> *{color:#4c9aff}2.log4j1.png (Attached){color}*
> ** *log4j-1.2-api-2.17.1.jar (Bridge jar)*
> *{color:#4c9aff}3.log4j-2.png (Attached){color}*
> Following the migration steps in
> [https://logging.apache.org/log4j/2.x/manual/migration.html]
> We are simply replacing the
> Jar: */usr/local/spark/jars/log4j-1.2.17.jar*
> With:
> * log4j-1.2-api-2.17.1.jar
> * log4j-api-2.17.1.jar
> * log4j-core-2.17.1.jar
> similar to what we had done 2 years back for version spark 2.1.3 version for
> which we were not downloading the spark zip on fly ,but we already had a
> downloaded zip on which we applied the patching changes. That seemed to work
> for 2.1.3 but for an older version where we are downloading the tar.gz now
> i.e 2.1.1, there seems to be an issue.
> Looking for a right resolution in this regard. Kindly let us know if any
> further information is required.
> FYI, Some of the various things tried:
> # Upgrading the bridge ,api ,core jar to 2.17.2 and even to the latest
> # Replaced the two slf4j jars with higher version : ex. slf4j-api-1.7.25.jar
> slf4j-log4j12-1.7.25.jar
> # Adding a log4j.properties file from the template available.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
