Mahima Khatri created SPARK-47796:
-------------------------------------
Summary: Spark Session is not created for spark-2.1.1 when log4j
is migrated from 1.* to 2.17.1 to fix the security issue
Key: SPARK-47796
URL: https://issues.apache.org/jira/browse/SPARK-47796
Project: Spark
Issue Type: Bug
Components: Spark Shell, Spark Submit
Affects Versions: 2.1.1
Reporter: Mahima Khatri
Fix For: 2.1.1
Spark Download Link:
[https://archive.apache.org/dist/spark/spark-2.1.1/spark-2.1.1-bin-hadoop2.7.tgz]
log4j Migration:
[https://logging.apache.org/log4j/2.x/manual/migration.html]
The spark creation is not happening .
Below is the exception:
!image-2024-04-10-13-42-36-796.png!
When analyzed further found that the class file “RendererMap“ is not at all
present in the bridge jar.
*log4j-1.2.17*
* !image-2024-04-10-13-43-01-206.png!*
** *log4j-1.2-api-2.17.1.jar (Bridge jar)*
*!image-2024-04-10-13-44-07-804.png!*
Following the migration steps in
[https://logging.apache.org/log4j/2.x/manual/migration.html]
We are simply replacing the
Jar: */usr/local/spark/jars/log4j-1.2.17.jar*
With:
* log4j-1.2-api-2.17.1.jar
* log4j-api-2.17.1.jar
* log4j-core-2.17.1.jar
similar to what we had done 2 years back for version spark 2.1.3 version for
which we were not downloading the spark zip on fly ,but we already had a
downloaded zip on which we applied the patching changes. That seemed to work
for 2.1.3 but for an older version where we are downloading the tar.gz now,
there seems to be an issue.
Looking for a right resolution in this regard.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
