[
https://issues.apache.org/jira/browse/PIG-5456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Koji Noguchi updated PIG-5456:
------------------------------
Attachment: pig-5456-v01.patch
It turns out log4j2 already provides log4j1 compatibility through
"Log4j 1.x bridge" from
[https://logging.apache.org/log4j/2.x/manual/migration.html.]
But this spark/log4j-1.2-api-2.19.0.jar conflicted with reload4j-1.2.24.jar
resulting in the error provided in the description. So far, work around in
running tests were to delete reload4j-1.2.24.jar (and log4j-1.2.17.jar).
log4j-1.2.17.jar was coming from stale zookeeper. Will create a new Jira to
update the dependency.
As for how to skip reload4j, [~rohini] , do you have any suggestions?
In addition, this log4j-1.2-api-2.19.0.jar implementation seems to have a bug
in use of SimpleLayout. Reported at
[https://github.com/apache/logging-log4j2/issues/2722.] For now, replacing
them with PatternLayout.
Also, log4j-api-2.19.0.jar from Spark somehow having a bug. Updating to
log4j-1.2-api-2.23.1.jar worked.
Patch uploaded.
> Upgrade Spark to 3.4.3
> ----------------------
>
> Key: PIG-5456
> URL: https://issues.apache.org/jira/browse/PIG-5456
> Project: Pig
> Issue Type: Improvement
> Components: spark
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Priority: Major
> Fix For: 0.19.0
>
> Attachments: pig-5456-v01.patch
>
>
> Major blocker for upgrading to Spark 3.4.3 was Spark started using log4j2.
> Simple upgrade failing a lot of tests with
> {noformat}
> java.lang.VerifyError: class org.apache.log4j.bridge.LogEventAdapter
> overrides final method getTimeStamp.()J {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
