[
https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17522627#comment-17522627
]
Dongjoon Hyun commented on SPARK-37814:
---------------------------------------
Hi, [~brentwritescode]. Thank you for the suggestion but none of them are
released yet, aren't they?
- First, I don't think the future release plan of Apache Hadoop community could
be the blocker for Apache Spark releases. As you know, Apache Spark 3.3+
already moved to log4j2.
- For Hadoop 2, Apache Spark binary distribution is Hadoop 2.7.4 and we have no
plan to upgrade to Hadoop 2.10.x. So, that doesn't look like a path for us
unfortunately.
- For Hadoop 3, I'm sure that Apache Spark community is going to try Apache
Hadoop 3.3.4 with Apache Spark 3.4 timeframe. However, there is no guarantee in
the open source community. Apache Hadoop 3.3.2 is also still under active
testing and we might revert it back to old one during RC period. Hadoop is one
of several key dependencies which we are considering seriously.
For the Apache Hadoop releases, let's talk later when the real releases arrives
to us so that we can play around them.
> Migrating from log4j 1 to log4j 2
> ---------------------------------
>
> Key: SPARK-37814
> URL: https://issues.apache.org/jira/browse/SPARK-37814
> Project: Spark
> Issue Type: Umbrella
> Components: Build
> Affects Versions: 3.3.0
> Reporter: L. C. Hsieh
> Assignee: L. C. Hsieh
> Priority: Major
> Labels: releasenotes
> Fix For: 3.3.0
>
>
> This is umbrella ticket for all tasks related to migrating to log4j2.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
