PandaMonkey created SPARK-23509:
-----------------------------------
Summary: Upgrade commons-net from 2.2 to 3.1
Key: SPARK-23509
URL: https://issues.apache.org/jira/browse/SPARK-23509
Project: Spark
Issue Type: Dependency upgrade
Components: Spark Core
Affects Versions: 2.4.0
Reporter: PandaMonkey
Fix For: 2.4.0
Attachments: spark.txt
Hi, after analyzing spark-master\core\pom.xml, we found that Spark-core depends
on org.apache.hadoop:hadoop-client:2.6.5, which transitivity introduced
commons-net:3.1. At the same time, Spark-core directly depends on a older
version of commons-net:2.2. By further look into the source code, these two
versions of commons-net have many different features. The dependency conflict
problem brings high risks of "NotClassDefFoundError:" or "NoSuchMethodError"
issues at runtime. Please notice this problem. Maybe upgrading commons-net from
2.2 to 3.1 is a good choice. Please notice this problem. Hope this report can
help you. Thanks!
Regards,
Panda
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
