caijialiang created HDFS-17287:
----------------------------------
Summary: Parallel Maven Build Support for Apache Hadoop
Key: HDFS-17287
URL: https://issues.apache.org/jira/browse/HDFS-17287
Project: Hadoop HDFS
Issue Type: Improvement
Components: build
Affects Versions: 3.3.6
Reporter: caijialiang
The reason for the slow compilation: The Hadoop project has many modules, and
the inability to compile them in parallel results in a slow process. For
instance, the first compilation of Hadoop might take several hours, and even
with local Maven dependencies, a subsequent compilation can still take close to
40 minutes, which is very slow.
How to solve it: Use {{mvn dependency:tree}} and {{maven-to-plantuml}} to
investigate the dependency issues that prevent parallel compilation.
* Investigate the dependencies between project modules.
* Analyze the dependencies in multi-module Maven projects.
* Download {{{}maven-to-plantuml{}}}:
{{wget
https://github.com/phxql/maven-to-plantuml/releases/download/v1.0/maven-to-plantuml-1.0.jar}}
* Generate a dependency tree:
{{mvn dependency:tree > dep.txt}}
* Generate a UML diagram from the dependency tree:
{{java -jar maven-to-plantuml.jar --input dep.txt --output dep.puml}}
For more information, visit: [maven-to-plantuml GitHub
repository|https://github.com/phxql/maven-to-plantuml/tree/master].
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
