[
https://issues.apache.org/jira/browse/AMBARI-26323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jialiang Cai updated AMBARI-26323:
----------------------------------
Description:
## Problem Description
After upgrading Commons-Collections library, Ambari is failing to install
components through the web interface. The specific error occurs when executing
the credential creation command:
```bash
/usr/lib/jvm/java-1.8.0/bin/java -cp "/var/lib/ambari-agent/cred/lib/*"
org.apache.hadoop.security.alias.CredentialShell create
javax.jdo.option.ConnectionPassword -value hive -provider
jceks://file/var/lib/ambari-agent/cred/conf/hive_metastore/hive-site.jceks
```
The command fails with the following error:
```
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/commons/collections/map/UnmodifiableMap
at
org.apache.hadoop.conf.Configuration$DeprecationContext.<init>(Configuration.java:409)
at org.apache.hadoop.conf.Configuration.<clinit>(Configuration.java:448)
at
org.apache.hadoop.security.alias.CredentialShell.main(CredentialShell.java:442)
Caused by: java.lang.ClassNotFoundException:
org.apache.commons.collections.map.UnmodifiableMap
at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
```
## Root Cause
The libraries in `/var/lib/ambari-agent/cred/lib/` directory are designed for
Hadoop 2.x, but the system has been upgraded to use Hadoop 3.x. The upgraded
Commons-Collections version is incompatible with the older Hadoop libraries, as
it no longer contains the required `UnmodifiableMap` class which has been moved
to a different package in newer versions.
## Solution
Update the libraries in `/var/lib/ambari-agent/cred/lib/` to be compatible with
Hadoop 3.x while ensuring backward compatibility with the credential creation
process:
1. Replace the existing libraries with Hadoop 3.x compatible versions
2. Add the missing dependencies required by Hadoop 3.x
3. Include a compatible version of Commons-Collections (3.2.2) that contains
the required `UnmodifiableMap` class
This approach ensures that the credential creation process works correctly
while maintaining compatibility with the upgraded Hadoop ecosystem.
## Implementation Steps
1. Back up the existing libraries
2. Download and add Hadoop 3.x compatible libraries
3. Include Commons-Collections 3.2.2 for backward compatibility
4. Update permissions on the new libraries
5. Test the credential creation command
6. Resume component installation through the Ambari web interface
> Ambari Component Installation Failure After Commons-Collections Upgrade
> -----------------------------------------------------------------------
>
> Key: AMBARI-26323
> URL: https://issues.apache.org/jira/browse/AMBARI-26323
> Project: Ambari
> Issue Type: Bug
> Reporter: Jialiang Cai
> Priority: Major
>
> ## Problem Description
>
> After upgrading Commons-Collections library, Ambari is failing to install
> components through the web interface. The specific error occurs when
> executing the credential creation command:
>
> ```bash
> /usr/lib/jvm/java-1.8.0/bin/java -cp "/var/lib/ambari-agent/cred/lib/*"
> org.apache.hadoop.security.alias.CredentialShell create
> javax.jdo.option.ConnectionPassword -value hive -provider
> jceks://file/var/lib/ambari-agent/cred/conf/hive_metastore/hive-site.jceks
> ```
>
> The command fails with the following error:
> ```
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/commons/collections/map/UnmodifiableMap
> at
> org.apache.hadoop.conf.Configuration$DeprecationContext.<init>(Configuration.java:409)
> at org.apache.hadoop.conf.Configuration.<clinit>(Configuration.java:448)
> at
> org.apache.hadoop.security.alias.CredentialShell.main(CredentialShell.java:442)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.commons.collections.map.UnmodifiableMap
> at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
> ```
>
> ## Root Cause
>
> The libraries in `/var/lib/ambari-agent/cred/lib/` directory are designed for
> Hadoop 2.x, but the system has been upgraded to use Hadoop 3.x. The upgraded
> Commons-Collections version is incompatible with the older Hadoop libraries,
> as it no longer contains the required `UnmodifiableMap` class which has been
> moved to a different package in newer versions.
>
> ## Solution
>
> Update the libraries in `/var/lib/ambari-agent/cred/lib/` to be compatible
> with Hadoop 3.x while ensuring backward compatibility with the credential
> creation process:
>
> 1. Replace the existing libraries with Hadoop 3.x compatible versions
> 2. Add the missing dependencies required by Hadoop 3.x
> 3. Include a compatible version of Commons-Collections (3.2.2) that contains
> the required `UnmodifiableMap` class
>
> This approach ensures that the credential creation process works correctly
> while maintaining compatibility with the upgraded Hadoop ecosystem.
>
> ## Implementation Steps
>
> 1. Back up the existing libraries
> 2. Download and add Hadoop 3.x compatible libraries
> 3. Include Commons-Collections 3.2.2 for backward compatibility
> 4. Update permissions on the new libraries
> 5. Test the credential creation command
> 6. Resume component installation through the Ambari web interface
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
