[ https://issues.apache.org/jira/browse/HDDS-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839979#comment-16839979 ]
Sammi Chen commented on HDDS-1525: ---------------------------------- [~elek], thanks for the information. I run the same test again after changed the configuraiton per your suggestions. Teragen reports "java.lang.NoClassDefFoundError: org/apache/hadoop/crypto/key/KeyProviderTokenIssuer" exception. KeyProviderTokenIssuer is defined in hadoop-common-3.2.0.jar. Its full class name is changed to "libs/org/apache/hadoop/crypto/key/KeyProviderTokenIssuer.class" in hadoop-ozone-filesystem-lib-legacy-0.4.0-alpha.jar. It's the reason why NoClassDefFoundError is throwed. If I add hadoop-common-3.2.0.jar to the classpath, then it will show following error. Caused by: java.lang.LinkageError: loader constraint violation: loader (instance of org/apache/hadoop/fs/ozone/FilteredClassLoader) previously initiated loading for a different type with name "org/apache/hadoop/crypto/key/KeyProvider" I think resolve the "java.lang.NoClassDefFoundError: org/apache/hadoop/crypto/key/KeyProviderTokenIssuer" exception is the key to this issue. Another point is teragen use AbstractFileSystem to access Ozone. AbstractFileSystem implemation of Ozone is "OzFs" which always delegates to OzoneFileSystem. So I think we need a "OzBasicFs" which can delegate to BasicOzoneFileSystem here for legacy Hadoop, right? > Mapreduce failure when using Hadoop 2.7.5 > ----------------------------------------- > > Key: HDDS-1525 > URL: https://issues.apache.org/jira/browse/HDDS-1525 > Project: Hadoop Distributed Data Store > Issue Type: Bug > Components: Ozone Filesystem > Affects Versions: 0.4.0 > Reporter: Sammi Chen > Priority: Major > Attachments: teragen.log > > > Integrate Ozone(0.4 branch) with Hadoop 2.7.5, "hdfs dfs -ls /" can pass, > while teragen failed. > When add -verbose:class to java options, it shows that class KeyProvider is > loaded twice by different classloader while it is only loaded once when > execute "hdfs dfs -ls /" > All jars under share/ozone/lib are added into hadoop classpath except ozone > file system current lib jar. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org