[
https://issues.apache.org/jira/browse/HADOOP-17378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231174#comment-17231174
]
Kihwal Lee commented on HADOOP-17378:
-------------------------------------
{{SpanReceiverHost}} has been removed since hadoop 2.8. That means you have
mixed versions of hadoop jars in the classpath. It is possible that one of the
artifacts you are picking up is bundling an older version of hadoop.
Please note that Jira is used for bug reporting. For general help in using
hadoop, please use the official mailing lists. See
https://hadoop.apache.org/mailing_lists.html.
> java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
> --------------------------------------------------------------------------
>
> Key: HADOOP-17378
> URL: https://issues.apache.org/jira/browse/HADOOP-17378
> Project: Hadoop Common
> Issue Type: Bug
> Components: tracing
> Affects Versions: 3.0.0
> Environment: those are librarys that i use
> compile 'org.apache.maven.plugins:maven-shade-plugin:2.4.3'
> compile 'org.apache.hadoop:hadoop-common:3.0.0'
> compile 'org.apache.flume.flume-ng-sinks:flume-hdfs-sink:1.9.0'
> compile 'org.apache.flume.flume-ng-sources:flume-kafka-source:1.9.0'
> compile 'org.apache.hbase:hbase-client:2.1.0'
> compile 'org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:1.9.0'
> compile 'redis.clients:jedis:2.9.0'
> compile 'org.apache.kafka:kafka-clients:0.10.2.1'
> compile 'org.apache.hadoop:hadoop-client:3.0.0'
> compile 'org.apache.hive:hive-exec:2.1.1'
> compile 'org.mariadb.jdbc:mariadb-java-client:1.6.1'
> compileOnly 'org.apache.flume:flume-ng-core:1.9.0'
> compile group: 'org.apache.kafka', name: 'kafka_2.10', version:'0.10.2.1'
> compile group: 'org.apache.kudu', name: 'kudu-client', version:'1.10.0'
> compile group: 'org.apache.flume', name: 'flume-ng-configuration',
> version:'1.9.0'
> compile group: 'org.apache.yetus', name: 'audience-annotations',
> version:'0.4.0'
> compile group: 'org.apache.avro', name: 'avro', version:'1.8.2'
> compile group: 'org.slf4j', name: 'slf4j-api', version:'1.7.25'
> compile group: 'org.postgresql', name: 'postgresql', version:'42.1.4.jre7'
> compile group: 'org.apache.maven.plugins', name: 'maven-resources-plugin',
> version:'2.6'
> testCompile group: 'junit', name: 'junit', version: '4.12'
> compile group: 'org.apache.parquet', name: 'parquet-hadoop-bundle', version:
> '1.9.0'
> compile group: 'org.apache.hive', name: 'hive-jdbc', version: '2.1.1'
> Reporter: 정진영
> Priority: Major
>
> Hi. I need help.
> now Im trying to migration Cloudera flume to Apache flume.
> (which means no use XXX _chd5.16 any more)
> during the test, when i stored data in HDFS i faced this problem below.
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/tracing/SpanReceiverHostjava.lang.NoClassDefFoundError:
> org/apache/hadoop/tracing/SpanReceiverHost at
> org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634) at
> org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619) at
> org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2816) at
> org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:98) at
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2853) at
> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2835) at
> org.apache.hadoop.fs.FileSystem.get(FileSystem.java:387) at
> org.apache.hadoop.fs.Path.getFileSystem(Path.java:296) at
> com.poscoict.posframe.bdp.flume.sink.hdfs.BucketWriter$1.call(BucketWriter.java:238)
> at
> com.poscoict.posframe.bdp.flume.sink.hdfs.BucketWriter$1.call(BucketWriter.java:230)
> at
> com.poscoict.posframe.bdp.flume.sink.hdfs.BucketWriter$9$1.run(BucketWriter.java:675)
> at java.security.AccessController.doPrivileged(Native Method) at
> javax.security.auth.Subject.doAs(Subject.java:422) at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
> at org.apache.flume.auth.UGIExecutor.execute(UGIExecutor.java:46) at
> com.poscoict.posframe.bdp.flume.sink.hdfs.BucketWriter$9.call(BucketWriter.java:672)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)Caused by:
> java.lang.ClassNotFoundException: org.apache.hadoop.tracing.SpanReceiverHost
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at
> java.lang.ClassLoader.loadClass(ClassLoader.java:424) at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) at
> java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>
> And i don't know fixed it .
> please help me.
> thank you!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
