Thanks for your suggestion Eason.
I think sequence file issue is resolved, how ever success is far on the hill
top!!!
*Below is the command I have executed in the terminal:*
#/bin/hadoop jar AggregateWordCount.jar
org.apache.hadoop.examples.AggregateWordCount words/*
aggregatewordcount_output 2 textinputformat
*Error:*
09/06/18 11:51:42 INFO mapred.JobClient: Task Id :
attempt_200906181145_0005_r_000001_1, Status : FAILED
java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.apache.hadoop.examples.AggregateWordCount$WordCountPlugInClass
at
org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
createInstance(UserDefinedValueAggregatorDescriptor.java:57)
at
org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
createAggregator(UserDefinedValueAggregatorDescriptor.java:64)
at
org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
<init>(UserDefinedValueAggregatorDescriptor.java:76)
at
org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.getValueAggreg
atorDescriptor(ValueAggregatorJobBase.java:54)
at
org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.getAggregatorD
escriptors(ValueAggregatorJobBase.java:65)
at
org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.initializeMySp
ec(ValueAggregatorJobBase.java:74)
at
org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.configure(Valu
eAggregatorJobBase.java:42)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:240)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.examples.AggregateWordCount$WordCountPlugInClass
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:242)
at
org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
createInstance(UserDefinedValueAggregatorDescriptor.java:52)
... 10 more
*However, I could see that
org.apache.hadoop.examples.AggregateWordCount$WordCountPlugInClass class is
available in the AggregateWordCount.jar, below is the listing of this jar: *
# jar -tvf AggregateWordCount.jar
0 Tue Jun 09 18:11:42 IST 2009 META-INF/
71 Tue Jun 09 18:11:42 IST 2009 META-INF/MANIFEST.MF
0 Tue Jun 09 18:10:58 IST 2009 org/
0 Tue Jun 09 18:10:58 IST 2009 org/apache/
0 Tue Jun 09 18:10:58 IST 2009 org/apache/hadoop/
0 Tue Jun 09 18:10:58 IST 2009 org/apache/hadoop/examples/
1298 Tue Jun 09 18:11:32 IST 2009
org/apache/hadoop/examples/AggregateWordCount$WordCountPlugInClass.class
846 Tue Jun 09 18:11:32 IST 2009
org/apache/hadoop/examples/AggregateWordCount.class
Could you please advice what could be the problem here?
Thank You,
Shravan Kumar. M
Catalytic Software Ltd. [SEI-CMMI Level 5 Company]
-----------------------------
This email and any files transmitted with it are confidential and intended
solely for the use of the individual or entity to whom they are addressed.
If you have received this email in error please notify the system
administrator - netopshelpd...@catalytic.com
-----Original Message-----
From: Eason.Lee [mailto:leongf...@gmail.com]
Sent: Thursday, June 18, 2009 11:27 AM
To: core-user@hadoop.apache.org; shravan.mahank...@catalytic.com
Subject: Re: not a SequenceFile?
you'd better run it like this:
bin/hadoop jar hadoop-*-examples.jar aggregatewordcount input output
numOfReducers *textinputformat*
*
*
input textinputformat to use textinputformat instand of SequenceFile
hope it is helpful!
2009/6/18 Shravan Mahankali <shravan.mahank...@catalytic.com>
> Hi Nick,
>
>
>
> Thanks for your response.
>
>
>
> I am very new to Hadoop. I was trying to execute the "AggregateWordCount"
> example program provided by Hadoop in the distribution from the linux but
> was having the issue as stated in my earlier email.
>
>
>
> I have also tried executing the MultiFetch example with no success.
>
>
>
> If this example program needs the input file to be a sequence file. how
> should I create one, please advice?
>
>
>
> Thank You,
>
> Shravan Kumar. M
>
> Catalytic Software Ltd. [SEI-CMMI Level 5 Company]
>
> -----------------------------
>
> This email and any files transmitted with it are confidential and intended
> solely for the use of the individual or entity to whom they are addressed.
> If you have received this email in error please notify the system
> administrator - <mailto:netopshelpd...@catalytic.com>
> netopshelpd...@catalytic.com
>
> _____
>
> From: Nick Cen [mailto:cenyo...@gmail.com]
> Sent: Wednesday, June 17, 2009 6:50 PM
> To: core-user@hadoop.apache.org; shravan.mahank...@catalytic.com
> Subject: Re: not a SequenceFile?
>
>
>
> I guest you have set SequenceFileFormat as your inputformat in the
> configuration object, but the file you provide is not a sequence file.
>
> 2009/6/17 Shravan Mahankali <shravan.mahank...@catalytic.com>
>
> Hi Group,
>
>
>
> I have trouble running couple of examples provided by Hadoop. Below are
the
> error messages I have from the console, could you please advise what could
> be the problem and probable solution?
>
>
>
> 09/06/17 16:30:29 INFO mapred.FileInputFormat: Total input paths to
process
> : 1
>
> 09/06/17 16:30:29 INFO mapred.FileInputFormat: Total input paths to
process
> : 1
>
> 09/06/17 16:30:29 INFO mapred.JobClient: Running job:
job_200906171601_0009
>
> 09/06/17 16:30:30 INFO mapred.JobClient: map 0% reduce 0%
>
> 09/06/17 16:30:38 INFO mapred.JobClient: Task Id :
> attempt_200906171601_0009_m_000000_0, Status : FAILED
>
> java.io.IOException: hdfs://localhost:9000/user/root/words not a
> SequenceFile
>
> at
> org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1458)
>
> at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1431)
>
> at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1420)
>
> at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1415)
>
> at
>
>
org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordR
> eader.java:43)
>
> at
>
>
org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFil
> eInputFormat.java:54)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
>
> at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198)
>
>
>
> 09/06/17 16:30:39 INFO mapred.JobClient: Task Id :
> attempt_200906171601_0009_r_000000_0, Status : FAILED
>
> java.lang.RuntimeException: java.lang.ClassNotFoundException:
> org.apache.hadoop.examples.AggregateWordCount$WordCountPlugInClass
>
> at
>
>
org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
> createInstance(UserDefinedValueAggregatorDescriptor.java:57)
>
> at
>
>
org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
> createAggregator(UserDefinedValueAggregatorDescriptor.java:64)
>
> at
>
>
org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
> <init>(UserDefinedValueAggregatorDescriptor.java:76)
>
> at
>
>
org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.getValueAggreg
> atorDescriptor(ValueAggregatorJobBase.java:54)
>
> at
>
>
org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.getAggregatorD
> escriptors(ValueAggregatorJobBase.java:65)
>
> at
>
>
org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.initializeMySp
> ec(ValueAggregatorJobBase.java:74)
>
> at
>
>
org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.configure(Valu
> eAggregatorJobBase.java:42)
>
> at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
>
> at
>
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
>
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:240)
>
> at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198)
>
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.examples.AggregateWordCount$WordCountPlugInClass
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
>
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
>
> at java.lang.Class.forName0(Native Method)
>
> at java.lang.Class.forName(Class.java:242)
>
> at
>
>
org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
> createInstance(UserDefinedValueAggregatorDescriptor.java:52)
>
> ... 10 more
>
>
>
> Thank You,
>
> Shravan Kumar. M
>
> Catalytic Software Ltd. [SEI-CMMI Level 5 Company]
>
> -----------------------------
>
> This email and any files transmitted with it are confidential and intended
> solely for the use of the individual or entity to whom they are addressed.
> If you have received this email in error please notify the system
> administrator - <mailto:netopshelpd...@catalytic.com>
> netopshelpd...@catalytic.com
>
>
>
>
>
>
>
>
>
> --
> http://daily.appspot.com/food/
>
>
