The issue seems to be with ur dictionary. What is the length of dictionary?
On Thursday, January 9, 2014 6:49 PM, Yang <teddyyyy...@gmail.com> wrote:
I am trying to run the lda (now called cvb) function, I followed the steps
listed in many online sources. the final step after getting the lda result,
to show the result in a human-readable form is doing this vectordump, but
it gave me the following exception:
I also listed the first few bytes of my cvb output file, looks to be at
least not empty.
Thanks!
yang
sh-3.2$ bin/mahout vectordump -i MAHOUT/cvb/part-m-00000 --dictionary
sparse/dictionary.file-0 --dictionaryType sequencefile --vectorSize 10 -o
cvbout
Running on hadoop, using /apache/hadoop/bin/hadoop and HADOOP_CONF_DIR=
MAHOUT-JOB:
/home/yyang15/mahout/mahout-distribution-0.8/mahout-examples-0.8-job.jar
14/01/08 16:37:03 INFO common.AbstractJob: Command line arguments:
{--dictionary=[sparse/dictionary.file-0], --dictionaryType=[sequencefile],
--endPhase=[2147483647], --input=[MAHOUT/cvb/part-m-00000],
--output=[cvbout], --startPhase=[0], --tempDir=[temp], --vectorSize=[10]}
14/01/08 16:37:04 INFO vectors.VectorDumper: Sort? false
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 0
at
org.apache.mahout.utils.vectors.VectorHelper$2.apply(VectorHelper.java:132)
at
org.apache.mahout.utils.vectors.VectorHelper$2.apply(VectorHelper.java:129)
at com.google.common.collect.Iterators$8.next(Iterators.java:812)
at java.util.AbstractCollection.toArray(AbstractCollection.java:124)
at java.util.ArrayList.<init>(ArrayList.java:131)
at com.google.common.collect.Lists.newArrayList(Lists.java:119)
at
org.apache.mahout.utils.vectors.VectorHelper.toWeightedTerms(VectorHelper.java:128)
at
org.apache.mahout.utils.vectors.VectorHelper.vectorToJson(VectorHelper.java:147)
at
org.apache.mahout.utils.vectors.VectorDumper.run(VectorDumper.java:240)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.mahout.utils.vectors.VectorDumper.main(VectorDumper.java:260)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at
org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
SEQ^F
org.apache.hadoop.io.IntWritable%org.apache.mahout.math.VectorWritable^@^@^@^@^@^@%<D3>NX<97><A9><FD><BB>a;H<98>KȪ<82>^@^A!^G^@^@^@^D^@^@^@^@^C<A0>H=<B6>g<9C>O
<EF>^?<D8>=ˍ<8A><F1>-<AC>8=ɪA+<E0><F1>^R=<AC>-^Ck<BE>^Cm=<F4>p-<E0>ul<D3>=<BA><FE>H7T<F6>^B=<D7>E<EC><95>RH<A7>=<BB>U<DE>^B^Y"<F1>=<D9>WV^F"^P^Q=հ`^?8^N<F1>=<D6>b^YJ
<91><A0>$=<BB><94><F1><C6>^S?c=<B1><BA><88>^G<EB>i^P=<9B>^N>R<92><D2>q=<BA>^H,<9E>^_<B3><91>=<CE><ED>
i<C1>^FA=<F4>6<9F><A6><BF>^V[=<9F><E8>IN<A4>L<D5>=<B4><E5><F4>j
<83><A0>I=<F4>p<AB>֣%<80>=<A3>'^A<AB><8B>=<A9>=<A4>^V<DB>3<80>^M<B7>=<B5>A^SV^Eͺ?4
^K0^\<9D><BA>=<AA><86>l<8B><F4><E8>m^@^@^@^@^@^@^@^@=<C4>w^NjK<BF>
=<AB>"^O;!<E0><F7>=<AF><BC>R<DC>-
