Re: ConnectedComponents example

2014-03-31 Thread Young Han
That's pretty interesting. Forgot to mention, the output I get is --3-- --4-- --5-- --6-- --7-- So it does look like something is up with Java. Young On Mon, Mar 31, 2014 at 5:05 PM, ghufran malik wrote: > Hmm yea, the only difference between mine and your system is the hadoop > your using an

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
Hmm yea, the only difference between mine and your system is the hadoop your using and maybe the jdk. I think it's most likely something to do with the jdk in this respect. On Mon, Mar 31, 2014 at 10:01 PM, ghufran malik wrote: > the output your code produced is: > > --3-- > --4-- > >

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
the output your code produced is: --3-- --4-- --5-- --6-- --7-- it's because of the space between the \t and closing ] in [\t ]. This will separate output by a space. Whereas if you just have [\t] it will separate this out using tab spacing. Thanks fo

Re: ConnectedComponents example

2014-03-31 Thread Young Han
Ah yeah, I found the answer to that question: https://stackoverflow.com/questions/3762347/ So I don't think that bit is a bug. I'm not really sure why inputs with tabs don't work for you. I'm using Hadoop 1.0.4 and jdk1.6.0_30 on Ubuntu 12.04 x64, if that helps you. Young On Mon, Mar 31, 2014 a

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
Hey, Yes when originally debugging the code I thought to check what \t actually split by and created my own test class: import java.util.regex.Pattern; class App { private static final Pattern SEPARATOR = Pattern.compile("[\t ]"); public static void main( String[] args ) { String

Re: ConnectedComponents example

2014-03-31 Thread Young Han
Weird, inputs with tabs work for me right out of the box. Either the "\t" is not the cause or it's some Java-version specific issue. Try this toy program: import java.util.regex.Pattern; public class Test { public static void main(String[] args) { Pattern SEPARATOR = Pattern.compile("[\t ]

Re: ConnectedComponents example

2014-03-31 Thread Young Han
Huh, it might be a bug in the code. Could it be that Pattern.compile has to take "[\\t ]" (note the double backslash) to properly match tabs? If so, that bug is in all the input formats... Happy to help :) Young On Mon, Mar 31, 2014 at 4:07 PM, ghufran malik wrote: > Hi, > > I removed the spac

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
Hi, I removed the spaces and it worked! I don't understand though. I'm sure the separator pattern means that it splits it by tab spaces?. Thanks for all your help though some what relieved now! Kind regards, Ghufran On Mon, Mar 31, 2014 at 8:15 PM, Young Han wrote: > Hi, > > That looks like

Re: ConnectedComponents example

2014-03-31 Thread Young Han
Hi, That looks like an error with the algorithm... What do the Hadoop userlogs say? And just to rule out weirdness, what happens if you use spaces instead of tabs (for your input graph)? Young On Mon, Mar 31, 2014 at 2:04 PM, ghufran malik wrote: > Hey, > > No even after I added the .txt it g

Fwd: ConnectedComponents example

2014-03-31 Thread ghufran malik
Hey, No even after I added the .txt it gets to map 100% then drops back down to 50 and gives me the error: 14/03/31 18:22:56 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your InputFormat does not require one. 14/03/31 18:22:56 WARN job.GiraphConfigurationValidator: Output

Re: ConnectedComponents example

2014-03-31 Thread Young Han
logs show Hadoop 0.20.203.0. Maybe that could be the cause too? >>>> >>>> Finally, this may be completely irrelevant, but I had issues running >>>> connected components on Giraph 1.0.0 and I fixed it by changing the >>>> algorithm and the input format. The

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
omponent = >>> vertex.getId().get(); vertex.setValue(new >>> IntWritable(currentComponent)); sendMessageToAllEdges(vertex, >>> vertex.getValue()); vertex.voteToHalt(); return;} >>> >>> I forget what error this change solved, so it m

Re: ConnectedComponents example

2014-03-31 Thread Young Han
may not help in your case. >> >> Young >> >> >> >> On Sun, Mar 30, 2014 at 6:13 AM, ghufran malik >> wrote: >> >>> Hello, >>> >>> I am a final year Bsc Computer Science Student who is using Apache >>> Giraph for

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
Mar 30, 2014 at 6:13 AM, ghufran malik wrote: > >> Hello, >> >> I am a final year Bsc Computer Science Student who is using Apache Giraph >> for my final year project and dissertation and would appreciate very much >> if someone could help me with the followi

Re: ConnectedComponents example

2014-03-30 Thread Young Han
n and would appreciate very much > if someone could help me with the following issue. > > I am using Apache Giraph 1.1.0 Snapshot with Hadoop 0.20.203.0 and am > having trouble running the ConnectedComponents example. I use the following > command: > > hadoop jar > /home/ghufran/Do

Re: ConnectedComponents example

2014-03-30 Thread nishant gandhi
Computer Science Student who is using Apache Giraph > for my final year project and dissertation and would appreciate very much > if someone could help me with the following issue. > > I am using Apache Giraph 1.1.0 Snapshot with Hadoop 0.20.203.0 and am > having trouble running the Con

ConnectedComponents example

2014-03-30 Thread ghufran malik
running the ConnectedComponents example. I use the following command: hadoop jar /home/ghufran/Downloads/Giraph2/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner