Re: Building Giraph Jar for Hadoop 2.0.0 Version

2014-03-31 Thread Agrta Rawat
Hi Lukas, Thank you so much for your reply. I have tried what you told. I have opened pom.xml. I have seendifferent profile id(s) and by default Hadoop-0.20.203 is true. I have changed by default activation property to Hadoop-2.0.0 but build failed with - [ERROR] The build could not read 1 proj

Re: why this messages?

2014-03-31 Thread Agrta Rawat
Perhaps you have not specified EdgeInputFormat and EdgeOutFormat in your jar run command. And it is just a message not exception as you can see that your task runs. Regards, Agrta Rawat On Mon, Mar 31, 2014 at 10:09 PM, nishant gandhi wrote: > Why this kind of error comes? What could be wrong?

Re: ConnectedComponents example

2014-03-31 Thread Young Han
That's pretty interesting. Forgot to mention, the output I get is --3-- --4-- --5-- --6-- --7-- So it does look like something is up with Java. Young On Mon, Mar 31, 2014 at 5:05 PM, ghufran malik wrote: > Hmm yea, the only difference between mine and your system is the hadoop > your using an

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
Hmm yea, the only difference between mine and your system is the hadoop your using and maybe the jdk. I think it's most likely something to do with the jdk in this respect. On Mon, Mar 31, 2014 at 10:01 PM, ghufran malik wrote: > the output your code produced is: > > --3-- > --4-- > >

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
the output your code produced is: --3-- --4-- --5-- --6-- --7-- it's because of the space between the \t and closing ] in [\t ]. This will separate output by a space. Whereas if you just have [\t] it will separate this out using tab spacing. Thanks fo

Re: ConnectedComponents example

2014-03-31 Thread Young Han
Ah yeah, I found the answer to that question: https://stackoverflow.com/questions/3762347/ So I don't think that bit is a bug. I'm not really sure why inputs with tabs don't work for you. I'm using Hadoop 1.0.4 and jdk1.6.0_30 on Ubuntu 12.04 x64, if that helps you. Young On Mon, Mar 31, 2014 a

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
Hey, Yes when originally debugging the code I thought to check what \t actually split by and created my own test class: import java.util.regex.Pattern; class App { private static final Pattern SEPARATOR = Pattern.compile("[\t ]"); public static void main( String[] args ) { String

Re: ConnectedComponents example

2014-03-31 Thread Young Han
Weird, inputs with tabs work for me right out of the box. Either the "\t" is not the cause or it's some Java-version specific issue. Try this toy program: import java.util.regex.Pattern; public class Test { public static void main(String[] args) { Pattern SEPARATOR = Pattern.compile("[\t ]

Re: ConnectedComponents example

2014-03-31 Thread Young Han
Huh, it might be a bug in the code. Could it be that Pattern.compile has to take "[\\t ]" (note the double backslash) to properly match tabs? If so, that bug is in all the input formats... Happy to help :) Young On Mon, Mar 31, 2014 at 4:07 PM, ghufran malik wrote: > Hi, > > I removed the spac

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
Hi, I removed the spaces and it worked! I don't understand though. I'm sure the separator pattern means that it splits it by tab spaces?. Thanks for all your help though some what relieved now! Kind regards, Ghufran On Mon, Mar 31, 2014 at 8:15 PM, Young Han wrote: > Hi, > > That looks like

Re: ConnectedComponents example

2014-03-31 Thread Young Han
Hi, That looks like an error with the algorithm... What do the Hadoop userlogs say? And just to rule out weirdness, what happens if you use spaces instead of tabs (for your input graph)? Young On Mon, Mar 31, 2014 at 2:04 PM, ghufran malik wrote: > Hey, > > No even after I added the .txt it g

Fwd: ConnectedComponents example

2014-03-31 Thread ghufran malik
Hey, No even after I added the .txt it gets to map 100% then drops back down to 50 and gives me the error: 14/03/31 18:22:56 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your InputFormat does not require one. 14/03/31 18:22:56 WARN job.GiraphConfigurationValidator: Output

Re: ConnectedComponents example

2014-03-31 Thread Young Han
Hmm.. it looks like a failure during graph loading. Did you forget a .txt in the input path? Young On Mon, Mar 31, 2014 at 1:17 PM, ghufran malik wrote: > Hi, > > Thanks for the speedy response! > > It didn't work for me :(. > > I updated the ConnectComponentsVertex class with yours and added i

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
Hi, Thanks for the speedy response! It didn't work for me :(. I updated the ConnectComponentsVertex class with yours and added in the new ConnectedComponentsInputFormat class. They are both in the giraph-examples/src/main/java/org/apache/giraph/examples package. To compile the example package: I

why this messages?

2014-03-31 Thread nishant gandhi
Why this kind of error comes? What could be wrong? Is it related with hadoop configuration or giraph code? 14/03/31 15:47:29 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your InputFormat does not require one. 14/03/31 15:47:29 INFO utils.ConfigurationUtils: No edge outpu

Re: ConnectedComponents example

2014-03-31 Thread Young Han
Hey, Sure, I've uploaded the 1.0.0 classes I'm using: http://pastebin.com/0cTdWrR4 http://pastebin.com/jWgVAzH6 They both go into giraph-examples/src/main/java/org/apache/giraph/examples Note that the input format it accepts is of the form "src dst1 dst2 dst3 ..."---there is no vertex value. So

Re: ConnectedComponents example

2014-03-31 Thread ghufran malik
Hi Young, I'd just like to say first thank you for your help it's much appreciated! I did the sanity check and everything seems fine I see the correct results. Yes I hadn't noticed that before that is strange, I don't know how that happened as on the quick start guide ( https://giraph.apache.org

Re: Building Giraph Jar for CDH 4.5

2014-03-31 Thread Agrta Rawat
Hi Pascal, I was able to install Hadoop 2.0.0 with CDH 4.6 repository. But now I need to build Giraph jar file for Hadoop 2.0.0.mI did "maven compile" but it gave me giraph-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar. I need giraph-1.0.0-for-hadoop-2.0.0-jar-with-dependencies.jar. Pleas

Re: Building Giraph Jar for Hadoop 2.0.0 Version

2014-03-31 Thread Lukas Nalezenec
Open pom.xml file from giraph-parent project, choose corresponding maven profile, active it from command line and recompile Giraph. Lukas On 31.3.2014 14:29, Agrta Rawat wrote: Hi All, I need to build Giraph 1.0.0 for Hadoop version2.0.0. how can I build Giraph jar for a specific version of

Building Giraph Jar for Hadoop 2.0.0 Version

2014-03-31 Thread Agrta Rawat
Hi All, I need to build Giraph 1.0.0 for Hadoop version2.0.0. how can I build Giraph jar for a specific version of Hadoop? Do i need to make some changes in any configuration file? Please suggest. Appreciate your help. Thanks. Regards, Agrta Rawat

Re: Edge/Vertex Balancing

2014-03-31 Thread Sebastian Schelter
Ah, ok. Haven't used that feature yet. On 03/31/2014 11:54 AM, Lukas Nalezenec wrote: Hi, Thanks for your reply, Sebastian It is feature in class org.apache.giraph.partition.PartitionBalancer. When workers load their partitions it counts number of vertexes/edges per worker and if division is

Re: Edge/Vertex Balancing

2014-03-31 Thread Lukas Nalezenec
Hi, Thanks for your reply, Sebastian It is feature in class org.apache.giraph.partition.PartitionBalancer. When workers load their partitions it counts number of vertexes/edges per worker and if division is not even it instructs workers to exchange partitions. I should write "partition bala

Re: Edge/Vertex Balancing

2014-03-31 Thread Sebastian Schelter
What exactly do you mean by that? Am 31.03.2014 11:32 schrieb "Lukas Nalezenec" < lukas.naleze...@firma.seznam.cz>: > Hi, > Is anybody successfully using edge/vertex Balancing ? > I need some answers, you can answer yes/no . > > Lukas >

Edge/Vertex Balancing

2014-03-31 Thread Lukas Nalezenec
Hi, Is anybody successfully using edge/vertex Balancing ? I need some answers, you can answer yes/no . Lukas