Time complexity of Single Source Shortest Path Algo

Hi Giraphers.. Can anybody help me analyzing the time complexity of Single Source Shortest Path Algo , while implementing in giraph.?? Thanks.

Re: Command Line output

Hi Akshay.. In your hadoop folder log directory will be there.. /hadoop_version/logs/userlogs/ For every giraph job you executed, log files are created here.. If you will write System.out.println(any statement) statement in your giraph pogram, it will be written here in the log files.. You

Taking string as vertex value..

Hi folks.. While implementing my algorithm , I am taking vertex value as string.. following is the sample input format... [0,hello world,[[1,1],[3,3]]] [1,a,[[0,1],[2,2],[3,1]]] [2,b,[[1,2],[4,4]]] [3,c,[[0,3],[1,1],[4,4]]] [4,d,[[3,4],[2,4]]] Suppose above is the input file given.. For

Re: Vertices reading the file..

,--vertexInputFormat arg Vertex input format -vip,--vertexInputPath arg Vertex input path -- Kindly regards Wojciech Indyk 2014-04-14 5:55 GMT+02:00 Jyoti Yadav rao.jyoti26ya...@gmail.com: Hi Folks.. In my algorithm,i want that all vertices should read some content stored

Vertices reading the file..

Hi Folks.. In my algorithm,i want that all vertices should read some content stored in the file.File is stored in local machine, not in hdfs. I am working on pseudo distributed mode. Suppose there are 5 lines stored in the file. First line is useful for vertex 1, and second line is useful for

File reading in giraph

Hi folks.. Is it possible to read a text file in master compute function. Text file just contain some integer values.. Seeking your ideas.. Thanks.. With Regards Jyoti

Re: help in compiling

Hi Nishant Steps to compile your own program in giraph... 1. write your java program to be executed.. 2. Save the program in giraph-examples directory. 3. in command prompt,type cd $GIRAPH_HOME then cd giraph-examples then type mvn compile Using above command to compile,your program will be

About edge weight update

Hi Giraphers.. Suppose in single source shortest path sample example data given below, [1,0[[2,*10*],[3,*20*]]] In Giraph, can we udate the edge weight *10* and *20* during our compute function?? Seeking your ideas.. Thanks Regards Jyoti

[no subject]

Hi Giraph Experts.. I am just new to hadoop 2.2.0.. I am not able to compile even sample example. I gave following command. hadoop jar /home/hadoopAdmin/hadoop/giraph-1.0.0/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar

Re: Sample data for Single Source shortest path

]. You will probably have to convert them to an appropriate format for Giraph. Best, Sebastian [1] http://konect.uni-koblenz.de/ [2] http://law.di.unimi.it/datasets.php On 03/01/2014 05:22 AM, Jyoti Yadav wrote: Hi folks.. I got new system which is of 64 cores and 512 GB memory and 3

Re: Sample data for Single Source shortest path

core system? What distro of Hadoop are working with? and is it a MRv1 or MRV2 (YARN) setup? Is your MapReduce system working properly ... can you run TerraSort for example? Cheers, Mirko On Sat, Mar 1, 2014 at 4:15 AM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Anyone please reply

Re: How to restart the job from last checkpoint?

Anybody please share views on above problem. I am not getting how to fix it.. Thanks On Tue, Feb 4, 2014 at 4:42 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi folks.. I am implementing one algorithm.It involves thousands of supersteps to be run. After running some supersteps

Running out of space..

Hi folks.. While executing one algorithm with enabling checkpointing feature on,system is running out of memory. I gave following command hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar org.apache.giraph.GiraphRunner

Re: constraint about no of supersteps

/01 23:24:03 INFO mapred.JobClient: Launched map tasks=4 14/02/01 23:24:03 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0 Seeking your suggestion.. Jyoti On Fri, Jan 31, 2014 at 12:41 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Thanks Claudio for your reply.. I think

Re: constraint about no of supersteps

:12 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi folks.. Is there any limit for maximum no of supersteps while running a giraph job?? Thanks Jyoti -- Claudio Martella

Re: About LineRank algo ..

: I have a student working on an implementation, do you have questions? On 01/20/2014 08:11 AM, Jyoti Yadav wrote: Hi.. Is there anyone who is working with linerank algorithm?? Thanks Jyoti

Re: About LineRank algo ..

eigenvector has to be rescaled to unit length. IIRC this is also done in the LineRank algorithm in the paper. --sebastian On 01/20/2014 10:04 AM, Jyoti Yadav wrote: Hi Sebastian.. I code this algorithm,but while running,it is not converging.. One more question,for power iteration.is

Re: Problem occured when running job with 1 worker.

it too. Sertug On 20-01-2014 09:22, Jyoti Yadav wrote: *h.master.MasterThread: masterThread: Master algorithm failed with ArrayIndexOutOfBoundsException java.lang.ArrayIndexOutOfBoundsException: -1*

Re: About LineRank algo ..

Thanks Sebastian.. You pls send your code,I will also check where i went wrong.. On Mon, Jan 20, 2014 at 8:51 PM, Sebastian Schelter s...@apache.org wrote: On 01/20/2014 11:48 AM, Jyoti Yadav wrote: Hi Sebastian... while referring the paper,paper talks about the normalization of L(G

About LineRank algo ..

Hi.. Is there anyone who is working with linerank algorithm?? Thanks Jyoti

Problem occured when running job with 1 worker.

Hi Folks... When i am running one algorithm on single system cluster with 1 worker,it is working fine...But when i increased the no of worker 1,following error is thrown at run time.. *ERROR org.apache.giraph.master.BspServiceMaster: superstepChosenWorkerAlive: Missing chosen worker

Error: Out of memory error..

Hi.. I faced some error at runtime Error running child java.lang.IllegalStateException: run: Caught an unrecoverable exception waitFor: ExecutionException occurred while waiting for org.apache.giraph.utils.ProgressableUtils$FutureWaitable@1a1d638 at

Re: Running one compute function after another..

statement. For my example, if the value is true then it goes through the first 'if'. When the condition you want is fullfilled, change the value of the variable to false (at all nodes) and then the second part will be executed. Ilias Στις 11/1/2014 6:18 μμ, ο/η Jyoti Yadav έγραψε: Hi folks

Re:

=... On 9.1.2014 11:20, Jyoti Yadav wrote: Hi.. Is anyone familiar with below mentioned error*??* * ERROR:*org.apache.giraph.master.BspServiceMaster: checkWorkers: Did not receive enough processes in time (only 0 of 1 required) after waiting 60msecs). This occurs if you do not have enough map

Fwd: Writing my own aggregator..

-- Forwarded message -- From: Ameya Vilankar ameya.vilan...@gmail.com Date: Fri, Jan 10, 2014 at 1:43 PM Subject: Re: Writing my own aggregator.. To: Jyoti Yadav rao.jyoti26ya...@gmail.com This should solve it I think. If it doesn't email me the error. // MyArrayWritable.java

Re: Writing my own aggregator..

Thanks a lot Ameya...It really worked..:). On Fri, Jan 10, 2014 at 2:32 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: -- Forwarded message -- From: Ameya Vilankar ameya.vilan...@gmail.com Date: Fri, Jan 10, 2014 at 1:43 PM Subject: Re: Writing my own aggregator

About writing our own aggregator..

Hi Folks... I am trying to implement one graph algorithm on giraph. I want that all vertices send their ids to the master .For that I need to implement my own aggregator class. Please suggest me how to proceed... Thanks Jyoti

[no subject]

Hi.. Is anyone familiar with below mentioned error*??* *ERROR:*org.apache.giraph.master.BspServiceMaster: checkWorkers: Did not receive enough processes in time (only 0 of 1 required) after waiting 60msecs). This occurs if you do not have enough map tasks available simultaneously on your

Re:

: SLOTS_MILLIS_REDUCES=12677 On Thu, Jan 9, 2014 at 3:51 PM, Sebastian Schelter s...@apache.org wrote: Did you try to increase the number of map slots in your cluster, as suggested? On 01/09/2014 11:20 AM, Jyoti Yadav wrote: Hi.. Is anyone familiar with below mentioned error*??* *ERROR

Re: How to implement a function in Mastercompute class?

, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi folks.. While implementing some graph algo,i face some problem.. I want to implement some function which is performed by master node after superstep 3.. Please help me dealing with this issue. With regards Jyoti

Running an algo for selected no of vertices..

Hi folks.. I am trying to implement some graph algorithm .I want compute function to run for some selected number of vertices. For eg. first compute function run for vertex id=2,when its work is completed,then i want to run compute function for vertex id =5. Is it possible in giraph??? Any

Re: Run time error

Thanks Pushparaj.. Your idea really worked.. On Tue, Dec 31, 2013 at 2:53 PM, Pushparaj Motamari pushpara...@gmail.comwrote: Hi, Use this in the job command you give giraph.useSuperstepCounters=false On Tue, Dec 31, 2013 at 9:31 AM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi

Run time error

Hi folks.. I am trying to execute a graph algorithm on relatively large graph.. I installed hadoop on single system and trying to execute algorithm on Giraph... I got following error... ERROR org.apache.giraph.graph.GraphTaskManager: run: Worker failure failed on another RuntimeException,

Re: Run time error

: Check for error in program during runtime..check the logs On Mon, Dec 30, 2013 at 10:46 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi folks.. I am trying to execute a graph algorithm on relatively large graph.. I installed hadoop on single system and trying to execute algorithm

Re: Need your help to serialize an boolean array....

.. On Wed, Nov 20, 2013 at 4:16 PM, Sebastian Schelter ssc.o...@googlemail.com wrote: It says Failed map tasks=1, you should have a deeper look into the logfiles or into the web console of Hadoop to find out why the map task fails. On 20.11.2013 11:44, Jyoti Yadav wrote: 13/11/20 15:56:28

Re: Need your help to serialize an boolean array....

/job_201311200901_0018/job.xml:a attempt to override final parameter: dfs.name.dir; Ignoring. On Wed, Nov 20, 2013 at 4:52 PM, Sebastian Schelter ssc.o...@googlemail.com wrote: What is the exact error message? On 20.11.2013 12:11, Jyoti Yadav wrote: Thanks Sir for your suggestions... I looked

Re: Need your help to serialize an boolean array....

in the parametrized constructor. In the readFields method you should make sure that the array has been allocated. if not you should instance an array of length size, as you just read from the byte stream. On Wed, Nov 20, 2013 at 12:25 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: 2013-11-20

Re: about retaining the variable value...

works like this. It's just how I would try it ... But I think we will see a definitive answer soon. Have a nice day! Mirko On Sun, Nov 17, 2013 at 6:55 AM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi folks... while executing my program ,i came across a doubt which is creating

Re: about retaining the variable value...

if a Giraph vertex works like this. It's just how I would try it ... But I think we will see a definitive answer soon. Have a nice day! Mirko On Sun, Nov 17, 2013 at 6:55 AM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi folks... while executing my program ,i came across a doubt

Re: about retaining the variable value...

, at the private part of the class. You will have to instantiate it at superstep 0 though, else you will have a NullPointerException thrown, in case you use it at superstep 1. Quoting Jyoti Yadav rao.jyoti26ya...@gmail.com: Thanks Ameya...I will give a try to your ideas... On Sun, Nov 17, 2013 at 3

About Sending a composite message

Hi.. I am trying to execute SingleSourceShortestPath example with some changes in this.. While sending message,i am sending two values-(sender vertex value+edge weight),sender_id.. For this message to send,i created my own message file MyMessageWritable.java. The graph input is given in following

About vertex input format..

Hi.. I am trying to execute SingleSourceShortestPath example with some changes in this.. While sending message,i am sending two values-(sender vertex value+edge weight),sender_id.. For this message to send,i created my own message file MyMessageWritable.java. The graph input is given in following

Re: About vertex input format..

, JSONException e) { throw new IllegalArgumentException( Couldn't get vertex from line + line, e); } } } On Wed, Nov 13, 2013 at 7:20 AM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi.. I am trying to execute

About giving multiple adjacency matrix as input to Giraph..

Hi.. while implementing LineRank algorithm,can we give multiple adjacency matrix as input to Giraph.. Any ideas?? Thanks Jyoti

Re: About Giraph Design

or bound by the diameter of the graph. --sebastian On 28.10.2013 05:09, Jyoti Yadav wrote: Hi.. one doubt is disturbing me..Would anyone suggest an idea? Is GIRAPH is designed for solving problems like AllPairShortestPath ? Thanks in advance. Jyoti

Need help to run Giraph program..

Hi .. I want to run my own giraph program. I made some modification to already existiing SimpleShortestPathsComputation program. I compiled it and created a jar file. I gave following command. bin/hadoop jar

Re: About Aggregators working

Please help.. Jyoti On Sun, Oct 27, 2013 at 9:14 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Anyone please reply.. On Sat, Oct 26, 2013 at 6:05 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi.. I have one query in my mind..I don't know whether it is a silly question

Re: About Aggregators working

the aggregated output to file. I don't know if Aggregator writer is present in the release branch of giraph. But, it is surely present in its trunk branch which I suggest you work off. Thanks On Mon, Oct 28, 2013 at 9:20 AM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Please help

Re: Problem in running my own giraph program

please suggest me something .. On Sun, Oct 27, 2013 at 10:42 AM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi Claudio... Thanks for your active response.. Still I have doubt.The giraph program which I am running is not the sample program given in the giraph examples,although the name

Problem in running giraph program

Hi .. I want to run my own giraph program. I made some modification to already existiing SimpleShortestPathsComputation program. I compiled it and created a jar file. I gave following command. bin/hadoop jar

Re: About Aggregators working

Anyone please reply.. On Sat, Oct 26, 2013 at 6:05 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi.. I have one query in my mind..I don't know whether it is a silly question or not? But the question is Suppose the scenario mentioned below.. At Superstep 0 1.All vertices

Problem in running my own giraph program

Hi.. I am new to giraph..I tried to run my giraph job,which compiled successfully. I gave following command.. but program is not running successfully. bin/hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar

Re: Problem in running my own giraph program

( org.apache.giraph.examples.SimpleShortestPathsComputation in your case). The rest looks fine for me. On Sat, Oct 26, 2013 at 8:14 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi.. I am new to giraph..I tried to run my giraph job,which compiled successfully. I gave following command

Problem running single source shortest path example in cluster

Hi.. I tried to run shortest path algo in cluster.. I follow giraph quick start documentation to execute the algo.. One thing I need to mention, on my cluster hadoop version is 1.2.1 and giraph version is 1.1.0.. but when I build the giraph the jar file which is create is named as

master knowing about message traffic

Is there any way for the master to know about how much message traffic is there? In my algo, I have to implement something when there is no msg flowing. Any ideas are really appreciated.. Regards Jyoti

Re: changes in SingleSourceShortestPath example

Jyoti, you can send any kind of message you want, as you can implement arbitrary custom datatypes. Best, Sebastian On 16.10.2013 18:30, Jyoti Yadav wrote: Hi.. I have one query in my mind.Which type of message we can send among vertices?? Can we send String message or String+int

Knowing about thee messages in the system.

Hi ... I am newbie to Giraph.While implementing one algorithm,I face some problem. Is there any way for the master node to know about messages flowing among vertices.?.How master come to know that there is no message flowing in the system? Any suggestions? With Regards Jyoti Yadav