Request for information on Giraph custom Partitioner using external service

2018-07-10 Thread Neha Raj
Hi, I am working on a Graph Partitioning algorithms, and have chosen Giraph as a Graph processing system to run Graph problems, and very new to both.I would like to provide external partitioning information(in the form of txt file) to Giraph. For this I have created a custom partition (something

Information

2014-03-26 Thread Angelo Immediata
Hi there In my project I have to implement a routing system with good performance; at the beginning this system should be able in giving routes information only for one italian region (Lombardia) but it could be used for the whole Italy (or world) Let's stop to the Lombardia for now

Re: Information

2014-03-26 Thread Sebastian Schelter
performance; at the beginning this system should be able in giving routes information only for one italian region (Lombardia) but it could be used for the whole Italy (or world) Let's stop to the Lombardia for now. By reading OSM files I can create my own graph in the best format i can use

Re: Information

2014-03-26 Thread Angelo Immediata
this system should be able in giving routes information only for one italian region (Lombardia) but it could be used for the whole Italy (or world) Let's stop to the Lombardia for now. By reading OSM files I can create my own graph in the best format i can use it; then I need to use Dijkstra

Re: Information

2014-03-26 Thread Claudio Martella
project I have to implement a routing system with good performance; at the beginning this system should be able in giving routes information only for one italian region (Lombardia) but it could be used for the whole Italy (or world) Let's stop to the Lombardia for now. By reading OSM files I can

Re: Information

2014-03-26 Thread Angelo Immediata
this system should be able in giving routes information only for one italian region (Lombardia) but it could be used for the whole Italy (or world) Let's stop to the Lombardia for now. By reading OSM files I can create my own graph in the best format i can use it; then I need to use Dijkstra

Re: Information

2014-03-26 Thread Sebastian Schelter
information only for one italian region (Lombardia) but it could be used for the whole Italy (or world) Let's stop to the Lombardia for now. By reading OSM files I can create my own graph in the best format i can use it; then I need to use Dijkstra (or any other algorithm) in order to propose

Re: Information

2014-03-26 Thread Angelo Immediata
, Angelo Immediata angelo...@gmail.com wrote: Hi there In my project I have to implement a routing system with good performance; at the beginning this system should be able in giving routes information only for one italian region (Lombardia) but it could be used for the whole Italy (or world

Re: Information

2014-03-26 Thread Claudio Martella
with good performance; at the beginning this system should be able in giving routes information only for one italian region (Lombardia) but it could be used for the whole Italy (or world) Let's stop to the Lombardia for now. By reading OSM files I can create my own graph in the best format i

Re: What a worker really is and other interesting runtime information

2012-11-29 Thread Alexandros Daglis
Ok, so I added the partitions flag, going with hadoop jar target/giraph-0.1-jar-with-dependencies.jar org.apache.giraph.examples.SimpleShortestPathsVertex -Dgiraph.SplitMasterWorker=false -Dgiraph.numComputeThreads=12 -Dhash.userPartitionCount=12 input output 12 1 but still I got no overall

RE: What a worker really is and other interesting runtime information

2012-11-29 Thread Magyar, Bence (US SSA)
To: user@giraph.apache.org Subject: Re: What a worker really is and other interesting runtime information Ok, so I added the partitions flag, going with hadoop jar target/giraph-0.1-jar-with-dependencies.jar org.apache.giraph.examples.SimpleShortestPathsVertex -Dgiraph.SplitMasterWorker=false

Re: What a worker really is and other interesting runtime information

2012-11-29 Thread Alexandros Daglis
@giraph.apache.org *Subject:* Re: What a worker really is and other interesting runtime information ** ** Ok, so I added the partitions flag, going with hadoop jar target/giraph-0.1-jar-with-dependencies.jar org.apache.giraph.examples.SimpleShortestPathsVertex -Dgiraph.SplitMasterWorker

RE: What a worker really is and other interesting runtime information

2012-11-29 Thread Magyar, Bence (US SSA)
Daglis [mailto:alexandros.dag...@epfl.ch] Sent: Thursday, November 29, 2012 12:30 PM To: user@giraph.apache.org Subject: Re: What a worker really is and other interesting runtime information Hello Bence, So, you have 96 cores at your disposal. My guess would be that 3 workers are not enough to use

Re: What a worker really is and other interesting runtime information

2012-11-28 Thread Avery Ching
Oh, forgot one thing. You need to set the number of partitions to use single each thread works on a single partition at a time. Try -Dhash.userPartitionCount=number of threads On 11/28/12 5:29 AM, Alexandros Daglis wrote: Dear Avery, I followed your advice, but the application seems to be

Re: What a worker really is and other interesting runtime information

2012-11-27 Thread Avery Ching
Hi Alexandros, The extra task is for the master process (a coordination task). In your case, since you are using a single machine, you can use a single task. -Dgiraph.SplitMasterWorker=false and you can try multithreading instead of multiple workers. -Dgiraph.numComputeThreads=12 The