Powered-by Giraph page

2014-04-09 Thread Claudio Martella
Hello giraphers,

as Giraph is getting more visibility and users, I think it would be nice to
add a Powered-by page on our site, were we collect names of companies
that (want to share that) are using Giraph.

So, this is basically a small survey about who is using Giraph. For those
that I know:

- Facebook


Anybody else?

Thanks!

Claudio

-- 
   Claudio Martella


Re: Powered-by Giraph page

2014-04-09 Thread Sebastian Schelter
We have a guy from spotify on the list, who seems to be evaluating 
Giraph. You could ask whether they want to be on that page.



On 04/09/2014 03:29 PM, Claudio Martella wrote:

Hello giraphers,

as Giraph is getting more visibility and users, I think it would be nice to
add a Powered-by page on our site, were we collect names of companies
that (want to share that) are using Giraph.

So, this is basically a small survey about who is using Giraph. For those
that I know:

- Facebook


Anybody else?

Thanks!

Claudio





How to set giraph runtime parameters?

2014-04-09 Thread Suijian Zhou
Hi,
  Does anybody know how to set runtime parameters in giraph? It should
be set in command line
 or in a *.xml file?  I tried -Dgiraph.zkSessionMsecTimeout=90(
googled) in command line but failed. Thanks!

  Best Regards,
  Suijian


Re: How to set giraph runtime parameters?

2014-04-09 Thread Claudio Martella
you can set them on the command line, by using -D (e.g.
-Dgiraph.isStaticGraph=true) after GiraphRunner,


On Wed, Apr 9, 2014 at 4:44 PM, Suijian Zhou suijian.z...@gmail.com wrote:

 Hi,
   Does anybody know how to set runtime parameters in giraph? It should be set 
 in command line

  or in a *.xml file?  I tried -Dgiraph.zkSessionMsecTimeout=90( googled) 
 in command line but failed. Thanks!

   Best Regards,
   Suijian







-- 
   Claudio Martella


Re: PageRank on custom input

2014-04-09 Thread Avery Ching

Hi Vikesh,

You just need to write an input format or use an existing one. You can 
specify any number and combination of VertexInputFormat and 
EdgeInputFormat formats as per your needs.


Please see giraph-core/src/main/java/org/apache/giraph/io/formats for 
some examples.


Avery

On 4/7/14, 9:57 PM, Vikesh Khanna wrote:

Hi,

We want to run a PageRank job (similar to PageRankBenchmark) for 
custom input graph. Is there an example for this? Giraph's website has 
a page for this but it is incomplete - 
http://giraph.apache.org/pagerank.html


Thanks,
Vikesh Khanna,
Masters, Computer Science (Class of 2015)
Stanford University






Re: How to set giraph runtime parameters?

2014-04-09 Thread Suijian Zhou
Thanks Claudio, it works.

Best Regards,
Suijian



2014-04-09 10:42 GMT-05:00 Claudio Martella claudio.marte...@gmail.com:

 you can set them on the command line, by using -D (e.g.
 -Dgiraph.isStaticGraph=true) after GiraphRunner,


 On Wed, Apr 9, 2014 at 4:44 PM, Suijian Zhou suijian.z...@gmail.comwrote:

 Hi,
   Does anybody know how to set runtime parameters in giraph? It should be 
 set in command line


  or in a *.xml file?  I tried -Dgiraph.zkSessionMsecTimeout=90( googled) 
 in command line but failed. Thanks!

   Best Regards,
   Suijian







 --
Claudio Martella




zookeeper setting problem in giraph.

2014-04-09 Thread Suijian Zhou
Hi,
   I have a problem in zookeeper in giraph, after the session has been
established, it will lose connection in ~1 minute although I see the
timeout is set to 60, i.e 10minutes. What's the possible reasons?

14/04/08 16:55:22 INFO mapred.JobClient: Running job: job_201404081444_0018
14/04/08 16:55:22 INFO zookeeper.ClientCnxn: Opening socket connection to
server compute-0-13.local/10.1.255.241:22181. Will not attempt to
authenticate using SASL (unknown error)
14/04/08 16:55:22 INFO zookeeper.ClientCnxn: Socket connection established
to compute-0-13.local/10.1.255.241:22181, initiating session
14/04/08 16:55:22 INFO zookeeper.ClientCnxn: Session establishment complete
on server compute-0-13.local/10.1.255.241:22181, sessionid =
0x14543567f5e0009, negotiated timeout = 60
..
..
14/04/08 16:57:02 INFO job.JobProgressTracker: Data from 8 workers -
Compute superstep 2: 0 out of 4847571 vertices computed; 0 out of 64
partitions computed; min free memory on worker 2 - 216.01MB, average
287.75MB
14/04/08 16:57:07 INFO zookeeper.ClientCnxn: Unable to read additional data
from server sessionid 0x14543567f5e0009, likely server has closed socket,
closing socket connection and attempting reconnect
14/04/08 16:57:09 INFO zookeeper.ClientCnxn: Opening socket connection to
server compute-0-13.local/10.1.255.241:22181. Will not attempt to
authenticate using SASL (unknown error)
14/04/08 16:57:09 WARN zookeeper.ClientCnxn: Session 0x14543567f5e0009 for
server null, unexpected error, closing socket connection and attempting
reconnect
java.net.ConnectException: Connection refused

  I tried to tuned the GC settings of hadoop but not working. Any hints?

  Best Regards,
  Suijian