Re: Using Giraph at Facebook

[Sebastian Schelter]

Just ran into it, great read. I hope that I will be able contribute again
in the future.

Awesome job done!
Am 14.08.2013 16:55 schrieb "Avery Ching" :

> Hi Giraphers,
>
> We recently released an article on we can use Giraph at the scale of a
> trillion edges at Facebook.  If you're interested, please take a look!
>
> https://www.facebook.com/**notes/facebook-engineering/**
> scaling-apache-giraph-to-a-**trillion-edges/**10151617006153920
>
> Avery
>

Using Giraph at Facebook

[Avery Ching]

Hi Giraphers,

We recently released an article on we can use Giraph at the scale of a 
trillion edges at Facebook.  If you're interested, please take a look!


https://www.facebook.com/notes/facebook-engineering/scaling-apache-giraph-to-a-trillion-edges/10151617006153920

Avery

Re: quick start tutorial errors

[Yazan Boshmaf]

For the first point, the tutorial assumes you have an admin account
called "hdadmin". The error indicates that you haven't created the
account. The details are in the "Overview" section (Ubuntu Server
configuration).

The second is a typo. The  tag needs to be removed. I
will patch this up.

Cheers,
Yazan

On Wed, Aug 14, 2013 at 9:48 AM, Kyle Orlando  wrote:
> 1.) This appears to be a typo on the quick start page. Assuming you've
> followed the previous steps, it should be:
>
> su - hduser
>
> 2.) This also appears to be a typo on the quick start page; the lack of the
> initial  tag is what's causing the error, but seeing that
> there's no description, the tag in general seems unnecessary. It should be
> this:
>
>
> 
> dfs.replication
> 1
> 
>
>
>
>
>
>
> On Tue, Aug 13, 2013 at 5:07 AM, 陆峰  wrote:
>>
>> Hi All
>>
>> When I start to use Giraph using this tutorial [0], I find some problems.
>>
>> 1. su - hdadmin
>> can not switch to hdadmin user, need to add hdadmin user first
>>
>> 2. hdfs-site.xml configuration error
>>
>> 
>> dfs.replication
>> 1
>> 
>> 
>>
>> missing description tag.
>>
>> thanks.
>>
>> [0] http://giraph.apache.org/quick_start.html
>>
>> --
>> Don't Grow Old, Grow Up.
>
>
>
>
> --
> Kyle Orlando
> Computer Engineering Major
> University of Maryland

Re: quick start tutorial errors

[Kyle Orlando]

1.) This appears to be a typo on the quick start page. Assuming you've
followed the previous steps, it should be:

su - hduser

2.) This also appears to be a typo on the quick start page; the lack of the
initial  tag is what's causing the error, but seeing that
there's no description, the tag in general seems unnecessary. It should be
this:

dfs.replication 1 






On Tue, Aug 13, 2013 at 5:07 AM, 陆峰  wrote:

> Hi All
>
> When I start to use Giraph using this tutorial [0], I find some problems.
>
> 1. su - hdadmin
>  can not switch to hdadmin user, need to add hdadmin user first
>
> 2. hdfs-site.xml configuration error
>
> dfs.replication 1  
> 
>
> missing description tag.
>
> thanks.
>
> [0] http://giraph.apache.org/quick_start.html
>
> --
> Don't Grow Old, Grow Up.
>



-- 
Kyle Orlando
Computer Engineering Major
University of Maryland

Re: Dynamic Graphs

[Claudio Martella]

Hi Marco,

Giraph currently does not support that. One way of doing this would be by
having a specific (pseudo-)vertex to act as the "injector" of the new
vertices and edges For example, it would read a file from HDFS and call the
mutable API during the computation, superstep after superstep.


On Wed, Aug 14, 2013 at 3:02 PM, Marco Aurelio Barbosa Fagnani Lotz <
m.a.b.l...@stu12.qmul.ac.uk> wrote:

>  Hello all,
>
> I would like to know if there is any form to use dynamic graphs with
> Giraph. By dynamic one can read graphs that may change while Giraph is
> computing/deliberating. The changes are in the input file and are not
> caused by the graph computation itself.
>
> Is there any way to analyse it using Giraph? If not, anyone has any
> idea/suggestion if it is possible to modify the framework in order to
> process it?
>
> Best Regards,
> Marco Lotz
>



-- 
   Claudio Martella
   claudio.marte...@gmail.com

Dynamic Graphs

[Marco Aurelio Barbosa Fagnani Lotz]

Hello all,

I would like to know if there is any form to use dynamic graphs with Giraph. By 
dynamic one can read graphs that may change while Giraph is 
computing/deliberating. The changes are in the input file and are not caused by 
the graph computation itself.

Is there any way to analyse it using Giraph? If not, anyone has any 
idea/suggestion if it is possible to modify the framework in order to process 
it?

Best Regards,
Marco Lotz