Re: Using Giraph at Facebook

[Eli Reisman]

Great paper!


On Thu, Aug 15, 2013 at 1:06 PM, Amaan Penang  wrote:

> All,
>
> Sorry for the unintentional spam; I meant to forward this message to a
> friend and accidentally hit reply. Keep up the great work!
>
> -a
>
> On Aug 15, 2013, at 12:58 PM, Amaan Penang  wrote:
>
> > Hey,
> >
> > Take a look at Apache Giraph; it's based on Google's Pregel paper. The
> > article below was put out by Facebook Engineering on how they use it.
> >
> > -a
> >
> > On Aug 14, 2013, at 4:55 PM, Avery Ching  wrote:
> >
> >> Hi Giraphers,
> >>
> >> We recently released an article on we can use Giraph at the scale of a
> trillion edges at Facebook.  If you're interested, please take a look!
> >>
> >>
> https://www.facebook.com/notes/facebook-engineering/scaling-apache-giraph-to-a-trillion-edges/10151617006153920
> >>
> >> Avery
>

Re: Using Giraph at Facebook

[Amaan Penang]

All,

Sorry for the unintentional spam; I meant to forward this message to a
friend and accidentally hit reply. Keep up the great work!

-a

On Aug 15, 2013, at 12:58 PM, Amaan Penang  wrote:

> Hey,
>
> Take a look at Apache Giraph; it's based on Google's Pregel paper. The
> article below was put out by Facebook Engineering on how they use it.
>
> -a
>
> On Aug 14, 2013, at 4:55 PM, Avery Ching  wrote:
>
>> Hi Giraphers,
>>
>> We recently released an article on we can use Giraph at the scale of a 
>> trillion edges at Facebook.  If you're interested, please take a look!
>>
>> https://www.facebook.com/notes/facebook-engineering/scaling-apache-giraph-to-a-trillion-edges/10151617006153920
>>
>> Avery

Re: Using Giraph at Facebook

[Amaan Penang]

Hey,

Take a look at Apache Giraph; it's based on Google's Pregel paper. The
article below was put out by Facebook Engineering on how they use it.

-a

On Aug 14, 2013, at 4:55 PM, Avery Ching  wrote:

> Hi Giraphers,
>
> We recently released an article on we can use Giraph at the scale of a 
> trillion edges at Facebook.  If you're interested, please take a look!
>
> https://www.facebook.com/notes/facebook-engineering/scaling-apache-giraph-to-a-trillion-edges/10151617006153920
>
> Avery

Re: Using Giraph at Facebook

[André Kelpe]

Great article! Can you say something about your deployment in terms of
java version and jvm parameters (gc, max memory etc.)? It will be
useful to others, to learn best practices for such huge giraph jobs.

- André


2013/8/15 Avery Ching 
>
> Hi Giraphers,
>
> We recently released an article on we can use Giraph at the scale of a 
> trillion edges at Facebook.  If you're interested, please take a look!
>
> https://www.facebook.com/notes/facebook-engineering/scaling-apache-giraph-to-a-trillion-edges/10151617006153920
>
> Avery

RE: Using Giraph at Facebook

[Marco Aurelio Barbosa Fagnani Lotz]

Great article! :)
Really interesting to see how you solved those many problems.

Btw, there's a small typo "in that help a variety of teams withchallenges they 
couldn’t solve with Hive/Hadoop or other custom systems in thepast."

Cheers,
Marco

From: Avery Ching 
Sent: 15 August 2013 00:55
To: user@giraph.apache.org
Subject: Using Giraph at Facebook

Hi Giraphers,

We recently released an article on we can use Giraph at the scale of a
trillion edges at Facebook.  If you're interested, please take a look!

https://www.facebook.com/notes/facebook-engineering/scaling-apache-giraph-to-a-trillion-edges/10151617006153920

Avery

Re: Using Giraph at Facebook

[Sebastian Schelter]

Just ran into it, great read. I hope that I will be able contribute again
in the future.

Awesome job done!
Am 14.08.2013 16:55 schrieb "Avery Ching" :

> Hi Giraphers,
>
> We recently released an article on we can use Giraph at the scale of a
> trillion edges at Facebook.  If you're interested, please take a look!
>
> https://www.facebook.com/**notes/facebook-engineering/**
> scaling-apache-giraph-to-a-**trillion-edges/**10151617006153920
>
> Avery
>

Using Giraph at Facebook

[Avery Ching]

Hi Giraphers,

We recently released an article on we can use Giraph at the scale of a 
trillion edges at Facebook.  If you're interested, please take a look!


https://www.facebook.com/notes/facebook-engineering/scaling-apache-giraph-to-a-trillion-edges/10151617006153920

Avery