Intermediate output

2014-01-18 Thread Sebastian Schelter 

Hi,

Did we have a way to write out the state of the graph after each 
superstep? I have an algorithm that requires this and I don't want to 
buffer the intermediate results in memory until the algorithm finishes.


--sebastian

Re: Intermediate output

2014-01-18 Thread Claudio Martella 
you can use giraph.doOutputDuringComputation.

If you use this option, instead of having saving vertices in the end of
application, saveVertex will be called right after each vertex.compute() is
called.NOTE: This feature doesn't work well with checkpointing - if you
restart from a checkpoint you won't have any ouptut from previous
supresteps.


On Sat, Jan 18, 2014 at 11:02 AM, Sebastian Schelter s...@apache.org wrote:

 Hi,

 Did we have a way to write out the state of the graph after each
 superstep? I have an algorithm that requires this and I don't want to
 buffer the intermediate results in memory until the algorithm finishes.

 --sebastian




-- 
   Claudio Martella
   claudio.marte...@gmail.com

Re: Release date for 1.1.0

2014-01-18 Thread Claudio Martella 
I agree, in particular considering that the current patch does not even
apply to trunk.


On Sat, Jan 18, 2014 at 4:43 PM, Sebastian Schelter s...@apache.org wrote:

 Hi,

 I had a look at the list and noticed that https://issues.apache.org/
 jira/browse/GIRAPH-818 (which is based on a research paper) is marked for
 1.1.0.

 Given that this issue proposes to change the programming and execution
 model of Giraph, I don't see it in the scope of the upcoming release.

 --sebastian


 On 01/18/2014 04:07 PM, Roman Shaposhnik wrote:

 The easiest way to start helping with a release would be to
 take a look at the JIRAs in the link I sent to the list a few
 days ago.

 Thanks,
 Roman,

 On Fri, Jan 17, 2014 at 5:54 PM, Rob Paul urlop...@gmail.com wrote:

 Hi Roman,

 I will be happy to extend my help in the new release. If you allow, I
 can initiate it and then you can jump in, as and when your time
 permits.
 Thanks

 On Wed, Jan 15, 2014 at 5:57 PM, Roman Shaposhnik r...@apache.org
 wrote:

 It is the usual community-driven ASF process. Somebody
 familiar with the project has to step forward as a Release Manager
 and drive the release.

 I did a few months back, but since then I went through a career
 change that made it very difficult for me to find free cycles to
 drive this release. I fully intend to pick up the slack begging
 of  Feb. Given that I think beginning of March should be a
 realistic deadline, but it all depends on the availability of
 the Giraph PMC members to cast votes on the release
 candidate.

 That said, if there's anybody else who would want to
 speed up this release I'd be more than happy to yield.

 By and large though, ASF project typically don't give any
 schedule for future releases. The way to speed it up is
 to join the community, start contributing and volunteering
 as RM.

 Thanks,
 Roman.

 On Wed, Jan 15, 2014 at 5:02 PM, Zhu, Xia xia@intel.com wrote:

 Is it possible to release 1.1.0 before March 2014?


 Thanks,
 Xia
 -Original Message-
 From: Zhu, Xia [mailto:xia@intel.com]
 Sent: Wednesday, January 15, 2014 4:36 PM
 To: user@giraph.apache.org
 Subject: RE: Release date for 1.1.0

 May I know what are the Giraph release process?


 Thanks,
 Ivy
 -Original Message-
 From: shaposh...@gmail.com [mailto:shaposh...@gmail.com] On Behalf Of
 Roman Shaposhnik
 Sent: Monday, January 06, 2014 9:22 PM
 To: user@giraph.apache.org
 Subject: Re: Release date for 1.1.0

 On Mon, Jan 6, 2014 at 6:13 AM, Ahmet Emre Aladağ 
 aladage...@gmail.com wrote:

 Hi,

 Are there any advances so far on the 1.1.0 release schedule?


 Unfortunately, with my recent job change driving 1.1.0 release dropped
 from my list. I'll try to pick it up back this month. Still very much 
 would
 like to help make it happen.

 Thanks,
 Roman.





-- 
   Claudio Martella
   claudio.marte...@gmail.com

Re: Release date for 1.1.0

2014-01-18 Thread Claudio Martella 
I think that after 1.1.0 we could consider this big change, and that there
should be voting for this. It's changing Giraph's shape at the core.


On Sat, Jan 18, 2014 at 5:15 PM, Mirko Kämpf mirko.kae...@cloudera.comwrote:

 Hi,

 also think this major change (or enhancement) might be something which
 goes into Giraph in a later release.

 Will there be a voting for such issues?



 Mirko




-- 
   Claudio Martella
   claudio.marte...@gmail.com