[jira] [Resolved] (GIRAPH-971) Simple Giraph Oozie Action module

2016-01-17 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman resolved GIRAPH-971. Resolution: Won't Fix old ticket, will come back to this if I end up needing it or anyone

Re: What is the best recipe for determining maximum worker count?

2015-02-08 Thread Eli Reisman
That's correct. There were some changes last year as to. How these worker containers are allocated that were supposed to fix another similar issue with the master task. Perhaps this introduced another bug. I'm not sure there's enough info to be sure can you give more details? Anyone else seeing thi

[jira] [Updated] (GIRAPH-969) STATIC_SASL_SYMBOL munge results in compilation errors for yarn profile with hadoop > 2.3.0

2015-01-31 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-969: --- Attachment: GIRAPH-969-1.patch This should fix the YARN profile Hadoop-2.6.x build issues

[jira] [Updated] (GIRAPH-971) Simple Giraph Oozie Action module

2014-12-17 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-971: --- Attachment: GIRAPH-971-3.patch > Simple Giraph Oozie Action mod

[jira] [Updated] (GIRAPH-971) Simple Giraph Oozie Action module

2014-12-16 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-971: --- Attachment: GIRAPH-971-2.patch Now passes 'mvn verify' on default build profile. Needs

[jira] [Updated] (GIRAPH-971) Simple Giraph Oozie Action module

2014-12-15 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-971: --- Attachment: GIRAPH-971-1.patch > Simple Giraph Oozie Action mod

[jira] [Created] (GIRAPH-971) Simple Giraph Oozie Action module

2014-12-15 Thread Eli Reisman (JIRA)
Eli Reisman created GIRAPH-971: -- Summary: Simple Giraph Oozie Action module Key: GIRAPH-971 URL: https://issues.apache.org/jira/browse/GIRAPH-971 Project: Giraph Issue Type: New Feature

[jira] [Commented] (GIRAPH-959) Giraph's 1.1.0 hadoop_yarn profile can no longer be built with hadoop 2.0.3-alpha

2014-12-15 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247459#comment-14247459 ] Eli Reisman commented on GIRAPH-959: The original hadoop_yarn profile ran on Ha

[jira] [Commented] (GIRAPH-811) Infinite ZooKeeper CleanUp

2014-04-19 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13974922#comment-13974922 ] Eli Reisman commented on GIRAPH-811: This is a good solution, are you certain

Re: Progress towards 1.1.0

2014-03-02 Thread Eli Reisman
Hey all! I haven't seen any motion from anyone else on GIRAPH-747 I was thinking maybe something changed in the switch to support Hadoop 2.2. I am kind of swamped right now but will attempt to get it fixed. If Muhammed or anyone else who worked on 2.2 update has any input please drop a note on the

Re: Review Request 17646: GIRAPH-841: fix missing munge symbols error for non-munge-using profiles

2014-02-09 Thread Eli Reisman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17646/#review34033 --- Ship it! Looks good to me, good call. +1 - Eli Reisman On Feb

Re: BspServiceMaster: cleanedUpZooKeeper infinite loop

2014-02-09 Thread Eli Reisman
Hi Eric, Can you take a look at GIRAPH-747 I think it relates. We had some issues in the original pre-Hadoop-2.2 GA YARN profile that I had to shim. I think something changed in the switchover to 2.2 or on the non-YARN side that made this an issue again. We produce an ApplicationMaster _and_ a mas

[jira] [Commented] (GIRAPH-747) BspServiceMaster finishes ZooKeeper cleanup without waiting for all workers to complete

2014-01-30 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13887351#comment-13887351 ] Eli Reisman commented on GIRAPH-747: Had a chance to look again and my read is

[jira] [Commented] (GIRAPH-747) BspServiceMaster finishes ZooKeeper cleanup without waiting for all workers to complete

2014-01-30 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13886989#comment-13886989 ] Eli Reisman commented on GIRAPH-747: Hey, reviewing this. I recall this iss

[jira] [Commented] (GIRAPH-747) BspServiceMaster finishes ZooKeeper cleanup without waiting for all workers to complete

2014-01-29 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13886195#comment-13886195 ] Eli Reisman commented on GIRAPH-747: I'll review and commit this, tha

[jira] [Commented] (GIRAPH-819) Number of containers required for a job

2014-01-29 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13886157#comment-13886157 ] Eli Reisman commented on GIRAPH-819: Thanks, sorry it took so long I will be happ

Re: Building Apache Giraph on top of hadoop 2.2.0

2013-12-08 Thread Eli Reisman
There is a YARN-only profile that runs on Hadoop 2.2.x line for Giraph. If you want to run Giraph in the mode that most Giraph profiles run in (Giraph tasks hosted on MapReduce Mappers rather than YARN containers) you shoudl also be able to do that, and there is a ticket on the Giraph JIRA to estab

[jira] [Commented] (GIRAPH-794) add support for generic hadoop1 and hadoop2 profiles

2013-12-08 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13842580#comment-13842580 ] Eli Reisman commented on GIRAPH-794: i like this idea, does anyone have a pro

[jira] [Updated] (GIRAPH-730) GiraphApplicationMaster race condition in resource loading

2013-11-05 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-730: --- Attachment: GIRAPH-730-2-suggestion.patch > GiraphApplicationMaster race condition in resou

[jira] [Updated] (GIRAPH-730) GiraphApplicationMaster race condition in resource loading

2013-11-05 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-730: --- Attachment: (was: GIRAPH-730-2.patch) > GiraphApplicationMaster race condition in resou

[jira] [Commented] (GIRAPH-737) Giraph Application Master: move to new and stable YARN API

2013-11-05 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13814479#comment-13814479 ] Eli Reisman commented on GIRAPH-737: Committed, thanks so much Muhammad, great

Re: Review Request 14575: Giraph Application Master: move to new and stable YARN API

2013-10-26 Thread Eli Reisman
> On Oct. 11, 2013, 1:52 a.m., Eli Reisman wrote: > > I'm +1 for moving to the new YARN APIs. I think with Hadoop 2 on the beta > > line now, supporting alpha is no longer such a priority. > > Eli Reisman wrote: > While I'm +1 for moving forward o

[jira] [Updated] (GIRAPH-737) Giraph Application Master: move to new and stable YARN API

2013-10-26 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-737: --- Attachment: GIRAPH-737-2.patch This is the most recent patch Muhammad uploaded to RB. I am posting

Re: Review Request 14575: Giraph Application Master: move to new and stable YARN API

2013-10-24 Thread Eli Reisman
> On Oct. 11, 2013, 1:52 a.m., Eli Reisman wrote: > > I'm +1 for moving to the new YARN APIs. I think with Hadoop 2 on the beta > > line now, supporting alpha is no longer such a priority. > > Eli Reisman wrote: > While I'm +1 for moving forward o

Re: Review Request 14575: Giraph Application Master: move to new and stable YARN API

2013-10-22 Thread Eli Reisman
> On Oct. 11, 2013, 1:52 a.m., Eli Reisman wrote: > > I'm +1 for moving to the new YARN APIs. I think with Hadoop 2 on the beta > > line now, supporting alpha is no longer such a priority. > > Eli Reisman wrote: > While I'm +1 for moving forward o

Re: Review Request 14575: Giraph Application Master: move to new and stable YARN API

2013-10-16 Thread Eli Reisman
> On Oct. 11, 2013, 1:52 a.m., Eli Reisman wrote: > > I'm +1 for moving to the new YARN APIs. I think with Hadoop 2 on the beta > > line now, supporting alpha is no longer such a priority. > > Eli Reisman wrote: > While I'm +1 for moving forward o

Re: Review Request 14575: Giraph Application Master: move to new and stable YARN API

2013-10-11 Thread Eli Reisman
> On Oct. 11, 2013, 1:52 a.m., Eli Reisman wrote: > > I'm +1 for moving to the new YARN APIs. I think with Hadoop 2 on the beta > > line now, supporting alpha is no longer such a priority. > > Eli Reisman wrote: > While I'm +1 for moving forward o

Re: Review Request 14575: Giraph Application Master: move to new and stable YARN API

2013-10-11 Thread Eli Reisman
> On Oct. 11, 2013, 1:52 a.m., Eli Reisman wrote: > > I'm +1 for moving to the new YARN APIs. I think with Hadoop 2 on the beta > > line now, supporting alpha is no longer such a priority. While I'm +1 for moving forward on the upgrade, I'm having a bit of troubl

Re: Review Request 14575: Giraph Application Master: move to new and stable YARN API

2013-10-10 Thread Eli Reisman
with Hadoop 2 on the beta line now, supporting alpha is no longer such a priority. - Eli Reisman On Oct. 10, 2013, 7:50 a.m., Mohammad Islam wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://rev

[jira] [Commented] (GIRAPH-737) Giraph Application Master: move to new and stable YARN API

2013-10-10 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792207#comment-13792207 ] Eli Reisman commented on GIRAPH-737: I'm +1 on moving forward with this, tha

Re: Review Request 14580: Update Giraph to HiveIO 1.8

2013-10-10 Thread Eli Reisman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14580/#review26905 --- +1 - Eli Reisman On Oct. 10, 2013, 6:48 p.m., Greg Malewicz

[jira] [Commented] (GIRAPH-730) GiraphApplicationMaster race condition in resource loading

2013-10-07 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13788341#comment-13788341 ] Eli Reisman commented on GIRAPH-730: Oops -- comment above seems to have cut off

[jira] [Updated] (GIRAPH-730) GiraphApplicationMaster race condition in resource loading

2013-10-07 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-730: --- Attachment: GIRAPH-730-2.patch I'll upload the patch here, but if Chaun is still working

Re: GIRAPH-684: Remove Writable Requirement?

2013-09-29 Thread Eli Reisman
I am +1 for options two or three. If we go with #2, better to do it now and get the distruption for users over with early in Giraph's history. On Wed, Aug 14, 2013 at 7:28 AM, Claudio Martella < claudio.marte...@gmail.com> wrote: > Hi Nitay, > > I'm +1 for (2). It would remove another explicit l

Re: Running Giraph on YARN

2013-09-16 Thread Eli Reisman
rs to run jobs on YARN, > if they have specific stuff. > Eli, would that be a lot of work? > > > On Fri, Aug 23, 2013 at 4:02 AM, Eli Reisman >wrote: > > > There are several YARN-specific configurations that must be applied when > > launching YARN jobs. There ar

[jira] [Commented] (GIRAPH-730) GiraphApplicationMaster race condition in resource loading

2013-08-31 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755667#comment-13755667 ] Eli Reisman commented on GIRAPH-730: My question is this: the AM is running

[jira] [Commented] (GIRAPH-737) Giraph Application Master: move to new and stable YARN API

2013-08-31 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755664#comment-13755664 ] Eli Reisman commented on GIRAPH-737: Originally, the concept was to be compat

[jira] [Commented] (GIRAPH-730) GiraphApplicationMaster race condition in resource loading

2013-08-23 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749300#comment-13749300 ] Eli Reisman commented on GIRAPH-730: Let me put it another way: I thought that

[jira] [Commented] (GIRAPH-730) GiraphApplicationMaster race condition in resource loading

2013-08-23 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749294#comment-13749294 ] Eli Reisman commented on GIRAPH-730: Hey Chuan than makes a lot of sense, thank

[jira] [Commented] (GIRAPH-730) GiraphApplicationMaster race condition in resource loading

2013-08-23 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749010#comment-13749010 ] Eli Reisman commented on GIRAPH-730: Hi Chaun, I'm having a bit of troubl

Re: Running Giraph on YARN

2013-08-22 Thread Eli Reisman
There are several YARN-specific configurations that must be applied when launching YARN jobs. There are command line options for these, take a look here: giraph-core/src/main/java/org/apache/giraph/utils/ConfigurationUtils.java I think a Giraph on YARN launcher script is a great idea if the config

Re: A new InputFormat. What to extend?

2013-07-26 Thread Eli Reisman
My instinct is you want to start from one of Giraph's higher-level abstractions instead of a raw Hadoop InputFormat. On Thu, Jul 11, 2013 at 4:47 PM, Renato MarroquĂ­n Mogrovejo < renatoj.marroq...@gmail.com> wrote: > Hi Armando, > > I really understand what you're saying about the input formats

[jira] [Commented] (GIRAPH-717) HiveJythonRunner with support for pure Jython value types.

2013-07-26 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13721195#comment-13721195 ] Eli Reisman commented on GIRAPH-717: +1 > HiveJythonRunn

[jira] [Commented] (GIRAPH-719) Typo fixes for strings in GiraphYarnClient.java

2013-07-26 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13721193#comment-13721193 ] Eli Reisman commented on GIRAPH-719: +1 on this, thank you! &g

[jira] [Commented] (GIRAPH-706) Hybrid management of configuration options

2013-07-04 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13700269#comment-13700269 ] Eli Reisman commented on GIRAPH-706: This is a great idea, and would make a g

[jira] [Created] (GIRAPH-707) Giraph could probably support Hadoop 2.0.x-alpha line using a single build profile

2013-07-04 Thread Eli Reisman (JIRA)
Eli Reisman created GIRAPH-707: -- Summary: Giraph could probably support Hadoop 2.0.x-alpha line using a single build profile Key: GIRAPH-707 URL: https://issues.apache.org/jira/browse/GIRAPH-707 Project

[jira] [Commented] (GIRAPH-687) Lets add support for Hadoop 2.0.4-alpha and 2.0.5-alpha

2013-07-04 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13700249#comment-13700249 ] Eli Reisman commented on GIRAPH-687: Ping. Can I get someone to take a peek at

[jira] [Commented] (GIRAPH-704) Specialized message stores

2013-07-04 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13700245#comment-13700245 ] Eli Reisman commented on GIRAPH-704: This is great, +1 on the patch, its big but

[jira] [Commented] (GIRAPH-687) Lets add support for Hadoop 2.0.4-alpha and 2.0.5-alpha

2013-06-26 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13694094#comment-13694094 ] Eli Reisman commented on GIRAPH-687: Tried this again today, it works

[jira] [Updated] (GIRAPH-688) Make sure Giraph builds against all compatible YARN-enabled Hadoop versions, warns if none set, works w/new 1.1.0 line

2013-06-26 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-688: --- Description: This makes the hadoop-yarn branch build again against all compatible Hadoop versions

[jira] [Updated] (GIRAPH-688) Make sure Giraph builds against all compatible YARN-enabled Hadoop versions, warns if none set, works w/new 1.1.0 line

2013-06-26 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-688: --- Description: This makes the hadoop-yarn branch build again against all compatible Hadoop versions

[jira] [Resolved] (GIRAPH-631) Remove Hardcoded Dependency on Hadoop-2.0.3-alpha from YARN and replace with a more flexible Maven config

2013-06-25 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman resolved GIRAPH-631. Resolution: Fixed Assignee: Eli Reisman I think we're good here at this point. Se

[jira] [Commented] (GIRAPH-693) Giraph-Hive check user code as soon as possible

2013-06-25 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13693574#comment-13693574 ] Eli Reisman commented on GIRAPH-693: I am not well versed in Hive I/O but thi

[jira] [Commented] (GIRAPH-688) Make sure Giraph builds against all compatible YARN-enabled Hadoop versions, warns if none set, works w/new 1.1.0 line

2013-06-25 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13693569#comment-13693569 ] Eli Reisman commented on GIRAPH-688: Hey all, Sorry I haven't checked

Re: Hadoop Summit 2013 in San Jose

2013-06-25 Thread Eli Reisman
ntributors to get involved and/or evaluate it. Eli On Mon, Jun 24, 2013 at 3:46 PM, Claudio Martella < claudio.marte...@gmail.com> wrote: > Best of luck eli! > > > On Mon, Jun 24, 2013 at 9:30 PM, Eli Reisman >wrote: > > > Ok, so I finally got in touch wit

Re: Hadoop Summit 2013 in San Jose

2013-06-24 Thread Eli Reisman
ally do it! On Mon, Jun 24, 2013 at 10:03 AM, Eli Reisman wrote: > Hi Avery, thanks for the response, > > Yeah it sucks because I was really looking forward to it, and had assumed > as of a month or two ago that my talk was not accepted as I just didn't > hear back from anyone

Re: Hadoop Summit 2013 in San Jose

2013-06-24 Thread Eli Reisman
a great > experience for you and also great for exposure for your new company. I > would advise that you try really hard to make it. If you absolutely > cannot, I hope that someone local might be able to make it on your behalf. > > Avery > > > > On 6/24/13 8:24 AM

Hadoop Summit 2013 in San Jose

2013-06-24 Thread Eli Reisman
Hey, Any of you going to be at Hadoop Summit in San Jose this week? I applied to talk about Giraph and its future (especially around YARN but kind of open to all sorts of new stuff there) while I was at Hortwonworks last spring. I did not hear back again since, upon accepting a job at Etsy, I did

[jira] [Commented] (GIRAPH-683) Jython for Computation

2013-06-13 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682420#comment-13682420 ] Eli Reisman commented on GIRAPH-683: This is fantastic work, excel

[jira] [Updated] (GIRAPH-688) Make sure Giraph builds against all compatible YARN-enabled Hadoop versions, warns if none set, works w/new 1.1.0 line

2013-06-12 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-688: --- Summary: Make sure Giraph builds against all compatible YARN-enabled Hadoop versions, warns if none

[jira] [Updated] (GIRAPH-688) Make sure YARN builds against all compatible Giraph versions, warns if none set, works w/new 1.1.0 line

2013-06-12 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-688: --- Attachment: GIRAPH-688-1.patch Here it is, sorry it took too long. Job/book/life...grr you get the

[jira] [Created] (GIRAPH-688) Make sure YARN builds against all compatible Giraph versions, warns if none set, works w/new 1.1.0 line

2013-06-12 Thread Eli Reisman (JIRA)
Eli Reisman created GIRAPH-688: -- Summary: Make sure YARN builds against all compatible Giraph versions, warns if none set, works w/new 1.1.0 line Key: GIRAPH-688 URL: https://issues.apache.org/jira/browse/GIRAPH-688

[jira] [Updated] (GIRAPH-687) Lets add support for Hadoop 2.0.4-alpha and 2.0.5-alpha

2013-06-12 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-687: --- Description: Just boilerplate to bring 2.0.4 and 2.0.5 in. Passes: mvn -Phadoop_2.0.4 clean verify

[jira] [Updated] (GIRAPH-687) Lets add support for Hadoop 2.0.4-alpha and 2.0.5-alpha

2013-06-12 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-687: --- Attachment: GIRAPH-687-1.patch Next up, take Eugene's advice for building YARN module and t

[jira] [Updated] (GIRAPH-687) Lets add support for Hadoop 2.0.4-alpha and 2.0.5-alpha

2013-06-12 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman updated GIRAPH-687: --- Issue Type: New Feature (was: Bug) > Lets add support for Hadoop 2.0.4-alpha and 2.0.5-al

[jira] [Created] (GIRAPH-687) Lets add support for Hadoop 2.0.4-alpha and 2.0.5-alpha

2013-06-12 Thread Eli Reisman (JIRA)
Eli Reisman created GIRAPH-687: -- Summary: Lets add support for Hadoop 2.0.4-alpha and 2.0.5-alpha Key: GIRAPH-687 URL: https://issues.apache.org/jira/browse/GIRAPH-687 Project: Giraph Issue

[jira] [Commented] (GIRAPH-629) YARN profile is broken when compiled against hadoop-2.0.4

2013-06-12 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13681797#comment-13681797 ] Eli Reisman commented on GIRAPH-629: awesome! I was out of the loop for a while

Re: [VOTE][CHANGED] Release Giraph 1.0.0 (rc3)

2013-04-22 Thread Eli Reisman
bably help. Maybe also Sebastian can help here at TU Berlin? > > > > > > On Sun, Apr 21, 2013 at 2:55 AM, Eli Reisman >wrote: > > > >> Thats a good point. It would represent a temporary solution. I'd like to > >> see us done with munge for all

Re: [VOTE][CHANGED] Release Giraph 1.0.0 (rc3)

2013-04-20 Thread Eli Reisman
Thats a good point. It would represent a temporary solution. I'd like to see us done with munge for all sorts of reasons if its possible. Might be a difficult student project to complete cleanly though. Any other thoughts on this? On Sat, Apr 20, 2013 at 3:08 PM, Nitay Joffe wrote: > Just FYI

Re: Karma for Giraph wiki

2013-04-20 Thread Eli Reisman
to the > > > > Nutch-Giraph integration problem. > > > > I was curious to see if we're still on time to get another student > for > > > > another problem (e.g. the integration with Tinkerpop), but I have the > > > >

[jira] [Commented] (GIRAPH-624) ByteArrayPartition reports 0 aggregate edges when used with DiskBackedPartitionStore

2013-04-20 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13637268#comment-13637268 ] Eli Reisman commented on GIRAPH-624: Sorry i didn't get to thsi sooner,

Re: ACK request for cmartella

2013-04-20 Thread Eli Reisman
ACKed On Thu, Apr 18, 2013 at 1:45 PM, Avery Ching wrote: > ACKed. Thanks Claudio! > > > On 4/18/13 10:43 AM, Claudio Martella wrote: > >> Hi devs, >> >> Please ACK my request to be a mentor for GSoC 2013. >> My username at google melange is cmartella and apache id and email is >> clau...@apac

Re: [VOTE][RESULT] Release Giraph 1.0.0 (rc3)

2013-04-20 Thread Eli Reisman
Awesome! On Sat, Apr 20, 2013 at 1:24 AM, Avery Ching wrote: > Vote result: > > Binding: > +1 Avery > +1 Eli > +1 Claudio > +1 Sebastian > > Non-binding: > +1 Lewis > +1 Roman > > The vote passes! I will work on getting the tarball out in the open! > > Thanks everyone for all your help with th

Re: Karma for Giraph wiki

2013-04-17 Thread Eli Reisman
iraph community > getting involved in the project or in GSoC. > Hopefully my other mail explains a bit more behind.the creation of the GSoC > page in the Giraph wiki. > Thank you > Lewis > > On Wednesday, April 17, 2013, Eli Reisman > wrote: > > Or is this for the

Re: [VOTE][CHANGED] Release Giraph 1.0.0 (rc3)

2013-04-17 Thread Eli Reisman
it builds fine for me on trunk "mvn clean install" On Wed, Apr 17, 2013 at 11:16 AM, Eli Reisman wrote: > I'm building it from trunk pull right now > > > > On Tue, Apr 16, 2013 at 5:05 PM, Lewis John Mcgibbney < > lewis.mcgibb...@gmail.com> wrote: > &g

Re: [VOTE][CHANGED] Release Giraph 1.0.0 (rc3)

2013-04-17 Thread Eli Reisman
I'm building it from trunk pull right now On Tue, Apr 16, 2013 at 5:05 PM, Lewis John Mcgibbney < lewis.mcgibb...@gmail.com> wrote: > Hi Avery, > On Tue, Apr 16, 2013 at 1:59 PM, Avery Ching wrote: > > > The md5sum I computed was of the giraph-1.0.0.tar.gz. > > > > How stupid of me. Thanks for

Re: Karma for Giraph wiki

2013-04-17 Thread Eli Reisman
Or is this for the Nutch/Giraph integration project specifically? On Wed, Apr 17, 2013 at 11:12 AM, Eli Reisman wrote: > Is this for Google Summer of Code? We have been accepted as potential > sponsors if someone wants to intern/work on Apache projects > > > On Wed, Apr 17,

Re: Karma for Giraph wiki

2013-04-17 Thread Eli Reisman
Is this for Google Summer of Code? We have been accepted as potential sponsors if someone wants to intern/work on Apache projects On Wed, Apr 17, 2013 at 3:27 AM, Claudio Martella < claudio.marte...@gmail.com> wrote: > Hi Lewis, thanks for this. > > One question: what do you mean by "adding you

Re: [VOTE][CHANGED] Release Giraph 1.0.0 (rc3)

2013-04-16 Thread Eli Reisman
+1 On Tue, Apr 16, 2013 at 1:36 AM, Avery Ching wrote: > Okay, we're on our 3rd RC now, mainly to incorporate Roman's suggestion > about fixing the maven version number from 0.2-SNAPSHOT => 1.0.0. Roman, > this is a source code release, we can't really deploy jars to maven since > we use munge

Re: Git Push Summary

2013-04-16 Thread Eli Reisman
Yay! Long time coming, congratulations everyone! So much hard work and smarts went into this. Now its time to spread the word On Tue, Apr 16, 2013 at 1:22 AM, wrote: > Updated Tags: refs/tags/release-1.0.0-RC3 [created] b5b3e9f9f >

Re: VertexEdges naming

2013-04-15 Thread Eli Reisman
Big +1 on OutEdges, I found VertexEdges confusing too. Good call! On Mon, Apr 15, 2013 at 2:17 PM, Sebastian Schelter wrote: > +1 on OutEdges > Am 15.04.2013 20:05 schrieb "Avery Ching" : > > > +1 on OutEdges. > > > > On 4/15/13 10:58 AM, Alessandro Presta wrote: > > > >> Hi all, > >> > >> The

[jira] [Commented] (GIRAPH-596) Single uber-jar

2013-04-14 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13631365#comment-13631365 ] Eli Reisman commented on GIRAPH-596: Great, great idea! I also noticed during GI

[jira] [Created] (GIRAPH-632) YARN dependencies add a fair amount of size to the fat jar and may be subject to simplification

2013-04-14 Thread Eli Reisman (JIRA)
Eli Reisman created GIRAPH-632: -- Summary: YARN dependencies add a fair amount of size to the fat jar and may be subject to simplification Key: GIRAPH-632 URL: https://issues.apache.org/jira/browse/GIRAPH-632

[jira] [Commented] (GIRAPH-592) YourKit profiling API for easy profiling of giraph

2013-04-14 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13631363#comment-13631363 ] Eli Reisman commented on GIRAPH-592: Hey man where's the

[jira] [Commented] (GIRAPH-631) Remove Hardcoded Dependency on Hadoop-2.0.3-alpha from YARN and replace with a more flexible Maven config

2013-04-14 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13631362#comment-13631362 ] Eli Reisman commented on GIRAPH-631: I'm not going to have time to attack t

[jira] [Created] (GIRAPH-631) Remove Hardcoded Dependency on Hadoop-2.0.3-alpha from YARN and replace with a more flexible Maven config

2013-04-14 Thread Eli Reisman (JIRA)
Eli Reisman created GIRAPH-631: -- Summary: Remove Hardcoded Dependency on Hadoop-2.0.3-alpha from YARN and replace with a more flexible Maven config Key: GIRAPH-631 URL: https://issues.apache.org/jira/browse/GIRAPH

[jira] [Resolved] (GIRAPH-629) YARN profile is broken when compiled against hadoop-2.0.4

2013-04-14 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Reisman resolved GIRAPH-629. Resolution: Won't Fix As is stated in the final Giraph-13 stuff, The hadoop version is curr

Re: Fwd: [VOTE] Release Giraph 1.0 (rc0)

2013-04-14 Thread Eli Reisman
I give this a big +1, I am waiting with excitement for the "tax day release" so I can get us up and running at Etsy! Our support for 1.1.1 is speculative, but we should definitely dig in and get this happening today/tomorrow to get it into the release, others have asked and I'm quite sure the 1.1.

Re: PageRankBenchmark supports VertexOutputFormat but not Output path

2013-04-12 Thread Eli Reisman
benchmarks never supported output. What's the use > case? > > >Comparing the output across different patches? > > > > > >On 4/11/13 4:05 PM, "Eli Reisman" wrote: > > > > > >>There have been some refactors on it, maybe something got f

Re: Cutting an RC for Giraph-1.0

2013-04-12 Thread Eli Reisman
awesome. I will be the first customer of the new release, the sooner the better! On Fri, Apr 12, 2013 at 5:52 PM, Avery Ching wrote: > Hi all, > I'm starting to cut an RC for Giraph-1.0. Please don't comment anything > until I'm done (hopefully soon, it's my first time). Thanks! > > Avery >

Re: PageRankBenchmark supports VertexOutputFormat but not Output path

2013-04-11 Thread Eli Reisman
There have been some refactors on it, maybe something got forgotten, or perhaps now we have to set this at cmd line as in examples. I htink the idea was to regularize the benchmarks to more closely match examples. Ask Alessando ;) On Wed, Apr 10, 2013 at 3:52 AM, Claudio Martella < claudio.marte

[jira] [Created] (GIRAPH-608) Spelling error in Combiner.java

2013-04-07 Thread Eli Reisman (JIRA)
Eli Reisman created GIRAPH-608: -- Summary: Spelling error in Combiner.java Key: GIRAPH-608 URL: https://issues.apache.org/jira/browse/GIRAPH-608 Project: Giraph Issue Type: Bug

[jira] [Commented] (GIRAPH-601) Exception when running pagerank benchmark with 6 or more workers on a pseudodistributed setup: SendVertexRequest cannot be cast to MasterRequest

2013-04-07 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13624979#comment-13624979 ] Eli Reisman commented on GIRAPH-601: to clarify point one: YARN adds that &qu

[jira] [Commented] (GIRAPH-601) Exception when running pagerank benchmark with 6 or more workers on a pseudodistributed setup: SendVertexRequest cannot be cast to MasterRequest

2013-04-07 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13624978#comment-13624978 ] Eli Reisman commented on GIRAPH-601: there are several yarn-site resource setting

[jira] [Commented] (GIRAPH-527) readVertexInputSplit is always reporting 0 vertices and 0 edges

2013-04-04 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13623389#comment-13623389 ] Eli Reisman commented on GIRAPH-527: Nice catch

[jira] [Commented] (GIRAPH-536) Clean up configuration options

2013-04-04 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13623387#comment-13623387 ] Eli Reisman commented on GIRAPH-536: This has waited a long time. Great

Re: [jira] [Commented] (GIRAPH-285) Release Giraph-0.2

2013-04-04 Thread Eli Reisman
A big jump from 0.1 is in order here, whatever happens for sure. On Wed, Apr 3, 2013 at 4:13 AM, Claudio Martella (JIRA) wrote: > > [ > https://issues.apache.org/jira/browse/GIRAPH-285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13620712#comment-13

[jira] [Commented] (GIRAPH-604) Clean up benchmarks

2013-04-04 Thread Eli Reisman (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13623380#comment-13623380 ] Eli Reisman commented on GIRAPH-604: Nice!!! +1 from me! >

Re: our git repo

2013-04-04 Thread Eli Reisman
there a branch-0.1? I see it in my git. > > > > > > On 3/29/13 5:29 PM, Eli Reisman wrote: > > > >> Avery, you know where our 0.1 release branch went to? > >> > >> > >> On Thu, Mar 28, 2013 at 11:18 PM, Avery Ching > wrote: > >&g

Re: [jira] [Commented] (GIRAPH-13) Port Giraph to YARN

2013-04-03 Thread Eli Reisman
h to YARN > > --- > > > > Key: GIRAPH-13 > > URL: https://issues.apache.org/jira/browse/GIRAPH-13 > > Project: Giraph > > Issue Type: New Feature > >Reporter: Jakob Homan > >

  1   2   3   4   5   6   7   8   9   10   >