Re: Review Request: GIRAPH-100 - Data input sampling and testing improvements

2011-12-01 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2959/ --- (Updated 2011-12-02 02:55:14.025295) Review request for giraph. Changes --

[jira] [Commented] (GIRAPH-100) Data input sampling and testing improvements

2011-12-01 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161357#comment-13161357 ] Avery Ching commented on GIRAPH-100: I added another JIRA https://issues.apache

[jira] [Commented] (GIRAPH-102) Create an exception class for Giraph

2011-12-01 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161356#comment-13161356 ] Avery Ching commented on GIRAPH-102: As a part of this issue, go through

[jira] [Created] (GIRAPH-102) Create an exception class for Giraph

2011-12-01 Thread Avery Ching (Created) (JIRA)
Create an exception class for Giraph Key: GIRAPH-102 URL: https://issues.apache.org/jira/browse/GIRAPH-102 Project: Giraph Issue Type: Improvement Reporter: Avery Ching Many of the

[jira] [Commented] (GIRAPH-100) Data input sampling and testing improvements

2011-12-01 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161243#comment-13161243 ] Avery Ching commented on GIRAPH-100: Ah, I see. We should file another JIR

[jira] [Commented] (GIRAPH-100) Data input sampling and testing improvements

2011-12-01 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161219#comment-13161219 ] Avery Ching commented on GIRAPH-100: Sorry Jakob, I'll try to stop doing f

[jira] [Commented] (GIRAPH-100) Data input sampling and testing improvements

2011-12-01 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161031#comment-13161031 ] Avery Ching commented on GIRAPH-100: Anyone? =) > Dat

[jira] [Updated] (GIRAPH-100) Data input sampling and testing improvements

2011-11-29 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-100: --- Attachment: GIRAPH-100.patch Duplicate of reviewboard patch (https://reviews.apache.org/r/2959/diff

Review Request: GIRAPH-100 - Data input sampling and testing improvements

2011-11-29 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2959/ --- Review request for giraph. Summary --- Got rid of ZooKeeper message for nod

[jira] [Created] (GIRAPH-101) Replace munge with shim layer similar to Pig and Hive

2011-11-28 Thread Avery Ching (Created) (JIRA)
: Avery Ching Priority: Minor Munge is a hacky way of support multiple versions of Hadoop. The shim layers in Pig and Hive are a cleaner way to do this I think. That being said, since it does work now, it's not a huge priority I guess. -- This message is automatically generat

[jira] [Created] (GIRAPH-100) Data input sampling and testing improvements

2011-11-28 Thread Avery Ching (Created) (JIRA)
Reporter: Avery Ching It would be really nice to help debug an application by limiting the input data (% of input splits, max vertices per input split). Also, it would be nice for the workers to provide a little more debugging info on how far along they are with processing the input data

[jira] [Assigned] (GIRAPH-100) Data input sampling and testing improvements

2011-11-28 Thread Avery Ching (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching reassigned GIRAPH-100: -- Assignee: Avery Ching > Data input sampling and testing improveme

[jira] [Commented] (GIRAPH-45) Improve the way to keep outgoing messages

2011-11-27 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158213#comment-13158213 ] Avery Ching commented on GIRAPH-45: --- It's a great idea, performance looks pr

[jira] [Commented] (GIRAPH-84) Simplify boolean expressions in BspRecordReader

2011-11-24 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-84?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156995#comment-13156995 ] Avery Ching commented on GIRAPH-84: --- Claudio, if you're comfortable with th

[jira] [Commented] (GIRAPH-90) LongDoubleFloatDoubleVertex has possibily the iterator() implementation broken

2011-11-24 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156994#comment-13156994 ] Avery Ching commented on GIRAPH-90: --- +1, feel free to commit Cla

[jira] [Commented] (GIRAPH-99) Make AdjacencyListVertexReader and its constructor public

2011-11-22 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-99?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155334#comment-13155334 ] Avery Ching commented on GIRAPH-99: --- Thanks Kohei, glad to see you working on Gi

Re: Apache Giraph talk @ FOSDEM

2011-11-21 Thread Avery Ching
Thanks for volunteering Claudio! It's very nice that Apache Giraph was mentioned in the invite, even though it's a relatively new open-source project. I'll read your draft and send you feedback privately sometime today. Also, if you need slides, please feel free to use anything I've ever pos

[jira] [Commented] (GIRAPH-84) Simplify boolean expressions in BspRecordReader

2011-11-20 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-84?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153927#comment-13153927 ] Avery Ching commented on GIRAPH-84: --- Claudio, once a committer +1's something

[jira] [Commented] (GIRAPH-84) Simplify boolean expressions in BspRecordReader

2011-11-17 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-84?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152488#comment-13152488 ] Avery Ching commented on GIRAPH-84: --- ternary is fine with me. I think we use it in

[jira] [Commented] (GIRAPH-77) Coordinator should expose a web interface with progress, vertex region assignments, etc.

2011-11-17 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152389#comment-13152389 ] Avery Ching commented on GIRAPH-77: --- +1 on no screen scraping, yuck! Given that Ha

[jira] [Commented] (GIRAPH-96) Support for Graphs with Huge adjacency lists

2011-11-17 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-96?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152203#comment-13152203 ] Avery Ching commented on GIRAPH-96: --- The general issue of overloading our memory

[jira] [Resolved] (GIRAPH-91) Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-17 Thread Avery Ching (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching resolved GIRAPH-91. --- Resolution: Fixed Thanks for the quick review Claudio. Hudson +1'ed it as well, reso

[jira] [Commented] (GIRAPH-93) Hive input / output format

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-93?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151866#comment-13151866 ] Avery Ching commented on GIRAPH-93: --- Specifically, we have a lot of data stored in

[jira] [Commented] (GIRAPH-93) Hive input / output format

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-93?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151848#comment-13151848 ] Avery Ching commented on GIRAPH-93: --- I think RCFile initially, then other format

[jira] [Commented] (GIRAPH-91) Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151844#comment-13151844 ] Avery Ching commented on GIRAPH-91: --- Arun, we can certainly try other data structure

[jira] [Created] (GIRAPH-93) Hive input / output format

2011-11-16 Thread Avery Ching (Created) (JIRA)
Hive input / output format -- Key: GIRAPH-93 URL: https://issues.apache.org/jira/browse/GIRAPH-93 Project: Giraph Issue Type: New Feature Reporter: Avery Ching Assignee: Avery Ching It would

[jira] [Commented] (GIRAPH-91) Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151793#comment-13151793 ] Avery Ching commented on GIRAPH-91: --- Thanks for commenting Claudio, however, I c

[jira] [Commented] (GIRAPH-78) Be smarter about multiple instances of the same vertex

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151782#comment-13151782 ] Avery Ching commented on GIRAPH-78: --- Actually the more I think about it, this might

[jira] [Commented] (GIRAPH-92) Need outputformat for just vertex ID and value

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151736#comment-13151736 ] Avery Ching commented on GIRAPH-92: --- I agree this could be useful. Couple of fo

[jira] [Commented] (GIRAPH-91) Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151603#comment-13151603 ] Avery Ching commented on GIRAPH-91: --- By the way, rb allows you to download the

[jira] [Updated] (GIRAPH-91) Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-16 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-91: -- Attachment: GIRAPH-91.diff Sure, sorry about that. > Large-memory improvements (Mem

[jira] [Assigned] (GIRAPH-91) Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-16 Thread Avery Ching (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching reassigned GIRAPH-91: - Assignee: Avery Ching > Large-memory improvements (Memory reduced vertex implementation, f

[jira] [Updated] (GIRAPH-86) Simplify boolean expressions in ZooKeeperExt::createExt

2011-11-16 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-86?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-86: -- Attachment: pom.diff See if this helps you...if so, please add to your patch

Review Request: GIRAPH-91 - Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-16 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2868/ --- Review request for giraph. Summary --- There general changes should support

[jira] [Created] (GIRAPH-91) Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-16 Thread Avery Ching (Created) (JIRA)
Project: Giraph Issue Type: Improvement Reporter: Avery Ching Current vertex implementation uses a HashMap for storing the edges, which is quite memory heavy for large graphs. The default settings in Giraph need to be improved for large graphs and heaps of >

Re: Review Request: GIRAPH-89: Remove debugging system.out from LongDoubleFloatDoubleVertex

2011-11-16 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2859/#review3304 --- Ship it! - Avery On 2011-11-16 20:20:09, shaunak wrote: > > --

[jira] [Commented] (GIRAPH-68) Implement a Graph Generator

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151405#comment-13151405 ] Avery Ching commented on GIRAPH-68: --- Looks good Hyunsik, a few comments. Probably

[jira] [Resolved] (GIRAPH-88) Message count not updated properly after GIRAPH-11

2011-11-15 Thread Avery Ching (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-88?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching resolved GIRAPH-88. --- Resolution: Fixed Thanks for the quick review Jakob! Moving fast... > Message co

[jira] [Commented] (GIRAPH-83) Is Vertex correct yet?

2011-11-15 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150867#comment-13150867 ] Avery Ching commented on GIRAPH-83: --- While you can decouple everything from verte

[jira] [Commented] (GIRAPH-45) Improve the way to keep outgoing messages

2011-11-15 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150864#comment-13150864 ] Avery Ching commented on GIRAPH-45: --- It's going to be a bit complicated to

[jira] [Updated] (GIRAPH-88) Message count not updated properly after GIRAPH-11

2011-11-15 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-88?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-88: -- Attachment: GIRAPH-88.diff Fix confirmed by Sebatian and passed unittests. Also changes vertexRangeMap

[jira] [Created] (GIRAPH-88) Message count not updated properly after GIRAPH-11

2011-11-15 Thread Avery Ching (Created) (JIRA)
Message count not updated properly after GIRAPH-11 -- Key: GIRAPH-88 URL: https://issues.apache.org/jira/browse/GIRAPH-88 Project: Giraph Issue Type: Bug Reporter: Avery Ching

Re: Did GIRAPH-11 break vertex reactivation?

2011-11-15 Thread Avery Ching
This should fix it. It passed local unittests. Let me know. Avery On 11/15/11 1:03 PM, Avery Ching wrote: Yes, I think I broke it. Sorry. Let me get you a diff to test quickly. Avery On 11/15/11 12:42 PM, Sebastian Schelter wrote: Hi, I updated to the latest trunk (after the GIRAPH-11

Re: Did GIRAPH-11 break vertex reactivation?

2011-11-15 Thread Avery Ching
Yes, I think I broke it. Sorry. Let me get you a diff to test quickly. Avery On 11/15/11 12:42 PM, Sebastian Schelter wrote: Hi, I updated to the latest trunk (after the GIRAPH-11 commit) and wanted to continue to work on GIRAPH-51 where I use a small toy graph to test SimpleShortestPathVert

[jira] [Commented] (GIRAPH-78) Be smarter about multiple instances of the same vertex

2011-11-15 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150673#comment-13150673 ] Avery Ching commented on GIRAPH-78: --- +1, this would be a great memory optimiza

[jira] [Commented] (GIRAPH-45) Improve the way to keep outgoing messages

2011-11-15 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150671#comment-13150671 ] Avery Ching commented on GIRAPH-45: --- Given the way we process our data, I am cur

[jira] [Commented] (GIRAPH-61) Worker's early failure will cause the whole system fail

2011-11-15 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-61?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150668#comment-13150668 ] Avery Ching commented on GIRAPH-61: --- Currently, the master knows whenever an ac

[jira] [Commented] (GIRAPH-74) GIRAPH-36 missed a couple of liners when passing from Vertex to BasicVertex

2011-11-15 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-74?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150663#comment-13150663 ] Avery Ching commented on GIRAPH-74: --- Claudio, are you synced to svn? The commi

[jira] [Closed] (GIRAPH-58) Update site with Arun Suresh's updated Id and Email

2011-11-14 Thread Avery Ching (Closed) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-58?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching closed GIRAPH-58. - > Update site with Arun Suresh's updated Id a

[jira] [Commented] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-14 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150213#comment-13150213 ] Avery Ching commented on GIRAPH-11: --- No problem. I can make vertexRangeMap prote

[jira] [Resolved] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-14 Thread Avery Ching (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching resolved GIRAPH-11. --- Resolution: Fixed Thanks for the reviews Jakob and Hyunsik. Closing now that Hudson also approves

[jira] [Commented] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-14 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150097#comment-13150097 ] Avery Ching commented on GIRAPH-11: --- Ran local tests, MR tests, and ran the page

[jira] [Updated] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-14 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-11: -- Attachment: GIRAPH-11.4.diff The diff used for reviewboard based on Jakob's r

Re: Review Request: GIRAPH-11 : Improve the graph distribution of Giraph

2011-11-14 Thread Avery Ching
ons of various index types. A developer can use RangeWorkerPartitioner as something to help them out for their particular implementation. This is somewhat experimental work, but the idea is that it will allow very very advanced users to customize partiitoning ba

Re: Review Request: GIRAPH-11 : Improve the graph distribution of Giraph

2011-11-14 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2788/ --- (Updated 2011-11-14 22:24:27.293676) Review request for giraph. Changes --

[jira] [Commented] (GIRAPH-80) Don't expose the list holding the messages in BasicVertex

2011-11-14 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149891#comment-13149891 ] Avery Ching commented on GIRAPH-80: --- Seems reasonable to me. Having the optio

[jira] [Commented] (GIRAPH-80) Don't expose the list holding the messages in BasicVertex

2011-11-14 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149876#comment-13149876 ] Avery Ching commented on GIRAPH-80: --- Since public abstract void compute(Iter

[jira] [Commented] (GIRAPH-64) Create VertexRunner to make it easier to run users' computations

2011-11-14 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149810#comment-13149810 ] Avery Ching commented on GIRAPH-64: --- Given that Jake is doing the review, I'l

[jira] [Updated] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-14 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-11: -- Attachment: GIRAPH-11.3.diff > Improve the graph distribution of Gir

[jira] [Updated] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-14 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-11: -- Attachment: (was: GIRAPH-11.3.diff) > Improve the graph distribution of Gir

[jira] [Updated] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-14 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-11: -- Attachment: GIRAPH-11.3.diff Sorry Hyunsik. I gave you the reviewboard diff I had to massage one line

[jira] [Commented] (GIRAPH-64) Create VertexRunner to make it easier to run users' computations

2011-11-13 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149474#comment-13149474 ] Avery Ching commented on GIRAPH-64: --- Jakob, it now builds fine for me. Not sure

[jira] [Updated] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-13 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-11: -- Attachment: GIRAPH-11.2.diff A recent diff generated from 'svn diff' from trunk that is also

Re: Review Request: GIRAPH-11 : Improve the graph distribution of Giraph

2011-11-13 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2788/ --- (Updated 2011-11-14 06:56:19.251685) Review request for giraph. Changes --

[jira] [Commented] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-12 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149022#comment-13149022 ] Avery Ching commented on GIRAPH-11: --- Thank you Hyunsik! Graph partitioning is a li

Re: better way to update site?

2011-11-11 Thread Avery Ching
+1. Having the pre-generated files in svn is good enough for me. Avery On 11/11/11 1:36 PM, Jakob Homan wrote: As Avery documented in GIRAPH-36 (https://issues.apache.org/jira/browse/GIRAPH-35?focusedCommentId=13107195&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comme

[jira] [Commented] (GIRAPH-74) GIRAPH-36 missed a couple of liners when passing from Vertex to BasicVertex

2011-11-10 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-74?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147975#comment-13147975 ] Avery Ching commented on GIRAPH-74: --- Well, if you vote to halt, your compute() is n

[jira] [Commented] (GIRAPH-74) GIRAPH-36 missed a couple of liners when passing from Vertex to BasicVertex

2011-11-10 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-74?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147968#comment-13147968 ] Avery Ching commented on GIRAPH-74: --- Either the vertex will keep track of it or the

[jira] [Commented] (GIRAPH-74) GIRAPH-36 missed a couple of liners when passing from Vertex to BasicVertex

2011-11-10 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-74?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147919#comment-13147919 ] Avery Ching commented on GIRAPH-74: --- Some of this I also addressed in GIRAPH-11 =)

[jira] [Commented] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-10 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147916#comment-13147916 ] Avery Ching commented on GIRAPH-11: --- Sooo...anyone care to look at this? I'

[jira] [Commented] (GIRAPH-73) A little refactoring

2011-11-10 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-73?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147913#comment-13147913 ] Avery Ching commented on GIRAPH-73: --- Hi Sebastian, Thanks for the refactoring and

Re: Newbie wanting to get involved with Giraph development

2011-11-10 Thread Avery Ching
Claudio gave great advice. The only thing I'd like to add is that you also might want to consider using reviewboard for throwing up patches (https://reviews.apache.org/) as it helps to get line-by-line comments and suggestions. Definitely email the mailing lists if you have questions and have

[jira] [Commented] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-09 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147226#comment-13147226 ] Avery Ching commented on GIRAPH-11: --- I started it so long ago that the merge was br

[jira] [Updated] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-09 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-11: -- Attachment: GIRAPH-11.diff Here's the diff for those of you who don't like r

Review Request: GIRAPH-11 : Improve the graph distribution of Giraph

2011-11-09 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2788/ --- Review request for giraph. Summary --- Warning: This is a very large change

[jira] [Updated] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-08 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-47: -- Attachment: GIRAPH-47.final Here's the final diff. Sorry about forgetting to atta

[jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-07 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145879#comment-13145879 ] Avery Ching commented on GIRAPH-47: --- I filed issue https://issues.apache.org/jira/br

[jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-07 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145868#comment-13145868 ] Avery Ching commented on GIRAPH-47: --- +1 Thanks Claudio. I'm going to commi

Re: FOSDEM

2011-11-07 Thread Avery Ching
I think it would be great if someone could talk about Giraph at FOSDEM. Thanks for volunteering, Claudio. I'm not planning to be there unfortunately. Avery On 11/7/11 12:33 PM, Claudio Martella wrote: Hello list, I was thinking about submitting for a talk at fosdem with topic Pregel & Gir

Re: Review Request: GIRAPH-47 Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-07 Thread Avery Ching
> On 2011-11-07 19:12:55, Avery Ching wrote: > > Claudio, really nice stuff here. Most of my comments are related to > > indenting. But otherwise, this is a lot better IMO. Please take a look at > > CODE_CONVENTIONS and fix accordingly. While the official policy is

Re: Review Request: GIRAPH-47 Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-07 Thread Avery Ching
/r/2746/#comment6884> Other javadoc has lines in between comment and params (i.e. * superstep starts. * * @throws IllegalAccessException - Avery On 2011-11-07 19:09:08, Avery Ching wrote: > > --

Review Request: GIRAPH-47 Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-07 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2746/ --- Review request for giraph. Summary --- Claudio's patch for GIRAPH-47. Thi

[jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-07 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145694#comment-13145694 ] Avery Ching commented on GIRAPH-47: --- Sorry, Claudio, my bad. I still had remnant

[jira] [Commented] (GIRAPH-64) Create VertexRunner to make it easier to run users' computations

2011-11-07 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145687#comment-13145687 ] Avery Ching commented on GIRAPH-64: --- $ mvn --version Apache Maven 3.0.3 (r1075438;

[jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-06 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145035#comment-13145035 ] Avery Ching commented on GIRAPH-47: --- Claudio, Just checked out your diff. Ove

[jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-05 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144735#comment-13144735 ] Avery Ching commented on GIRAPH-47: --- I agree with the proxy approach of WorkerContex

[jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-05 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144618#comment-13144618 ] Avery Ching commented on GIRAPH-47: --- do we still want WorkerContext.preApplication(

[jira] [Commented] (GIRAPH-64) Create VertexRunner to make it easier to run users' computations

2011-11-03 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13143314#comment-13143314 ] Avery Ching commented on GIRAPH-64: --- Jakob, pulled the diff from your last rb (upda

[jira] [Commented] (GIRAPH-72) Running multiple Giraph jobs on the same cluster can lead to port collisions

2011-11-02 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-72?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13142870#comment-13142870 ] Avery Ching commented on GIRAPH-72: --- Ah, you can set the base rpc port by the way, s

[jira] [Commented] (GIRAPH-64) Create VertexRunner to make it easier to run users' computations

2011-11-02 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13142810#comment-13142810 ] Avery Ching commented on GIRAPH-64: --- Sorry, that was my bad. Forgot to do a '

Re: Review Request: GIRAPH-64 Create VertexRunner to make it easier to run users' computations

2011-11-02 Thread Avery Ching
? Seems like it's missing stuff. Only has GraphMapper.java changes and pom.xml... - Jake On November 3rd, 2011, 2:29 a.m., Avery Ching wrote: Review request for giraph and Jake Mannix. By Avery Ching. *Updated 2011-11-03 02:29:54* Description This is filed on behalf of Jakob Homan. Te

[jira] [Commented] (GIRAPH-72) Running multiple Giraph jobs on the same cluster can lead to port collisions

2011-11-02 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-72?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13142785#comment-13142785 ] Avery Ching commented on GIRAPH-72: --- Yes, this is a possible problem. In the past,

Review Request: GIRAPH-64 Create VertexRunner to make it easier to run users' computations

2011-11-02 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2691/ --- Review request for giraph and Jake Mannix. Summary --- This is filed on beh

[jira] [Commented] (GIRAPH-64) Create VertexRunner to make it easier to run users' computations

2011-11-02 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13142780#comment-13142780 ] Avery Ching commented on GIRAPH-64: --- I don't know how to make reviewbo

[jira] [Commented] (GIRAPH-64) Create VertexRunner to make it easier to run users' computations

2011-11-01 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141969#comment-13141969 ] Avery Ching commented on GIRAPH-64: --- Anyone want to take a crack at reviewing this?

[jira] [Updated] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-11-01 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-36: -- Attachment: GIRAPH-36.diff.warnings Revised version of Jake's patch, addressing the warnings i

[jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-11-01 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141965#comment-13141965 ] Avery Ching commented on GIRAPH-36: --- +1. Jake, just re-ran with your new patch. Pa

[jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-11-01 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141573#comment-13141573 ] Avery Ching commented on GIRAPH-36: --- Since this is a somewhat large change, can you

[jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-10-31 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140974#comment-13140974 ] Avery Ching commented on GIRAPH-36: --- Regarding 1) I think it would be safer for us

Re: [jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-10-31 Thread Avery Ching
I'd also like to hear the use case. Currently we don't dump messages in the vertex output format, but maybe there is a similar case to do so? Avery On 10/31/11 11:46 AM, Jake Mannix wrote: Well I guess that gives us one reason to keep it in the API. What's the reasoning? Are there static da

<    1   2   3   4   5   6   7   >