Giraph-13: Porting Giraph to YARN

Hi all, I finished an excursion into Giraph's code and now I kinda know what it takes to port Giraph over to run on top of YARN. When the base Hadoop clusters are replaced by YARN clusters, Giraph will have two options: - *Giraph still works over mapreduce APIs*: Even after moving to YARN

[jira] [Updated] (GIRAPH-32) Implement benchmarks to evaluate the performance of message passing

[ https://issues.apache.org/jira/browse/GIRAPH-32?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyunsik Choi updated GIRAPH-32: --- Attachment: GIRAPH-32_2.patch Good idea! According to which InputFormat we use, we could choose the

[jira] [Commented] (GIRAPH-37) Implement Netty-backed rpc solution

[ https://issues.apache.org/jira/browse/GIRAPH-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107455#comment-13107455 ] Jakob Homan commented on GIRAPH-37: --- I'll take a look at Finagle. Security probably

[jira] [Commented] (GIRAPH-38) Change of website in team-list.html

[ https://issues.apache.org/jira/browse/GIRAPH-38?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107513#comment-13107513 ] Christian Kunz commented on GIRAPH-38: -- I intend to follow the procedure outlined in

[jira] [Created] (GIRAPH-38) Change of website in team-list.html

Change of website in team-list.html --- Key: GIRAPH-38 URL: https://issues.apache.org/jira/browse/GIRAPH-38 Project: Giraph Issue Type: Improvement Components: site Reporter: Christian

[jira] [Commented] (GIRAPH-38) Change of website in team-list.html

[ https://issues.apache.org/jira/browse/GIRAPH-38?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107527#comment-13107527 ] Avery Ching commented on GIRAPH-38: --- You'll also need to change the check in the pom.xml

[jira] [Commented] (GIRAPH-38) Change of website in team-list.html

[ https://issues.apache.org/jira/browse/GIRAPH-38?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107528#comment-13107528 ] Hudson commented on GIRAPH-38: -- Integrated in Giraph-trunk-Commit #8 (See

[jira] [Commented] (GIRAPH-38) Change of website in team-list.html

[ https://issues.apache.org/jira/browse/GIRAPH-38?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107535#comment-13107535 ] Christian Kunz commented on GIRAPH-38: -- Right, that's the actual source. Thanks for

Re: [jira] [Commented] (GIRAPH-37) Implement Netty-backed rpc solution

Note that finagle is not thrift specific. It's rpc protocol agnostic. We can make a finagle-hadooprpc connector. Granted, the thrift implementation is pretty hardened. Actually the fact that finagle is independent of rpc frework may be another reason to use it -- flip between hadooprpc and thrift