[jira] [Updated] (GIRAPH-68) Implement a Graph Generator

2011-11-16 Thread Hyunsik Choi (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/GIRAPH-68?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyunsik Choi updated GIRAPH-68:
---

Attachment: GIRAPH-68_1.patch

I attached the patch. GraphGenerator class writes a generated graph data into a 
specific HDFS directory by using existing Input/OutputFormats.

> Implement a Graph Generator
> ---
>
> Key: GIRAPH-68
> URL: https://issues.apache.org/jira/browse/GIRAPH-68
> Project: Giraph
>  Issue Type: New Feature
>  Components: benchmark
>Affects Versions: 0.70.0
>Reporter: Hyunsik Choi
>Assignee: Hyunsik Choi
> Attachments: GIRAPH-68_1.patch
>
>
> To provide users with benchmark environments and to deeply test the 
> input/output system of giraph, we need a graph generator. We will enable the 
> graph generator to generate various kinds of graph data sets by specifying a 
> VertexInputFormat and a VertexOutputFormat.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (GIRAPH-68) Implement a Graph Generator

2011-11-17 Thread Hyunsik Choi (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/GIRAPH-68?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyunsik Choi updated GIRAPH-68:
---

Attachment: GIRAPH-68_2.patch

Avery,

Thank you for review.

I think that the GraphGenerator is necessary to test the overall of IO-related 
sub systems. For example, *InputFormat and Partitioners can be examined by some 
generated data set instead of PseudoRandomVertexInputFormat.

As you mentioned, I modified PageRank/RandomMessageBenchmark to use a specified 
InputFormat and an input path. If the input format and input path are not 
given, they will work as the current implementation using 
PseudoRandomVertexInputFormat.

> Implement a Graph Generator
> ---
>
> Key: GIRAPH-68
> URL: https://issues.apache.org/jira/browse/GIRAPH-68
> Project: Giraph
>  Issue Type: New Feature
>  Components: benchmark
>Affects Versions: 0.70.0
>Reporter: Hyunsik Choi
>Assignee: Hyunsik Choi
> Attachments: GIRAPH-68_1.patch, GIRAPH-68_2.patch
>
>
> To provide users with benchmark environments and to deeply test the 
> input/output system of giraph, we need a graph generator. We will enable the 
> graph generator to generate various kinds of graph data sets by specifying a 
> VertexInputFormat and a VertexOutputFormat.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira