Re: HBase EdgeInputFormat

2013-07-19 Thread Ahmet Emre Aladağ
Thank you, TextVertexInputFormat has getEdges() method but EdgeInputFormat does not have (since it's not a vertex) and it does not support returning multiple edges per record. Normally, a row should have only one edge but in my case (Nutch2), we have multiple edges per row. key: URL value: o

Re: HBase EdgeInputFormat

2013-07-18 Thread Avery Ching
I don't think it will be hard to implement. Just start with the HbaseVertexInputFormat and have it extend EdgeInputFormat. You can look at TableEdgeInputFormat for an example. It sounds like a good contribution to Giraph. On 7/18/13 1:57 PM, Puneet Jain wrote: I also need this feature. Wil

Re: HBase EdgeInputFormat

2013-07-18 Thread Puneet Jain
I also need this feature. Will be really helpful. On Thu, Jul 18, 2013 at 10:49 AM, Ahme Emre Aladağ wrote: > Hi, > > Question: Will there be HBaseEdgeInputFormat class or is there a > restriction of HBase thus we can't implement it? > > HBaseVertexInputFormat is fine for vertex-centric reading,

HBase EdgeInputFormat

2013-07-18 Thread Ahme Emre Aladağ
Hi, Question: Will there be HBaseEdgeInputFormat class or is there a restriction of HBase thus we can't implement it? HBaseVertexInputFormat is fine for vertex-centric reading, i.e. each row in HBase corresponds to one Vertex. But it does not allow me to create duplicate vertices with the same