How to convert SequenceFile into HFile?

2013-12-05 Thread Igor Gatis
I have SequenceFiles I'd like to convert to HFile. How do I that?

Re: How to convert SequenceFile into HFile?

2013-12-06 Thread Jean-Marc Spaggiari
Hi Igor, I will say, MapReduce. SequenceFileInputFormat HFileOutputFormat JM 2013/12/5 Igor Gatis > I have SequenceFiles I'd like to convert to HFile. How do I that? >

Re: How to convert SequenceFile into HFile?

2013-12-06 Thread Igor Gatis
That's the kind of solution I'm looking for. Here is what I have: String jobName = "Seq2HFile"; Job job = new Job(getConf(), jobName); job.setJarByClass(Seq2HFile.class); job.setMapperClass(*MyIdentityMapper.class*); job.setMapOutputKeyClass(BytesWritable.class); job.setM

Re: How to convert SequenceFile into HFile?

2013-12-06 Thread Igor Gatis
Sounds like hbase's HFileOutputFormat depends on KeyValue's "family" field. I don't want that. All I want is to keep keys and values in an indexed filed. TFile would work as well. But it seems there is no TFileOutputFormat available. On Fri, Dec 6, 2013 at 4:47 PM, Igor Gatis wrote: > That's t

Re: How to convert SequenceFile into HFile?

2013-12-06 Thread Jean-Marc Spaggiari
Hi Igor, Have you looked at this constructor? /** * Constructs KeyValue structure filled with null value. * @param row - row key (arbitrary byte array) * @param family family name * @param qualifier column qualifier */ public KeyValue(final byte [] row, final byte [] family,

Re: How to convert SequenceFile into HFile?

2013-12-07 Thread Igor Gatis
Hi JM, My usage is the following: I want to write a C++ program which will answer RPC requests. Each request has a list of keys and responses will contain values. I want to use HFile because it has an efficient key-based index and because there is a whole set of tools in hadoop to produce this kin