Re: Using Hadoop's MulitpleInputs with AccumuloInputFormat in a MR job

2013-09-16 Thread Corey Nolet
Aaron, We are currently re-working the AccumuloInputFormat for Accumulo 1.6 to provide inputs from multiple tables (each with their own set of configured iterators, ranges, columns). Check out ACCUMULO-391. On Mon, Sep 16, 2013 at 11:41 AM, Aaron aarongm...@gmail.com wrote: I was curious if

Re: Using Hadoop's MulitpleInputs with AccumuloInputFormat in a MR job

2013-09-16 Thread Corey Nolet
Adding to my previous response- when you say you are setting different iterators on a scan are you referring to a single table with different iterators? Are the sets of iterators tied to different ranges? The changes we are making to the current InputFormat will still not allow different iterators

Re: Using Hadoop's MulitpleInputs with AccumuloInputFormat in a MR job

2013-09-16 Thread Aaron
Sorry about that, I should have clarified better. My original question did involve scanning one table. Our particular use case is that we ingest a number of txt files into one table (not to say we couldn't do multiple, we just went with one for now). After our ingest runs, we run some MR jobs