Re: using stateful iterators to do filtering during major compaction?

2017-04-10 Thread Adam Fuchs
Hi Jonathan, Did you consider simply not using the whole row iterator in the compaction scope? Iterators don't get torn down and rebuilt in the compaction scope, so partial row reads as you describe in the scan scope don't really exist in compaction scopes unless another iterator above your

Re: using stateful iterators to do filtering during major compaction?

2017-04-10 Thread Josh Elser
Hi Jonathan -- good questions. I've tried to address them inline. Jonathan LASKO wrote: Hi Accumulo wizards, TL;DR - this is a question about custom iterators and saving state (or seeking backwards) in order to filter / mask data during major compaction. For a project I'm working on, we

using stateful iterators to do filtering during major compaction?

2017-04-10 Thread Jonathan LASKO
Hi Accumulo wizards, TL;DR - this is a question about custom iterators and saving state (or seeking backwards) in order to filter / mask data during major compaction. For a project I'm working on, we would like to be able to use one entry to filter other entries in the same row. (I will call