Ah, ok. Thanks for clarifying.
If that is indeed the cause here, it's a bug in our provided Combiners.
Z is just using the "user" iterators that we provide and invoking the
API. Based on provided usage earlier, he's doing the right thing.
If you can verify, Z, that'd be really helpful!
Eric Newton wrote:
Sure, but not during a compaction that does not involve all the underlying
files. The delete keys must be propagated.
I'm not completely familiar with the underlying libraries that help you
write iterators, I just know it's a common mistake.
On Mon, Aug 31, 2015 at 11:53 PM, Josh Elser<[email protected]> wrote:
Shouldn't the delete be masked at a lower layer (DeletingIterator)? Or am
I forgetting that Combiners see that value somehow (and maybe
SummingCombiner is broken)?
Eric Newton wrote:
You may be seeing a delete marker. In a compaction, you will see delete
markers, which have an empty value. You will have to check the delete flag
on the key before grabbing the Value.
-Eric
On Mon, Aug 31, 2015 at 8:28 PM, z11373<[email protected]> wrote:
Thanks Josh! I am going to do more experiments, because this is really
weird.
I'll post the update if there are any interesting stuff I found out
later.
Thanks,
Z
--
View this message in context:
http://apache-accumulo.1065345.n5.nabble.com/exception-thrown-during-minor-compaction-tp15010p15017.html
Sent from the Developers mailing list archive at Nabble.com.
