Re: Thoughts on Acid reader

2017-09-14 Thread Gopal Vijayaraghavan
> For performance reasons, you prefer the second option that I rejected > where users give a file and the system finds the deletes from there. I can > buy that. That's simpler at least to understand and debug, the logs from ORC alone are enough to find consistency issues. The rest of the det

Re: Thoughts on Acid reader

2017-09-14 Thread Alan Gates
​For performance reasons, you prefer the second option that I rejected where users give a file and the system finds the deletes from there. I can buy that. As for passing splits rather than files, that makes sense but seems like a bigger change, since this should work with and without ACID, so I’