Re: Bulk Load running files multiple times

2018-07-10 Thread Austin Heyne
Sorry, was out for a week. But yes, I am seeing the renamed files. I'm going to try re-running the bulk load tomorrow with emrfs enabled and see if the consistency layer can help with the master thinking a file didn't get renamed. I'll let you know how it goes or reply with the info from the R

Re: Bulk Load running files multiple times

2018-06-29 Thread Stack
On Thu, Jun 28, 2018 at 1:24 PM Austin Heyne wrote: > Hey again, > > I'm running a bulk load on s3 and I'm seeing region servers being > instructed to load an hfile multiple times. I've seen this behavior two > different ways. The first time I saw this was after deciding to brute > force my way a

Bulk Load running files multiple times

2018-06-28 Thread Austin Heyne
Hey again, I'm running a bulk load on s3 and I'm seeing region servers being instructed to load an hfile multiple times. I've seen this behavior two different ways. The first time I saw this was after deciding to brute force my way around the problem in HBASE-20774 [1] by just letting the clu