Re: bulk load architecture

Thanks, Chris. I would still appreciate any anecdotes people have for setting these thread pools. I did a bit more log analysis on bulk import times. With the default of 5 threads we're seeing an average somewhere around 50-100ms per file per thread in the master bulk import thread pool. This

Re: bulk load architecture

Bumping this thread up, because I'm also curious if anybody has any thoughts on Adam's questions. On Mon, Aug 15, 2016 at 1:49 PM Adam Fuchs wrote: > I've been looking through the bulk load code lately related to some > performance issues a customer of ours is experiencing,

bulk load architecture

I've been looking through the bulk load code lately related to some performance issues a customer of ours is experiencing, and I'm perplexed by a couple of things. Between o.a.a.master.tableOps.LoadFiles and o.a.a.server.client.BulkImporter we have 4 thread pools that are used in bulk load. It