Hello, I'm having some performance issues testing Drill on a large MapR cluster. I've been building a cluster of 100 nodes for the past few weeks. When the cluster had only 40 nodes, I ran a benchmark test where Drill performed very well, returning in 80 seconds from counting a large table. After adding the additional 60 nodes, the same benchmark test is not finishing. It times out after approx. 5 minutes due to configured timeout value of 300000. My understanding of Drill is that performance should improve when you increase the cluster size. Each drillbit is configured with 16G. Can someone tell me if there are some configuration settings that can improve this? Or, is there some point where Drill performance decreases when the size of the cluster is too large?
Thanks, Scott