Is there a way to make the broker merge big result set faster?

2017-12-25 Thread Mu Kong
Hi, community, I have a subquery running slow on druid cluster. The *inner query* yield fields: *SELECT D1, D2, D3, MAX(M1) as MAX_M1* *FROM SOME_TABLE* *GROUP BY D1, D2, D3* Then, the outer query looks like: *SELECT D1, D2, SUM(MAX_M1)* *FROM INNER_QUERY* *GROUP BY D1, D2* The D3 is a high

Re: Question about standalone Spark cluster reading from Kerberosed hadoop

2017-06-23 Thread Mu Kong
n does when when you give it keytab. > > > see also: > https://www.gitbook.com/book/steveloughran/kerberos_and_hadoop/details > > On Fri, Jun 23, 2017 at 5:10 PM, Mu Kong <kong.mu@gmail.com> wrote: > >> Hi, all! >> >> I was trying to read from a Kerberosed

Question about standalone Spark cluster reading from Kerberosed hadoop

2017-06-23 Thread Mu Kong
Hi, all! I was trying to read from a Kerberosed hadoop cluster from a standalone spark cluster. Right now, I encountered some authentication issues with Kerberos: java.io.IOException: Failed on local exception: java.io.IOException: org.apache.hadoop.security.AccessControlException: Client