The slow query is a kind of warning. As the administrator, you need to analyze why the query was so slow; In many cases, it was due to the bad design of the cube, for example, the dimension sequence on Rowkey, the aggregation group, etc. You can search for the best practices of Kylin, or check it on the FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Besides, analyze the memory dump is also recommended. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org wanmin_ws <wanmin...@aliyun.com.invalid> 于2019年3月13日周三 下午5:51写道： > > > ------------------------------------------------------------------ > 发件人：wanmin_ws <wanmin...@aliyun.com> > 发送时间：2019年3月12日(星期二) 16:58 > 收件人：yuzhang <shifengdefan...@163.com> > 主 题：回复：kylin内存溢出问题 > > 没有做什么多余的配置，就是在查询的高峰期的时候kylin崩溃了，崩溃了肯定作业什么的都不能运行了啊。kylin.log日志是正常的，只有这一个错误信息。不然也不会排查了那么久。想请教一下，1、slow > query多了会不会导致kylin崩溃。2、kylin的查询并发是多少？ 3、是不是每一个查询都要创建一个session。 > 谢谢。 > ------------------------------------------------------------------ > 发件人：yuzhang <shifengdefan...@163.com> > 发送时间：2019年3月9日(星期六) 11:33 > 收件人：dev@kylin.apache.org <dev@kylin.apache.org>; wanmin...@aliyun.com < > wanmin...@aliyun.com> > 抄 送：wanmin...@aliyun.com <wanmin...@aliyun.com>; dev@kylin.apache.org < > dev@kylin.apache.org> > 主 题：回复：kylin内存溢出问题 > > > Hi, wanmin > I am interested in this problem and making some research on it. > When the query kylin instance down, are the job and all instances > running normally? The most number of concurrents are query request? Have > you ever redeploy or shutdown kylin web app by hand before the exception > occured? Any extra configurations have been set in tomcat? > As shishaofeng said, the log information is limited. More log or the > way to reproduce the error will be helpful. > > > Best regards > > yuzhang > > > > > yuzhang > > shifengdefan...@163.com > 签名由 网易邮箱大师 定制 > 在2019年3月7日 11:08，wanmin_ws<wanmin...@aliyun.com.INVALID> 写道： 你好，请问能解答一下吗。 > ------------------------------------------------------------------ > 发件人：wanmin_ws <wanmin...@aliyun.com> > 发送时间：2019年3月6日(星期三) 10:55 > 收件人：wanmin_ws <wanmin...@aliyun.com.INVALID>; dev <dev@kylin.apache.org> > 抄 送：dev <dev@kylin.apache.org> > 主 题：回复：kylin内存溢出问题 > > kylin 2.5.0 大数据平台HDP，一共5台kylin节点，一台all，一台job，三台query节点。 > 挂掉的都是query节点，但是这个错误在5个节点上都有报 > ------------------------------------------------------------------ > 发件人：yuzhang <shifengdefan...@163.com> > 发送时间：2019年3月5日(星期二) 17:37 > 收件人：wanmin_ws <wanmin...@aliyun.com.INVALID> > 抄 送：dev <dev@kylin.apache.org> > 主 题：回复：kylin内存溢出问题 > > Hi, Could you describe your deploy environment and Kylie version and > Number of concurrent > > > | | > yuzhang > | > | > Email:shifengdefan...@163.com > | > > Signature is customized by Netease Mail Master > > 在2019年03月05日 17:27，wanmin_ws 写道： > 只有查询高峰期的时候会出现这个问题，这个问题和slow query > 有没有关系？这个错是kylin.out报出来的，显示是tomcat不能开启更多的session > ------------------------------------------------------------------ > 发件人：ShaoFeng Shi <shaofeng...@apache.org> > 发送时间：2019年3月5日(星期二) 17:23 > 收件人：dev <dev@kylin.apache.org>; wanmin_ws <wanmin...@aliyun.com> > 抄 送：user <u...@kylin.apache.org> > 主 题：Re: kylin内存溢出问题 > > Hi Min, > > The log information is so limited that we don't know what may caused that. > I highly recommend you to do some analysis from the following perspective: > 1) check the log files in "logs/" and "tomcat/logs" folder; > 2) using jmap and jhat to analysis the heap usage; > 3) using jstack to analysis the thread information; > 4) check your cube definition to see whether there is some UHC dimension > and the dictionary encoding was used for that. > > Best regards, > > Shaofeng Shi 史少锋 > Apache Kylin PMC > Work email: shaofeng....@kyligence.io > Kyligence Inc: https://kyligence.io/ > > Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html > Join Kylin user mail group: user-subscr...@kylin.apache.org > Join Kylin dev mail group: dev-subscr...@kylin.apache.org > > > > > wanmin_ws <wanmin...@aliyun.com.invalid> 于2019年3月5日周二 下午5:03写道： > > 错误描述：在访问高峰期的时候，kylin会挂掉，查看日志如下，但不知道如何操作，请问能帮我看一下吗。这个问题已经困扰很久了。 > 日志： > 严重: The web application [/kylin] created a ThreadLocal with key of type > [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@6cc63032]) and a > value of type [org.apache.kylin.rest.msg.Message] (value > [org.apache.kylin.rest.msg.Message@3ad18e2f]) but failed to remove it > when the web application was stopped. Threads are going to be renewed over > time to try and avoid a probable memory leak. > 三月 01, 2019 9:50:52 上午 org.apache.catalina.loader.WebappClassLoaderBase > checkThreadLocalMapForLeaks > 严重: The web application [/kylin] created a ThreadLocal with key of type > [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@76397470]) and a > value of type [org.apache.kylin.common.util.ImplementationSwitch] (value > [org.apache.kylin.common.util.ImplementationSwitch@26f33af5]) but failed > to remove it when the web application was stopped. Threads are going to be > renewed over time to try and avoid a probable memory leak. > 三月 01, 2019 9:50:52 上午 org.apache.coyote.AbstractProtocol stop > 信息: Stopping ProtocolHandler ["http-bio-7070"] > 三月 01, 2019 9:50:52 上午 org.apache.coyote.AbstractProtocol stop > 信息: Stopping ProtocolHandler ["ajp-bio-9009"] > > > > >
