hi zeng, please send to mail list instead of me.
take a look at https://github.com/KylinOLAP/Kylin/blob/master/bin/kylin.sh#L54 On Wed, May 6, 2015 at 10:51 AM, [email protected] < [email protected]> wrote: > When I built a cube,an OOM error occured at the third step of Job(Build > Dimension Dictionary) ,and then the tomcat crashed? How can I configurate > the OPTS? > > the kylin.log info : > > ------------------------------ > [email protected] > > > *发件人：* hongbin ma <[email protected]> > *发送时间：* 2015-05-05 10:52 > *收件人：* [email protected] > *主题：* Re: Re: kylin0.7.1 && hadoop2.6.0部署任务调度器出错问题 > did you ever modified the last line "kylin.sandbox=false"? you don't have > to change it to false > Actually, i suggest you restore this file to what it was when you > downloaded Kylin tar, and try again > > On Tue, May 5, 2015 at 10:49 AM, [email protected] < > [email protected]> wrote: > >> My $KYLIN_HOME/conf/kylin.properties : >> >> >> # >> # Licensed to the Apache Software Foundation (ASF) under one or more >> # contributor license agreements. See the NOTICE file distributed with >> # this work for additional information regarding copyright ownership. >> # The ASF licenses this file to You under the Apache License, Version 2.0 >> # (the "License"); you may not use this file except in compliance with >> # the License. You may obtain a copy of the License at >> # >> # http://www.apache.org/licenses/LICENSE-2.0 >> # >> # Unless required by applicable law or agreed to in writing, software >> # distributed under the License is distributed on an "AS IS" BASIS, >> # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or >> implied. >> # See the License for the specific language governing permissions and >> # limitations under the License. >> # >> >> ## Config for Kylin Engine ## >> >> # List of web servers in use, this enables one web server instance to >> sync up with other servers. >> kylin.rest.servers=10.1.80.142:7070 >> >> # The metadata store in hbase >> #kylin_metadata_qa@hbase:hd26:2181:/hbase >> kylin.metadata.url=kylin_metadata@hbase:10.1.80.249:2181 >> :/hbase,hbase:10.1.80.250:2181:/hbase,hbase:10.1.80.251:2181:/hbase >> >> # The storage for final cube file in hbase >> #hbase:hd26:2181:/hbase >> kylin.storage.url=hbase:10.1.80.249:2181:/hbase,hbase:10.1.80.250:2181 >> :/hbase,hbase:10.1.80.251:2181:/hbase >> >> # Temp folder in hdfs >> kylin.hdfs.working.dir=/kylin/tmp >> >> kylin.job.mapreduce.default.reduce.input.mb=500 >> >> # If true, job engine will not assume that hadoop CLI reside on the same >> server as it self >> # you will have to specify kylin.job.remote.cli.hostname, >> kylin.job.remote.cli.username and kylin.job.remote.cli.password >> kylin.job.run.as.remote.cmd=false >> >> # Only necessary when kylin.job.run.as.remote.cmd=true >> kylin.job.remote.cli.hostname= >> >> # Only necessary when kylin.job.run.as.remote.cmd=true >> kylin.job.remote.cli.username= >> >> # Only necessary when kylin.job.run.as.remote.cmd=true >> kylin.job.remote.cli.password= >> >> # Used by test cases to prepare synthetic data for sample cube >> kylin.job.remote.cli.working.dir=/data1/app/kylin-0.7.1-incubating-SNAPSHOT/tmp/lylin >> >> >> # Max count of concurrent jobs running >> kylin.job.concurrent.max.limit=10 >> >> # Time interval to check hadoop job status >> kylin.job.yarn.app.rest.check.interval.seconds=10 >> >> >> ## Config for Restful APP ## >> # database connection settings: >> ldap.server= >> ldap.username= >> ldap.password= >> ldap.user.searchBase= >> ldap.user.searchPattern= >> ldap.user.groupSearchBase= >> ldap.service.searchBase=OU= >> ldap.service.searchPattern= >> ldap.service.groupSearchBase= >> acl.adminRole= >> acl.defaultRole= >> ganglia.group= >> ganglia.port=8664 >> >> ## Config for mail service >> >> # If true, will send email notification; >> mail.enabled=false >> mail.host= >> mail.username= >> mail.password= >> mail.sender= >> >> ###########################config info for web####################### >> >> #help info ,format{name|displayName|link} ,optional >> kylin.web.help.length=4 >> kylin.web.help.0=start|Getting Started| >> kylin.web.help.1=odbc|ODBC Driver| >> kylin.web.help.2=tableau|Tableau Guide| >> kylin.web.help.3=onboard|Cube Design Tutorial| >> #hadoop url link ,optional >> kylin.web.hadoop= >> #job diagnostic url link ,optional >> kylin.web.diagnostic= >> #contact mail on web page ,optional >> kylin.web.contact_mail= >> >> ###########################config info for front####################### >> >> #env DEV|QA|PROD >> deploy.env=DEV >> >> ###########################config info for sandbox####################### >> kylin.sandbox=false >> >> ------------------------------ >> [email protected] >> >> >> *发件人：* hongbin ma <[email protected]> >> *发送时间：* 2015-05-05 10:44 >> *收件人：* [email protected] >> *主题：* Re: Re: kylin0.7.1 && hadoop2.6.0部署任务调度器出错问题 >> you can use https://gist.github.com/ as a pastebin >> >> On Tue, May 5, 2015 at 10:43 AM, hongbin ma <[email protected]> wrote: >> >>> can you paste $KYLIN_HOME/conf/kylin.properties? >>> I assume you have modified it somewhere. >>> >>> Normally factory settings will suffice for on CLI installation >>> >>> On Tue, May 5, 2015 at 10:31 AM, [email protected] < >>> [email protected]> wrote: >>> >>>> An error occurred when excute kylin.sh start。 Detail: >>>> >>>> ------------------------------ >>>> [email protected] >>>> >>>> >>>> *发件人：* hongbin ma <[email protected]> >>>> *发送时间：* 2015-05-05 10:15 >>>> *收件人：* [email protected] >>>> *主题：* Re: Re: kylin0.7.1 && hadoop2.6.0部署任务调度器出错问题 >>>> LDAP have to be configurated for Kylin with on-hadoop installtion (not >>>> in sandbox) >>>> >>>> is it a quote or your question? >>>> afaik it's not necessary >>>> >>>> On Tue, May 5, 2015 at 10:11 AM, [email protected] < >>>> [email protected]> wrote: >>>> >>>>> LDAP have to be configurated for Kylin with on-hadoop installtion >>>>> (not in sandbox)? >>>>> >>>>> Can I skip the follwing configuration? >>>>> >>>>> ## Config for Restful APP ## >>>>> # database connection settings: >>>>> ldap.server= >>>>> ldap.username= >>>>> ldap.password= >>>>> ldap.user.searchBase= >>>>> ldap.user.searchPattern= >>>>> ldap.user.groupSearchBase= >>>>> ldap.service.searchBase=OU= >>>>> ldap.service.searchPattern= >>>>> ldap.service.groupSearchBase= >>>>> acl.adminRole= >>>>> acl.defaultRole= >>>>> ganglia.group= >>>>> ganglia.port=8664 >>>>> >>>>> >>>>> >>>>> ------------------------------ >>>>> [email protected] >>>>> >>>>> >>>>> *发件人：* hongbin ma <[email protected]> >>>>> *发送时间：* 2015-05-05 09:36 >>>>> *收件人：* [email protected] >>>>> *主题：* Re: Re: kylin0.7.1 && hadoop2.6.0部署任务调度器出错问题 >>>>> for kylin 0.7, it's hadoop 2.6 >>>>> and we use hdp 2.2 sandbox for testing purpose >>>>> >>>>> On Mon, May 4, 2015 at 7:24 PM, [email protected] < >>>>> [email protected]> wrote: >>>>> >>>>>> which hadoop version you used? and in your $HADOOP_HOME has contrib >>>>>> folder? >>>>>> >>>>>> ------------------------------ >>>>>> [email protected] >>>>>> >>>>>> >>>>>> *发件人：* hongbin ma <[email protected]> >>>>>> *发送时间：* 2015-05-04 17:46 >>>>>> *收件人：* [email protected] >>>>>> *抄送：* dev <[email protected]> >>>>>> *主题：* Re: Re: kylin0.7.1 && hadoop2.6.0部署任务调度器出错问题 >>>>>> hi, zeng, >>>>>> >>>>>> maybe you can modify >>>>>> https://github.com/KylinOLAP/Kylin/blob/0.7.1/bin/kylin.sh#L53 to >>>>>> print all the variables to check which variable introduced "xx/contrib" >>>>>> >>>>>> a.f.a.i.k we did not explicitly added dependency on "xx/contrib" >>>>>> >>>>>> On Mon, May 4, 2015 at 4:00 PM, [email protected] < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> My HBASE_CLASSPATH and hive's classpath don't include >>>>>>> /data1/app/hadoop-2.6.0/contrib and contrib folder is not exist in >>>>>>> $HADOOP_HOME. >>>>>>> >>>>>>> Will I have to rebuild the hadoop? >>>>>>> >>>>>>> >>>>>>> ------------------------------ >>>>>>> [email protected] >>>>>>> >>>>>>> >>>>>>> *发件人：* hongbin ma <[email protected]> >>>>>>> *发送时间：* 2015-05-04 15:42 >>>>>>> *收件人：* zengzhaozheng <[email protected]>; dev >>>>>>> <[email protected]> >>>>>>> *主题：* Re: kylin0.7.1 && hadoop2.6.0部署任务调度器出错问题 >>>>>>> https://github.com/KylinOLAP/Kylin/blob/0.7.1/bin/kylin.sh#L53 >>>>>>> >>>>>>> On Mon, May 4, 2015 at 3:41 PM, hongbin ma <[email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> when kylin starts, it will include everything in HBASE_CLASSPATH >>>>>>>> and hive's classpath. Does your HBASE_CLASSPATH include >>>>>>>> /data1/app/hadoop-2.6.0/contrib? >>>>>>>> >>>>>>>> On Mon, May 4, 2015 at 3:41 PM, hongbin ma <[email protected]> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> forward to mail list for discussion >>>>>>>>> >>>>>>>>> >>>>>>>>> On Mon, May 4, 2015 at 3:39 PM, hongbin ma <[email protected]> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> WARNING: Failed to process JAR >>>>>>>>>> [jar:file:/data1/app/hadoop-2.6.0/contrib/capacity-scheduler/.jar!/] >>>>>>>>>> for >>>>>>>>>> TLD files >>>>>>>>>> java.io.FileNotFoundException: >>>>>>>>>> /data1/app/hadoop-2.6.0/contrib/capacity-scheduler/.jar (No such >>>>>>>>>> file or >>>>>>>>>> directory) >>>>>>>>>> at java.util.zip.ZipFile.open(Native Method) >>>>>>>>>> at java.util.zip.ZipFile.(ZipFile.java:215) >>>>>>>>>> at java.util.zip.ZipFile.(ZipFile.java:145) >>>>>>>>>> at java.util.jar.JarFile.(JarFile.java:153) >>>>>>>>>> at java.util.jar.JarFile.(JarFile.java:90) >>>>>>>>>> at sun.net.www.protocol.jar.URLJarFile.(URLJarFile.java:93) >>>>>>>>>> at >>>>>>>>>> sun.net.www.protocol.jar.URLJarFile.getJarFile(URLJarFile.java:69) >>>>>>>>>> at >>>>>>>>>> sun.net.www.protocol.jar.JarFileFactory.get(JarFileFactory.java:99) >>>>>>>>>> at >>>>>>>>>> sun.net.www.protocol.jar.JarURLConnection.connect(JarURLConnection.java:122) >>>>>>>>>> at >>>>>>>>>> sun.net.www.protocol.jar.JarURLConnection.getJarFile(JarURLConnection.java:89) >>>>>>>>>> at org.apache.tomcat.util.scan.FileUrlJar.(FileUrlJar.java:41) >>>>>>>>>> at >>>>>>>>>> org.apache.tomcat.util.scan.JarFactory.newInstance(JarFactory.java:34) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.startup.TldConfig.tldScanJar(TldConfig.java:485) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.startup.TldConfig.access$100(TldConfig.java:61) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.startup.TldConfig$TldJarScannerCallback.scan(TldConfig.java:296) >>>>>>>>>> at >>>>>>>>>> org.apache.tomcat.util.scan.StandardJarScanner.process(StandardJarScanner.java:258) >>>>>>>>>> at >>>>>>>>>> org.apache.tomcat.util.scan.StandardJarScanner.scan(StandardJarScanner.java:220) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.startup.TldConfig.execute(TldConfig.java:269) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.startup.TldConfig.lifecycleEvent(TldConfig.java:565) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:117) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:90) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5412) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.core.StandardHost.addChild(StandardHost.java:649) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1081) >>>>>>>>>> at >>>>>>>>>> org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1877) >>>>>>>>>> at >>>>>>>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>>>>>>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >>>>>>>>>> at >>>>>>>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >>>>>>>>>> at >>>>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >>>>>>>>>> at java.lang.Thread.run(Thread.java:744) >>>>>>>>>> hadoop2.x contrib文件夹应该是没有的，这个为什么还会用这个文件夹？ >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Regards, >>>>>>>>> >>>>>>>>> *Bin Mahone | 马洪宾* >>>>>>>>> Apache Kylin: http://kylin.io >>>>>>>>> Github: https://github.com/binmahone >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Regards, >>>>>>>> >>>>>>>> *Bin Mahone | 马洪宾* >>>>>>>> Apache Kylin: http://kylin.io >>>>>>>> Github: https://github.com/binmahone >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Regards, >>>>>>> >>>>>>> *Bin Mahone | 马洪宾* >>>>>>> Apache Kylin: http://kylin.io >>>>>>> Github: https://github.com/binmahone >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Regards, >>>>>> >>>>>> *Bin Mahone | 马洪宾* >>>>>> Apache Kylin: http://kylin.io >>>>>> Github: https://github.com/binmahone >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Regards, >>>>> >>>>> *Bin Mahone | 马洪宾* >>>>> Apache Kylin: http://kylin.io >>>>> Github: https://github.com/binmahone >>>>> >>>>> >>>> >>>> >>>> -- >>>> Regards, >>>> >>>> *Bin Mahone | 马洪宾* >>>> Apache Kylin: http://kylin.io >>>> Github: https://github.com/binmahone >>>> >>>> >>> >>> >>> -- >>> Regards, >>> >>> *Bin Mahone | 马洪宾* >>> Apache Kylin: http://kylin.io >>> Github: https://github.com/binmahone >>> >> >> >> >> -- >> Regards, >> >> *Bin Mahone | 马洪宾* >> Apache Kylin: http://kylin.io >> Github: https://github.com/binmahone >> >> > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > > -- Regards, *Bin Mahone | 马洪宾* Apache Kylin: http://kylin.io Github: https://github.com/binmahone
