@Santosh, will appreciate if you could fix "find-hive-dependency.sh" that it can report correct hive conf dir and jar path in your case.
Thanks! On Mon, Mar 2, 2015 at 7:43 PM, Luke Han <[email protected]> wrote: > Please pull request to code repo or draft wiki here: > https://github.com/KylinOLAP/Kylin/wiki > > Thank you very much. > > > Best Regards! > --------------------- > > Luke Han > > 2015-03-02 12:49 GMT+08:00 Santoshakhilesh <[email protected]>: > > > Hi Yang , > > Please let me know how could I contribute ? Writing a wiki with > > samples is what you mean or something else ? > > > > Regards, > > Santosh Akhilesh > > Bangalore R&D > > HUAWEI TECHNOLOGIES CO.,LTD. > > > > www.huawei.com > > > > > ------------------------------------------------------------------------------------------------------------------------------------- > > This e-mail and its attachments contain confidential information from > > HUAWEI, which > > is intended only for the person or entity whose address is listed above. > > Any use of the > > information contained herein in any way (including, but not limited to, > > total or partial > > disclosure, reproduction, or dissemination) by persons other than the > > intended > > recipient(s) is prohibited. If you receive this e-mail in error, please > > notify the sender by > > phone or email immediately and delete it! > > > > ________________________________________ > > From: Li Yang [[email protected]] > > Sent: Monday, March 02, 2015 9:16 AM > > To: [email protected] > > Subject: Re: Hive Table is not loaded in Kylin//RE: About building kylin > > > > Nice catch Santosh! > > > > All "find-hive-dependency.sh" does is to locate hive conf dir and hive > > jars, so they can be put on Kylin classpath later. Due to the various > > Hadoop distribution out there, the script is not yet perfect. Your case > -- > > hive in local embedded mode -- is one we never tested before. Help us > > improve the shell if you like. > > > > Cheers > > Yang > > > > On Sat, Feb 21, 2015 at 4:11 AM, Santosh Akhilesh < > > [email protected] > > > wrote: > > > > > Finally after debugging common/util/HiveClient. java and a bit of > google > > > search helped me to resolve this issue. now I am able to load hive > tables > > > in Kylin successfully. > > > > > > My hive configuration is local embedded mode and the default storage is > > > Derby. I need to set following config for local embedded mode in > > > hive-site.xml. At the end I am adding my hive-site.xml here so that if > > some > > > else faces same issue needn't spend so much time as me. > > > > > > I plan to write a wiki when I am done with my test of Kylin to let > others > > > know how to setup Kylin from scratch using just apache hive , hbase and > > > hadoop binaries. May be we should create wikis for standalone , pseudo > > > distributed and fully distributed mode of kylin just like other apache > > > projects. > > > > > > I find source of find-hivedependency.sh is unnecessary and this script > is > > > not working now for all cases , all you need is lib and conf path of > > hive , > > > to build kylin one need to set hive in path so I guess the lib and conf > > > path can be retrieved automatically. > > > > > > > > > Following is one good link about hive configuration mode which helped > me > > to > > > understand hive deployment modes. > > > > > > > > > http://www.cloudera.com/content/cloudera/en/documentation/cdh4/latest/CDH4-InstallationGuide/cdh4ig_hive_metastore_configure.html > > > > > > Now I move to next step to create cubes , thanks everyone for answering > > my > > > queries patiently. > > > > > > hive-site.xml which is required to setup for local embedded mode. > > > > > > <configuration> > > > <property> > > > <name>hive.metastore.local</name> > > > <value>true</value> > > > </property> > > > <property> > > > <name>hive.metastore.warehouse.dir</name> > > > <value>file://user/hive/warehouse</value> > > > </property> > > > <property> > > > <name>javax.jdo.option.ConnectionURL</name> > > > > > > > > > <value>jdbc:derby:;databaseName=/home/santosh/work/frameworks/apache-hive-1.0.0/bin/metastore_db;create=true > > > </value> > > > </property> > > > <property> > > > <name>javax.jdo.option.ConnectionDriverName</name> > > > <value>org.apache.derby.jdbc.EmbeddedDriver</value> > > > </property> > > > </configuration> > > > > > > On Sat, Feb 21, 2015 at 12:25 AM, Santosh Akhilesh < > > > [email protected]> wrote: > > > > > > > I prepared a debug environment to debug HiveClient in inverted index > > > branch > > > > > > > > private HiveMetaStoreClient getMetaStoreClient() throws > Exception { > > > > if (metaStoreClient == null) { > > > > metaStoreClient = new HiveMetaStoreClient(hiveConf); > > > > } > > > > return metaStoreClient; > > > > } > > > > > > > > problem comes in above function and log is as below , next thing > for > > me > > > > is to know , what to set in hive-site.xml to make this code work. Any > > > help > > > > is appreciated. > > > > > > > > 15/02/21 00:06:45 INFO metastore.HiveMetaStore: 0: Opening raw store > > with > > > > implemenation class:org.apache.hadoop.hive.metastore.ObjectStore > > > > 15/02/21 00:06:46 INFO metastore.ObjectStore: ObjectStore, initialize > > > > called > > > > 15/02/21 00:06:47 INFO DataNucleus.Persistence: Property > > > > datanucleus.cache.level2 unknown - will be ignored > > > > 15/02/21 00:06:47 INFO DataNucleus.Persistence: Property > > > > hive.metastore.integral.jdo.pushdown unknown - will be ignored > > > > 15/02/21 00:07:13 INFO metastore.ObjectStore: Setting MetaStore > object > > > pin > > > > classes with > > > > > > > > > > hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order" > > > > 15/02/21 00:07:26 INFO DataNucleus.Datastore: The class > > > > "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as > > > > "embedded-only" so does not have its own datastore table. > > > > 15/02/21 00:07:26 INFO DataNucleus.Datastore: The class > > > > "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as > > > > "embedded-only" so does not have its own datastore table. > > > > 15/02/21 00:07:46 INFO DataNucleus.Datastore: The class > > > > "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as > > > > "embedded-only" so does not have its own datastore table. > > > > 15/02/21 00:07:46 INFO DataNucleus.Datastore: The class > > > > "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as > > > > "embedded-only" so does not have its own datastore table. > > > > 15/02/21 00:07:52 INFO metastore.MetaStoreDirectSql: Using direct > SQL, > > > > underlying DB is DERBY > > > > 15/02/21 00:07:52 INFO metastore.ObjectStore: Initialized ObjectStore > > > > 15/02/21 00:07:54 WARN metastore.ObjectStore: Version information not > > > > found in metastore. hive.metastore.schema.verification is not enabled > > so > > > > recording the schema version 0.14.0 > > > > 15/02/21 00:07:55 WARN metastore.ObjectStore: Failed to get database > > > > default, returning NoSuchObjectException > > > > > > > > > > > > On Fri, Feb 20, 2015 at 11:25 PM, Santosh Akhilesh < > > > > [email protected]> wrote: > > > > > > > >> HI , > > > >> I tried to set the hive-site.xml using the example you gave. But > after > > > >> applying this , hive shell itself can't load. > > > >> There are some configs which are specific to hortonworks sandbox , I > > had > > > >> removed them. > > > >> If someone can tell me whats the process of connecting to hive > > database > > > , > > > >> is it a jdbc connection , depend on sql or through thirft which can > > > help me > > > >> to find which params really necessary. As per exception there is > > > exception > > > >> while calling getHivetable so some params are not correct in > HiveConf. > > > >> Regards, > > > >> Santosh > > > >> > > > >> On Fri, Feb 20, 2015 at 10:19 PM, Santosh Akhilesh < > > > >> [email protected]> wrote: > > > >> > > > >>> Oops thats a big list of configure items :). Most of them will take > > > time > > > >>> for me to understand and apply. Thanks any way will get back after > I > > > apply > > > >>> in my env. To Chinese friends Xin Niam Quai la. Gong xi fa cai:) > > > >>> > > > >>> On Fri, 20 Feb 2015 at 9:56 pm, 周千昊 <[email protected]> wrote: > > > >>> > > > >>>> Here is the link: > > > >>>> https://github.com/KylinOLAP/Kylin/blob/master/examples/test > > > >>>> _case_data/sandbox/hive-site.xml > > > >>>> > > > >>>> On Sat Feb 21 2015 at 12:21:59 AM Santosh Akhilesh < > > > >>>> [email protected]> wrote: > > > >>>> > > > >>>> > Can someone give me a link to sample hive-site.xml which is > > working > > > >>>> with > > > >>>> > kylin? > > > >>>> > I feel I need to set some mandatory parameter which hive shell > can > > > >>>> get but > > > >>>> > need to be specified if being accessed from external client? Do > I > > > >>>> need to > > > >>>> > set megastore db path? > > > >>>> > On Fri, 20 Feb 2015 at 9:12 pm, Santosh Akhilesh < > > > >>>> > [email protected]> > > > >>>> > wrote: > > > >>>> > > > > >>>> > > You replied to wrong thread. Didn't want to hijack that > thread. > > > >>>> > > My hive Conf is under hive install. Following is the hive > > > >>>> dependency I > > > >>>> > > export in startkylin.sh > > > >>>> > > > > > >>>> > > export > > > >>>> > > hive_dependency=/home/santosh/work/frameworks/apache-hive-1. > > > >>>> > 0.0/conf/:/home/santosh/work/frameworks/apache-hive-1.0.0/ > > > >>>> > lib/*:/home/santosh/work/frameworks/apache-hive-1.0.0/ > > > >>>> > hcatalog/share/hcatalog/* > > > >>>> > > On Fri, 20 Feb 2015 at 8:43 pm, Santosh Akhilesh < > > > >>>> > > [email protected]> wrote: > > > >>>> > > > > > >>>> > >> Hi , > > > >>>> > >> I have set the conf path in start_kylin.sh as below. I > have > > > >>>> removed > > > >>>> > >> the sourcing of find-hive-dependency.sh as its not working in > > my > > > >>>> env. > > > >>>> > >> > > > >>>> > >> In the hive-site.xml , I have set following; still i get same > > > >>>> error , is > > > >>>> > >> there anything else I need to do ? > > > >>>> > >> > > > >>>> > >> <configuration> > > > >>>> > >> <property> > > > >>>> > >> <name>hive.exec.scratchdir</name> > > > >>>> > >> <value>/tmp/hive</value> > > > >>>> > >> <description>Scratch space for Hive jobs</description> > > > >>>> > >> </property> > > > >>>> > >> </configuration> > > > >>>> > >> > > > >>>> > >> > > > >>>> > >> #source ${dir}/find-hive-dependency.sh > > > >>>> > >> export hive_dependency=/home/santosh/ > > > >>>> work/frameworks/apache-hive-1. > > > >>>> > >> 0.0/conf/:/home/santosh/work/frameworks/apache-hive-1.0.0/ > > > >>>> > >> lib/*:/home/santosh/work/frameworks/apache-hive-1.0.0/ > > > >>>> > >> hcatalog/share/hcatalog/* > > > >>>> > >> export HBASE_CLASSPATH_PREFIX=${tomcat_root}/bin/bootstrap. > > > >>>> > >> jar:${tomcat_root}/bin/tomcat-juli.jar:${tomcat_root}/lib/*: > > > >>>> > >> $HBASE_CLASSPATH_PREFIX > > > >>>> > >> export HBASE_CLASSPATH=$hive_dependency:${HBASE_CLASSPATH} > > > >>>> > >> > > > >>>> > >> hbase -Djava.util.logging.config.file=${tomcat_root}/conf/ > > > >>>> > logging.properties > > > >>>> > >> \ > > > >>>> > >> > > -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager > > > >>>> \ > > > >>>> > >> > -Dorg.apache.tomcat.util.buf.UDecoder.ALLOW_ENCODED_SLASH=true > > \ > > > >>>> > >> > > > -Dorg.apache.catalina.connector.CoyoteAdapter.ALLOW_BACKSLASH=true > > > >>>> \ > > > >>>> > >> -Djava.endorsed.dirs=${tomcat_root}/endorsed \ > > > >>>> > >> -Dcatalina.base=${tomcat_root} \ > > > >>>> > >> -Dcatalina.home=${tomcat_root} \ > > > >>>> > >> -Djava.io.tmpdir=${tomcat_root}/temp \ > > > >>>> > >> -Dkylin.hive.dependency=${hive_dependency} \ > > > >>>> > >> -Dspring.profiles.active=${spring_profile} \ > > > >>>> > >> org.apache.hadoop.util.RunJar > ${tomcat_root}/bin/bootstrap.jar > > > >>>> > >> org.apache.catalina.startup.Bootstrap start > > > > >>>> > >> ${tomcat_root}/logs/kylin.log 2>&1 & > > > >>>> > >> echo "A new Kylin instance is started by $USER, stop it using > > > >>>> > >> \"stop-kylin.sh\"" > > > >>>> > >> if [ "$useSandbox" = "true" ] > > > >>>> > >> then echo "Please visit http:// > > <your_sandbox_ip>:7070/kylin > > > >>>> to play > > > >>>> > >> with the cubes! (Useranme: ADMIN, Password: KYLIN)" > > > >>>> > >> else > > > >>>> > >> echo "Please visit http://<ip>:7070/kylin" > > > >>>> > >> fi > > > >>>> > >> echo "You can check the log at ${tomcat_root}/logs/kylin.log" > > > >>>> > >> > > > >>>> > >> > > > >>>> > >> On Fri, Feb 20, 2015 at 8:10 PM, Shi, Shaofeng < > > [email protected] > > > > > > > >>>> > wrote: > > > >>>> > >> > > > >>>> > >>> Hi, > > > >>>> > >>> > > > >>>> > >>> Kylin from 7.0.x and later needs hive-site.xml on the > > classpth, > > > to > > > >>>> > allow > > > >>>> > >>> Kylin connect with the hive metadata service via API, to get > > the > > > >>>> table > > > >>>> > >>> info; As you can execute hive commands on your machine, the > > hive > > > >>>> client > > > >>>> > >>> should have been properly set, you can search the > > hive-site.xml > > > >>>> from / > > > >>>> > to > > > >>>> > >>> get its path, and then add it to the script as Qianhao > > > mentioned. > > > >>>> > >>> > > > >>>> > >>> On 2/20/15, 10:28 PM, "Santosh Akhilesh" < > > > >>>> [email protected]> > > > >>>> > >>> wrote: > > > >>>> > >>> > > > >>>> > >>> >Hi Qianhao, > > > >>>> > >>> > I really wonder what kind of config I need to set > for > > > >>>> making > > > >>>> > >>> sure > > > >>>> > >>> >kylin can load the hive tables. > > > >>>> > >>> > I am not using the ready made sandbox , I have > > > downloaded > > > >>>> > hbase > > > >>>> > >>> , > > > >>>> > >>> >hive , hadoop from apcahe site to make the env. As far as I > > can > > > >>>> see > > > >>>> > >>> >currently I can query hive tables in hive shell. Mine is > > single > > > >>>> node > > > >>>> > >>> >pseudo > > > >>>> > >>> >distributed cluster. I have not set any changes to > > > hive-site.xml > > > >>>> , the > > > >>>> > >>> >metastoredb is created under $HIVE_INSTALL/bin > > > >>>> > >>> >data is on hdfs under /user/hive/warehouse. > > > >>>> > >>> > > > > >>>> > >>> >I am really out of clue why the exception , I suspect its > > some > > > >>>> setting > > > >>>> > >>> >which kylin expects to make hive query run > > > >>>> > >>> > > > > >>>> > >>> >Please help me to get over this issue , thanks. > > > >>>> > >>> >2015-02-20 19:38:10,435 INFO [http-bio-7070-exec-3] > > > >>>> > >>> HiveMetaStore.audit: > > > >>>> > >>> >ugi=santosh ip=unknown-ip-addr cmd=get_table : db=DEFAULT > > > >>>> tbl=books > > > >>>> > >>> >NoSuchObjectException(message:DEFAULT.books table not > found) > > > >>>> > >>> >at > > > >>>> > >>> >org.apache.hadoop.hive.metastore.HiveMetaStore$ > > > >>>> > >>> HMSHandler.get_table_core(H > > > >>>> > >>> >iveMetaStore.java:1729) > > > >>>> > >>> >at > > > >>>> > >>> >org.apache.hadoop.hive.metastore.HiveMetaStore$ > > > >>>> > >>> HMSHandler.get_table(HiveMe > > > >>>> > >>> >taStore.java:1699) > > > >>>> > >>> >at sun.reflect.NativeMethodAccessorImpl.invoke0(Native > > Method) > > > >>>> > >>> >at > > > >>>> > >>> >sun.reflect.NativeMethodAccessorImpl.invoke( > > > >>>> > >>> NativeMethodAccessorImpl.java: > > > >>>> > >>> >57) > > > >>>> > >>> >at > > > >>>> > >>> >sun.reflect.DelegatingMethodAccessorImpl.invoke( > > > >>>> > >>> DelegatingMethodAccessorIm > > > >>>> > >>> >pl.java:43) > > > >>>> > >>> >at java.lang.reflect.Method.invoke(Method.java:606) > > > >>>> > >>> >at > > > >>>> > >>> >org.apache.hadoop.hive.metastore.RetryingHMSHandler. > > > >>>> > >>> invoke(RetryingHMSHand > > > >>>> > >>> >ler.java:102) > > > >>>> > >>> >at com.sun.proxy.$Proxy37.get_table(Unknown Source) > > > >>>> > >>> >at > > > >>>> > >>> >org.apache.hadoop.hive.metastore.HiveMetaStoreClient. > > > >>>> > >>> getTable(HiveMetaStor > > > >>>> > >>> >eClient.java:1097) > > > >>>> > >>> >at > > > >>>> > >>> >org.apache.kylin.common.util.HiveClient.getHiveTable( > > > >>>> > >>> HiveClient.java:115) > > > >>>> > >>> >at > > > >>>> > >>> >org.apache.kylin.metadata.tool.HiveSourceTableLoader. > > > >>>> > >>> extractHiveTables(Hiv > > > >>>> > >>> >eSourceTableLoader.java:86) > > > >>>> > >>> > > > > >>>> > >>> >On Fri, Feb 20, 2015 at 4:53 PM, Santosh Akhilesh > > > >>>> > >>> ><[email protected] > > > >>>> > >>> >> wrote: > > > >>>> > >>> > > > > >>>> > >>> >> Hi Qianhao, > > > >>>> > >>> >> *I have installed hive from Apache hive site. I dont > > have > > > >>>> > >>> following > > > >>>> > >>> >> folder. * > > > >>>> > >>> >> /usr/hdp/current/hive-client/conf/ in this script. > > > >>>> > >>> >> *I am using Hive 1.0.0 version.* > > > >>>> > >>> >> *Where can I get this ? and which conf files I need to > set > > > >>>> under > > > >>>> > conf > > > >>>> > >>> >> folder ?* > > > >>>> > >>> >> *Regards,* > > > >>>> > >>> >> *Santosh Akhilesh* > > > >>>> > >>> >> > > > >>>> > >>> >> > > > >>>> > >>> >> > > > >>>> > >>> >> > > > >>>> > >>> >> On Fri, Feb 20, 2015 at 10:51 AM, 周千昊 < > [email protected] > > > > > > >>>> wrote: > > > >>>> > >>> >> > > > >>>> > >>> >>> Hi, Santosh > > > >>>> > >>> >>> Thanks for reporting the issue, it looks to me that > > it > > > is > > > >>>> > still > > > >>>> > >>> >>>the > > > >>>> > >>> >>> problem of find-hive-dependecny.sh. > > > >>>> > >>> >>> As a workaround, you can just manually add > > > >>>> > >>> >>> /usr/hdp/current/hive-client/conf/ in this script. > > > >>>> > >>> >>> > > > >>>> > >>> >>> On Thu Feb 19 2015 at 8:01:39 PM Santoshakhilesh < > > > >>>> > >>> >>> [email protected]> wrote: > > > >>>> > >>> >>> > > > >>>> > >>> >>> > Hi , > > > >>>> > >>> >>> > I analyzed the Kylin.log and found that > > > >>>> > find-hive-dependency.sh > > > >>>> > >>> >>>was > > > >>>> > >>> >>> > not able to locate hive installation path correctly , > > so I > > > >>>> > modified > > > >>>> > >>> >>>the > > > >>>> > >>> >>> > script to set the correct hive lib path. > > > >>>> > >>> >>> > Now I dont get no classs found error so it means > > that > > > >>>> class > > > >>>> > >>> path > > > >>>> > >>> >>>is > > > >>>> > >>> >>> > set right now to resolve hive dependencies. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > The next exception I get is following , > > > >>>> > >>> >>> > NoSuchObjectException(message:DEFAULT.books table not > > > >>>> found) > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > I could run following query on hive console; > > > >>>> > >>> >>> > select * from default.books; > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > So again problem seems to be some settings related to > > hive > > > >>>> , can > > > >>>> > >>> >>>someone > > > >>>> > >>> >>> > help me locate this issue ? > > > >>>> > >>> >>> > Also I want to know do I need to include following > lib; > > I > > > >>>> dont > > > >>>> > have > > > >>>> > >>> >>>it > > > >>>> > >>> >>> > currently in my path > > > >>>> > >>> >>> > /usr/hdp/current/hive-client/conf/ > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > Exception: > > > >>>> > >>> >>> > 2015-02-20 01:15:18,163 INFO [http-bio-7070-exec-10] > > > >>>> > >>> >>> > DataNucleus.Datastore: The class > > > >>>> > >>> >>> "org.apache.hadoop.hive.metastore.model.MFieldSchema" > > > >>>> > >>> >>> > is tagged as "embedded-only" so does not have its own > > > >>>> datastore > > > >>>> > >>> >>>table. > > > >>>> > >>> >>> > 2015-02-20 01:15:18,163 INFO [http-bio-7070-exec-10] > > > >>>> > >>> >>> > DataNucleus.Datastore: The class > > > >>>> > >>> >>> "org.apache.hadoop.hive.metastore.model.MOrder" > > > >>>> > >>> >>> > is tagged as "embedded-only" so does not have its own > > > >>>> datastore > > > >>>> > >>> >>>table. > > > >>>> > >>> >>> > 2015-02-20 01:15:18,532 INFO [http-bio-7070-exec-10] > > > >>>> > >>> >>> > DataNucleus.Datastore: The class > > > >>>> > >>> >>> "org.apache.hadoop.hive.metastore.model.MFieldSchema" > > > >>>> > >>> >>> > is tagged as "embedded-only" so does not have its own > > > >>>> datastore > > > >>>> > >>> >>>table. > > > >>>> > >>> >>> > 2015-02-20 01:15:18,532 INFO [http-bio-7070-exec-10] > > > >>>> > >>> >>> > DataNucleus.Datastore: The class > > > >>>> > >>> >>> "org.apache.hadoop.hive.metastore.model.MOrder" > > > >>>> > >>> >>> > is tagged as "embedded-only" so does not have its own > > > >>>> datastore > > > >>>> > >>> >>>table. > > > >>>> > >>> >>> > 2015-02-20 01:15:18,710 INFO [http-bio-7070-exec-10] > > > >>>> > >>> >>>DataNucleus.Query: > > > >>>> > >>> >>> > Reading in results for query > > > >>>> > >>> >>> "org.datanucleus.store.rdbms.query.SQLQuery@0" > > > >>>> > >>> >>> > since the connection used is closing > > > >>>> > >>> >>> > 2015-02-20 01:15:18,713 INFO [http-bio-7070-exec-10] > > > >>>> > >>> >>> > metastore.ObjectStore: Initialized ObjectStore > > > >>>> > >>> >>> > 2015-02-20 01:15:19,002 INFO [http-bio-7070-exec-10] > > > >>>> > >>> >>> > metastore.HiveMetaStore: Added admin role in metastore > > > >>>> > >>> >>> > 2015-02-20 01:15:19,004 INFO [http-bio-7070-exec-10] > > > >>>> > >>> >>> > metastore.HiveMetaStore: Added public role in > metastore > > > >>>> > >>> >>> > 2015-02-20 01:15:19,090 INFO [http-bio-7070-exec-10] > > > >>>> > >>> >>> > metastore.HiveMetaStore: No user is added in admin > role, > > > >>>> since > > > >>>> > >>> >>>config is > > > >>>> > >>> >>> > empty > > > >>>> > >>> >>> > 2015-02-20 01:15:19,213 INFO [http-bio-7070-exec-10] > > > >>>> > >>> >>> > metastore.HiveMetaStore: 0: get_table : db=DEFAULT > > > tbl=books > > > >>>> > >>> >>> > 2015-02-20 01:15:19,213 INFO [http-bio-7070-exec-10] > > > >>>> > >>> >>> HiveMetaStore.audit: > > > >>>> > >>> >>> > ugi=root ip=unknown-ip-addr cmd=get_table : db=DEFAULT > > > >>>> tbl=books > > > >>>> > >>> >>> > NoSuchObjectException(message:DEFAULT.books table not > > > >>>> found) > > > >>>> > >>> >>> > at org.apache.hadoop.hive.metastore.HiveMetaStore$ > > > >>>> > >>> >>> > HMSHandler.get_table_core(HiveMetaStore.java:1729) > > > >>>> > >>> >>> > at > > > >>>> > >>> >>>org.apache.hadoop.hive.metastore.HiveMetaStore$ > > > >>>> > HMSHandler.get_table( > > > >>>> > >>> >>> > HiveMetaStore.java:1699) > > > >>>> > >>> >>> > at > sun.reflect.NativeMethodAccessorImpl.invoke0(Native > > > >>>> Method) > > > >>>> > >>> >>> > at sun.reflect.NativeMethodAccessorImpl.invoke( > > > >>>> > >>> >>> > NativeMethodAccessorImpl.java:57) > > > >>>> > >>> >>> > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > > > >>>> > >>> >>> > DelegatingMethodAccessorImpl.java:43) > > > >>>> > >>> >>> > at java.lang.reflect.Method.invoke(Method.java:606) > > > >>>> > >>> >>> > at > org.apache.hadoop.hive.metastore.RetryingHMSHandler. > > > >>>> > >>> >>> > invoke(RetryingHMSHandler.java:102) > > > >>>> > >>> >>> > at com.sun.proxy.$Proxy37.get_table(Unknown Source) > > > >>>> > >>> >>> > at > > org.apache.hadoop.hive.metastore.HiveMetaStoreClient. > > > >>>> > >>> >>> > getTable(HiveMetaStoreClient.java:1091) > > > >>>> > >>> >>> > at > > org.apache.kylin.common.util.HiveClient.getHiveTable( > > > >>>> > >>> >>> > HiveClient.java:115) > > > >>>> > >>> >>> > at > > org.apache.kylin.metadata.tool.HiveSourceTableLoader. > > > >>>> > >>> >>> > extractHiveTables(HiveSourceTableLoader.java:86) > > > >>>> > >>> >>> > at > > > >>>> > >>> >>> org.apache.kylin.metadata.tool.HiveSourceTableLoader. > > > >>>> > >>> reloadHiveTables( > > > >>>> > >>> >>> > HiveSourceTableLoader.java:70) > > > >>>> > >>> >>> > at org.apache.kylin.rest.service. > > > >>>> CubeService.reloadHiveTable( > > > >>>> > >>> >>> > CubeService.java:537) > > > >>>> > >>> >>> > at org.apache.kylin.rest.service. > > > >>>> CubeService$$FastClassByCGLIB$ > > > >>>> > >>> >>> > $17a07c0e.invoke(<generated>) > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > Regards, > > > >>>> > >>> >>> > Santosh Akhilesh > > > >>>> > >>> >>> > Bangalore R&D > > > >>>> > >>> >>> > HUAWEI TECHNOLOGIES CO.,LTD. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > www.huawei.com > > > >>>> > >>> >>> > ------------------------------ > > > >>>> ------------------------------ > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > >>>> > >>> >>>--------------------------------------------------------- > > > >>>> > >>> --------------- > > > >>>> > >>> >>>- > > > >>>> > >>> >>> > This e-mail and its attachments contain confidential > > > >>>> information > > > >>>> > >>> from > > > >>>> > >>> >>> > HUAWEI, which > > > >>>> > >>> >>> > is intended only for the person or entity whose > address > > is > > > >>>> listed > > > >>>> > >>> >>>above. > > > >>>> > >>> >>> > Any use of the > > > >>>> > >>> >>> > information contained herein in any way (including, > but > > > not > > > >>>> > limited > > > >>>> > >>> >>>to, > > > >>>> > >>> >>> > total or partial > > > >>>> > >>> >>> > disclosure, reproduction, or dissemination) by persons > > > >>>> other than > > > >>>> > >>> the > > > >>>> > >>> >>> > intended > > > >>>> > >>> >>> > recipient(s) is prohibited. If you receive this e-mail > > in > > > >>>> error, > > > >>>> > >>> >>>please > > > >>>> > >>> >>> > notify the sender by > > > >>>> > >>> >>> > phone or email immediately and delete it! > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > ________________________________________ > > > >>>> > >>> >>> > From: Santoshakhilesh [[email protected]] > > > >>>> > >>> >>> > Sent: Thursday, February 19, 2015 3:37 PM > > > >>>> > >>> >>> > To: [email protected] > > > >>>> > >>> >>> > Subject: RE: Hive Table is not loaded in Kylin//RE: > > About > > > >>>> > building > > > >>>> > >>> >>>kylin > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > Looks like this is the issue , I find one exception in > > > >>>> > >>> >>> > localhost.2015-02-19.log > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > Does this mean there is some issue in hive version I > > use , > > > >>>> I am > > > >>>> > >>> using > > > >>>> > >>> >>> > 0.14.0? > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > SEVERE: Servlet.service() for servlet [kylin] in > context > > > >>>> with > > > >>>> > path > > > >>>> > >>> >>> > [/kylin] threw exception [Handler processing failed; > > > nested > > > >>>> > >>> >>>exception is > > > >>>> > >>> >>> > java.lang.NoClassDefFoundError: > > > >>>> > >>> >>> org/apache/hadoop/hive/ql/session/SessionState] > > > >>>> > >>> >>> > with root cause > > > >>>> > >>> >>> > java.lang.ClassNotFoundException: > > > >>>> org.apache.hadoop.hive.ql. > > > >>>> > >>> >>> > session.SessionState > > > >>>> > >>> >>> > at > > > org.apache.catalina.loader.WebappClassLoader.loadClass( > > > >>>> > >>> >>> > WebappClassLoader.java:1720) > > > >>>> > >>> >>> > at > > > org.apache.catalina.loader.WebappClassLoader.loadClass( > > > >>>> > >>> >>> > WebappClassLoader.java:1571) > > > >>>> > >>> >>> > at > > org.apache.kylin.metadata.tool.HiveSourceTableLoader. > > > >>>> > >>> >>> > extractHiveTables(HiveSourceTableLoader.java:83) > > > >>>> > >>> >>> > at > > > >>>> > >>> >>> org.apache.kylin.metadata.tool.HiveSourceTableLoader. > > > >>>> > >>> reloadHiveTables( > > > >>>> > >>> >>> > HiveSourceTableLoader.java:70) > > > >>>> > >>> >>> > at org.apache.kylin.rest.service. > > > >>>> CubeService.reloadHiveTable( > > > >>>> > >>> >>> > CubeService.java:537) > > > >>>> > >>> >>> > at org.apache.kylin.rest.service. > > > >>>> CubeService$$FastClassByCGLIB$ > > > >>>> > >>> >>> > $17a07c0e.invoke(<generated>) > > > >>>> > >>> >>> > at net.sf.cglib.proxy.MethodProxy.invoke( > > > >>>> MethodProxy.java:204) > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > Regards, > > > >>>> > >>> >>> > Santosh Akhilesh > > > >>>> > >>> >>> > Bangalore R&D > > > >>>> > >>> >>> > HUAWEI TECHNOLOGIES CO.,LTD. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > www.huawei.com > > > >>>> > >>> >>> > ------------------------------ > > > >>>> ------------------------------ > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > >>>> > >>> >>>--------------------------------------------------------- > > > >>>> > >>> --------------- > > > >>>> > >>> >>>- > > > >>>> > >>> >>> > This e-mail and its attachments contain confidential > > > >>>> information > > > >>>> > >>> from > > > >>>> > >>> >>> > HUAWEI, which > > > >>>> > >>> >>> > is intended only for the person or entity whose > address > > is > > > >>>> listed > > > >>>> > >>> >>>above. > > > >>>> > >>> >>> > Any use of the > > > >>>> > >>> >>> > information contained herein in any way (including, > but > > > not > > > >>>> > limited > > > >>>> > >>> >>>to, > > > >>>> > >>> >>> > total or partial > > > >>>> > >>> >>> > disclosure, reproduction, or dissemination) by persons > > > >>>> other than > > > >>>> > >>> the > > > >>>> > >>> >>> > intended > > > >>>> > >>> >>> > recipient(s) is prohibited. If you receive this e-mail > > in > > > >>>> error, > > > >>>> > >>> >>>please > > > >>>> > >>> >>> > notify the sender by > > > >>>> > >>> >>> > phone or email immediately and delete it! > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > ________________________________________ > > > >>>> > >>> >>> > From: Santoshakhilesh [[email protected]] > > > >>>> > >>> >>> > Sent: Thursday, February 19, 2015 1:27 PM > > > >>>> > >>> >>> > To: [email protected] > > > >>>> > >>> >>> > Cc: Kulbhushan Rana > > > >>>> > >>> >>> > Subject: Hive Table is not loaded in Kylin//RE: About > > > >>>> building > > > >>>> > >>> kylin > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > Hi , > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > I have resolved this issue. I have hivesingle > column > > > >>>> table > > > >>>> > and I > > > >>>> > >>> >>>can > > > >>>> > >>> >>> > access from Hive console and do queries on it > > sucecssfully > > > >>>> using > > > >>>> > >>> hive > > > >>>> > >>> >>> > console. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > When I try to synch hive table using Kylin web > > > >>>> specifiying the > > > >>>> > >>> >>>hive > > > >>>> > >>> >>> > table name and synch. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > I get an error dialog "Oops Failed to take action" > . > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > Kylin.log > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > [pool-3-thread-1]:[2015-02-19 21:09:54,152][INFO][org. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > >>>> > >>> >>>apache.kylin.job.impl.threadpool.DefaultScheduler$ > > > >>>> > >>> FetcherRunner.run(Defa > > > >>>> > >>> >>>ultScheduler.java:117)] > > > >>>> > >>> >>> > - Job Fetcher: 0 running, 0 actual running, 0 ready, 0 > > > >>>> others > > > >>>> > >>> >>> > [http-bio-7070-exec-4]:[2015-02-19 > > > 21:09:59,556][INFO][org. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > >>>> > >>> >>>apache.kylin.rest.controller.TableController. > > > >>>> > >>> getHiveTables(TableControll > > > >>>> > >>> >>>er.java:74)] > > > >>>> > >>> >>> > - Return all table metadata in 0 seconds > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > localhost_access_log.2015-02-19.txt > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > 10.19.36.67 - - [19/Feb/2015:21:21:58 +0800] "POST > > > >>>> > >>> >>> > /kylin/api/tables/books/Sample HTTP/1.1" 500 1972 > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > Here books is my table (I have used default database) > > and > > > >>>> sample > > > >>>> > is > > > >>>> > >>> >>>name > > > >>>> > >>> >>> > of my project > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > What could be reason of not loading the hive tables ? > > > >>>> Someone whi > > > >>>> > >>> is > > > >>>> > >>> >>> able > > > >>>> > >>> >>> > to load the hive table successfully can help me to > debug > > > >>>> this > > > >>>> > >>> issue ? > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > Regards, > > > >>>> > >>> >>> > Santosh Akhilesh > > > >>>> > >>> >>> > Bangalore R&D > > > >>>> > >>> >>> > HUAWEI TECHNOLOGIES CO.,LTD. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > www.huawei.com > > > >>>> > >>> >>> > ------------------------------ > > > >>>> ------------------------------ > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > >>>> > >>> >>>--------------------------------------------------------- > > > >>>> > >>> --------------- > > > >>>> > >>> >>>- > > > >>>> > >>> >>> > This e-mail and its attachments contain confidential > > > >>>> information > > > >>>> > >>> from > > > >>>> > >>> >>> > HUAWEI, which > > > >>>> > >>> >>> > is intended only for the person or entity whose > address > > is > > > >>>> listed > > > >>>> > >>> >>>above. > > > >>>> > >>> >>> > Any use of the > > > >>>> > >>> >>> > information contained herein in any way (including, > but > > > not > > > >>>> > limited > > > >>>> > >>> >>>to, > > > >>>> > >>> >>> > total or partial > > > >>>> > >>> >>> > disclosure, reproduction, or dissemination) by persons > > > >>>> other than > > > >>>> > >>> the > > > >>>> > >>> >>> > intended > > > >>>> > >>> >>> > recipient(s) is prohibited. If you receive this e-mail > > in > > > >>>> error, > > > >>>> > >>> >>>please > > > >>>> > >>> >>> > notify the sender by > > > >>>> > >>> >>> > phone or email immediately and delete it! > > > >>>> > >>> >>> > ________________________________ > > > >>>> > >>> >>> > From: Santosh Akhilesh [[email protected]] > > > >>>> > >>> >>> > Sent: Tuesday, February 17, 2015 8:13 PM > > > >>>> > >>> >>> > To: [email protected] > > > >>>> > >>> >>> > Subject: Re: About building kylin > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > Hi, > > > >>>> > >>> >>> > These days I spent time to learn Hive and create > > > tables > > > >>>> > >>> required > > > >>>> > >>> >>> for > > > >>>> > >>> >>> > my test. > > > >>>> > >>> >>> > Unfortunately when I am all set with Hive > tables , > > > >>>> Kylin > > > >>>> > >>> can't > > > >>>> > >>> >>> start > > > >>>> > >>> >>> > normally. Before this I could start and login to web > ui. > > > >>>> the logs > > > >>>> > >>> are > > > >>>> > >>> >>> like > > > >>>> > >>> >>> > below. What has gone wring any idea ? > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > SLF4J: Class path contains multiple SLF4J bindings. > > > >>>> > >>> >>> > SLF4J: Found binding in [jar:file:/home/santosh/work/ > > > >>>> > >>> >>> > > frameworks/hbase-0.98.10-hadoop2/lib/slf4j-log4j12-1.6. > > > >>>> > >>> >>> > 4.jar!/org/slf4j/impl/StaticLoggerBinder.class] > > > >>>> > >>> >>> > SLF4J: Found binding in [jar:file:/home/santosh/work/ > > > >>>> > >>> >>> > > > frameworks/hadoop-1.2.1/lib/slf4j-log4j12-1.4.3.jar!/org/ > > > >>>> > >>> >>> > slf4j/impl/StaticLoggerBinder.class] > > > >>>> > >>> >>> > SLF4J: Found binding in [jar:file:/home/santosh/work/ > > > >>>> > >>> >>> > frameworks/kylin/tomcat/webapps/kylin/WEB-INF/lib/ > > > >>>> > >>> >>> > > > > slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder. > > > >>>> > class] > > > >>>> > >>> >>> > SLF4J: See http://www.slf4j.org/codes.htm > > > >>>> l#multiple_bindings for > > > >>>> > >>> an > > > >>>> > >>> >>> > explanation. > > > >>>> > >>> >>> > [localhost-startStop-1]:[2015-02-17 > > > >>>> 19:57:41,307][WARN][org. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > >>>> > >>> >>>apache.kylin.common.KylinConfig.getKylinProperties( > > > >>>> > >>> KylinConfig.java:527) > > > >>>> > >>> >>>] > > > >>>> > >>> >>> > - KYLIN_CONF_HOME has not been set > > > >>>> > >>> >>> > [localhost-startStop-1]:[2015-02-17 > > > >>>> 19:57:41,419][INFO][org. > > > >>>> > >>> >>> > > > > >>>> > >>> >>>springframework.core.io.support.PropertiesLoaderSupport. > > > >>>> > >>> loadProperties( > > > >>>> > >>> >>> > PropertiesLoaderSupport.java:177)] - Loading > properties > > > >>>> file > > > >>>> > from > > > >>>> > >>> >>> > resource loaded through InputStream > > > >>>> > >>> >>> > [localhost-startStop-1]:[2015-02-17 > > > >>>> 19:57:41,815][WARN][org. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > >>>> > >>> >>>apache.kylin.common.KylinConfig.getKylinProperties( > > > >>>> > >>> KylinConfig.java:527) > > > >>>> > >>> >>>] > > > >>>> > >>> >>> > - KYLIN_CONF_HOME has not been set > > > >>>> > >>> >>> > SLF4J: Class path contains multiple SLF4J bindings. > > > >>>> > >>> >>> > SLF4J: Found binding in [jar:file:/home/santosh/work/ > > > >>>> > >>> >>> > > frameworks/hbase-0.98.10-hadoop2/lib/slf4j-log4j12-1.6. > > > >>>> > >>> >>> > 4.jar!/org/slf4j/impl/StaticLoggerBinder.class] > > > >>>> > >>> >>> > SLF4J: Found binding in [jar:file:/home/santosh/work/ > > > >>>> > >>> >>> > > > frameworks/hadoop-1.2.1/lib/slf4j-log4j12-1.4.3.jar!/org/ > > > >>>> > >>> >>> > slf4j/impl/StaticLoggerBinder.class] > > > >>>> > >>> >>> > SLF4J: See http://www.slf4j.org/codes.htm > > > >>>> l#multiple_bindings for > > > >>>> > >>> an > > > >>>> > >>> >>> > explanation. > > > >>>> > >>> >>> > [localhost-startStop-1]:[2015-02-17 > > > >>>> 19:57:43,051][ERROR][org. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > >>>> > >>> >>>springframework.web.context.ContextLoader. > > > >>>> > >>> initWebApplicationContext(Cont > > > >>>> > >>> >>>extLoader.java:307)] > > > >>>> > >>> >>> > - Context initialization failed > > > >>>> > >>> >>> > > org.springframework.beans.factory.BeanCreationException: > > > >>>> Error > > > >>>> > >>> >>>creating > > > >>>> > >>> >>> > bean with name 'com.ryantenney.metrics.spring. > > > >>>> > >>> >>> > MetricsBeanPostProcessorFactory#0': BeanPostProcessor > > > >>>> before > > > >>>> > >>> >>> > instantiation of bean failed; nested exception is > > > >>>> > >>> >>> org.springframework.beans.factory.BeanCreationException: > > > >>>> > >>> >>> > Error creating bean with name > > > >>>> > >>> >>> 'org.springframework.cache.config.internalCacheAdvisor': > > > >>>> > >>> >>> > Cannot resolve reference to bean > > > >>>> > >>> >>>'org.springframework.cache.annotation. > > > >>>> > >>> >>> > AnnotationCacheOperationSource#0' while setting bean > > > >>>> property > > > >>>> > >>> >>> > 'cacheOperationSource'; nested exception is > > > >>>> > >>> >>> org.springframework.beans.factory.BeanCreationException: > > > >>>> > >>> >>> > Error creating bean with name > > 'org.springframework.cache. > > > >>>> > >>> annotation. > > > >>>> > >>> >>> > AnnotationCacheOperationSource#0': BeanPostProcessor > > > before > > > >>>> > >>> >>> instantiation > > > >>>> > >>> >>> > of bean failed; nested exception is > > > >>>> > >>> >>> org.springframework.beans.factory.BeanCreationException: > > > >>>> > >>> >>> > Error creating bean with name > > > 'org.springframework.security. > > > >>>> > >>> >>> > methodSecurityMetadataSourceAdvisor': Cannot resolve > > > >>>> reference > > > >>>> > to > > > >>>> > >>> >>>bean > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > > >>>> > >>> >>>'org.springframework.security.access.method. > > > >>>> > >>> DelegatingMethodSecurityMeta > > > >>>> > >>> >>>dataSource#0' > > > >>>> > >>> >>> > while setting constructor argument; nested exception > is > > > >>>> > >>> >>> > > org.springframework.beans.factory.BeanCreationException: > > > >>>> Error > > > >>>> > >>> >>>creating > > > >>>> > >>> >>> > bean with name > > > 'org.springframework.security.access.method. > > > >>>> > >>> >>> > DelegatingMethodSecurityMetadataSource#0': Cannot > create > > > >>>> inner > > > >>>> > >>> bean > > > >>>> > >>> >>> > '(inner bean)' of type [org.springframework.security. > > > >>>> > >>> access.prepost. > > > >>>> > >>> >>> > PrePostAnnotationSecurityMetadataSource] while setting > > > >>>> > constructor > > > >>>> > >>> >>> > argument with key [0]; nested exception is > > > >>>> > >>> >>> org.springframework.beans.factory.BeanCreationException: > > > >>>> > >>> >>> > Error creating bean with name '(inner bean)': Cannot > > > create > > > >>>> inner > > > >>>> > >>> >>>bean > > > >>>> > >>> >>> > '(inner bean)' of type [org.springframework.security. > > > >>>> > >>> >>> > > access.expression.method.ExpressionBasedAnnotationAttri > > > >>>> > >>> buteFactory] > > > >>>> > >>> >>> while > > > >>>> > >>> >>> > setting constructor argument; nested exception is > > > >>>> > >>> >>> org.springframework.beans.factory.BeanCreationException: > > > >>>> > >>> >>> > Error creating bean with name '(inner bean)': Cannot > > > resolve > > > >>>> > >>> >>>reference > > > >>>> > >>> >>> to > > > >>>> > >>> >>> > bean 'expressionHandler' while setting constructor > > > argument; > > > >>>> > nested > > > >>>> > >>> >>> > exception is org.springframework.beans. > > > >>>> > >>> factory.BeanCreationException: > > > >>>> > >>> >>> > Error creating bean with name 'expressionHandler' > > defined > > > in > > > >>>> > class > > > >>>> > >>> >>>path > > > >>>> > >>> >>> > resource [kylinSecurity.xml]: Cannot resolve reference > > to > > > >>>> bean > > > >>>> > >>> >>> > 'permissionEvaluator' while setting bean property > > > >>>> > >>> >>>'permissionEvaluator'; > > > >>>> > >>> >>> > nested exception is > > > >>>> > >>> >>> org.springframework.beans.factory.BeanCreationException: > > > >>>> > >>> >>> > Error creating bean with name 'permissionEvaluator' > > > defined > > > >>>> in > > > >>>> > >>> class > > > >>>> > >>> >>> path > > > >>>> > >>> >>> > resource [kylinSecurity.xml]: Cannot resolve reference > > to > > > >>>> bean > > > >>>> > >>> >>> 'aclService' > > > >>>> > >>> >>> > while setting constructor argument; nested exception > is > > > >>>> > >>> >>> > > org.springframework.beans.factory.BeanCreationException: > > > >>>> Error > > > >>>> > >>> >>>creating > > > >>>> > >>> >>> > bean with name 'aclService' defined in file > > > >>>> [/home/santosh/work/ > > > >>>> > >>> >>> > frameworks/kylin/tomcat/webapps/kylin/WEB-INF/classes/ > > > >>>> > >>> >>> > org/apache/kylin/rest/service/AclService.class]: > > > >>>> Instantiation > > > >>>> > of > > > >>>> > >>> >>>bean > > > >>>> > >>> >>> > failed; nested exception is > > > >>>> > >>> >>> org.springframework.beans.BeanInstantiationException: > > > >>>> > >>> >>> > Could not instantiate bean class > > > >>>> > >>> >>> [org.apache.kylin.rest.service.AclService]: > > > >>>> > >>> >>> > Constructor threw exception; nested exception is > > > >>>> > >>> >>> org.apache.kylin.common.persistence.StorageException: > > > >>>> > >>> >>> > Error when open connection hbase > > > >>>> > >>> >>> > at org.springframework.beans.factory.support. > > > >>>> > >>> >>> > AbstractAutowireCapableBeanFactory.createBean( > > > >>>> > >>> >>> > AbstractAutowireCapableBeanFactory.java:452) > > > >>>> > >>> >>> > at org.springframework.beans.factory.support. > > > >>>> > >>> AbstractBeanFactory$1. > > > >>>> > >>> >>> > getObject(AbstractBeanFactory.java:294) > > > >>>> > >>> >>> > at > > > >>>> > >>> >>> org.springframework.beans.factory.support. > > > >>>> > >>> DefaultSingletonBeanRegistry. > > > >>>> > >>> >>> > getSingleton(DefaultSingletonBeanRegistry.java:225) > > > >>>> > >>> >>> > at org.springframework.beans.factory.support. > > > >>>> > >>> >>> > > > > AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291) > > > >>>> > >>> >>> > at > > > >>>> > >>> >>> org.springframework.beans.factory.support. > > > >>>> > >>> AbstractBeanFactory.getBean( > > > >>>> > >>> >>> > AbstractBeanFactory.java:197) > > > >>>> > >>> >>> > at org.springframework.context.support. > > > >>>> > AbstractApplicationContext. > > > >>>> > >>> >>> > > > > registerBeanPostProcessors(AbstractApplicationContext.java: > > > >>>> 745) > > > >>>> > >>> >>> > at > > > >>>> > >>> >>> > > org.springframework.context.support.AbstractApplicationConte > > > >>>> xt. > > > >>>> > >>> refresh( > > > >>>> > >>> >>> > AbstractApplicationContext.java:454) > > > >>>> > >>> >>> > at org.springframework.web.context.ContextLoader. > > > >>>> > >>> >>> > configureAndRefreshWebApplicat > > > >>>> ionContext(ContextLoader.java:383) > > > >>>> > >>> >>> > at org.springframework.web.context.ContextLoader. > > > >>>> > >>> >>> > initWebApplicationContext(ContextLoader.java:283) > > > >>>> > >>> >>> > at > > org.springframework.web.context.ContextLoaderListener. > > > >>>> > >>> >>> > contextInitialized(ContextLoaderListener.java:111) > > > >>>> > >>> >>> > at > > org.apache.catalina.core.StandardContext.listenerStart( > > > >>>> > >>> >>> > StandardContext.java:5016) > > > >>>> > >>> >>> > at > > org.apache.catalina.core.StandardContext.startInternal( > > > >>>> > >>> >>> > StandardContext.java:5524) > > > >>>> > >>> >>> > at > > > >>>> > >>> >>>org.apache.catalina.util.LifecycleBase.start( > > > >>>> > LifecycleBase.java:150) > > > >>>> > >>> >>> > at > > > org.apache.catalina.core.ContainerBase.addChildInternal( > > > >>>> > >>> >>> > ContainerBase.java:901) > > > >>>> > >>> >>> > at > > > >>>> > >>> >>> org.apache.catalina.core.ContainerBase.addChild( > > > >>>> > >>> ContainerBase.java:877) > > > >>>> > >>> >>> > at > > > >>>> > >>> >>>org.apache.catalina.core.StandardHost.addChild( > > > >>>> > StandardHost.java:649) > > > >>>> > >>> >>> > at > > > >>>> > >>> >>> org.apache.catalina.startup.HostConfig.deployWAR( > > > >>>> > >>> HostConfig.java:1081) > > > >>>> > >>> >>> > at > org.apache.catalina.startup.HostConfig$DeployWar.run( > > > >>>> > >>> >>> > HostConfig.java:1877) > > > >>>> > >>> >>> > at > > > >>>> > >>> >>> java.util.concurrent.Executors$RunnableAdapter. > > > >>>> > >>> call(Executors.java:471) > > > >>>> > >>> >>> > at > > > java.util.concurrent.FutureTask.run(FutureTask.java:262) > > > >>>> > >>> >>> > at java.util.concurrent.ThreadPoolExecutor.runWorker( > > > >>>> > >>> >>> > ThreadPoolExecutor.java:1145) > > > >>>> > >>> >>> > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > > > >>>> > >>> >>> > ThreadPoolExecutor.java:615) > > > >>>> > >>> >>> > at java.lang.Thread.run(Thread.java:745) > > > >>>> > >>> >>> > Caused by: org.springframework.beans. > > > >>>> > >>> factory.BeanCreationException: > > > >>>> > >>> >>> Error > > > >>>> > >>> >>> > creating bean with name > > > >>>> > >>> >>> 'org.springframework.cache.config.internalCacheAdvisor': > > > >>>> > >>> >>> > Cannot resolve reference to bean > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > On Fri Feb 13 2015 at 8:32:48 PM Zhou, Qianhao < > > > >>>> > [email protected] > > > >>>> > >>> >>> <mailto: > > > >>>> > >>> >>> > [email protected]>> wrote: > > > >>>> > >>> >>> > You should create your own table in hive. > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > 2015年2月13日 下午10:47于 Santosh Akhilesh > > > >>>> > >>> >>><[email protected]<mailto: > > > >>>> > >>> >>> > [email protected]>>写道： > > > >>>> > >>> >>> > Oh thanks. You mean I should create my own table > schema > > > and > > > >>>> > insert > > > >>>> > >>> >>>data > > > >>>> > >>> >>> and > > > >>>> > >>> >>> > then need to import? > > > >>>> > >>> >>> > Does it mean I should create tables in hbase ? Any > > > specific > > > >>>> > >>> location > > > >>>> > >>> >>>? > > > >>>> > >>> >>> I am > > > >>>> > >>> >>> > quite new to hbase and hive so may be I have many > silly > > > >>>> > questions. > > > >>>> > >>> >>> > On Fri, 13 Feb 2015 at 8:05 pm, 周千昊 < > > [email protected] > > > >>>> <mailto: > > > >>>> > z. > > > >>>> > >>> >>> > [email protected]>> wrote: > > > >>>> > >>> >>> > > > > >>>> > >>> >>> > > Hi Santosh, > > > >>>> > >>> >>> > > As you have setup a new hadoop environment, so > > > there > > > >>>> is no > > > >>>> > >>> >>>data > > > >>>> > >>> >>> in > > > >>>> > >>> >>> > > hive. And we have not provided standalone data pack > > for > > > >>>> this > > > >>>> > >>> >>> situation. > > > >>>> > >>> >>> > > That means you have to manually import the data into > > > hive > > > >>>> > table. > > > >>>> > >>> >>> > > > > > >>>> > >>> >>> > > On Fri Feb 13 2015 at 10:26:57 PM Santosh Akhilesh < > > > >>>> > >>> >>> > > [email protected]<mailto: > > santoshakhilesh@gmail. > > > >>>> com>> > > > >>>> > >>> wrote: > > > >>>> > >>> >>> > > > > > >>>> > >>> >>> > > > I have seen this link but my question is how to > get > > > EDW > > > >>>> data > > > >>>> > >>> >>>source > > > >>>> > >>> >>> as > > > >>>> > >>> >>> > > > mentioned in tutorial > > > >>>> > >>> >>> > > > On Fri, 13 Feb 2015 at 7:41 pm, 周千昊 > > > >>>> > >>> >>><[email protected]<mailto:z. > > > >>>> > >>> >>> > [email protected]>> wrote: > > > >>>> > >>> >>> > > > > > > >>>> > >>> >>> > > > > Hi, Santosh > > > >>>> > >>> >>> > > > > There is a tutorial about how to create a > > cube: > > > >>>> > >>> >>> > > > > https://github.com/KylinOLAP/K > > > >>>> ylin/wiki/Kylin-Cube- > > > >>>> > >>> >>> > > > Creation-Tutorial > > > >>>> > >>> >>> > > > > > > > >>>> > >>> >>> > > > > On Fri Feb 13 2015 at 10:05:55 PM Santosh > > Akhilesh < > > > >>>> > >>> >>> > > > > [email protected]<mailto: > > > >>>> [email protected] > > > >>>> > >> > > > >>>> > >>> >>> wrote: > > > >>>> > >>> >>> > > > > > > > >>>> > >>> >>> > > > > > Hi Zhou, > > > >>>> > >>> >>> > > > > > Yes I understand. I was wondering how do I use > > the > > > >>>> create > > > >>>> > >>> >>>cube > > > >>>> > >>> >>> > > > tutorial. > > > >>>> > >>> >>> > > > > If > > > >>>> > >>> >>> > > > > > there are some sample tables exist for me to > try > > > >>>> out the > > > >>>> > >>> >>>sample > > > >>>> > >>> >>> > cube > > > >>>> > >>> >>> > > > > > described in tutorial. I am quite new to these > > > >>>> stuffs so > > > >>>> > if > > > >>>> > >>> >>>you > > > >>>> > >>> >>> can > > > >>>> > >>> >>> > > > give > > > >>>> > >>> >>> > > > > me > > > >>>> > >>> >>> > > > > > pointers about how do I create sample hive > > tables > > > >>>> and > > > >>>> > >>> import > > > >>>> > >>> >>>it > > > >>>> > >>> >>> > would > > > >>>> > >>> >>> > > > be > > > >>>> > >>> >>> > > > > > great. Thanks for your quick responses. I know > > in > > > >>>> China > > > >>>> > you > > > >>>> > >>> >>>have > > > >>>> > >>> >>> > > spring > > > >>>> > >>> >>> > > > > > holidays but you guys still working :) > > > >>>> > >>> >>> > > > > > Regards > > > >>>> > >>> >>> > > > > > Santosh > > > >>>> > >>> >>> > > > > > On Fri, 13 Feb 2015 at 7:13 pm, Zhou, Qianhao > < > > > >>>> > >>> >>> [email protected] > > > >>>> > >>> >>> > <mailto:[email protected]>> > > > >>>> > >>> >>> > > > wrote: > > > >>>> > >>> >>> > > > > > > > > >>>> > >>> >>> > > > > > > Hi Santosh > > > >>>> > >>> >>> > > > > > > Kylin is not responsible for source of > the > > > >>>> data, > > > >>>> > >>> >>>however > > > >>>> > >>> >>> you > > > >>>> > >>> >>> > > can > > > >>>> > >>> >>> > > > > > > import table from your hive table, there is > a > > > tab > > > >>>> in > > > >>>> > the > > > >>>> > >>> >>>web > > > >>>> > >>> >>> ui > > > >>>> > >>> >>> > > > called > > > >>>> > >>> >>> > > > > > > table, you can import the table there > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > 2015年2月13日 下午9:33于 Santoshakhilesh < > > > >>>> > >>> >>> [email protected]< > > > >>>> > >>> >>> > mailto:[email protected]>> > > > >>>> > >>> >>> > > 写道： > > > >>>> > >>> >>> > > > > > > I saw the following link about creating the > > > cube. > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > https://github.com/KylinOLAP/K > > > >>>> ylin/wiki/Kylin-Cube- > > > >>>> > >>> >>> > > Creation-Tutorial > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > In this there is already source table EDW > > exist > > > , > > > >>>> But > > > >>>> > in > > > >>>> > >>> my > > > >>>> > >>> >>> > > > environment > > > >>>> > >>> >>> > > > > > > there is no such table. > > > >>>> > >>> >>> > > > > > > How can I create this table manually or I > need > > > to > > > >>>> > export > > > >>>> > >>> >>>from > > > >>>> > >>> >>> > > > > somewhere ? > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > Also , how do I insert tables , data in > table > > > >>>> when I > > > >>>> > >>> start > > > >>>> > >>> >>> > creating > > > >>>> > >>> >>> > > > my > > > >>>> > >>> >>> > > > > > own > > > >>>> > >>> >>> > > > > > > cubes and tables ? > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > Regards, > > > >>>> > >>> >>> > > > > > > Santosh Akhilesh > > > >>>> > >>> >>> > > > > > > Bangalore R&D > > > >>>> > >>> >>> > > > > > > HUAWEI TECHNOLOGIES CO.,LTD. > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>>www.huawei.com<http://www.huawei.com>< > > http://www.huawei.com> > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> > > >>>------------------------------------------------------------ > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> > > >>>------------------------------------------------------------ > > > >>>> > >>> >>> > > > > > ------------- > > > >>>> > >>> >>> > > > > > > This e-mail and its attachments contain > > > >>>> confidential > > > >>>> > >>> >>> information > > > >>>> > >>> >>> > > from > > > >>>> > >>> >>> > > > > > > HUAWEI, which > > > >>>> > >>> >>> > > > > > > is intended only for the person or entity > > whose > > > >>>> address > > > >>>> > >>> is > > > >>>> > >>> >>> listed > > > >>>> > >>> >>> > > > > above. > > > >>>> > >>> >>> > > > > > > Any use of the > > > >>>> > >>> >>> > > > > > > information contained herein in any way > > > >>>> (including, but > > > >>>> > >>> not > > > >>>> > >>> >>> > limited > > > >>>> > >>> >>> > > > to, > > > >>>> > >>> >>> > > > > > > total or partial > > > >>>> > >>> >>> > > > > > > disclosure, reproduction, or dissemination) > by > > > >>>> persons > > > >>>> > >>> >>>other > > > >>>> > >>> >>> than > > > >>>> > >>> >>> > > the > > > >>>> > >>> >>> > > > > > > intended > > > >>>> > >>> >>> > > > > > > recipient(s) is prohibited. If you receive > > this > > > >>>> e-mail > > > >>>> > in > > > >>>> > >>> >>> error, > > > >>>> > >>> >>> > > > please > > > >>>> > >>> >>> > > > > > > notify the sender by > > > >>>> > >>> >>> > > > > > > phone or email immediately and delete it! > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > ________________________________________ > > > >>>> > >>> >>> > > > > > > From: Santoshakhilesh [ > > > >>>> [email protected]< > > > >>>> > >>> mailto: > > > >>>> > >>> >>> > [email protected]>] > > > >>>> > >>> >>> > > > > > > Sent: Friday, February 13, 2015 5:40 PM > > > >>>> > >>> >>> > > > > > > To: > > > >>>> > >>> >>>[email protected]<mailto: > [email protected] > > > >>>> > >>> >>> . > > > >>>> > >>> >>> > apache.org> > > > >>>> > >>> >>> > > > > > > Subject: RE: About building kylin > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > Hi Zhou, > > > >>>> > >>> >>> > > > > > > Thanks a million, it was hbase issue , > now > > I > > > >>>> am able > > > >>>> > >>> to > > > >>>> > >>> >>> login > > > >>>> > >>> >>> > to > > > >>>> > >>> >>> > > > > main > > > >>>> > >>> >>> > > > > > > interface page. > > > >>>> > >>> >>> > > > > > > In the documents I see a section of > > building > > > >>>> cubes. > > > >>>> > >>> are > > > >>>> > >>> >>> there > > > >>>> > >>> >>> > > any > > > >>>> > >>> >>> > > > > > > sample cubles I can try with ? > > > >>>> > >>> >>> > > > > > > Can you please tell me where can I get > them > > > and > > > >>>> > steps > > > >>>> > >>> to > > > >>>> > >>> >>> > import > > > >>>> > >>> >>> > > > and > > > >>>> > >>> >>> > > > > > > query them. > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > Regards, > > > >>>> > >>> >>> > > > > > > Santosh Akhilesh > > > >>>> > >>> >>> > > > > > > Bangalore R&D > > > >>>> > >>> >>> > > > > > > HUAWEI TECHNOLOGIES CO.,LTD. > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>>www.huawei.com<http://www.huawei.com>< > > http://www.huawei.com> > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> > > >>>------------------------------------------------------------ > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> > > >>>------------------------------------------------------------ > > > >>>> > >>> >>> > > > > > ------------- > > > >>>> > >>> >>> > > > > > > This e-mail and its attachments contain > > > >>>> confidential > > > >>>> > >>> >>> information > > > >>>> > >>> >>> > > from > > > >>>> > >>> >>> > > > > > > HUAWEI, which > > > >>>> > >>> >>> > > > > > > is intended only for the person or entity > > whose > > > >>>> address > > > >>>> > >>> is > > > >>>> > >>> >>> listed > > > >>>> > >>> >>> > > > > above. > > > >>>> > >>> >>> > > > > > > Any use of the > > > >>>> > >>> >>> > > > > > > information contained herein in any way > > > >>>> (including, but > > > >>>> > >>> not > > > >>>> > >>> >>> > limited > > > >>>> > >>> >>> > > > to, > > > >>>> > >>> >>> > > > > > > total or partial > > > >>>> > >>> >>> > > > > > > disclosure, reproduction, or dissemination) > by > > > >>>> persons > > > >>>> > >>> >>>other > > > >>>> > >>> >>> than > > > >>>> > >>> >>> > > the > > > >>>> > >>> >>> > > > > > > intended > > > >>>> > >>> >>> > > > > > > recipient(s) is prohibited. If you receive > > this > > > >>>> e-mail > > > >>>> > in > > > >>>> > >>> >>> error, > > > >>>> > >>> >>> > > > please > > > >>>> > >>> >>> > > > > > > notify the sender by > > > >>>> > >>> >>> > > > > > > phone or email immediately and delete it! > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > ________________________________________ > > > >>>> > >>> >>> > > > > > > From: Santoshakhilesh [ > > > >>>> [email protected]< > > > >>>> > >>> mailto: > > > >>>> > >>> >>> > [email protected]>] > > > >>>> > >>> >>> > > > > > > Sent: Friday, February 13, 2015 2:38 PM > > > >>>> > >>> >>> > > > > > > To: > > > >>>> > >>> >>>[email protected]<mailto: > [email protected] > > > >>>> > >>> >>> . > > > >>>> > >>> >>> > apache.org> > > > >>>> > >>> >>> > > > > > > Cc: Kulbhushan Rana > > > >>>> > >>> >>> > > > > > > Subject: RE: About building kylin > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > Hi Zhou, > > > >>>> > >>> >>> > > > > > > The exceptions I see are below , So it > > seems > > > >>>> Kylin > > > >>>> > >>> >>> instance > > > >>>> > >>> >>> > is > > > >>>> > >>> >>> > > > not > > > >>>> > >>> >>> > > > > > > deployed correctly; > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > WARNING: Failed to scan > > > >>>> > >>> >>> [file:/contrib/capacity-scheduler/*.jar] > > > >>>> > >>> >>> > > > from > > > >>>> > >>> >>> > > > > > > classloader hierarchy > > > >>>> > >>> >>> > > > > > > java.io.FileNotFoundException: > > > >>>> > >>> >>> /contrib/capacity-scheduler/*.jar > > > >>>> > >>> >>> > > (No > > > >>>> > >>> >>> > > > > > such > > > >>>> > >>> >>> > > > > > > file or directory) > > > >>>> > >>> >>> > > > > > > at java.util.zip.ZipFile.open(Native > Method) > > > >>>> > >>> >>> > > > > > > at java.util.zip.ZipFile.<init>(Z > > > >>>> ipFile.java:215) > > > >>>> > >>> >>> > > > > > > at java.util.zip.ZipFile.<init>(Z > > > >>>> ipFile.java:145) > > > >>>> > >>> >>> > > > > > > at java.util.jar.JarFile.<init>(J > > > >>>> arFile.java:154) > > > >>>> > >>> >>> > > > > > > at > > > java.util.jar.JarFile.<init>(JarFile.java:91) > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > Feb 13, 2015 10:27:32 PM > > > >>>> org.apache.catalina.startup. > > > >>>> > >>> >>> > ContextConfig > > > >>>> > >>> >>> > > > > > > processResourceJARs > > > >>>> > >>> >>> > > > > > > SEVERE: Failed to processes JAR found at URL > > > >>>> > >>> >>> > > > > [jar:file:/contrib/capacity- > > > >>>> > >>> >>> > > > > > scheduler/*.jar!/] > > > >>>> > >>> >>> > > > > > > for static resources to be included in > context > > > >>>> with > > > >>>> > name > > > >>>> > >>> >>> > > > > > > > [jar:file:/contrib/capacity-scheduler/*.jar!/] > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > resource loaded through InputStream > > > >>>> > >>> >>> > > > > > > [localhost-startStop-1]:[2015-02-13 > > > >>>> > >>> >>>22:27:34,475][WARN][org. > > > >>>> > >>> >>> > > > > > > apache.kylin.common.KylinConfig. > > > >>>> getKylinProperties( > > > >>>> > >>> >>> > > > > > KylinConfig.java:527)] > > > >>>> > >>> >>> > > > > > > - KYLIN_CONF_HOME has not been set > > > >>>> > >>> >>> > > > > > > 2015-02-13 22:27:34,919 INFO > > > >>>> [localhost-startStop-1] > > > >>>> > >>> >>> zookeeper. > > > >>>> > >>> >>> > > > > > RecoverableZooKeeper: > > > >>>> > >>> >>> > > > > > > Process identifier=hconnection-0x2b5a652e > > > >>>> connecting > > > >>>> > to > > > >>>> > >>> >>> > ZooKeeper > > > >>>> > >>> >>> > > > > > > ensemble=localhost:2181 > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > 2015-02-13 22:27:34,958 INFO > > > >>>> [localhost-startStop-1- > > > >>>> > >>> >>> > > > > > SendThread(localhost:2181)] > > > >>>> > >>> >>> > > > > > > zookeeper.ClientCnxn: Opening socket > > connection > > > to > > > >>>> > server > > > >>>> > >>> >>> > > > > > > localhost/0:0:0:0:0:0:0:1:2181. Will not > > attempt > > > >>>> to > > > >>>> > >>> >>> authenticate > > > >>>> > >>> >>> > > > using > > > >>>> > >>> >>> > > > > > > SASL (unknown error) > > > >>>> > >>> >>> > > > > > > 2015-02-13 22:27:34,965 WARN > > > >>>> [localhost-startStop-1- > > > >>>> > >>> >>> > > > > > SendThread(localhost:2181)] > > > >>>> > >>> >>> > > > > > > zookeeper.ClientCnxn: Session 0x0 for server > > > null, > > > >>>> > >>> >>>unexpected > > > >>>> > >>> >>> > > error, > > > >>>> > >>> >>> > > > > > > closing socket connection and attempting > > > reconnect > > > >>>> > >>> >>> > > > > > > java.net.ConnectException: Connection > refused > > > >>>> > >>> >>> > > > > > > at sun.nio.ch.SocketChannelImpl.c > > > >>>> heckConnect(Native > > > >>>> > >>> >>>Method) > > > >>>> > >>> >>> > > > > > > at > > sun.nio.ch.SocketChannelImpl.finishConnect( > > > >>>> > >>> >>> > > > > > SocketChannelImpl.java:739) > > > >>>> > >>> >>> > > > > > > at > org.apache.zookeeper.ClientCnxnSocketNIO. > > > >>>> > >>> doTransport( > > > >>>> > >>> >>> > > > > > > ClientCnxnSocketNIO.java:361) > > > >>>> > >>> >>> > > > > > > at org.apache.zookeeper.ClientCnx > > > >>>> n$SendThread.run( > > > >>>> > >>> >>> > > > > ClientCnxn.java:1081) > > > >>>> > >>> >>> > > > > > > 2015-02-13 22:27:35,070 INFO > > > >>>> [localhost-startStop-1- > > > >>>> > >>> >>> > > > > > SendThread(localhost:2181)] > > > >>>> > >>> >>> > > > > > > zookeeper.ClientCnxn: Opening socket > > connection > > > to > > > >>>> > server > > > >>>> > >>> >>> > > localhost/ > > > >>>> > >>> >>> > > > > > > 127.0.0.1:2181<http://127.0.0.1:2181>. Will > > not > > > >>>> > attempt > > > >>>> > >>> to > > > >>>> > >>> >>> > authenticate using SASL > > > >>>> > >>> >>> > > (unknown > > > >>>> > >>> >>> > > > > > > error) > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > 2015-02-13 22:27:51,920 WARN > > > >>>> [localhost-startStop-1] > > > >>>> > >>> >>> zookeeper. > > > >>>> > >>> >>> > > > > > RecoverableZooKeeper: > > > >>>> > >>> >>> > > > > > > Possibly transient ZooKeeper, > > > >>>> quorum=localhost:2181, > > > >>>> > >>> >>> > > > > > exception=org.apache. > > > >>>> > >>> >>> > > > > > > zookeeper.KeeperException$Conn > > > >>>> ectionLossException: > > > >>>> > >>> >>> > > KeeperErrorCode = > > > >>>> > >>> >>> > > > > > > ConnectionLoss for /hbase/hbaseid > > > >>>> > >>> >>> > > > > > > 2015-02-13 22:27:51,921 ERROR > > > >>>> [localhost-startStop-1] > > > >>>> > >>> >>> zookeeper. > > > >>>> > >>> >>> > > > > > RecoverableZooKeeper: > > > >>>> > >>> >>> > > > > > > ZooKeeper exists failed after 4 attempts > > > >>>> > >>> >>> > > > > > > 2015-02-13 22:27:51,921 WARN > > > >>>> [localhost-startStop-1] > > > >>>> > >>> >>> > > > zookeeper.ZKUtil: > > > >>>> > >>> >>> > > > > > > hconnection-0x2b5a652e, > quorum=localhost:2181, > > > >>>> > >>> >>> baseZNode=/hbase > > > >>>> > >>> >>> > > > Unable > > > >>>> > >>> >>> > > > > to > > > >>>> > >>> >>> > > > > > > set watcher on znode (/hbase/hbaseid) > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> > > >>>org.apache.zookeeper.KeeperException$ConnectionLossException: > > > >>>> > >>> >>> > > > > > > KeeperErrorCode = ConnectionLoss for > > > >>>> /hbase/hbaseid > > > >>>> > >>> >>> > > > > > > at > > org.apache.zookeeper.KeeperException.create( > > > >>>> > >>> >>> > > > > KeeperException.java:99) > > > >>>> > >>> >>> > > > > > > at > > org.apache.zookeeper.KeeperException.create( > > > >>>> > >>> >>> > > > > KeeperException.java:51) > > > >>>> > >>> >>> > > > > > > at > > > >>>> > >>> > >>>org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045) > > > >>>> > >>> >>> > > > > > > at org.apache.hadoop.hbase.zookeeper. > > > >>>> > >>> >>> > RecoverableZooKeeper.exists( > > > >>>> > >>> >>> > > > > > > RecoverableZooKeeper.java:222) > > > >>>> > >>> >>> > > > > > > at org.apache.hadoop.hbase. > > > >>>> > >>> zookeeper.ZKUtil.checkExists( > > > >>>> > >>> >>> > > > > > ZKUtil.java:479) > > > >>>> > >>> >>> > > > > > > at org.apache.hadoop.hbase.zookee > > > >>>> per.ZKClusterId. > > > >>>> > >>> >>> > > > readClusterIdZNode( > > > >>>> > >>> >>> > > > > > > ZKClusterId.java:65) > > > >>>> > >>> >>> > > > > > > at org.apache.hadoop.hbase.client > > > >>>> .ZooKeeperRegistry. > > > >>>> > >>> >>> > getClusterId( > > > >>>> > >>> >>> > > > > > > ZooKeeperRegistry.java:83) > > > >>>> > >>> >>> > > > > > > at org.apache.hadoop.hbase.client > > > >>>> .HConnectionManager$ > > > >>>> > >>> >>> > > > > > > HConnectionImplementation.retrieveClusterId( > > > >>>> > >>> >>> > > > > HConnectionManager.java:897) > > > >>>> > >>> >>> > > > > > > at org.apache.hadoop.hbase.client > > > >>>> .HConnectionManager$ > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> > > >>>HConnectionImplementation.<init>(HConnectionManager.java:694) > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > Regards, > > > >>>> > >>> >>> > > > > > > Santosh Akhilesh > > > >>>> > >>> >>> > > > > > > Bangalore R&D > > > >>>> > >>> >>> > > > > > > HUAWEI TECHNOLOGIES CO.,LTD. > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>>www.huawei.com<http://www.huawei.com>< > > http://www.huawei.com> > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> > > >>>------------------------------------------------------------ > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> > > >>>------------------------------------------------------------ > > > >>>> > >>> >>> > > > > > ------------- > > > >>>> > >>> >>> > > > > > > This e-mail and its attachments contain > > > >>>> confidential > > > >>>> > >>> >>> information > > > >>>> > >>> >>> > > from > > > >>>> > >>> >>> > > > > > > HUAWEI, which > > > >>>> > >>> >>> > > > > > > is intended only for the person or entity > > whose > > > >>>> address > > > >>>> > >>> is > > > >>>> > >>> >>> listed > > > >>>> > >>> >>> > > > > above. > > > >>>> > >>> >>> > > > > > > Any use of the > > > >>>> > >>> >>> > > > > > > information contained herein in any way > > > >>>> (including, but > > > >>>> > >>> not > > > >>>> > >>> >>> > limited > > > >>>> > >>> >>> > > > to, > > > >>>> > >>> >>> > > > > > > total or partial > > > >>>> > >>> >>> > > > > > > disclosure, reproduction, or dissemination) > by > > > >>>> persons > > > >>>> > >>> >>>other > > > >>>> > >>> >>> than > > > >>>> > >>> >>> > > the > > > >>>> > >>> >>> > > > > > > intended > > > >>>> > >>> >>> > > > > > > recipient(s) is prohibited. If you receive > > this > > > >>>> e-mail > > > >>>> > in > > > >>>> > >>> >>> error, > > > >>>> > >>> >>> > > > please > > > >>>> > >>> >>> > > > > > > notify the sender by > > > >>>> > >>> >>> > > > > > > phone or email immediately and delete it! > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > ________________________________________ > > > >>>> > >>> >>> > > > > > > From: Zhou, Qianhao [[email protected] > > <mailto: > > > >>>> > >>> >>> [email protected] > > > >>>> > >>> >>> > >] > > > >>>> > >>> >>> > > > > > > Sent: Friday, February 13, 2015 2:07 PM > > > >>>> > >>> >>> > > > > > > To: > > > >>>> > >>> >>>[email protected]<mailto: > [email protected] > > > >>>> > >>> >>> . > > > >>>> > >>> >>> > apache.org> > > > >>>> > >>> >>> > > > > > > Subject: Re: About building kylin > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > Hi, Santosh > > > >>>> > >>> >>> > > > > > > Please check tomcat/logs/kylin.log to see if > > > >>>> there is > > > >>>> > any > > > >>>> > >>> >>> > exception > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > Best Regard > > > >>>> > >>> >>> > > > > > > Zhou QianHao > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > On 2/13/15, 4:24 PM, "Santoshakhilesh" < > > > >>>> > >>> >>> > > [email protected]<mailto: > santosh.akhilesh@ > > > >>>> huawei.com > > > >>>> > >> > > > >>>> > >>> >>> > > > > > > wrote: > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>> > > > > > > >Hi Zhou, > > > >>>> > >>> >>> > > > > > > > I am able to access the > > > >>>> > >>> http://127.0.0.17070/kylin > > > >>>> > >>> >>> using > > > >>>> > >>> >>> > > > > firefox > > > >>>> > >>> >>> > > > > > > > All I get is a blank page , its not > > 404 , > > > >>>> it > > > >>>> > >>> means I > > > >>>> > >>> >>> could > > > >>>> > >>> >>> > > > > connect > > > >>>> > >>> >>> > > > > > > >to web server successfully but there is > some > > > >>>> issue in > > > >>>> > >>> >>> > rendering. I > > > >>>> > >>> >>> > > > was > > > >>>> > >>> >>> > > > > > > >noty asked for user name and password. > > > >>>> > >>> >>> > > > > > > > When I run start kylin shell file , > > > >>>> following > > > >>>> > >>> >>>prompt > > > >>>> > >>> >>> > really > > > >>>> > >>> >>> > > > > means > > > >>>> > >>> >>> > > > > > > >everuthing went ok , or I should check some > > log > > > >>>> files > > > >>>> > to > > > >>>> > >>> >>>know > > > >>>> > >>> >>> > the > > > >>>> > >>> >>> > > > real > > > >>>> > >>> >>> > > > > > > >status ? > > > >>>> > >>> >>> > > > > > > >A new Kylin instance is started by root, > stop > > > it > > > >>>> using > > > >>>> > >>> >>> > > > "stop-kylin.sh" > > > >>>> > >>> >>> > > > > > > >Please visit http:// > > > <your_sandbox_ip>:7070/kylin > > > >>>> to > > > >>>> > >>> play > > > >>>> > >>> >>> with > > > >>>> > >>> >>> > the > > > >>>> > >>> >>> > > > > > cubes! > > > >>>> > >>> >>> > > > > > > > > > > >>>> > >>> >>> > > > > > > >Regards, > > > >>>> > >>> >>> > > > > > > >Santosh Akhilesh > > > >>>> > >>> >>> > > > > > > >Bangalore R&D > > > >>>> > >>> >>> > > > > > > >HUAWEI TECHNOLOGIES CO.,LTD. > > > >>>> > >>> >>> > > > > > > > > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>>>www.huawei.com<http://www.huawei.com>< > > http://www.huawei.com > > > > > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> > > >>>>----------------------------------------------------------- > > > >>>> > >>> >>> > > > > > > --------------- > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> > > >>>>----------------------------------------------------------- > > > >>>> > >>> >>> > > > > > > >This e-mail and its attachments contain > > > >>>> confidential > > > >>>> > >>> >>> information > > > >>>> > >>> >>> > > > from > > > >>>> > >>> >>> > > > > > > >HUAWEI, which > > > >>>> > >>> >>> > > > > > > >is intended only for the person or entity > > whose > > > >>>> > address > > > >>>> > >>> is > > > >>>> > >>> >>> > listed > > > >>>> > >>> >>> > > > > above. > > > >>>> > >>> >>> > > > > > > >Any use of the > > > >>>> > >>> >>> > > > > > > >information contained herein in any way > > > >>>> (including, > > > >>>> > but > > > >>>> > >>> >>>not > > > >>>> > >>> >>> > > limited > > > >>>> > >>> >>> > > > > to, > > > >>>> > >>> >>> > > > > > > >total or partial > > > >>>> > >>> >>> > > > > > > >disclosure, reproduction, or dissemination) > > by > > > >>>> persons > > > >>>> > >>> >>>other > > > >>>> > >>> >>> > than > > > >>>> > >>> >>> > > > the > > > >>>> > >>> >>> > > > > > > >intended > > > >>>> > >>> >>> > > > > > > >recipient(s) is prohibited. If you receive > > this > > > >>>> e-mail > > > >>>> > >>> in > > > >>>> > >>> >>> error, > > > >>>> > >>> >>> > > > > please > > > >>>> > >>> >>> > > > > > > >notify the sender by > > > >>>> > >>> >>> > > > > > > >phone or email immediately and delete it! > > > >>>> > >>> >>> > > > > > > > > > > >>>> > >>> >>> > > > > > > >________________________________________ > > > >>>> > >>> >>> > > > > > > >From: Zhou, Qianhao [[email protected] > > <mailto: > > > >>>> > >>> >>> [email protected] > > > >>>> > >>> >>> > >] > > > >>>> > >>> >>> > > > > > > >Sent: Friday, February 13, 2015 1:04 PM > > > >>>> > >>> >>> > > > > > > >To: [email protected]<mailto: > > > >>>> > >>> >>> [email protected]. > > > >>>> > >>> >>> > apache.org> > > > >>>> > >>> >>> > > > > > > >Cc: Kulbhushan Rana > > > >>>> > >>> >>> > > > > > > >Subject: Re: About building kylin > > > >>>> > >>> >>> > > > > > > > > > > >>>> > >>> >>> > > > > > > >Hi, Santosh > > > >>>> > >>> >>> > > > > > > > You will see a kylin.war inside > > > >>>> > >>> >>> > ${KYLIN_HOME}/tomcat/webapps. > > > >>>> > >>> >>> > > > That > > > >>>> > >>> >>> > > > > > is > > > >>>> > >>> >>> > > > > > > >the server war package. The tomcat version > is > > > >>>> 7.0.59. > > > >>>> > >>> >>> > > > > > > > If you want to bind 0.0.0.0:7070< > > > >>>> http://0.0.0.0: > > > >>>> > >>> 7070>, > > > >>>> > >>> >>> > please refer to the tomcat > > > >>>> > >>> >>> > > > > > > document, > > > >>>> > >>> >>> > > > > > > >there should be some configurations to let > > you > > > do > > > >>>> > that. > > > >>>> > >>> >>> > > > > > > > > > > >>>> > >>> >>> > > > > > > >Best Regard > > > >>>> > >>> >>> > > > > > > >Zhou QianHao > > > >>>> > >>> >>> > > > > > > > > > > >>>> > >>> >>> > > > > > > > > > > >>>> > >>> >>> > > > > > > > > > > >>>> > >>> >>> > > > > > > > > > > >>>> > >>> >>> > > > > > > > > > > >>>> > >>> >>> > > > > > > >On 2/13/15, 1:46 PM, "Santoshakhilesh" < > > > >>>> > >>> >>> > > [email protected]<mailto: > santosh.akhilesh@ > > > >>>> huawei.com > > > >>>> > > > > > >>>> > >>> >>> > > > > > > > >>>> > >>> >>> > > > > > > >wrote: > > > >>>> > >>> >>> > > > > > > > > > > >>>> > >>> >>> > > > > > > >>Hi Zhou, > > > >>>> > >>> >>> > > > > > > >> Due to some practical constarints , I > > > have > > > >>>> to > > > >>>> > >>> setup > > > >>>> > >>> >>> > clusster > > > >>>> > >>> >>> > > > > > > >>manually. > > > >>>> > >>> >>> > > > > > > >> I have downloaded all the dependency > > like > > > >>>> > hadoop , > > > >>>> > >>> >>> hbase , > > > >>>> > >>> >>> > > > hive > > > >>>> > >>> >>> > > > > , > > > >>>> > >>> >>> > > > > > > >>tomcat and I have run the check-env.sh > after > > > it > > > >>>> > passes > > > >>>> > >>> , > > > >>>> > >>> >>>I > > > >>>> > >>> >>> have > > > >>>> > >>> >>> > > run > > > >>>> > >>> >>> > > > > the > > > >>>> > >>> >>> > > > > > > >>start-kylin.sh > > > >>>> > >>> >>> > > > > > > >> Following is the log on console after > > > >>>> running > > > >>>> > the > > > >>>> > >>> >>> > > > > > ./start-kylin.sh. > > > >>>> > >>> >>> > > > > > > >> Does this mean everything is ok or I > > > >>>> should > > > >>>> > check > > > >>>> > >>> >>>some > > > >>>> > >>> >>> > > other > > > >>>> > >>> >>> > > > > > logs ? > > > >>>> > >>> >>> > > > > > > >>Currently I am unable to login to http:// > > > >>>> > >>> >>> > <your_sandbox_ip>:7070/ > > > >>>> > >>> >>> > > > > kylin > > > >>>> > >>> >>> > > > > > > >>from outside the machine. > > > >>>> > >>> >>> > > > > > > >> Is it possible to bind it to 0.0.0.0 > > :7070 > > > >>>> so > > > >>>> > that > > > >>>> > >>> I > > > >>>> > >>> >>>can > > > >>>> > >>> >>> > > > connect > > > >>>> > >>> >>> > > > > > from > > > >>>> > >>> >>> > > > > > > >>outside the lab network ? Where can I > > > configure > > > >>>> this > > > >>>> > ? > > > >>>> > >>> >>> > > > > > > >> > > > >>>> > >>> >>> > > > > > > >> ./start-kylin.sh > > > >>>> > >>> >>> > > > > > > >>Checking KYLIN_HOME... > > > >>>> > >>> >>> > > > > > > >>KYLIN_HOME is set to /opt/kylinb > > > >>>> > >>> >>> > > > > > > >>Checking hbase... > > > >>>> > >>> >>> > > > > > > >>hbase check passed > > > >>>> > >>> >>> > > > > > > >>Checking hive... > > > >>>> > >>> >>> > > > > > > >>hive check passed > > > >>>> > >>> >>> > > > > > > >>Checking hadoop... > > > >>>> > >>> >>> > > > > > > >>hadoop check passed > > > >>>> > >>> >>> > > > > > > >>Logging initialized using configuration in > > > >>>> > >>> >>> > > > > > > >>jar:file:/opt/hive/apache-hi > > > >>>> ve-0.14.0-bin/lib/hive- > > > >>>> > >>> >>> > > > > > > common-0.14.0.jar!/hiv > > > >>>> > >>> >>> > > > > > > >>e > > > >>>> > >>> >>> > > > > > > >>-log4j.properties > > > >>>> > >>> >>> > > > > > > >>SLF4J: Class path contains multiple SLF4J > > > >>>> bindings. > > > >>>> > >>> >>> > > > > > > >>SLF4J: Found binding in > > > >>>> > >>> >>> > > > > > > >>[jar:file:/opt/hadoop/hadoop > > > >>>> -2.6.0/share/hadoop/ > > > >>>> > >>> >>> > > > > > > common/lib/slf4j-log4j12- > > > >>>> > >>> >>> > > > > > > >>1 > > > >>>> > >>> >>> > > > > > > >>.7.5.jar!/org/slf4j/impl/Sta > > > >>>> ticLoggerBinder.class] > > > >>>> > >>> >>> > > > > > > >>SLF4J: Found binding in > > > >>>> > >>> >>> > > > > > > >>[jar:file:/opt/hive/apache- > > > >>>> > >>> hive-0.14.0-bin/lib/hive-jdbc- > > > >>>> > >>> >>> > > > > > > 0.14.0-standalon > > > >>>> > >>> >>> > > > > > > >>e > > > >>>> > >>> >>> > > > > > > > > >>.jar!/org/slf4j/impl/StaticLoggerBinder.class] > > > >>>> > >>> >>> > > > > > > >>SLF4J: See > > > >>>> > >>> >>> http://www.slf4j.org/codes.html#multiple_bindings > > > >>>> > >>> >>> > for > > > >>>> > >>> >>> > > > an > > > >>>> > >>> >>> > > > > > > >>explanation. > > > >>>> > >>> >>> > > > > > > >>SLF4J: Actual binding is of type > > > >>>> [org.slf4j.impl. > > > >>>> > >>> >>> > > > Log4jLoggerFactory] > > > >>>> > >>> >>> > > > > > > >>hive dependency: > > > >>>> > >>> >>> > > > > > > >>/usr/hdp/current/hive-client > > > >>>> /conf/:/hive/lib/*:/ > > > >>>> > >>> >>> > > > > > > hive-hcatalog/share/hcata > > > >>>> > >>> >>> > > > > > > >>l > > > >>>> > >>> >>> > > > > > > >>og/* > > > >>>> > >>> >>> > > > > > > >>A new Kylin instance is started by root, > > stop > > > it > > > >>>> > using > > > >>>> > >>> >>> > > > > "stop-kylin.sh" > > > >>>> > >>> >>> > > > > > > >>Please visit http:// > > > <your_sandbox_ip>:7070/kylin > > > >>>> to > > > >>>> > >>> play > > > >>>> > >>> >>> with > > > >>>> > >>> >>> > > the > > > >>>> > >>> >>> > > > > > cubes! > > > >>>> > >>> >>> > > > > > > >>(Useranme: ADMIN, Password: KYLIN) > > > >>>> > >>> >>> > > > > > > >>You can check the log at > > > >>>> ./../tomcat/logs/kylin.log > > > >>>> > >>> >>> > > > > > > >> > > > >>>> > >>> >>> > > > > > > >>Regards, > > > >>>> > >>> >>> > > > > > > >>Santosh Akhilesh > > > >>>> > >>> >>> > > > > > > >>Bangalore R&D > > > >>>> > >>> >>> > > > > > > >>HUAWEI TECHNOLOGIES CO.,LTD. > > > >>>> > >>> >>> > > > > > > >> > > > >>>> > >>> >>> > > > > > > > > > >>>> > >>> >>>>> <http://www.huawei.com> > > > >>> > > > >>> > > > >> > > > >> > > > >> -- > > > >> Regards, > > > >> Santosh Akhilesh > > > >> +91-0-9845482201 > > > >> > > > > > > > > > > > > > > > > -- > > > > Regards, > > > > Santosh Akhilesh > > > > +91-0-9845482201 > > > > > > > > > > > > > > > > -- > > > Regards, > > > Santosh Akhilesh > > > +91-0-9845482201 > > > > > >
