[jira] [Comment Edited] (KYLIN-4545) unable to load HiveMetaStore
[ https://issues.apache.org/jira/browse/KYLIN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17126541#comment-17126541 ] praveenece edited comment on KYLIN-4545 at 6/5/20, 6:11 PM: When we give show tables in hive shell, we are getting tables(created external table). we are using MariaDB(version -10.0.38) as Hive metadata store, not using MySQL database. is this may be a reason for the issues or what is the compatibility version of Mariadb for kylin 3.0.0. *Note:**We are getting this issues only on hive external table.* Other tables able to load without issues. We are able to run group by query in Hive(actual data present in Hbase). Please help us to resolve the issues. was (Author: praveenece): When we give show tables in hive shell, we are getting tables(created external table). we are using MariaDB(version -10.0.38) as Hive metadata store, not using MySQL database. is this may be a reason for the issues or what is the compatibility version of Mariadb for kylin 3.0.0. We are able to run group by query in Hive(actual data present in Hbase). Please help us to resolve the issues. > unable to load HiveMetaStore > > > Key: KYLIN-4545 > URL: https://issues.apache.org/jira/browse/KYLIN-4545 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v3.0.2 > Environment: hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > We are using the below software to setup kylin environment. > hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 > After configuring everything getting *message: Caused by: > javax.jdo.JDOException: Exception thrown when executing query : SELECT > `A0`.`NAME` FROM `DBS` `A0` WHERE `A0`.`CATALOG_NAME` = ?* this error message. > i have executed below query against hive Metastore to fix the issues. > USE metastore; >ALTER TABLE TBLS ADD REWRITE_ENABLED BIT(1) NOT NULL; >UPDATE TBLS SET REWRITE_ENABLED=IS_REWRITE_ENABLED; >ALTER TABLE DBS ADD CATALOG_NAME varchar(256) not Null; >UPDATE DBS SET CATALOG_NAME=CTLG_NAME; > After that i am able to see the hive tables in kylin model, but i am not able > to Sync the tables. Getting the "can not get Hive TableMeta" error message. > Please help us to fix the issues ASAP. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (KYLIN-4545) unable to load HiveMetaStore
[ https://issues.apache.org/jira/browse/KYLIN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17126541#comment-17126541 ] praveenece edited comment on KYLIN-4545 at 6/5/20, 4:39 PM: When we give show tables in hive shell, we are getting tables(created external table). we are using MariaDB(version -10.0.38) as Hive metadata store, not using MySQL database. is this may be a reason for the issues or what is the compatibility version of Mariadb for kylin 3.0.0. We are able to run group by query in Hive(actual data present in Hbase). Please help us to resolve the issues. was (Author: praveenece): When i give show tables in hive shell, i am getting my table(created external table). Hive metadata stored in Mariadb. I am able to run group by query in Hive(actual data present in Hbase). Please help us to resolve the issues. > unable to load HiveMetaStore > > > Key: KYLIN-4545 > URL: https://issues.apache.org/jira/browse/KYLIN-4545 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v3.0.2 > Environment: hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > We are using the below software to setup kylin environment. > hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 > After configuring everything getting *message: Caused by: > javax.jdo.JDOException: Exception thrown when executing query : SELECT > `A0`.`NAME` FROM `DBS` `A0` WHERE `A0`.`CATALOG_NAME` = ?* this error message. > i have executed below query against hive Metastore to fix the issues. > USE metastore; >ALTER TABLE TBLS ADD REWRITE_ENABLED BIT(1) NOT NULL; >UPDATE TBLS SET REWRITE_ENABLED=IS_REWRITE_ENABLED; >ALTER TABLE DBS ADD CATALOG_NAME varchar(256) not Null; >UPDATE DBS SET CATALOG_NAME=CTLG_NAME; > After that i am able to see the hive tables in kylin model, but i am not able > to Sync the tables. Getting the "can not get Hive TableMeta" error message. > Please help us to fix the issues ASAP. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (KYLIN-4545) unable to load HiveMetaStore
[ https://issues.apache.org/jira/browse/KYLIN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17126541#comment-17126541 ] praveenece edited comment on KYLIN-4545 at 6/5/20, 8:36 AM: When i give show tables in hive shell, i am getting my table(created external table). Hive metadata stored in Mariadb. I am able to run group by query in Hive(actual data present in Hbase). Please help us to resolve the issues. was (Author: praveenece): When i give show tables in hive shell, i am getting my table(created external table). I am able to run group by query in Hive(actual data present in Hbase). Please help us to resolve the issues. > unable to load HiveMetaStore > > > Key: KYLIN-4545 > URL: https://issues.apache.org/jira/browse/KYLIN-4545 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v3.0.2 > Environment: hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > We are using the below software to setup kylin environment. > hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 > After configuring everything getting *message: Caused by: > javax.jdo.JDOException: Exception thrown when executing query : SELECT > `A0`.`NAME` FROM `DBS` `A0` WHERE `A0`.`CATALOG_NAME` = ?* this error message. > i have executed below query against hive Metastore to fix the issues. > USE metastore; >ALTER TABLE TBLS ADD REWRITE_ENABLED BIT(1) NOT NULL; >UPDATE TBLS SET REWRITE_ENABLED=IS_REWRITE_ENABLED; >ALTER TABLE DBS ADD CATALOG_NAME varchar(256) not Null; >UPDATE DBS SET CATALOG_NAME=CTLG_NAME; > After that i am able to see the hive tables in kylin model, but i am not able > to Sync the tables. Getting the "can not get Hive TableMeta" error message. > Please help us to fix the issues ASAP. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (KYLIN-4545) unable to load HiveMetaStore
[ https://issues.apache.org/jira/browse/KYLIN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17126541#comment-17126541 ] praveenece edited comment on KYLIN-4545 at 6/5/20, 8:36 AM: When i give show tables in hive shell, i am getting my table(created external table). I am able to run group by query in Hive(actual data present in Hbase). Please help us to resolve the issues. was (Author: praveenece): When i give show tables in hive shell, i am getting my table(created external table) > unable to load HiveMetaStore > > > Key: KYLIN-4545 > URL: https://issues.apache.org/jira/browse/KYLIN-4545 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v3.0.2 > Environment: hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > We are using the below software to setup kylin environment. > hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 > After configuring everything getting *message: Caused by: > javax.jdo.JDOException: Exception thrown when executing query : SELECT > `A0`.`NAME` FROM `DBS` `A0` WHERE `A0`.`CATALOG_NAME` = ?* this error message. > i have executed below query against hive Metastore to fix the issues. > USE metastore; >ALTER TABLE TBLS ADD REWRITE_ENABLED BIT(1) NOT NULL; >UPDATE TBLS SET REWRITE_ENABLED=IS_REWRITE_ENABLED; >ALTER TABLE DBS ADD CATALOG_NAME varchar(256) not Null; >UPDATE DBS SET CATALOG_NAME=CTLG_NAME; > After that i am able to see the hive tables in kylin model, but i am not able > to Sync the tables. Getting the "can not get Hive TableMeta" error message. > Please help us to fix the issues ASAP. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4545) unable to load HiveMetaStore
[ https://issues.apache.org/jira/browse/KYLIN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17126541#comment-17126541 ] praveenece commented on KYLIN-4545: --- When i give show tables in hive shell, i am getting my table(created external table) > unable to load HiveMetaStore > > > Key: KYLIN-4545 > URL: https://issues.apache.org/jira/browse/KYLIN-4545 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v3.0.2 > Environment: hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > We are using the below software to setup kylin environment. > hadoop-3.2.0 > hbase-2.2.0 > hive-3.1.0 > kylin-3.0.2-bin-hadoop3 > After configuring everything getting *message: Caused by: > javax.jdo.JDOException: Exception thrown when executing query : SELECT > `A0`.`NAME` FROM `DBS` `A0` WHERE `A0`.`CATALOG_NAME` = ?* this error message. > i have executed below query against hive Metastore to fix the issues. > USE metastore; >ALTER TABLE TBLS ADD REWRITE_ENABLED BIT(1) NOT NULL; >UPDATE TBLS SET REWRITE_ENABLED=IS_REWRITE_ENABLED; >ALTER TABLE DBS ADD CATALOG_NAME varchar(256) not Null; >UPDATE DBS SET CATALOG_NAME=CTLG_NAME; > After that i am able to see the hive tables in kylin model, but i am not able > to Sync the tables. Getting the "can not get Hive TableMeta" error message. > Please help us to fix the issues ASAP. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4545) unable to load HiveMetaStore
praveenece created KYLIN-4545: - Summary: unable to load HiveMetaStore Key: KYLIN-4545 URL: https://issues.apache.org/jira/browse/KYLIN-4545 Project: Kylin Issue Type: Test Components: Environment Affects Versions: v3.0.2 Environment: hadoop-3.2.0 hbase-2.2.0 hive-3.1.0 kylin-3.0.2-bin-hadoop3 Reporter: praveenece We are using the below software to setup kylin environment. hadoop-3.2.0 hbase-2.2.0 hive-3.1.0 kylin-3.0.2-bin-hadoop3 After configuring everything getting *message: Caused by: javax.jdo.JDOException: Exception thrown when executing query : SELECT `A0`.`NAME` FROM `DBS` `A0` WHERE `A0`.`CATALOG_NAME` = ?* this error message. i have executed below query against hive Metastore to fix the issues. USE metastore; ALTER TABLE TBLS ADD REWRITE_ENABLED BIT(1) NOT NULL; UPDATE TBLS SET REWRITE_ENABLED=IS_REWRITE_ENABLED; ALTER TABLE DBS ADD CATALOG_NAME varchar(256) not Null; UPDATE DBS SET CATALOG_NAME=CTLG_NAME; After that i am able to see the hive tables in kylin model, but i am not able to Sync the tables. Getting the "can not get Hive TableMeta" error message. Please help us to fix the issues ASAP. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KYLIN-4186) Cannot get hivetablemeta
[ https://issues.apache.org/jira/browse/KYLIN-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] praveenece updated KYLIN-4186: -- Description: apache-kylin-2.6.3-bin-hadoop3 apache-hive-2.3.2-bin hbase-2.0.0 hadoop-3.1.1 When load data from hive in Kylin getting * Cannot get hivetablemeta* this error. Please help me which version of hive i need to use for this environment. was: hadoop-3.1.1 apache-hive-2.3.4-bin hbase-2.1.1 apache-kylin-2.5.2-bin-hadoop3 When load data from hive in Kylin getting * Cannot get hivetablemeta* this error. Please help me which version of hive i need to use for this environment. > Cannot get hivetablemeta > > > Key: KYLIN-4186 > URL: https://issues.apache.org/jira/browse/KYLIN-4186 > Project: Kylin > Issue Type: Test > Components: Environment > Environment: hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > apache-kylin-2.6.3-bin-hadoop3 > apache-hive-2.3.2-bin > hbase-2.0.0 > hadoop-3.1.1 > When load data from hive in Kylin getting * Cannot get hivetablemeta* this > error. > Please help me which version of hive i need to use for this environment. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4186) Cannot get hivetablemeta
praveenece created KYLIN-4186: - Summary: Cannot get hivetablemeta Key: KYLIN-4186 URL: https://issues.apache.org/jira/browse/KYLIN-4186 Project: Kylin Issue Type: Test Components: Environment Environment: hadoop-3.1.1 apache-hive-2.3.4-bin hbase-2.1.1 apache-kylin-2.5.2-bin-hadoop3 Reporter: praveenece hadoop-3.1.1 apache-hive-2.3.4-bin hbase-2.1.1 apache-kylin-2.5.2-bin-hadoop3 When load data from hive in Kylin getting * Cannot get hivetablemeta* this error. Please help me which version of hive i need to use for this environment. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-3948) org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V
[ https://issues.apache.org/jira/browse/KYLIN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941829#comment-16941829 ] praveenece commented on KYLIN-3948: --- Hi, apache-kylin-2.6.3-bin-hadoop3 apache-hive-2.3.2-bin hbase-2.0.0 hadoop-3.1.1 Getting the same error: org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V Instead of apache-hive-2.3.2-bin I tried with apache-hive-3.1.0-bin getting the below error: "Cannot get hivetablemeta" Please help some one to fix the issues. which version of hive,hadoop, hbase for apache-kylin-2.6.3-bin-hadoop3 need to use. > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > --- > > Key: KYLIN-3948 > URL: https://issues.apache.org/jira/browse/KYLIN-3948 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v2.5.2 > Environment: hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 > Now I tried with above environment, kylin is stated but i unable to load > metadata from hbase to kylin getting this below error in kylin UI. > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > 2019-04-09 15:02:44,979 DEBUG [http-nio-7070-exec-9] common.KylinConfig:327 : > KYLIN_CONF property was not set, will seek KYLIN_HOME env variable > 2019-04-09 15:02:50,071 ERROR [http-nio-7070-exec-6] > controller.TableController:190 : > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > java.lang.NoSuchMethodError: > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > at > org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:132) > at > org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames(CLIHiveClient.java:116) > at > org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases(HiveMetadataExplorer.java:47) > at > org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:277) > at > org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:188) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (KYLIN-3940) Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase
[ https://issues.apache.org/jira/browse/KYLIN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16825803#comment-16825803 ] praveenece edited comment on KYLIN-3940 at 4/25/19 7:13 AM: No not yet resolved. Still having the same problem. was (Author: praveenece): No not yet resolved. > Exception in thread "main" java.lang.IllegalArgumentException: Failed to find > metadata store by url: kylin_metadata@hbase > - > > Key: KYLIN-3940 > URL: https://issues.apache.org/jira/browse/KYLIN-3940 > Project: Kylin > Issue Type: Task > Components: Environment >Affects Versions: v2.5.2 > Environment: apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > I am getting the below error. This error occurred when use > apache-kylin-2.5.2-bin-hadoop3. if we use apache-kylin-2.5.2-bin-hbase1x > kylin gets started. > apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hadoop3 > Exception in thread "main" java.lang.IllegalArgumentException: Failed to find > metadata store by url: kylin_metadata@hbase > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:98) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:110) > at > org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:98) > at > org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92) > ... 3 more > Caused by: java.lang.NoClassDefFoundError: > org/apache/hadoop/hbase/client/ColumnFamilyDescriptor > at > org.apache.kylin.storage.hbase.HBaseResourceStore.getConnection(HBaseResourceStore.java:86) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:112) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.(HBaseResourceStore.java:93) > ... 8 more > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.hbase.client.ColumnFamilyDescriptor > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3940) Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase
[ https://issues.apache.org/jira/browse/KYLIN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16825803#comment-16825803 ] praveenece commented on KYLIN-3940: --- No not yet resolved. > Exception in thread "main" java.lang.IllegalArgumentException: Failed to find > metadata store by url: kylin_metadata@hbase > - > > Key: KYLIN-3940 > URL: https://issues.apache.org/jira/browse/KYLIN-3940 > Project: Kylin > Issue Type: Task > Components: Environment >Affects Versions: v2.5.2 > Environment: apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > I am getting the below error. This error occurred when use > apache-kylin-2.5.2-bin-hadoop3. if we use apache-kylin-2.5.2-bin-hbase1x > kylin gets started. > apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hadoop3 > Exception in thread "main" java.lang.IllegalArgumentException: Failed to find > metadata store by url: kylin_metadata@hbase > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:98) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:110) > at > org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:98) > at > org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92) > ... 3 more > Caused by: java.lang.NoClassDefFoundError: > org/apache/hadoop/hbase/client/ColumnFamilyDescriptor > at > org.apache.kylin.storage.hbase.HBaseResourceStore.getConnection(HBaseResourceStore.java:86) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:112) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.(HBaseResourceStore.java:93) > ... 8 more > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.hbase.client.ColumnFamilyDescriptor > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (KYLIN-3948) org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V
[ https://issues.apache.org/jira/browse/KYLIN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16822853#comment-16822853 ] praveenece edited comment on KYLIN-3948 at 4/22/19 3:51 AM: Hi Chao Long, Thanks for your update, please let me know which version of kylin support hadoop3 as well as spark engine. was (Author: praveenece): Hi Chao Long, Thanks for your update, please let me know which version of kylin support hadoop3 and spark engine. > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > --- > > Key: KYLIN-3948 > URL: https://issues.apache.org/jira/browse/KYLIN-3948 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v2.5.2 > Environment: hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 > Now I tried with above environment, kylin is stated but i unable to load > metadata from hbase to kylin getting this below error in kylin UI. > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > 2019-04-09 15:02:44,979 DEBUG [http-nio-7070-exec-9] common.KylinConfig:327 : > KYLIN_CONF property was not set, will seek KYLIN_HOME env variable > 2019-04-09 15:02:50,071 ERROR [http-nio-7070-exec-6] > controller.TableController:190 : > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > java.lang.NoSuchMethodError: > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > at > org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:132) > at > org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames(CLIHiveClient.java:116) > at > org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases(HiveMetadataExplorer.java:47) > at > org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:277) > at > org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:188) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3948) org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V
[ https://issues.apache.org/jira/browse/KYLIN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16822853#comment-16822853 ] praveenece commented on KYLIN-3948: --- Hi Chao Long, Thanks for your update, please let me know which version of kylin support hadoop3 and spark engine. > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > --- > > Key: KYLIN-3948 > URL: https://issues.apache.org/jira/browse/KYLIN-3948 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v2.5.2 > Environment: hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 > Now I tried with above environment, kylin is stated but i unable to load > metadata from hbase to kylin getting this below error in kylin UI. > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > 2019-04-09 15:02:44,979 DEBUG [http-nio-7070-exec-9] common.KylinConfig:327 : > KYLIN_CONF property was not set, will seek KYLIN_HOME env variable > 2019-04-09 15:02:50,071 ERROR [http-nio-7070-exec-6] > controller.TableController:190 : > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > java.lang.NoSuchMethodError: > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > at > org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:132) > at > org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames(CLIHiveClient.java:116) > at > org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases(HiveMetadataExplorer.java:47) > at > org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:277) > at > org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:188) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3948) org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V
[ https://issues.apache.org/jira/browse/KYLIN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819752#comment-16819752 ] praveenece commented on KYLIN-3948: --- Hi, I have doubt like, is kylin-2.5.2(hbase or hadoop3) supports spark? I am not finding any hadoop3 dependent jar in Spark jar path. only hadoop 2.7.3 available Please let me know, I am working on this kylin build with spark getting hadoop3 dependent jar issues only.Thanks By Map-reduce its is running successfully. > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > --- > > Key: KYLIN-3948 > URL: https://issues.apache.org/jira/browse/KYLIN-3948 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v2.5.2 > Environment: hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 > Now I tried with above environment, kylin is stated but i unable to load > metadata from hbase to kylin getting this below error in kylin UI. > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > 2019-04-09 15:02:44,979 DEBUG [http-nio-7070-exec-9] common.KylinConfig:327 : > KYLIN_CONF property was not set, will seek KYLIN_HOME env variable > 2019-04-09 15:02:50,071 ERROR [http-nio-7070-exec-6] > controller.TableController:190 : > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > java.lang.NoSuchMethodError: > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > at > org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:132) > at > org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames(CLIHiveClient.java:116) > at > org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases(HiveMetadataExplorer.java:47) > at > org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:277) > at > org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:188) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3948) org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V
[ https://issues.apache.org/jira/browse/KYLIN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818628#comment-16818628 ] praveenece commented on KYLIN-3948: --- Hi Chao Long, I tried with Hive-3.1.0 but still getting the same error. ERROR [http-nio-7070-exec-1] controller.BasicController:62 : org.apache.kylin.rest.exception.InternalErrorException: org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V at org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:191) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > --- > > Key: KYLIN-3948 > URL: https://issues.apache.org/jira/browse/KYLIN-3948 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v2.5.2 > Environment: hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 > Now I tried with above environment, kylin is stated but i unable to load > metadata from hbase to kylin getting this below error in kylin UI. > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > 2019-04-09 15:02:44,979 DEBUG [http-nio-7070-exec-9] common.KylinConfig:327 : > KYLIN_CONF property was not set, will seek KYLIN_HOME env variable > 2019-04-09 15:02:50,071 ERROR [http-nio-7070-exec-6] > controller.TableController:190 : > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > java.lang.NoSuchMethodError: > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > at > org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:132) > at > org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames(CLIHiveClient.java:116) > at > org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases(HiveMetadataExplorer.java:47) > at > org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:277) > at > org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:188) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3940) Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase
[ https://issues.apache.org/jira/browse/KYLIN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] praveenece updated KYLIN-3940: -- Issue Type: Task (was: Test) > Exception in thread "main" java.lang.IllegalArgumentException: Failed to find > metadata store by url: kylin_metadata@hbase > - > > Key: KYLIN-3940 > URL: https://issues.apache.org/jira/browse/KYLIN-3940 > Project: Kylin > Issue Type: Task > Components: Environment >Affects Versions: v2.5.2 > Environment: apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > I am getting the below error. This error occurred when use > apache-kylin-2.5.2-bin-hadoop3. if we use apache-kylin-2.5.2-bin-hbase1x > kylin gets started. > apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hadoop3 > Exception in thread "main" java.lang.IllegalArgumentException: Failed to find > metadata store by url: kylin_metadata@hbase > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:98) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:110) > at > org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:98) > at > org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92) > ... 3 more > Caused by: java.lang.NoClassDefFoundError: > org/apache/hadoop/hbase/client/ColumnFamilyDescriptor > at > org.apache.kylin.storage.hbase.HBaseResourceStore.getConnection(HBaseResourceStore.java:86) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:112) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.(HBaseResourceStore.java:93) > ... 8 more > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.hbase.client.ColumnFamilyDescriptor > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3948) org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V
[ https://issues.apache.org/jira/browse/KYLIN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] praveenece updated KYLIN-3948: -- Description: hadoop-3.1.1 apache-hive-2.3.4-bin hbase-2.1.1 apache-kylin-2.5.2-bin-hadoop3 Now I tried with above environment, kylin is stated but i unable to load metadata from hbase to kylin getting this below error in kylin UI. org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V 2019-04-09 15:02:44,979 DEBUG [http-nio-7070-exec-9] common.KylinConfig:327 : KYLIN_CONF property was not set, will seek KYLIN_HOME env variable 2019-04-09 15:02:50,071 ERROR [http-nio-7070-exec-6] controller.TableController:190 : org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V java.lang.NoSuchMethodError: org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V at org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:132) at org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames(CLIHiveClient.java:116) at org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases(HiveMetadataExplorer.java:47) at org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:277) at org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:188) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) was: hadoop-3.1.1 apache-hive-2.3.4-bin hbase-2.1.1 apache-kylin-2.5.2-bin-hadoop3 Now I tried with above environment, kylin is stated but i unable to load metadata from hbase to kylin getting this below error in kylin UI. > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > --- > > Key: KYLIN-3948 > URL: https://issues.apache.org/jira/browse/KYLIN-3948 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v2.5.2 > Environment: hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > hadoop-3.1.1 > apache-hive-2.3.4-bin > hbase-2.1.1 > apache-kylin-2.5.2-bin-hadoop3 > Now I tried with above environment, kylin is stated but i unable to load > metadata from hbase to kylin getting this below error in kylin UI. > org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V > 2019-04-09 15:02:44,979 DEBUG [http-nio-7070-exec-9] common.KylinConfig:327 : > KYLIN_CONF property was not set, will seek KYLIN_HOME env variable > 2019-04-09 15:02:50,071 ERROR [http-nio-7070-exec-6] > controller.TableController:190 : > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > java.lang.NoSuchMethodError: > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V > at > org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:132) > at > org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames(CLIHiveClient.java:116) > at > org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases(HiveMetadataExplorer.java:47) > at > org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:277) > at > org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:188) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) > at > org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3948) org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V
praveenece created KYLIN-3948: - Summary: org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V Key: KYLIN-3948 URL: https://issues.apache.org/jira/browse/KYLIN-3948 Project: Kylin Issue Type: Test Components: Environment Affects Versions: v2.5.2 Environment: hadoop-3.1.1 apache-hive-2.3.4-bin hbase-2.1.1 apache-kylin-2.5.2-bin-hadoop3 Reporter: praveenece hadoop-3.1.1 apache-hive-2.3.4-bin hbase-2.1.1 apache-kylin-2.5.2-bin-hadoop3 Now I tried with above environment, kylin is stated but i unable to load metadata from hbase to kylin getting this below error in kylin UI. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3940) Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase
[ https://issues.apache.org/jira/browse/KYLIN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16813180#comment-16813180 ] praveenece commented on KYLIN-3940: --- Hi Chao Long, hadoop-3.1.1 apache-hive-2.3.4-bin hbase-2.1.1 apache-kylin-2.5.2-bin-hadoop3 Now I tried with above environment, kylin is stated but i unable to load metadata from hbase to kylin getting this below error in kylin UI. org.apache.hadoop.hive.metastore.HiveMetaStoreClint.(Lorg/apache/hadoop/conf/configuration;)V 2019-04-09 15:02:44,979 DEBUG [http-nio-7070-exec-9] common.KylinConfig:327 : KYLIN_CONF property was not set, will seek KYLIN_HOME env variable 2019-04-09 15:02:50,071 ERROR [http-nio-7070-exec-6] controller.TableController:190 : org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V java.lang.NoSuchMethodError: org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/conf/Configuration;)V at org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:132) at org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames(CLIHiveClient.java:116) at org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases(HiveMetadataExplorer.java:47) at org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:277) at org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:188) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) > Exception in thread "main" java.lang.IllegalArgumentException: Failed to find > metadata store by url: kylin_metadata@hbase > - > > Key: KYLIN-3940 > URL: https://issues.apache.org/jira/browse/KYLIN-3940 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v2.5.2 > Environment: apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > I am getting the below error. This error occurred when use > apache-kylin-2.5.2-bin-hadoop3. if we use apache-kylin-2.5.2-bin-hbase1x > kylin gets started. > apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hadoop3 > Exception in thread "main" java.lang.IllegalArgumentException: Failed to find > metadata store by url: kylin_metadata@hbase > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:98) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:110) > at > org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:98) > at > org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92) > ... 3 more > Caused by: java.lang.NoClassDefFoundError: > org/apache/hadoop/hbase/client/ColumnFamilyDescriptor > at > org.apache.kylin.storage.hbase.HBaseResourceStore.getConnection(HBaseResourceStore.java:86) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:112) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.(HBaseResourceStore.java:93) > ... 8 more > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.hbase.client.ColumnFamilyDescriptor > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) -- This message was sent by Atlassian JIRA
[jira] [Updated] (KYLIN-3931) Caused by: java.lang.RuntimeException: Could not create interface org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the hadoop compatibility jar o
[ https://issues.apache.org/jira/browse/KYLIN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] praveenece updated KYLIN-3931: -- Environment: apache-hive-2.3.4-bin hbase-1.4.9 hadoop-3.1.0 apache-kylin-2.5.2-bin-hbase1x was: apache-hive-2.3.4-bin hbase-1.4.9 hadoop-3.1.0 apache-kylin-2.5.2-bin-hadoop3 > Caused by: java.lang.RuntimeException: Could not create interface > org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the > hadoop compatibility jar on the classpath? > -- > > Key: KYLIN-3931 > URL: https://issues.apache.org/jira/browse/KYLIN-3931 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v2.5.2 > Environment: apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hbase1x >Reporter: praveenece >Priority: Critical > > I am getting the below error. please find the environment details. > apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hbase1x.tar.gz > Engine Type: Spark > Kylin 63% completed after that i am getting this below error. > WARN TaskSetManager: Lost task 0.0 in stage 1.0 (TID 2, server.com, executor > 1): java.lang.ExceptionInInitializerError > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.getNewWriter(HFileOutputFormat2.java:305) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:229) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:167) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply$mcV$sp(PairRDDFunctions.scala:1125) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) > at > org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1353) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1131) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > Caused by: java.lang.RuntimeException: Could not create interface > org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the > hadoop compatibility jar on the classpath? > at > org.apache.hadoop.hbase.CompatibilitySingletonFactory.getInstance(CompatibilitySingletonFactory.java:73) > at org.apache.hadoop.hbase.io.MetricsIO.(MetricsIO.java:31) > at org.apache.hadoop.hbase.io.hfile.HFile.(HFile.java:191) > ... 15 more > Caused by: java.util.NoSuchElementException > at > java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:365) > at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404) > at java.util.ServiceLoader$1.next(ServiceLoader.java:480) > at > org.apache.hadoop.hbase.CompatibilitySingletonFactory.getInstance(CompatibilitySingletonFactory.java:59) > ... 17 more > 19/04/01 11:47:55 INFO TaskSetManager: Starting task 0.1 in stage 1.0 (TID 3, > server.com, executor 1, partition 0, NODE_LOCAL, 5842 bytes) > 19/04/01 11:47:55 WARN TaskSetManager: Lost task 0.1 in stage 1.0 (TID 3, > server.com, executor 1): java.lang.NoClassDefFoundError: Could not initialize > class org.apache.hadoop.hbase.io.hfile.HFile -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3931) Caused by: java.lang.RuntimeException: Could not create interface org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the hadoop compatibility jar o
[ https://issues.apache.org/jira/browse/KYLIN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] praveenece updated KYLIN-3931: -- Environment: apache-hive-2.3.4-bin hbase-1.4.9 hadoop-3.1.0 apache-kylin-2.5.2-bin-hadoop3 was: apache-hive-2.3.4-bin hbase-1.4.9 hadoop-3.1.0 apache-kylin-2.5.2-bin-hbase1x.tar.gz > Caused by: java.lang.RuntimeException: Could not create interface > org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the > hadoop compatibility jar on the classpath? > -- > > Key: KYLIN-3931 > URL: https://issues.apache.org/jira/browse/KYLIN-3931 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v2.5.2 > Environment: apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hadoop3 >Reporter: praveenece >Priority: Critical > > I am getting the below error. please find the environment details. > apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hbase1x.tar.gz > Engine Type: Spark > Kylin 63% completed after that i am getting this below error. > WARN TaskSetManager: Lost task 0.0 in stage 1.0 (TID 2, server.com, executor > 1): java.lang.ExceptionInInitializerError > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.getNewWriter(HFileOutputFormat2.java:305) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:229) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:167) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply$mcV$sp(PairRDDFunctions.scala:1125) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) > at > org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1353) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1131) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > Caused by: java.lang.RuntimeException: Could not create interface > org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the > hadoop compatibility jar on the classpath? > at > org.apache.hadoop.hbase.CompatibilitySingletonFactory.getInstance(CompatibilitySingletonFactory.java:73) > at org.apache.hadoop.hbase.io.MetricsIO.(MetricsIO.java:31) > at org.apache.hadoop.hbase.io.hfile.HFile.(HFile.java:191) > ... 15 more > Caused by: java.util.NoSuchElementException > at > java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:365) > at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404) > at java.util.ServiceLoader$1.next(ServiceLoader.java:480) > at > org.apache.hadoop.hbase.CompatibilitySingletonFactory.getInstance(CompatibilitySingletonFactory.java:59) > ... 17 more > 19/04/01 11:47:55 INFO TaskSetManager: Starting task 0.1 in stage 1.0 (TID 3, > server.com, executor 1, partition 0, NODE_LOCAL, 5842 bytes) > 19/04/01 11:47:55 WARN TaskSetManager: Lost task 0.1 in stage 1.0 (TID 3, > server.com, executor 1): java.lang.NoClassDefFoundError: Could not initialize > class org.apache.hadoop.hbase.io.hfile.HFile -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3940) Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase
praveenece created KYLIN-3940: - Summary: Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase Key: KYLIN-3940 URL: https://issues.apache.org/jira/browse/KYLIN-3940 Project: Kylin Issue Type: Test Components: Environment Affects Versions: v2.5.2 Environment: apache-hive-2.3.4-bin hbase-1.4.9 hadoop-3.1.0 apache-kylin-2.5.2-bin-hadoop3 Reporter: praveenece I am getting the below error. This error occurred when use apache-kylin-2.5.2-bin-hadoop3. if we use apache-kylin-2.5.2-bin-hbase1x kylin gets started. apache-hive-2.3.4-bin hbase-1.4.9 hadoop-3.1.0 apache-kylin-2.5.2-bin-hadoop3 Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:98) at org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:110) at org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:98) at org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92) ... 3 more Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/client/ColumnFamilyDescriptor at org.apache.kylin.storage.hbase.HBaseResourceStore.getConnection(HBaseResourceStore.java:86) at org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:112) at org.apache.kylin.storage.hbase.HBaseResourceStore.(HBaseResourceStore.java:93) ... 8 more Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.client.ColumnFamilyDescriptor at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3931) Caused by: java.lang.RuntimeException: Could not create interface org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the hadoop compatibility jar o
[ https://issues.apache.org/jira/browse/KYLIN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] praveenece updated KYLIN-3931: -- Description: I am getting the below error. please find the environment details. apache-hive-2.3.4-bin hbase-1.4.9 hadoop-3.1.0 apache-kylin-2.5.2-bin-hbase1x.tar.gz Engine Type: Spark Kylin 63% completed after that i am getting this below error. WARN TaskSetManager: Lost task 0.0 in stage 1.0 (TID 2, server.com, executor 1): java.lang.ExceptionInInitializerError at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.getNewWriter(HFileOutputFormat2.java:305) at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:229) at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:167) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply$mcV$sp(PairRDDFunctions.scala:1125) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) at org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1353) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1131) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) at org.apache.spark.scheduler.Task.run(Task.scala:99) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.RuntimeException: Could not create interface org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the hadoop compatibility jar on the classpath? at org.apache.hadoop.hbase.CompatibilitySingletonFactory.getInstance(CompatibilitySingletonFactory.java:73) at org.apache.hadoop.hbase.io.MetricsIO.(MetricsIO.java:31) at org.apache.hadoop.hbase.io.hfile.HFile.(HFile.java:191) ... 15 more Caused by: java.util.NoSuchElementException at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:365) at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404) at java.util.ServiceLoader$1.next(ServiceLoader.java:480) at org.apache.hadoop.hbase.CompatibilitySingletonFactory.getInstance(CompatibilitySingletonFactory.java:59) ... 17 more 19/04/01 11:47:55 INFO TaskSetManager: Starting task 0.1 in stage 1.0 (TID 3, server.com, executor 1, partition 0, NODE_LOCAL, 5842 bytes) 19/04/01 11:47:55 WARN TaskSetManager: Lost task 0.1 in stage 1.0 (TID 3, server.com, executor 1): java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hbase.io.hfile.HFile was: I am getting the below error. please find the environment details. apache-hive-2.3.4-bin hbase-1.4.9 hadoop-3.1.0 apache-kylin-2.5.2-bin-hbase1x.tar.gz Engine Type: Spark Kylin 63% completed after that i am getting this below error. WARN TaskSetManager: Lost task 0.0 in stage 1.0 (TID 2, CPCINCHDV001523.CTS.COM, executor 1): java.lang.ExceptionInInitializerError at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.getNewWriter(HFileOutputFormat2.java:305) at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:229) at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:167) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply$mcV$sp(PairRDDFunctions.scala:1125) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) at org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1353) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1131) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) at org.apache.spark.schedul
[jira] [Updated] (KYLIN-3931) Caused by: java.lang.RuntimeException: Could not create interface org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the hadoop compatibility jar o
[ https://issues.apache.org/jira/browse/KYLIN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] praveenece updated KYLIN-3931: -- Priority: Critical (was: Major) > Caused by: java.lang.RuntimeException: Could not create interface > org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the > hadoop compatibility jar on the classpath? > -- > > Key: KYLIN-3931 > URL: https://issues.apache.org/jira/browse/KYLIN-3931 > Project: Kylin > Issue Type: Test > Components: Environment >Affects Versions: v2.5.2 > Environment: apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hbase1x.tar.gz >Reporter: praveenece >Priority: Critical > > I am getting the below error. please find the environment details. > apache-hive-2.3.4-bin > hbase-1.4.9 > hadoop-3.1.0 > apache-kylin-2.5.2-bin-hbase1x.tar.gz > Engine Type: Spark > Kylin 63% completed after that i am getting this below error. > WARN TaskSetManager: Lost task 0.0 in stage 1.0 (TID 2, server.com, executor > 1): java.lang.ExceptionInInitializerError > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.getNewWriter(HFileOutputFormat2.java:305) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:229) > at > org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:167) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply$mcV$sp(PairRDDFunctions.scala:1125) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) > at > org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1353) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1131) > at > org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > Caused by: java.lang.RuntimeException: Could not create interface > org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the > hadoop compatibility jar on the classpath? > at > org.apache.hadoop.hbase.CompatibilitySingletonFactory.getInstance(CompatibilitySingletonFactory.java:73) > at org.apache.hadoop.hbase.io.MetricsIO.(MetricsIO.java:31) > at org.apache.hadoop.hbase.io.hfile.HFile.(HFile.java:191) > ... 15 more > Caused by: java.util.NoSuchElementException > at > java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:365) > at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404) > at java.util.ServiceLoader$1.next(ServiceLoader.java:480) > at > org.apache.hadoop.hbase.CompatibilitySingletonFactory.getInstance(CompatibilitySingletonFactory.java:59) > ... 17 more > 19/04/01 11:47:55 INFO TaskSetManager: Starting task 0.1 in stage 1.0 (TID 3, > server.com, executor 1, partition 0, NODE_LOCAL, 5842 bytes) > 19/04/01 11:47:55 WARN TaskSetManager: Lost task 0.1 in stage 1.0 (TID 3, > server.com, executor 1): java.lang.NoClassDefFoundError: Could not initialize > class org.apache.hadoop.hbase.io.hfile.HFile -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3931) Caused by: java.lang.RuntimeException: Could not create interface org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the hadoop compatibility jar o
praveenece created KYLIN-3931: - Summary: Caused by: java.lang.RuntimeException: Could not create interface org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the hadoop compatibility jar on the classpath? Key: KYLIN-3931 URL: https://issues.apache.org/jira/browse/KYLIN-3931 Project: Kylin Issue Type: Test Components: Environment Affects Versions: v2.5.2 Environment: apache-hive-2.3.4-bin hbase-1.4.9 hadoop-3.1.0 apache-kylin-2.5.2-bin-hbase1x.tar.gz Reporter: praveenece I am getting the below error. please find the environment details. apache-hive-2.3.4-bin hbase-1.4.9 hadoop-3.1.0 apache-kylin-2.5.2-bin-hbase1x.tar.gz Engine Type: Spark Kylin 63% completed after that i am getting this below error. WARN TaskSetManager: Lost task 0.0 in stage 1.0 (TID 2, CPCINCHDV001523.CTS.COM, executor 1): java.lang.ExceptionInInitializerError at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.getNewWriter(HFileOutputFormat2.java:305) at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:229) at org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2$1.write(HFileOutputFormat2.java:167) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply$mcV$sp(PairRDDFunctions.scala:1125) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12$$anonfun$apply$4.apply(PairRDDFunctions.scala:1123) at org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1353) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1131) at org.apache.spark.rdd.PairRDDFunctions$$anonfun$saveAsNewAPIHadoopDataset$1$$anonfun$12.apply(PairRDDFunctions.scala:1102) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) at org.apache.spark.scheduler.Task.run(Task.scala:99) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.RuntimeException: Could not create interface org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactory Is the hadoop compatibility jar on the classpath? at org.apache.hadoop.hbase.CompatibilitySingletonFactory.getInstance(CompatibilitySingletonFactory.java:73) at org.apache.hadoop.hbase.io.MetricsIO.(MetricsIO.java:31) at org.apache.hadoop.hbase.io.hfile.HFile.(HFile.java:191) ... 15 more Caused by: java.util.NoSuchElementException at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:365) at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404) at java.util.ServiceLoader$1.next(ServiceLoader.java:480) at org.apache.hadoop.hbase.CompatibilitySingletonFactory.getInstance(CompatibilitySingletonFactory.java:59) ... 17 more 19/04/01 11:47:55 INFO TaskSetManager: Starting task 0.1 in stage 1.0 (TID 3, CPCINCHDV001523.CTS.COM, executor 1, partition 0, NODE_LOCAL, 5842 bytes) 19/04/01 11:47:55 WARN TaskSetManager: Lost task 0.1 in stage 1.0 (TID 3, CPCINCHDV001523.CTS.COM, executor 1): java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hbase.io.hfile.HFile -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3859) Unknown column 'A0.CATALOG_NAME' in 'where clause'
[ https://issues.apache.org/jira/browse/KYLIN-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] praveenece updated KYLIN-3859: -- Description: Find below software and its version installed. 1.apache-kylin-2.6.0-bin-hadoop3 2.hadoop-3.1.1 3.hbase-2.0.0 4.apache-hive-3.1.1-bin the below exception is being thrown while trying to load data source from Kylin UI. com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown column 'A0.CATALOG_NAME' in 'where clause'. after updating columns in DBS and TBLS in Hive metastore i am able to view db and table names but we tried to do sync i am getting exceptions like : org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.RuntimeException: cannot get HiveTableMeta at org.apache.kylin.source.hive.HiveTable.(HiveTable.java:50) at org.apache.kylin.source.hive.HiveSource.createReadableTable(HiveSource.java:68) at org.apache.kylin.source.SourceManager.createReadableTable(SourceManager.java:145) at org.apache.kylin.cube.CubeManager$DictionaryAssist.buildSnapshotTable(CubeManager.java:1173) at org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:1090) at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:97) at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:55) at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:73) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93) at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: MetaException(message:java.lang.UnsupportedOperationException: Storage schema reading not supported) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newMetaException(HiveMetaStore.java:6935) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_fields_with_environment_context(HiveMetaStore.java:5182) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_fields(HiveMetaStore.java:5144) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) at com.sun.proxy.$Proxy66.get_fields(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getFields(HiveMetaStoreClient.java:1845) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getFields(HiveMetaStoreClient.java:1839) at org.apache.kylin.source.hive.CLIHiveClient.getHiveTableMeta(CLIHiveClient.java:78) at org.apache.kylin.source.hive.HiveTable.(HiveTable.java:48) ... 16 more Caused by: java.lang.UnsupportedOperationException: Storage schema reading not supported at org.apache.hadoop.hive.metastore.DefaultStorageSchemaReader.readSchema(DefaultStorageSchemaReader.java:36) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_fields_with_environment_context(HiveMetaStore.java:5173) ... 28 more result code:2 at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Threa
[jira] [Created] (KYLIN-3859) Unknown column 'A0.CATALOG_NAME' in 'where clause'
praveenece created KYLIN-3859: - Summary: Unknown column 'A0.CATALOG_NAME' in 'where clause' Key: KYLIN-3859 URL: https://issues.apache.org/jira/browse/KYLIN-3859 Project: Kylin Issue Type: Test Components: Storage - HBase Reporter: praveenece Find below software and its version installed. 1.apache-kylin-2.6.0-bin-hadoop3 2.hadoop-3.1.1 3.hbase-2.0.0 4.apache-hive-3.1.1-bin the below exception is being thrown while trying load data source from Kylin UI. com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown column 'A0.CATALOG_NAME' in 'where clause'. after updating columns in DBS and TBLS in HIve metasore i am able to view db and table names but we tried to do sync i am getting exceptions like : org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.RuntimeException: cannot get HiveTableMeta at org.apache.kylin.source.hive.HiveTable.(HiveTable.java:50) at org.apache.kylin.source.hive.HiveSource.createReadableTable(HiveSource.java:68) at org.apache.kylin.source.SourceManager.createReadableTable(SourceManager.java:145) at org.apache.kylin.cube.CubeManager$DictionaryAssist.buildSnapshotTable(CubeManager.java:1173) at org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:1090) at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:97) at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:55) at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:73) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93) at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: MetaException(message:java.lang.UnsupportedOperationException: Storage schema reading not supported) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newMetaException(HiveMetaStore.java:6935) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_fields_with_environment_context(HiveMetaStore.java:5182) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_fields(HiveMetaStore.java:5144) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) at com.sun.proxy.$Proxy66.get_fields(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getFields(HiveMetaStoreClient.java:1845) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getFields(HiveMetaStoreClient.java:1839) at org.apache.kylin.source.hive.CLIHiveClient.getHiveTableMeta(CLIHiveClient.java:78) at org.apache.kylin.source.hive.HiveTable.(HiveTable.java:48) ... 16 more Caused by: java.lang.UnsupportedOperationException: Storage schema reading not supported at org.apache.hadoop.hive.metastore.DefaultStorageSchemaReader.readSchema(DefaultStorageSchemaReader.java:36) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_fields_with_environment_context(HiveMetaStore.java:5173) ... 28 more result code:2 at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:165) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) at java.util.concurrent.ThreadPoolExecutor.runWorker(Thr
[jira] [Created] (KYLIN-3409) write metric error when i hit query.
praveenece created KYLIN-3409: - Summary: write metric error when i hit query. Key: KYLIN-3409 URL: https://issues.apache.org/jira/browse/KYLIN-3409 Project: Kylin Issue Type: Bug Reporter: praveenece Hi, I hit query(using sub query) against Cube the below exception is coming in kylin log but kylin UI response output. why its coming? 2018-06-13 17:15:51,153 WARN [Query 707b91e9-bcaa-46ef-be66-e7b74a3442d0-69] service.QueryService:471 : Write metric error. java.lang.NullPointerException at org.apache.kylin.rest.metrics.QueryMetricsFacade.updateMetricsToReservoir(QueryMetricsFacade.java:125) at org.apache.kylin.rest.metrics.QueryMetricsFacade.updateMetrics(QueryMetricsFacade.java:73) at org.apache.kylin.rest.service.QueryService.recordMetric(QueryService.java:560) at org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:469) at org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:390) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:86) at sun.reflect.GeneratedMethodAccessor313.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872) at javax.servlet.http.HttpServlet.service(HttpServlet.java:650) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846) at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3397) Kylin UI Timestemp(GMT) issue
[ https://issues.apache.org/jira/browse/KYLIN-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16507902#comment-16507902 ] praveenece commented on KYLIN-3397: --- Hi Pan, Could you check this issue? > Kylin UI Timestemp(GMT) issue > - > > Key: KYLIN-3397 > URL: https://issues.apache.org/jira/browse/KYLIN-3397 > Project: Kylin > Issue Type: Bug > Components: Web >Reporter: praveenece >Priority: Major > > > Kylin Version 2.3.1 > In Kylin React-the Data has inserted into System Cube table based on GMT > format,but the user > Changed option GMT to GMT+5.30 in kylin UI (Kylin.properties). > when we build segment wise in System Cube(Kylin UI).the system has generated > select statement in first step of build,its > taken internally GMT+5.30 format not for GMT. > below i given generated select query from First step of Create Intermediate > Flat Hive Table(log) > SELECT x,y,z > FROM KYLIN.HIVE_METRICS_QUERY_CUBE_QA as HIVE_METRICS_QUERY_CUBE_QA > WHERE 1=1 AND (((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-01' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME >= '17:10:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE > '2018-06-01')) > AND ((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-04' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME < '16:27:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE < '2018-06-04'))) > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3397) Kylin UI Timestemp(GMT) issue
[ https://issues.apache.org/jira/browse/KYLIN-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16504522#comment-16504522 ] praveenece commented on KYLIN-3397: --- Hi chen, could you any update on this issue? > Kylin UI Timestemp(GMT) issue > - > > Key: KYLIN-3397 > URL: https://issues.apache.org/jira/browse/KYLIN-3397 > Project: Kylin > Issue Type: Bug > Components: Web >Reporter: praveenece >Priority: Major > > > Kylin Version 2.3.1 > In Kylin React-the Data has inserted into System Cube table based on GMT > format,but the user > Changed option GMT to GMT+5.30 in kylin UI (Kylin.properties). > when we build segment wise in System Cube(Kylin UI).the system has generated > select statement in first step of build,its > taken internally GMT+5.30 format not for GMT. > below i given generated select query from First step of Create Intermediate > Flat Hive Table(log) > SELECT x,y,z > FROM KYLIN.HIVE_METRICS_QUERY_CUBE_QA as HIVE_METRICS_QUERY_CUBE_QA > WHERE 1=1 AND (((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-01' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME >= '17:10:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE > '2018-06-01')) > AND ((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-04' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME < '16:27:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE < '2018-06-04'))) > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3397) Kylin UI Timestemp(GMT) issue
[ https://issues.apache.org/jira/browse/KYLIN-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501633#comment-16501633 ] praveenece commented on KYLIN-3397: --- Hi Chen, i give you one example whenever i hit query against CUBE means the data updated in System Cube table GMT Timezone format. ex: Cube Name-KYLIN_HIVE_METRICS_QUERY_CUBE_QA kday_date=2018-06-04 kday_time=06:30:00(*GMT based*) GMT+5.30=12:00:00 Now am going to build System Cube segment wise.whether i want to give(From and Todate)*GMT+5.30* format or *GMT* format? because i changed GMT+5.30 format in kylin.properties. On Tue, Jun 5, 2018 at 12:27 PM, Zhixiong Chen (JIRA) > Kylin UI Timestemp(GMT) issue > - > > Key: KYLIN-3397 > URL: https://issues.apache.org/jira/browse/KYLIN-3397 > Project: Kylin > Issue Type: Bug > Components: Web >Reporter: praveenece >Assignee: Zhixiong Chen >Priority: Major > > > Kylin Version 2.3.1 > In Kylin React-the Data has inserted into System Cube table based on GMT > format,but the user > Changed option GMT to GMT+5.30 in kylin UI (Kylin.properties). > when we build segment wise in System Cube(Kylin UI).the system has generated > select statement in first step of build,its > taken internally GMT+5.30 format not for GMT. > below i given generated select query from First step of Create Intermediate > Flat Hive Table(log) > SELECT x,y,z > FROM KYLIN.HIVE_METRICS_QUERY_CUBE_QA as HIVE_METRICS_QUERY_CUBE_QA > WHERE 1=1 AND (((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-01' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME >= '17:10:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE > '2018-06-01')) > AND ((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-04' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME < '16:27:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE < '2018-06-04'))) > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Issue Comment Deleted] (KYLIN-3397) Kylin UI Timestemp(GMT) issue
[ https://issues.apache.org/jira/browse/KYLIN-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] praveenece updated KYLIN-3397: -- Comment: was deleted (was: Hi Chen, i give you one example whenever i hit query against CUBE means the data updated in System Cube table GMT Timezone format. ex: Cube Name-KYLIN_HIVE_METRICS_QUERY_CUBE_QA kday_date=2018-06-04 kday_time=06:30:00(GMT based) GMT+5.30=12:00:00 Now am going to build System Cube segment wise.whether i want to give(From and Todate)GMT+5.30 format or GMT format? because i changed GMT+5.30 format in kylin.properties.) > Kylin UI Timestemp(GMT) issue > - > > Key: KYLIN-3397 > URL: https://issues.apache.org/jira/browse/KYLIN-3397 > Project: Kylin > Issue Type: Bug > Components: Web >Reporter: praveenece >Assignee: Zhixiong Chen >Priority: Major > > > Kylin Version 2.3.1 > In Kylin React-the Data has inserted into System Cube table based on GMT > format,but the user > Changed option GMT to GMT+5.30 in kylin UI (Kylin.properties). > when we build segment wise in System Cube(Kylin UI).the system has generated > select statement in first step of build,its > taken internally GMT+5.30 format not for GMT. > below i given generated select query from First step of Create Intermediate > Flat Hive Table(log) > SELECT x,y,z > FROM KYLIN.HIVE_METRICS_QUERY_CUBE_QA as HIVE_METRICS_QUERY_CUBE_QA > WHERE 1=1 AND (((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-01' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME >= '17:10:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE > '2018-06-01')) > AND ((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-04' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME < '16:27:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE < '2018-06-04'))) > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3397) Kylin UI Timestemp(GMT) issue
[ https://issues.apache.org/jira/browse/KYLIN-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501565#comment-16501565 ] praveenece commented on KYLIN-3397: --- Hi Chen, i give you one example whenever i hit query against CUBE means the data updated in System Cube table GMT Timezone format. ex: Cube Name-KYLIN_HIVE_METRICS_QUERY_CUBE_QA kday_date=2018-06-04 kday_time=06:30:00(GMT based) GMT+5.30=12:00:00 Now am going to build System Cube segment wise.whether i want to give(From and Todate)GMT+5.30 format or GMT format? because i changed GMT+5.30 format in kylin.properties. > Kylin UI Timestemp(GMT) issue > - > > Key: KYLIN-3397 > URL: https://issues.apache.org/jira/browse/KYLIN-3397 > Project: Kylin > Issue Type: Bug > Components: Web >Reporter: praveenece >Assignee: Zhixiong Chen >Priority: Major > > > Kylin Version 2.3.1 > In Kylin React-the Data has inserted into System Cube table based on GMT > format,but the user > Changed option GMT to GMT+5.30 in kylin UI (Kylin.properties). > when we build segment wise in System Cube(Kylin UI).the system has generated > select statement in first step of build,its > taken internally GMT+5.30 format not for GMT. > below i given generated select query from First step of Create Intermediate > Flat Hive Table(log) > SELECT x,y,z > FROM KYLIN.HIVE_METRICS_QUERY_CUBE_QA as HIVE_METRICS_QUERY_CUBE_QA > WHERE 1=1 AND (((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-01' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME >= '17:10:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE > '2018-06-01')) > AND ((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-04' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME < '16:27:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE < '2018-06-04'))) > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (KYLIN-3397) Kylin UI Timestemp(GMT) issue
[ https://issues.apache.org/jira/browse/KYLIN-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501495#comment-16501495 ] praveenece edited comment on KYLIN-3397 at 6/5/18 8:52 AM: --- Hi Chen, i give you one example whenever i hit query against CUBE means the data updated in System Cube table GMT Timezone format. ex: Cube Name-KYLIN_HIVE_METRICS_QUERY_CUBE_QA kday_date=2018-06-04 kday_time=06:30:00(*GMT based*) GMT+5.30=12:00:00 Now am going to build System Cube segment wise.whether i want to give(From and Todate)*GMT+5.30* format or *GMT* format? because i changed GMT+5.30 format in kylin.properties. was (Author: praveenece): Hi Chen, i give you one example whenever i hit query against CUBE means the data updated in System Cube table GMT Timezone format. ex: Cube Name-KYLIN_HIVE_METRICS_QUERY_CUBE_QA kday_date-2018-06-04 kdat_time=06:30:00(*GMT based*) GMT+5.30=12:00:00 Now am going to build System Cube segment wise.whether i want to give(From and Todate)*GMT+5.30* format or *GMT* format? because i changed GMT+5.30 format in kylin.properties. > Kylin UI Timestemp(GMT) issue > - > > Key: KYLIN-3397 > URL: https://issues.apache.org/jira/browse/KYLIN-3397 > Project: Kylin > Issue Type: Bug > Components: Web >Reporter: praveenece >Assignee: Zhixiong Chen >Priority: Major > > > Kylin Version 2.3.1 > In Kylin React-the Data has inserted into System Cube table based on GMT > format,but the user > Changed option GMT to GMT+5.30 in kylin UI (Kylin.properties). > when we build segment wise in System Cube(Kylin UI).the system has generated > select statement in first step of build,its > taken internally GMT+5.30 format not for GMT. > below i given generated select query from First step of Create Intermediate > Flat Hive Table(log) > SELECT x,y,z > FROM KYLIN.HIVE_METRICS_QUERY_CUBE_QA as HIVE_METRICS_QUERY_CUBE_QA > WHERE 1=1 AND (((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-01' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME >= '17:10:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE > '2018-06-01')) > AND ((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-04' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME < '16:27:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE < '2018-06-04'))) > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3397) Kylin UI Timestemp(GMT) issue
[ https://issues.apache.org/jira/browse/KYLIN-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501495#comment-16501495 ] praveenece commented on KYLIN-3397: --- Hi Chen, i give you one example whenever i hit query against CUBE means the data updated in System Cube table GMT Timezone format. ex: Cube Name-KYLIN_HIVE_METRICS_QUERY_CUBE_QA kday_date-2018-06-04 kdat_time=06:30:00(*GMT based*) GMT+5.30=12:00:00 Now am going to build System Cube segment wise.whether i want to give(From and Todate)*GMT+5.30* format or *GMT* format? because i changed GMT+5.30 format in kylin.properties. > Kylin UI Timestemp(GMT) issue > - > > Key: KYLIN-3397 > URL: https://issues.apache.org/jira/browse/KYLIN-3397 > Project: Kylin > Issue Type: Bug > Components: Web >Reporter: praveenece >Assignee: Zhixiong Chen >Priority: Major > > > Kylin Version 2.3.1 > In Kylin React-the Data has inserted into System Cube table based on GMT > format,but the user > Changed option GMT to GMT+5.30 in kylin UI (Kylin.properties). > when we build segment wise in System Cube(Kylin UI).the system has generated > select statement in first step of build,its > taken internally GMT+5.30 format not for GMT. > below i given generated select query from First step of Create Intermediate > Flat Hive Table(log) > SELECT x,y,z > FROM KYLIN.HIVE_METRICS_QUERY_CUBE_QA as HIVE_METRICS_QUERY_CUBE_QA > WHERE 1=1 AND (((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-01' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME >= '17:10:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE > '2018-06-01')) > AND ((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-04' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME < '16:27:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE < '2018-06-04'))) > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3397) Kylin UI Timestemp(GMT) issue
[ https://issues.apache.org/jira/browse/KYLIN-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] praveenece updated KYLIN-3397: -- Description: Kylin Version 2.3.1 In Kylin React-the Data has inserted into System Cube table based on GMT format,but the user Changed option GMT to GMT+5.30 in kylin UI (Kylin.properties). when we build segment wise in System Cube(Kylin UI).the system has generated select statement in first step of build,its taken internally GMT+5.30 format not for GMT. below i given generated select query from First step of Create Intermediate Flat Hive Table(log) SELECT x,y,z FROM KYLIN.HIVE_METRICS_QUERY_CUBE_QA as HIVE_METRICS_QUERY_CUBE_QA WHERE 1=1 AND (((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-01' AND HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME >= '17:10:00') OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE > '2018-06-01')) AND ((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-04' AND HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME < '16:27:00') OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE < '2018-06-04'))) was: Kylin Version 2.3.1 In Kylin React-the Data has inserted into System Cube table based on GMT format,but the user Changed option GMT to GMT+5.30 in kylin UI (Kylin.properties). when we build segement wise in System Cube(Kylin UI).the system has generated select statment in first step of build,its taken GMT+5.30 format not for GMT. below i given generated select query from First step of Create Intermediate Flat Hive Table(log) SELECT x,y,z FROM KYLIN.HIVE_METRICS_QUERY_CUBE_QA as HIVE_METRICS_QUERY_CUBE_QA WHERE 1=1 AND (((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-01' AND HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME >= '17:10:00') OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE > '2018-06-01')) AND ((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-04' AND HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME < '16:27:00') OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE < '2018-06-04'))) > Kylin UI Timestemp(GMT) issue > - > > Key: KYLIN-3397 > URL: https://issues.apache.org/jira/browse/KYLIN-3397 > Project: Kylin > Issue Type: Bug > Components: Web >Reporter: praveenece >Assignee: Zhixiong Chen >Priority: Major > > > Kylin Version 2.3.1 > In Kylin React-the Data has inserted into System Cube table based on GMT > format,but the user > Changed option GMT to GMT+5.30 in kylin UI (Kylin.properties). > when we build segment wise in System Cube(Kylin UI).the system has generated > select statement in first step of build,its > taken internally GMT+5.30 format not for GMT. > below i given generated select query from First step of Create Intermediate > Flat Hive Table(log) > SELECT x,y,z > FROM KYLIN.HIVE_METRICS_QUERY_CUBE_QA as HIVE_METRICS_QUERY_CUBE_QA > WHERE 1=1 AND (((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-01' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME >= '17:10:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE > '2018-06-01')) > AND ((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-04' AND > HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME < '16:27:00') > OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE < '2018-06-04'))) > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3397) Kylin UI Timestemp(GMT) issue
praveenece created KYLIN-3397: - Summary: Kylin UI Timestemp(GMT) issue Key: KYLIN-3397 URL: https://issues.apache.org/jira/browse/KYLIN-3397 Project: Kylin Issue Type: Bug Reporter: praveenece Kylin Version 2.3.1 In Kylin React-the Data has inserted into System Cube table based on GMT format,but the user Changed option GMT to GMT+5.30 in kylin UI (Kylin.properties). when we build segement wise in System Cube(Kylin UI).the system has generated select statment in first step of build,its taken GMT+5.30 format not for GMT. below i given generated select query from First step of Create Intermediate Flat Hive Table(log) SELECT x,y,z FROM KYLIN.HIVE_METRICS_QUERY_CUBE_QA as HIVE_METRICS_QUERY_CUBE_QA WHERE 1=1 AND (((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-01' AND HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME >= '17:10:00') OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE > '2018-06-01')) AND ((HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE = '2018-06-04' AND HIVE_METRICS_QUERY_CUBE_QA.KDAY_TIME < '16:27:00') OR (HIVE_METRICS_QUERY_CUBE_QA.KDAY_DATE < '2018-06-04'))) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16494733#comment-16494733 ] praveenece commented on KYLIN-3351: --- Could u explain anyone Above my question? > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > Attachments: image 1.png, image 2.png > > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16493138#comment-16493138 ] praveenece edited comment on KYLIN-3351 at 5/29/18 9:02 AM: Hi Shaofeng I attached a screenshot of my cube. image 1 the Leaf Cuboid rollup rate 99.87% I prepared a query for this Cuboid and hit it. image 2 this cuboid is parent cuboid of image 1 cuboid. this cuboid rollup rate -99% whenever I hit query means changes(colors) happen only main cuboid, not for image 1 cuboid(99.87%) the roll up rate from parent cuboid to leaf cuboid is high, so that colors change happen in leaf cuboid.but not happen. kindly guide me. On Fri, May 18, 2018 at 2:54 PM, Shaofeng SHI (JIRA) was (Author: praveenece): Hi Shaofeng I attached a screenshot of my cube. image 1 the Leaf Cuboid rollup rate 99.87% I prepared a query for this Cuboid and hit it. image 2 this cuboid is parent cuboid of image 1 cuboid. this cuboid rollup rate -99% whenever I hit query means changes(colors) happen only main cuboid, not for image 1 cuboid(99.87%) the roll up rate from parent cuboid to leaf cuboid is not so high, so that colors change not happen in leaf cuboid. kindly guide me. On Fri, May 18, 2018 at 2:54 PM, Shaofeng SHI (JIRA) > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > Attachments: image 1.png, image 2.png > > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] praveenece updated KYLIN-3351: -- Attachment: image 2.png image 1.png Hi Shaofeng I attached a screenshot of my cube. image 1 the Leaf Cuboid rollup rate 99.87% I prepared a query for this Cuboid and hit it. image 2 this cuboid is parent cuboid of image 1 cuboid. this cuboid rollup rate -99% whenever I hit query means changes(colors) happen only main cuboid, not for image 1 cuboid(99.87%) the roll up rate from parent cuboid to leaf cuboid is not so high, so that colors change not happen in leaf cuboid. kindly guide me. On Fri, May 18, 2018 at 2:54 PM, Shaofeng SHI (JIRA) > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > Attachments: image 1.png, image 2.png > > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482261#comment-16482261 ] praveenece commented on KYLIN-3351: --- Sure Shaofang... On Fri, May 18, 2018 at 2:54 PM, Shaofeng SHI (JIRA) > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16478956#comment-16478956 ] praveenece commented on KYLIN-3351: --- i struck with this stage. Could u explain anyone Above my question? > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16474035#comment-16474035 ] praveenece edited comment on KYLIN-3351 at 5/16/18 10:55 AM: - Hi How we Decide Cuboid color changing?whether user hit the query against cuboids? or we follows any other steps? Scenario i selected one leaf-cuboid under that cuboid i checked what r the dimension combination based on i prepared query. example total dimension ABCD leaf cuboid -abc,abd,acd,bcd so i prepared select query which is contains dimension like abc (quboid) ex:select a,b,c from table; i hit qube and get records but abc (quboid )not change color instead of changed in parent cubiod like(abcd) . kindly guide me why this happen? was (Author: praveenece): Hi How we Decide Cuboid color changing?whether user hit the query against cuboids? or we follows any other steps? Scenario i selected one leaf-cuboid under that cuboid i checked what r the dimension combination based on i prepared query. i hit that query many times but leaf-Cuboid colors not changed. How we calculate row count in every Cuboid? > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16474035#comment-16474035 ] praveenece edited comment on KYLIN-3351 at 5/14/18 10:56 AM: - Hi How we Decide Cuboid color changing?whether user hit the query against cuboids? or we follows any other steps? Scenario i selected one leaf-cuboid under that cuboid i checked what r the dimension combination based on i prepared query. i hit that query many times but leaf-Cuboid colors not changed. How we calculate row count in every Cuboid? was (Author: praveenece): Hi How we Decide Cuboid color changing?whether user hit the query against cuboids? or we follows any other steps? Scenario i selected one leaf-cuboid under that cuboid i checked what r the dimension combination based on i prepared query. i hit that query many times but leaf-Cubiod colors not changed. > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16474035#comment-16474035 ] praveenece commented on KYLIN-3351: --- Hi How we Decide Cuboid color changing?whether user hit the query against cuboids? or we follows any other steps? Scenario i selected one leaf-cuboid under that cuboid i checked what r the dimension combination based on i prepared query. i hit that query many times but leaf-Cubiod colors not changed. > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16473848#comment-16473848 ] praveenece commented on KYLIN-3351: --- Hi Roberto, Thanks for Reply Roberto However as you say i also Done but in CubePlanner tab *right Corner recommend button* near not showing last optimized time detail even i done cube optimized also. Kindly guide me any steps follow to populate On Sun, May 13, 2018 at 11:15 PM, Roberto Tardío Olmos (JIRA) < > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471888#comment-16471888 ] praveenece commented on KYLIN-3351: --- Hi Chuqian i optimized my Cube but not Display Last optimized time in Cub planner tab Page. i referred below page Kindly tell me any configuration or steps to follow? User is able to get to know the last optimized time of the cube in Cube Planner tab page. http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16471527#comment-16471527 ] praveenece commented on KYLIN-3351: --- Hi Chuqian Yu thanks for Support. System Cube Data's are loaded and kylin Dashboard also working fine. > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469955#comment-16469955 ] praveenece commented on KYLIN-3351: --- Hi Chuqian, thanks for reply i checked kylinMetrics.xml which have hivesink only we used. i will try remaining things which your mentioned(kylin.properties) and let you know. > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468481#comment-16468481 ] praveenece edited comment on KYLIN-3351 at 5/9/18 8:55 AM: --- Hi Zhong i tried to collect Query metrics so i followed below steps. Below mentioned steps are done still in Dashboard (Query count and other items are Zero)what i want to do ? i checked jmx also for query count and pass,fail count are correctly showing but not link to kylin dashboard. what steps i missed kindly give me steps? # set following commands to setenv.sh export KYLIN_DEBUG_SETTINGS="-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=8008 -Djava.rmi.server.hostname=your server IP -Dcom.sun.management.jmxremote.rmi.port=8008 -Dcom.sun.management.jmxremote.local.only=false" 2. restart kylin server 3. test a query 4. run jconsole on my local computer 5. connect remote kylin server with ip:port 6. click MBean button and find Hadoop-kylin-*** MBeans. Kindly Give me Steps to solve this problem? was (Author: praveenece): Hi Zhong i tried to collect Query metrics so i followed below steps. Below mentioned steps are done still in Dashboard (Query count and other items are Zero)what i want to do ? i checked jmx also for query count and pass,fail count are correctly showing but not link to kylin dashboard. # set following commands to setenv.sh export KYLIN_DEBUG_SETTINGS="-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=8008 -Djava.rmi.server.hostname=your server IP -Dcom.sun.management.jmxremote.rmi.port=8008 -Dcom.sun.management.jmxremote.local.only=false" 2. restart kylin server 3. test a query 4. run jconsole on your local computer 5. connect remote kylin server with ip:port 6. click MBean button and find Hadoop-kylin-*** MBeans. Kindly Give me Steps to solve this problem? > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468481#comment-16468481 ] praveenece commented on KYLIN-3351: --- Hi Zhong i tried to collect Query metrics so i followed below steps. Below mentioned steps are done still in Dashboard (Query count and other items are Zero)what i want to do ? i checked jmx also for query count and pass,fail count are correctly showing but not link to kylin dashboard. # set following commands to setenv.sh export KYLIN_DEBUG_SETTINGS="-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=8008 -Djava.rmi.server.hostname=your server IP -Dcom.sun.management.jmxremote.rmi.port=8008 -Dcom.sun.management.jmxremote.local.only=false" 2. restart kylin server 3. test a query 4. run jconsole on your local computer 5. connect remote kylin server with ip:port 6. click MBean button and find Hadoop-kylin-*** MBeans. Kindly Give me Steps to solve this problem? > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466950#comment-16466950 ] praveenece commented on KYLIN-3351: --- Ok zhong i will check jira thanks for reply > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466935#comment-16466935 ] praveenece commented on KYLIN-3351: --- Hi Lisa , Thanks Lisa for Reply. i Didn't Run System Cube via Cron job, but i executed every cube manually. Whether its(Cron job) mandatory via execute? > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16463508#comment-16463508 ] praveenece commented on KYLIN-3351: --- Hi Zhong, i builded System Cubes but Source records is zero. whether i want to do any Data level? Can you please Guide me? Regards Praveen. G On Wed, May 2, 2018 at 1:34 PM, Zhong Yanghong (JIRA) > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16463392#comment-16463392 ] praveenece commented on KYLIN-3351: --- whether its mandatory to set (build system cubes to collect query metrics) for Cube planner? Regards Praveen.G On Wed, May 2, 2018 at 1:34 PM, Zhong Yanghong (JIRA) > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16463381#comment-16463381 ] praveenece commented on KYLIN-3351: --- No Zhong whether its mandatory (build system cubes to collect query metrics) for Cube planner? > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
[ https://issues.apache.org/jira/browse/KYLIN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460621#comment-16460621 ] praveenece commented on KYLIN-3351: --- thanks Billy for reply. Could you give me kylin user mailer? > Cube Planner not working in apche kylin 2.3.0(open Source) > -- > > Key: KYLIN-3351 > URL: https://issues.apache.org/jira/browse/KYLIN-3351 > Project: Kylin > Issue Type: Task >Reporter: praveenece >Priority: Major > > Hi Team > i want test Cube planner in apache-kylin(2.3.0),So i created cube with > segment, and i hit query to cube many times more than thousands but the cube > planner there is no change in cuboid level like color changing and not get > COUNT in exactly row count and other items.can u please guide me. > Note: > Could u tell me? > Cube Planner Working only old Cube (like 3 month before) or new Cube also. > Configuration(kylin.Properties) > kylin.cube.cubeplanner.enabled=true > Kylin Version=2.3.0(SINGLE NODE) > MyCube creation =10days before > I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3351) Cube Planner not working in apche kylin 2.3.0(open Source)
praveenece created KYLIN-3351: - Summary: Cube Planner not working in apche kylin 2.3.0(open Source) Key: KYLIN-3351 URL: https://issues.apache.org/jira/browse/KYLIN-3351 Project: Kylin Issue Type: Task Reporter: praveenece Hi Team i want test Cube planner in apache-kylin(2.3.0),So i created cube with segment, and i hit query to cube many times more than thousands but the cube planner there is no change in cuboid level like color changing and not get COUNT in exactly row count and other items.can u please guide me. Note: Could u tell me? Cube Planner Working only old Cube (like 3 month before) or new Cube also. Configuration(kylin.Properties) kylin.cube.cubeplanner.enabled=true Kylin Version=2.3.0(SINGLE NODE) MyCube creation =10days before I referred: http://kylin.apache.org/docs23/howto/howto_use_cube_planner.html -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3261) Out of Memory Error
praveenece created KYLIN-3261: - Summary: Out of Memory Error Key: KYLIN-3261 URL: https://issues.apache.org/jira/browse/KYLIN-3261 Project: Kylin Issue Type: Bug Components: Environment Affects Versions: v2.2.0 Reporter: praveenece Fix For: v2.2.0 I used apache Kylin for building cube (star Schema based) in cluster mode,but i have issue which i mentioned below.please guide me. Cluster detail three machine have 64GB(memory) one machine set job other two machine set query. version -apache kylin 2.2.0(hbase) hadoop version-2.4.0(Cluster mode) hbase version =1.3.1(Cluster mode) hive version 2.1.1 Exception: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.yarn.exceptions.YarnRuntimeException): java.io.IOException: Failed on local exception: java.io.IOException: Couldn't set up IO streams; Host Details : local host is: "hostname/ipname"; destination host is: "hostname":9000; at org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage.getFullJob(CachedHistoryStorage.java:147) at org.apache.hadoop.mapreduce.v2.hs.JobHistory.getJob(JobHistory.java:217) at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler$1.run(HistoryClientService.java:203) at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler$1.run(HistoryClientService.java:199) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.verifyAndGetJob(HistoryClientService.java:199) at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getJobReport(HistoryClientService.java:231) at org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getJobReport(MRClientProtocolPBServiceImpl.java:122) at org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:275) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007) Caused by: java.io.IOException: Failed on local exception: java.io.IOException: Couldn't set up IO streams; Host Details : local host is: "[hostname/|http://ctsingtohp12.cts.com/10.237.247.12]ipaddress";; destination host is: "[h|http://ctsingtohp12.cts.com/]ostname":9000; at [org.apache.hadoop.net|http://org.apache.hadoop.net/].NetUtils.wrapException(NetUtils.java:764) at org.apache.hadoop.ipc.Client.call(Client.java:1414) at org.apache.hadoop.ipc.Client.call(Client.java:1363) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) at com.sun.proxy.$Proxy9.getListing(Unknown Source) at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:190) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:103) at com.sun.proxy.$Proxy9.getListing(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getListing(ClientNamenodeProtocolTranslatorPB.java:515) at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1743) at org.apache.hadoop.fs.Hdfs$DirListingIterator.(Hdfs.java:203) at org.apache.hadoop.fs.Hdfs$DirListingIterator.(Hdfs.java:190) at org.apache.hadoop.fs.Hdfs$2.(Hdfs.java:172) at org.apache.hadoop.fs.Hdfs.listStatusIterator(Hdfs.java:172) at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1393) at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1388) at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90) at org.apache.hadoop.fs.FileContext.listStatus(FileContext.java:1388) at org.apache.hadoop.mapreduce.v2.jobhistory.JobHist