[jira] [Created] (KYLIN-4785) Unable to have multiple AD groups access restriction
BKRV created KYLIN-4785: --- Summary: Unable to have multiple AD groups access restriction Key: KYLIN-4785 URL: https://issues.apache.org/jira/browse/KYLIN-4785 Project: Kylin Issue Type: Bug Components: Others Affects Versions: v3.0.1 Environment: Production - Edge Node of AWS EMR 5.26 Reporter: BKRV I have three different user groups in AD requiring different user privileges. Readonly Create Admin With the current AD integration, I am unable to have access setting privileges. How to fixthis? Is this is a feature issue? -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4655) Load HFile to HBase Table step is loading the files over and over
[
https://issues.apache.org/jira/browse/KYLIN-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163196#comment-17163196
]
BKRV commented on KYLIN-4655:
-
Have uploaded kylin logs.
Just so I understand it right, if the "{color:#44}Convert Cuboid Data to
HFile{color}" creates 8 GB of data...am I to expect that "{color:#44}Load
HFile to HBase Table{color}" should also have 8 GB output?
> Load HFile to HBase Table step is loading the files over and over
> -
>
> Key: KYLIN-4655
> URL: https://issues.apache.org/jira/browse/KYLIN-4655
> Project: Kylin
> Issue Type: Bug
> Components: Storage - HBase
>Affects Versions: v2.6.5
> Environment: Production
>Reporter: BKRV
>Priority: Major
> Attachments: logs.zip
>
>
> When the cube is created using Spark engine selection load Hfile to Hbase
> step is required to copy ~9 GB data. But in turn the job runs in a never
> ending loop and the files are getting copied over several times. Even after
> discarding the cube the job keeps running in backend.
> Hbase master service is required to be rebooted for this stop.
> Unable to identify the root cause.
> When running using MR engine do not encounter this issue.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (KYLIN-4655) Load HFile to HBase Table step is loading the files over and over
[ https://issues.apache.org/jira/browse/KYLIN-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BKRV updated KYLIN-4655: Attachment: logs.zip > Load HFile to HBase Table step is loading the files over and over > - > > Key: KYLIN-4655 > URL: https://issues.apache.org/jira/browse/KYLIN-4655 > Project: Kylin > Issue Type: Bug > Components: Storage - HBase >Affects Versions: v2.6.5 > Environment: Production >Reporter: BKRV >Priority: Major > Attachments: logs.zip > > > When the cube is created using Spark engine selection load Hfile to Hbase > step is required to copy ~9 GB data. But in turn the job runs in a never > ending loop and the files are getting copied over several times. Even after > discarding the cube the job keeps running in backend. > Hbase master service is required to be rebooted for this stop. > Unable to identify the root cause. > When running using MR engine do not encounter this issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4655) Load HFile to HBase Table step is loading the files over and over
BKRV created KYLIN-4655: --- Summary: Load HFile to HBase Table step is loading the files over and over Key: KYLIN-4655 URL: https://issues.apache.org/jira/browse/KYLIN-4655 Project: Kylin Issue Type: Bug Components: Storage - HBase Affects Versions: v2.6.5 Environment: Production Reporter: BKRV When the cube is created using Spark engine selection load Hfile to Hbase step is required to copy ~9 GB data. But in turn the job runs in a never ending loop and the files are getting copied over several times. Even after discarding the cube the job keeps running in backend. Hbase master service is required to be rebooted for this stop. Unable to identify the root cause. When running using MR engine do not encounter this issue. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (KYLIN-4439) Failed to find metadata store by url: kylin_metadata@hbase
[ https://issues.apache.org/jira/browse/KYLIN-4439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BKRV closed KYLIN-4439. --- Resolution: Not A Problem > Failed to find metadata store by url: kylin_metadata@hbase > -- > > Key: KYLIN-4439 > URL: https://issues.apache.org/jira/browse/KYLIN-4439 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.6.5, v3.0.1 > Environment: EMR 5.26 and tried both 3.0.1 and 2.6.5 versions >Reporter: BKRV >Priority: Major > Labels: beginner > > I followed the instructions provided in installation guide. Setting up Kylin > in EMR 5.26 > On trying to start Kylin, I get the following error > > 2020-04-01 02:53:35,493 INFO [main] client.ZooKeeperRegistry:107 : ClusterId > read in ZooKeeper is null > Exception in thread "main" java.lang.IllegalArgumentException: Failed to find > metadata store by url: kylin_metadata@hbase > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:99) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:111) > at > org.apache.kylin.common.persistence.ResourceTool.reset(ResourceTool.java:300) > at > org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:81) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92) > ... 3 more > Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Can't > get the location for replica 0 > at > org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:372) > at > org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:153) > at > org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:58) > at > org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:219) > at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:275) > at > org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:436) > at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:310) > at > org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:640) > at > org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:367) > at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:411) > at > org.apache.kylin.storage.hbase.HBaseConnection.tableExists(HBaseConnection.java:289) > at > org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:314) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:114) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.(HBaseResourceStore.java:88) > ... 8 more > 2020-04-01 02:53:40,477 INFO [close-hbase-conn] hbase.HBaseConnection:136 : > Closing HBase connections... > 2020-04-01 02:53:40,477 INFO [close-hbase-conn] > client.ConnectionManager$HConnectionImplementation:1776 : Closing zookeeper > sessionid=0x1036c090018 > 2020-04-01 02:53:40,479 INFO [close-hbase-conn] zookeeper.ZooKeeper:693 : > Session: 0x1036c090018 closed > 2020-04-01 02:53:40,479 INFO [main-EventThread] zookeeper.ClientCnxn:522 : > EventThread shut down for session: 0x1036c090018 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4439) Failed to find metadata store by url: kylin_metadata@hbase
[ https://issues.apache.org/jira/browse/KYLIN-4439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162466#comment-17162466 ] BKRV commented on KYLIN-4439: - The problem was with EMR unable to create the Hbase root directory on S3. Issue is not with Kylin > Failed to find metadata store by url: kylin_metadata@hbase > -- > > Key: KYLIN-4439 > URL: https://issues.apache.org/jira/browse/KYLIN-4439 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.6.5, v3.0.1 > Environment: EMR 5.26 and tried both 3.0.1 and 2.6.5 versions >Reporter: BKRV >Priority: Major > Labels: beginner > > I followed the instructions provided in installation guide. Setting up Kylin > in EMR 5.26 > On trying to start Kylin, I get the following error > > 2020-04-01 02:53:35,493 INFO [main] client.ZooKeeperRegistry:107 : ClusterId > read in ZooKeeper is null > Exception in thread "main" java.lang.IllegalArgumentException: Failed to find > metadata store by url: kylin_metadata@hbase > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:99) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:111) > at > org.apache.kylin.common.persistence.ResourceTool.reset(ResourceTool.java:300) > at > org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:81) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92) > ... 3 more > Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Can't > get the location for replica 0 > at > org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:372) > at > org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:153) > at > org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:58) > at > org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:219) > at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:275) > at > org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:436) > at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:310) > at > org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:640) > at > org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:367) > at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:411) > at > org.apache.kylin.storage.hbase.HBaseConnection.tableExists(HBaseConnection.java:289) > at > org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:314) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:114) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.(HBaseResourceStore.java:88) > ... 8 more > 2020-04-01 02:53:40,477 INFO [close-hbase-conn] hbase.HBaseConnection:136 : > Closing HBase connections... > 2020-04-01 02:53:40,477 INFO [close-hbase-conn] > client.ConnectionManager$HConnectionImplementation:1776 : Closing zookeeper > sessionid=0x1036c090018 > 2020-04-01 02:53:40,479 INFO [close-hbase-conn] zookeeper.ZooKeeper:693 : > Session: 0x1036c090018 closed > 2020-04-01 02:53:40,479 INFO [main-EventThread] zookeeper.ClientCnxn:522 : > EventThread shut down for session: 0x1036c090018 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4439) Failed to find metadata store by url: kylin_metadata@hbase
BKRV created KYLIN-4439: --- Summary: Failed to find metadata store by url: kylin_metadata@hbase Key: KYLIN-4439 URL: https://issues.apache.org/jira/browse/KYLIN-4439 Project: Kylin Issue Type: Bug Components: Environment Affects Versions: v3.0.1, v2.6.5 Environment: EMR 5.26 and tried both 3.0.1 and 2.6.5 versions Reporter: BKRV I followed the instructions provided in installation guide. Setting up Kylin in EMR 5.26 On trying to start Kylin, I get the following error 2020-04-01 02:53:35,493 INFO [main] client.ZooKeeperRegistry:107 : ClusterId read in ZooKeeper is null Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:99) at org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:111) at org.apache.kylin.common.persistence.ResourceTool.reset(ResourceTool.java:300) at org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:81) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92) ... 3 more Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Can't get the location for replica 0 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:372) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:153) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:58) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:219) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:275) at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:436) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:310) at org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:640) at org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:367) at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:411) at org.apache.kylin.storage.hbase.HBaseConnection.tableExists(HBaseConnection.java:289) at org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:314) at org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:114) at org.apache.kylin.storage.hbase.HBaseResourceStore.(HBaseResourceStore.java:88) ... 8 more 2020-04-01 02:53:40,477 INFO [close-hbase-conn] hbase.HBaseConnection:136 : Closing HBase connections... 2020-04-01 02:53:40,477 INFO [close-hbase-conn] client.ConnectionManager$HConnectionImplementation:1776 : Closing zookeeper sessionid=0x1036c090018 2020-04-01 02:53:40,479 INFO [close-hbase-conn] zookeeper.ZooKeeper:693 : Session: 0x1036c090018 closed 2020-04-01 02:53:40,479 INFO [main-EventThread] zookeeper.ClientCnxn:522 : EventThread shut down for session: 0x1036c090018 -- This message was sent by Atlassian Jira (v8.3.4#803005)
