回复：no mapreduce.tar.gz available for kylin to build cube

2019-03-17 Thread 叩 龙 
Hi Na Zhai,

issue resolved by uploading that file. thanks

Thanks,
Sent from phone


 原始邮件 
主题：答复: no mapreduce.tar.gz available for kylin to build cube
发件人：Na Zhai
收件人：dev@kylin.apache.org
抄送：


Hi, 叩龙.

You should find mapreduce.tar.gz in your hdp env and put it to the 
hdfs://s1.hdp.com:8020/app/hw-base/hdp/apps/3.0.1.0-187/mapreduce/ directory.

发送自 Windows 10 版邮件应用


发件人: 叩 龙
发送时间: Friday, March 15, 2019 12:14:58 PM
收件人: dev@kylin.apache.org
主题: no mapreduce.tar.gz available for kylin to build cube

hi Team，

I use below :
HDP 3.0.1
Apache-Kylin-2.6.0-bin-hadoop3

while trying to build cube from kylin, I got below error. I checked that path, 
we don’t have mapreduce but only tez. Could you please advise how to make it 
forward? thanks

[cid:Image449.png@1697f8d33c71c2]




Error while building cube:

java.io.FileNotFoundException: File does not exist: 
hdfs://s1.hdp.com:8020/app/hw-base/hdp/apps/3.0.1.0-187/mapreduce/mapreduce.tar.gz
at org.apache.hadoop.fs.Hdfs.getFileStatus(Hdfs.java:145)
at 
org.apache.hadoop.fs.AbstractFileSystem.resolvePath(AbstractFileSystem.java:488)
at org.apache.hadoop.fs.FileContext$25.next(FileContext.java:2292)
at org.apache.hadoop.fs.FileContext$25.next(FileContext.java:2288)
at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90)

[cid:Image442.png@1697f89cd191bb]

发自 Windows 邮件

回复：/app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 40: [: too many arguments

2019-03-17 Thread 叩 龙 
hi Na Zhai ,

yes , I can start it and query from cube .thanks for your reply

Thanks,
Sent from phone


 原始邮件 
主题：答复: /app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 
40: [: too many arguments
发件人：Na Zhai
收件人：dev@kylin.apache.org
抄送：


Hi, 叩 龙.



Can you start Kylin and query with sample Cube successfully? If so, I think it 
is does not matter.



发送自 Windows 10 版邮件应用




发件人: 叩 龙
发送时间: Friday, March 15, 2019 1:36:10 PM
收件人: dev@kylin.apache.org
主题: /app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 40: 
[: too many arguments

hi Team，

does subjected error matter while starting up kylin?

kylin 2.6.0 & HDP 3.0

[root@s4 bin]# ./kylin.sh start
Retrieving hadoop conf dir...
KYLIN_HOME is set to /app/apache-kylin-2.6.0-bin-hadoop3
Retrieving hive dependency...
/app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 40: [: 
too many arguments
Retrieving hbase dependency...
Retrieving hadoop conf dir...
Retrieving kafka dependency...
Retrieving Spark dependency...
Start to check whether we need to migrate acl tables
Retrieving hive dependency...
/app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 40: [: 
too many arguments
Retrieving hbase dependency...
Retrieving hadoop conf dir...
Retrieving kafka dependency...
Retrieving Spark dependency...
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in 
[jar:file:/app/apache-kylin-2.6.0-bin-hadoop3/tool/kylin-tool-2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in 
[jar:file:/usr/hdp/3.0.1.0-187/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-03-15 13:35:03,549 INFO [main] common.KylinConfig:101 : Loading 
kylin-defaults.properties from 
file:/app/apache-kylin-2.6.0-bin-hadoop3/tool/kylin-tool-2.6.0.jar!/kylin-defaults.properties
2019-03-15 13:35:03,572 DEBUG [main] common.KylinConfig:328 : KYLIN_CONF 
property was not set, will seek KYLIN_HOME env variable
2019-03-15 13:35:03,576 INFO [main] common.KylinConfig:136 : Initialized a new 
KylinConfig from getInstanceFromEnv : 957465255
2019-03-15 13:35:03,644 INFO [main] persistence.ResourceStore:88 : Using 
metadata url kylin_metadata@hbase for resource store


发自 Windows 邮件

/app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 40: [: too many arguments

2019-03-14 Thread 叩 龙 
hi Team，

does subjected error matter while starting up kylin?

kylin 2.6.0 & HDP 3.0

[root@s4 bin]# ./kylin.sh start
Retrieving hadoop conf dir...
KYLIN_HOME is set to /app/apache-kylin-2.6.0-bin-hadoop3
Retrieving hive dependency...
/app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 40: [: 
too many arguments
Retrieving hbase dependency...
Retrieving hadoop conf dir...
Retrieving kafka dependency...
Retrieving Spark dependency...
Start to check whether we need to migrate acl tables
Retrieving hive dependency...
/app/apache-kylin-2.6.0-bin-hadoop3/bin/find-hive-dependency.sh: line 40: [: 
too many arguments
Retrieving hbase dependency...
Retrieving hadoop conf dir...
Retrieving kafka dependency...
Retrieving Spark dependency...
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in 
[jar:file:/app/apache-kylin-2.6.0-bin-hadoop3/tool/kylin-tool-2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in 
[jar:file:/usr/hdp/3.0.1.0-187/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-03-15 13:35:03,549 INFO  [main] common.KylinConfig:101 : Loading 
kylin-defaults.properties from 
file:/app/apache-kylin-2.6.0-bin-hadoop3/tool/kylin-tool-2.6.0.jar!/kylin-defaults.properties
2019-03-15 13:35:03,572 DEBUG [main] common.KylinConfig:328 : KYLIN_CONF 
property was not set, will seek KYLIN_HOME env variable
2019-03-15 13:35:03,576 INFO  [main] common.KylinConfig:136 : Initialized a new 
KylinConfig from getInstanceFromEnv : 957465255
2019-03-15 13:35:03,644 INFO  [main] persistence.ResourceStore:88 : Using 
metadata url kylin_metadata@hbase for resource 
store


发自 Windows 邮件

no mapreduce.tar.gz available for kylin to build cube

2019-03-14 Thread 叩 龙 
hi Team，

I use below :
HDP 3.0.1
Apache-Kylin-2.6.0-bin-hadoop3

while trying to build cube from kylin, I got below error. I checked that path, 
we don’t have mapreduce but only tez. Could you please advise how to make it 
forward? thanks

[cid:Image449.png@1697f8d33c71c2]




Error while building cube:

java.io.FileNotFoundException: File does not exist: 
hdfs://s1.hdp.com:8020/app/hw-base/hdp/apps/3.0.1.0-187/mapreduce/mapreduce.tar.gz
at org.apache.hadoop.fs.Hdfs.getFileStatus(Hdfs.java:145)
at 
org.apache.hadoop.fs.AbstractFileSystem.resolvePath(AbstractFileSystem.java:488)
at org.apache.hadoop.fs.FileContext$25.next(FileContext.java:2292)
at org.apache.hadoop.fs.FileContext$25.next(FileContext.java:2288)
at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90)

[cid:Image442.png@1697f89cd191bb]

发自 Windows 邮件

回复：api to build cube

2018-10-16 Thread 叩 龙 
thanks, i found that when use api to rebuild cube(non partition related), i 
will get http 500. pls see attached. Could you pls advise? thanks

Thanks,
Sent from phone


 原始邮件 
主题：答复: api to build cube
发件人：Na Zhai
收件人：dev@kylin.apache.org
抄送：


Hi, koulong

You are right. It is related to the partition that you choose in model. If you 
do not choose the partition, the start and end time will not need.

I hope this can help you. 
http://kylin.apache.org/docs/howto/howto_build_cube_with_restapi.html



发送自 Windows 10 版邮件应用




发件人: 叩 龙
发送时间: Monday, October 15, 2018 10:18:44 PM
收件人: kylin dev
主题: api to build cube

hi team,

i am trying to build cube. from the kylin web page, i can see some of the cubes 
reqiure start and end time but some not. what is the different between them? 
does it related to partition？
also according to the rest api kylin provided, which api shall i use if the 
cube doesnt require starttime and endtime at all?


Thanks,
Sent from phone

api to build cube

2018-10-15 Thread 叩 龙 
hi team,

i am trying to build cube. from the kylin web page, i can see some of the cubes 
reqiure start and end time but some not. what is the different between them? 
does it related to partition？
also according to the rest api kylin provided, which api shall i use if the 
cube doesnt require starttime and endtime at all?


Thanks,
Sent from phone

答复: starting up Apache got error :Failed to find metadata store by url: kylin_metadata@hbase

2018-09-27 Thread 叩 龙 


hi  Team,


i am using HDP 3.0 and apache kylin(apache-kylin-2.5.0-bin-hbase1x). while i 
was trying to start kylin in my first time, i got following error, could 
someone give me a help ? looks like it is compatibility issue as it cased by no 
such method. thanks


2018-09-27 21:21:58,058 INFO  [main] imps.CuratorFrameworkImpl:326 : Default 
schema
2018-09-27 21:21:58,059 DEBUG [main] util.ZookeeperDistributedLock:143 : 
20863@hw-04 trying to lock 
/kylin/kylin_metadata/create_htable/kylin_metadata/lock
2018-09-27 21:21:58,061 INFO  [main-SendThread(hw-03.hdp.com:2181)] 
zookeeper.ClientCnxn:1279 : Session establishment complete on server 
hw-03.hdp.com/192.168.1.93:2181, sessionid = 0x26616015ea10039, negotiated 
timeout = 6
2018-09-27 21:21:58,065 INFO  [main-EventThread] 
state.ConnectionStateManager:237 : State change: CONNECTED
Exception in thread "main" java.lang.IllegalArgumentException: Failed to find 
metadata store by url: kylin_metadata@hbase
at 
org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:98)
at 
org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:110)
at 
org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:98)
at 
org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at 
org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92)
... 3 more
Caused by: java.lang.NoSuchMethodError: 
org.apache.curator.framework.api.CreateBuilder.creatingParentsIfNeeded()Lorg/apache/curator/framework/api/ProtectACLCreateModePathAndBytesable;
at 
org.apache.kylin.storage.hbase.util.ZookeeperDistributedLock.lock(ZookeeperDistributedLock.java:146)
at 
org.apache.kylin.storage.hbase.util.ZookeeperDistributedLock.lock(ZookeeperDistributedLock.java:167)
at 
org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:328)
at 
org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:112)
at 
org.apache.kylin.storage.hbase.HBaseResourceStore.(HBaseResourceStore.java:93)
... 8 more
2018-09-27 21:21:58,086 INFO  [Curator-Framework-0] 
imps.CuratorFrameworkImpl:924 : backgroundOperationsLoop exiting

starting up Apache got error :Failed to find metadata store by url: kylin_metadata@hbase

2018-09-27 Thread 叩 龙 
hi  Team,


i am using HDP 3.0 and apache kylin(apache-kylin-2.5.0-bin-hbase1x). while i 
was trying to start kylin in my first time, i got following error, could 
someone give me a help ? looks like it is compatibility issue as it cased by no 
such method. thanks


2018-09-27 21:21:58,058 INFO  [main] imps.CuratorFrameworkImpl:326 : Default 
schema
2018-09-27 21:21:58,059 DEBUG [main] util.ZookeeperDistributedLock:143 : 
20863@hw-04 trying to lock 
/kylin/kylin_metadata/create_htable/kylin_metadata/lock
2018-09-27 21:21:58,061 INFO  [main-SendThread(hw-03.hdp.com:2181)] 
zookeeper.ClientCnxn:1279 : Session establishment complete on server 
hw-03.hdp.com/192.168.1.93:2181, sessionid = 0x26616015ea10039, negotiated 
timeout = 6
2018-09-27 21:21:58,065 INFO  [main-EventThread] 
state.ConnectionStateManager:237 : State change: CONNECTED
Exception in thread "main" java.lang.IllegalArgumentException: Failed to find 
metadata store by url: kylin_metadata@hbase
at 
org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:98)
at 
org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:110)
at 
org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:98)
at 
org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at 
org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92)
... 3 more
Caused by: java.lang.NoSuchMethodError: 
org.apache.curator.framework.api.CreateBuilder.creatingParentsIfNeeded()Lorg/apache/curator/framework/api/ProtectACLCreateModePathAndBytesable;
at 
org.apache.kylin.storage.hbase.util.ZookeeperDistributedLock.lock(ZookeeperDistributedLock.java:146)
at 
org.apache.kylin.storage.hbase.util.ZookeeperDistributedLock.lock(ZookeeperDistributedLock.java:167)
at 
org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:328)
at 
org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:112)
at 
org.apache.kylin.storage.hbase.HBaseResourceStore.(HBaseResourceStore.java:93)
... 8 more
2018-09-27 21:21:58,086 INFO  [Curator-Framework-0] 
imps.CuratorFrameworkImpl:924 : backgroundOperationsLoop exiting