[
https://issues.apache.org/jira/browse/KYLIN-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shailesh updated KYLIN-1114:
----------------------------
Description:
-- Pulled from https://github.com/apache/incubator-kylin/tree/1.x-HBase1.x on
10/20.
-- Successfully built and packaged on 10/20
-- Started kylin.sh
Please review the cube building steps here:
http://spark.datalenz.com/kylin/mov/JIRA.mov
Latest pull of 1.x-HBase1.x fails on the script find-hive-dependency.sh. I
noted there are differences between the latest and one that I pulled on 10/20.
Kylin does not start due to failed Hive dependency with the latest code. But
no issues starting from the 10/20/2015 pull.
/home/worker1/kylin/1.1-HBase-1.1-bin/apache-kylin-1.1-incubating-SNAPSHOT-bin/bin
[root@worker1 bin]# ./find-hive-dependency.sh
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/spark/lib/spark-assembly-1.4.1.2.3.2.0-2950-hadoop2.7.1.2.3.2.0-2950.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
WARNING: Use "yarn jar" to launch YARN applications.
^C
[root@worker1 bin]# ^C
[root@worker1 bin]# export
KYLIN_HOME=/home/worker1/kylin/1.1-HBase-1.1-bin/apache-kylin-1.1-incubating-SNAPSHOT-bin
[root@worker1 bin]# ./find-hive-dependency.sh
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/spark/lib/spark-assembly-1.4.1.2.3.2.0-2950-hadoop2.7.1.2.3.2.0-2950.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
WARNING: Use "yarn jar" to launch YARN applications.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/spark/lib/spark-assembly-1.4.1.2.3.2.0-2950-hadoop2.7.1.2.3.2.0-2950.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Logging initialized using configuration in
file:/etc/hive/2.3.2.0-2950/0/hive-log4j.properties
hcatalog lib not found
[root@worker1 bin]# diff find-hive-dependency.sh
../../../1.x-HBase1.x-bin/kylin-1.1-incubating-SNAPSHOT/bin/find-hive-dependency.sh
39c39
< hive_home=`echo $hive_exec_path | awk -F '/lib/' '{print $1}'`/
---
> hdp_home=`echo $hive_exec_path | awk -F '/hive.*/lib/' '{print $1}'`
41c41
< hcatalog=`find $hive_home -name "hive-hcatalog-core[0-9\.-]*jar" 2>&1 | grep
-m 1 -v 'Permission denied'`
---
> hcatalog=`find $hdp_home -name "hive-hcatalog-core[0-9\.-]*jar" 2>&1 | grep
> -m 1 -v 'Permission denied'`
[root@worker1 bin]#
Update: 10/30. I fixed the find-hive-dependency script and it fails at the
same step while building the cube. Kindly look at the way the cube is being
built and help us guide on the right way to build it, if this is not a bug.
was:
-- Pulled from https://github.com/apache/incubator-kylin/tree/1.x-HBase1.x on
10/20.
-- Successfully built and packaged on 10/20
-- Started kylin.sh
Please review the cube building steps here:
http://spark.datalenz.com/kylin/mov/JIRA.mov
Latest pull of 1.x-HBase1.x fails on the script find-hive-dependency.sh. I
noted there are differences between the latest and one that I pulled on 10/20.
Kylin does not start due to failed Hive dependency with the latest code. But
no issues starting from the 10/20/2015 pull.
/home/worker1/kylin/1.1-HBase-1.1-bin/apache-kylin-1.1-incubating-SNAPSHOT-bin/bin
[root@worker1 bin]# ./find-hive-dependency.sh
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/spark/lib/spark-assembly-1.4.1.2.3.2.0-2950-hadoop2.7.1.2.3.2.0-2950.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
WARNING: Use "yarn jar" to launch YARN applications.
^C
[root@worker1 bin]# ^C
[root@worker1 bin]# export
KYLIN_HOME=/home/worker1/kylin/1.1-HBase-1.1-bin/apache-kylin-1.1-incubating-SNAPSHOT-bin
[root@worker1 bin]# ./find-hive-dependency.sh
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/spark/lib/spark-assembly-1.4.1.2.3.2.0-2950-hadoop2.7.1.2.3.2.0-2950.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
WARNING: Use "yarn jar" to launch YARN applications.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/hdp/2.3.2.0-2950/spark/lib/spark-assembly-1.4.1.2.3.2.0-2950-hadoop2.7.1.2.3.2.0-2950.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Logging initialized using configuration in
file:/etc/hive/2.3.2.0-2950/0/hive-log4j.properties
hcatalog lib not found
[root@worker1 bin]# diff find-hive-dependency.sh
../../../1.x-HBase1.x-bin/kylin-1.1-incubating-SNAPSHOT/bin/find-hive-dependency.sh
39c39
< hive_home=`echo $hive_exec_path | awk -F '/lib/' '{print $1}'`/
---
> hdp_home=`echo $hive_exec_path | awk -F '/hive.*/lib/' '{print $1}'`
41c41
< hcatalog=`find $hive_home -name "hive-hcatalog-core[0-9\.-]*jar" 2>&1 | grep
-m 1 -v 'Permission denied'`
---
> hcatalog=`find $hdp_home -name "hive-hcatalog-core[0-9\.-]*jar" 2>&1 | grep
> -m 1 -v 'Permission denied'`
[root@worker1 bin]#
> Cannot find rowkey column XXX in cube CubeDesc
> -----------------------------------------------
>
> Key: KYLIN-1114
> URL: https://issues.apache.org/jira/browse/KYLIN-1114
> Project: Kylin
> Issue Type: Bug
> Components: Tools, Build and Test
> Affects Versions: 1.x-HBase1.x
> Environment: CentOS 7
> HDFS 2.7.1.2.3
> MapReduce2 2.7.1.2.3
> YARN 2.7.1.2.3
> Hive 1.2.1.2.3
> HBase 1.1.1.2.3
> Reporter: Shailesh
> Assignee: hongbin ma
>
> -- Pulled from https://github.com/apache/incubator-kylin/tree/1.x-HBase1.x
> on 10/20.
> -- Successfully built and packaged on 10/20
> -- Started kylin.sh
> Please review the cube building steps here:
> http://spark.datalenz.com/kylin/mov/JIRA.mov
> Latest pull of 1.x-HBase1.x fails on the script find-hive-dependency.sh. I
> noted there are differences between the latest and one that I pulled on
> 10/20. Kylin does not start due to failed Hive dependency with the latest
> code. But no issues starting from the 10/20/2015 pull.
> /home/worker1/kylin/1.1-HBase-1.1-bin/apache-kylin-1.1-incubating-SNAPSHOT-bin/bin
> [root@worker1 bin]# ./find-hive-dependency.sh
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/usr/hdp/2.3.2.0-2950/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/hdp/2.3.2.0-2950/spark/lib/spark-assembly-1.4.1.2.3.2.0-2950-hadoop2.7.1.2.3.2.0-2950.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> WARNING: Use "yarn jar" to launch YARN applications.
> ^C
> [root@worker1 bin]# ^C
> [root@worker1 bin]# export
> KYLIN_HOME=/home/worker1/kylin/1.1-HBase-1.1-bin/apache-kylin-1.1-incubating-SNAPSHOT-bin
> [root@worker1 bin]# ./find-hive-dependency.sh
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/usr/hdp/2.3.2.0-2950/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/hdp/2.3.2.0-2950/spark/lib/spark-assembly-1.4.1.2.3.2.0-2950-hadoop2.7.1.2.3.2.0-2950.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> WARNING: Use "yarn jar" to launch YARN applications.
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/usr/hdp/2.3.2.0-2950/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/hdp/2.3.2.0-2950/spark/lib/spark-assembly-1.4.1.2.3.2.0-2950-hadoop2.7.1.2.3.2.0-2950.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> Logging initialized using configuration in
> file:/etc/hive/2.3.2.0-2950/0/hive-log4j.properties
> hcatalog lib not found
> [root@worker1 bin]# diff find-hive-dependency.sh
> ../../../1.x-HBase1.x-bin/kylin-1.1-incubating-SNAPSHOT/bin/find-hive-dependency.sh
>
> 39c39
> < hive_home=`echo $hive_exec_path | awk -F '/lib/' '{print $1}'`/
> ---
> > hdp_home=`echo $hive_exec_path | awk -F '/hive.*/lib/' '{print $1}'`
> 41c41
> < hcatalog=`find $hive_home -name "hive-hcatalog-core[0-9\.-]*jar" 2>&1 |
> grep -m 1 -v 'Permission denied'`
> ---
> > hcatalog=`find $hdp_home -name "hive-hcatalog-core[0-9\.-]*jar" 2>&1 | grep
> > -m 1 -v 'Permission denied'`
> [root@worker1 bin]#
> Update: 10/30. I fixed the find-hive-dependency script and it fails at the
> same step while building the cube. Kindly look at the way the cube is being
> built and help us guide on the right way to build it, if this is not a bug.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
