Re: doesnt complete a job in apache kylin.

[ebrahim zare]

hi.
I did not solve the problem and set the source of Yarn. Please send me the
settings for that (kylin.properties ,...)
my Email:ebrahimzare1...@gmail.com.
thanks .

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

dont complete a job in apache kylin.

[ebrahim zare]

hi. I built a job and see it in the monitor of Kylin.
the status is running.
I see a new table in Hive and all tables in
yarn(hadoop:http://localhost:8088/cluster/apps/ACCEPTED) but dont full
progress (final status=UNDEFINED).
I check the kylin.log but i dont find Error.

---

 

 

 
..
 thank you.

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

why does not the job complete?

[ebrahim zare]

hi. 
I could install Apache Kylin and built a job but doesnt complete it after
100 minutes and wait in first step (Create Intermediate Flat Hive Table) 
(status= running).
why does not the job complete?

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

doesnt complete a job in apache kylin

[ebrahim zare]

I installed hadoop 2.7.3 and hive 1.2.1 and Hbase 2.0.2 and spark 2.1.1.
I built a job(*BUILD CUBE - kylin_sales_cube -*
*2014060101_2015020200*) on the sample and after 57.10 mins(*#1
Step Name: Create Intermediate Flat Hive Table*
*Duration: 0 seconds Waiting: 0 seconds*) still is running it and doesnt
complete it.
I can see database and add a table in Data Source of window.

How long does the job complete for execute SQLs?
Do i have to configuration in Apache Kylin?
Please help me to complete it.
[image: image.png]

there is a log at run time a job about the sample cube of apache kylin

[ebrahim zare]

hi
When I run the cube, I encounter the following log
--
Create and distribute table, cmd:
hive -e "USE default;

DROP TABLE IF EXISTS
kylin_intermediate_kylin_sales_cube_a485908d_9d07_4219_8e4c_e64f13fdb686;
CREATE EXTERNAL TABLE IF NOT EXISTS
kylin_intermediate_kylin_sales_cube_a485908d_9d07_4219_8e4c_e64f13fdb686
(
KYLIN_SALES_TRANS_ID bigint
,KYLIN_SALES_PART_DT date
,KYLIN_SALES_LEAF_CATEG_ID bigint
,KYLIN_SALES_LSTG_SITE_ID int
,KYLIN_CATEGORY_GROUPINGS_META_CATEG_NAME string
,KYLIN_CATEGORY_GROUPINGS_CATEG_LVL2_NAME string
,KYLIN_CATEGORY_GROUPINGS_CATEG_LVL3_NAME string
,KYLIN_SALES_LSTG_FORMAT_NAME string
,KYLIN_SALES_SELLER_ID bigint
,KYLIN_SALES_BUYER_ID bigint
,BUYER_ACCOUNT_ACCOUNT_BUYER_LEVEL int
,SELLER_ACCOUNT_ACCOUNT_SELLER_LEVEL int
,BUYER_ACCOUNT_ACCOUNT_COUNTRY string
,SELLER_ACCOUNT_ACCOUNT_COUNTRY string
,BUYER_COUNTRY_NAME string
,SELLER_COUNTRY_NAME string
,KYLIN_SALES_OPS_USER_ID string
,KYLIN_SALES_OPS_REGION string
,KYLIN_SALES_PRICE decimal(19,4)
)
STORED AS SEQUENCEFILE
LOCATION
'hdfs://localhost:9000/usr/local/apache-hive-2.3.3-bin/metastore_db/kylin-a6f17f9b-830a-473c-b5e7-64bcbe8fb24f/kylin_intermediate_kylin_sales_cube_a485908d_9d07_4219_8e4c_e64f13fdb686';
ALTER TABLE
kylin_intermediate_kylin_sales_cube_a485908d_9d07_4219_8e4c_e64f13fdb686
SET TBLPROPERTIES('auto.purge'='true');
INSERT OVERWRITE TABLE
kylin_intermediate_kylin_sales_cube_a485908d_9d07_4219_8e4c_e64f13fdb686
SELECT
KYLIN_SALES.TRANS_ID as KYLIN_SALES_TRANS_ID
,KYLIN_SALES.PART_DT as KYLIN_SALES_PART_DT
,KYLIN_SALES.LEAF_CATEG_ID as KYLIN_SALES_LEAF_CATEG_ID
,KYLIN_SALES.LSTG_SITE_ID as KYLIN_SALES_LSTG_SITE_ID
,KYLIN_CATEGORY_GROUPINGS.META_CATEG_NAME as
KYLIN_CATEGORY_GROUPINGS_META_CATEG_NAME
,KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME as
KYLIN_CATEGORY_GROUPINGS_CATEG_LVL2_NAME
,KYLIN_CATEGORY_GROUPINGS.CATEG_LVL3_NAME as
KYLIN_CATEGORY_GROUPINGS_CATEG_LVL3_NAME
,KYLIN_SALES.LSTG_FORMAT_NAME as KYLIN_SALES_LSTG_FORMAT_NAME
,KYLIN_SALES.SELLER_ID as KYLIN_SALES_SELLER_ID
,KYLIN_SALES.BUYER_ID as KYLIN_SALES_BUYER_ID
,BUYER_ACCOUNT.ACCOUNT_BUYER_LEVEL as BUYER_ACCOUNT_ACCOUNT_BUYER_LEVEL
,SELLER_ACCOUNT.ACCOUNT_SELLER_LEVEL as SELLER_ACCOUNT_ACCOUNT_SELLER_LEVEL
,BUYER_ACCOUNT.ACCOUNT_COUNTRY as BUYER_ACCOUNT_ACCOUNT_COUNTRY
,SELLER_ACCOUNT.ACCOUNT_COUNTRY as SELLER_ACCOUNT_ACCOUNT_COUNTRY
,BUYER_COUNTRY.NAME as BUYER_COUNTRY_NAME
,SELLER_COUNTRY.NAME as SELLER_COUNTRY_NAME
,KYLIN_SALES.OPS_USER_ID as KYLIN_SALES_OPS_USER_ID
,KYLIN_SALES.OPS_REGION as KYLIN_SALES_OPS_REGION
,KYLIN_SALES.PRICE as KYLIN_SALES_PRICE
FROM DEFAULT.KYLIN_SALES as KYLIN_SALES
INNER JOIN DEFAULT.KYLIN_CAL_DT as KYLIN_CAL_DT
ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
INNER JOIN DEFAULT.KYLIN_CATEGORY_GROUPINGS as KYLIN_CATEGORY_GROUPINGS
ON KYLIN_SALES.LEAF_CATEG_ID = KYLIN_CATEGORY_GROUPINGS.LEAF_CATEG_ID AND
KYLIN_SALES.LSTG_SITE_ID = KYLIN_CATEGORY_GROUPINGS.SITE_ID
INNER JOIN DEFAULT.KYLIN_ACCOUNT as BUYER_ACCOUNT
ON KYLIN_SALES.BUYER_ID = BUYER_ACCOUNT.ACCOUNT_ID
INNER JOIN DEFAULT.KYLIN_ACCOUNT as SELLER_ACCOUNT
ON KYLIN_SALES.SELLER_ID = SELLER_ACCOUNT.ACCOUNT_ID
INNER JOIN DEFAULT.KYLIN_COUNTRY as BUYER_COUNTRY
ON BUYER_ACCOUNT.ACCOUNT_COUNTRY = BUYER_COUNTRY.COUNTRY
INNER JOIN DEFAULT.KYLIN_COUNTRY as SELLER_COUNTRY
ON SELLER_ACCOUNT.ACCOUNT_COUNTRY = SELLER_COUNTRY.COUNTRY
WHERE 1=1 AND (KYLIN_SALES.PART_DT >= '2012-01-01' AND KYLIN_SALES.PART_DT
< '2012-02-01')
;

" --hiveconf hive.merge.mapredfiles=false --hiveconf
hive.auto.convert.join=true --hiveconf dfs.replication=2 --hiveconf
hive.exec.compress.output=true --hiveconf
hive.auto.convert.join.noconditionaltask=true --hiveconf
mapreduce.job.split.metainfo.maxsize=-1 --hiveconf
hive.merge.mapfiles=false --hiveconf
hive.auto.convert.join.noconditionaltask.size=1 --hiveconf
hive.stats.autogather=true
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/local/apache-hive-2.3.3-bin/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/local/hadoop-3.0.3/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type
[org.apache.logging.slf4j.Log4jLoggerFactory]

Logging initialized using configuration in
jar:file:/usr/local/apache-hive-2.3.3-bin/lib/hive-common-2.3.3.jar!/hive-log4j2.properties
Async: true
Tue Oct 30 10:12:38 PDT 2018 WARN: Establishing SSL connection without
server's identity verification is not recommended. According to MySQL
5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established
by default if explicit option isn't set. For compliance with existing
applications not using SSL the verifyServerCertificate property is set to
'false'. You need either to explicitly disable SSL by setting useSSL=false,
or set useSSL=true and provide truststore for server certificate
verification.
Tue Oct 30 10:12:38 P

does Apache Kylin need a Apache Derby or Mysql for run the sample cube

[ebrahim zare]

I installed Java and Hadoop and Hbase and Hive and Spark and Kylin.
hadoop-3.0.3

hbase-1.2.6

apache-hive-2.3.3-bin

spark-2.2.2-bin-without-hadoop

apache-kylin-2.3.1-bin

I will be grateful if someone in Help me with Kyle's installation and
configuration them.