RE: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Kumar, Manoj H
Excellent catch.. It was due to wrong Topic name. It ran fine when changed it. Regards, Manoj From: Billy Liu [mailto:billy...@apache.org] Sent: Friday, October 13, 2017 12:05 PM To: user Subject: Re: Kafka Streaming data - Error while building the Cube And in Kylin tutorial, the topic is kylind

yarn configuration problem when building kylin

2017-10-12 Thread op
when i builing my cube,the progress is always pending,then i find this in kylin.log,can't connect to the correct resourcemanager address,i've checked my environment,can you give me some advice? 2017-10-13 14:33:48,978 INFO [Job a8f48457-7c00-4cae-8857-c6e61c10213d-63] client.RMProxy:56 : Conn

Re: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Billy Liu
And in Kylin tutorial, the topic is kylindemo, in your sample, the topic is kylin_demo. Please double check the topic name. 2017-10-13 14:27 GMT+08:00 Billy Liu : > If you could package the source code, please try to add more debug log > when retrieving partition info by Kafka consumer. Check whi

Re: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Billy Liu
If you could package the source code, please try to add more debug log when retrieving partition info by Kafka consumer. Check which topic and how many partitions you got. 2017-10-12 23:19 GMT+08:00 Kumar, Manoj H : > I guess KafkaSource Class file where it has enrichSourcePartitionBeforeBuild()

Re: How to remove error model?

2017-10-12 Thread ShaoFeng Shi
Hi Hao, You can dump the metadata to local disk, modify them, and then restore back to HBase: https://kylin.apache.org/docs21/howto/howto_backup_metadata.html If you're doing this in production env, please be cautious, and take a backup is recommended. 2017-10-13 11:13 GMT+08:00 杨浩 : > There

Re: How to remove error model?

2017-10-12 Thread Shuangyin Ge
Hello Hao, Can you please try the steps mentioned in this page http://apache-kylin.74782.x6.nabble.com/How-to-clean-up-the-invisible-cube-td9023.html ? This should resolve most of the metadata inconsistency issues. 2017-10-13 11:13 GMT+08:00 杨浩 : > There are some error model/cube in kylin, it c

How to remove error model?

2017-10-12 Thread 杨浩
There are some error model/cube in kylin, it cannot be seen in the website, and I cannot genereate the same model named that, How to delete it? Command bin/metastore.sh clean --delete true cannot delete the dirty model.

RE: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Kumar, Manoj H
I guess KafkaSource Class file where it has enrichSourcePartitionBeforeBuild() to get partition values. There its getting Error out. Do we know how can we test out to find why its coming as 0 for start & end offset? Regards, Manoj From: Kumar, Manoj H Sent: Thursday, October 12, 2017 3:35 PM To

RE: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Kumar, Manoj H
Yes its there.. I could see the messages.. Regards, Manoj From: Billy Liu [mailto:billy...@apache.org] Sent: Thursday, October 12, 2017 3:11 PM To: user Subject: Re: Kafka Streaming data - Error while building the Cube STREAMING_SALES_TABLE table reads messages from Kafka topic kylin_demo，but go

Re: cannot file ojdbc6.jar while kylin startup

2017-10-12 Thread Billy Liu
You could ignore the boring message. That's tomcat tries to detect ODBC libraries from environment. Not real Kylin error. 2017-10-12 17:19 GMT+08:00 li...@fcyun.com : > > Hi, all > > Here my logs in kylin.out file. why this error ocuurs? > > > Another confusion, while I start kylin from > /usr/

Re: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Billy Liu
STREAMING_SALES_TABLE table reads messages from Kafka topic kylin_demo，but got 0 message. Could you check if the topic has incoming message: bin/kafka-console-consumer.sh --zookeeper localhost:2181 --bootstrap-server localhost:9092 --topic kylin_demo 2017-10-12 17:19 GMT+08:00 Kumar, Manoj H : >

cannot file ojdbc6.jar while kylin startup

2017-10-12 Thread li...@fcyun.com
Hi, all Here my logs in kylin.out file. why this error ocuurs? Another confusion, while I start kylin from /usr/local/apache-kylin-2.0.0-bin/lib/, then it complaint "/usr/local/apache-kylin-2.0.0-bin/lib/ojdbc6.jar" not found. #cd /usr/local/apache-kylin-2.0.0-bin/lib/ #../bin/kylin.sh sta

RE: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Kumar, Manoj H
Pls. find below information about consumer config from Kylin log file. 2017-10-11 02:11:43,787 INFO [pool-8-thread-1] threadpool.DefaultScheduler:123 : Job Fetcher: 0 should running, 0 actual running, 0 stopped, 0 ready, 1 already succeed, 0 error, 0 discarded, 0 others 2017-10-11 02:12:13,783

Re: Merge Segment ERROR

2017-10-12 Thread Billy Liu
Fixed at https://issues.apache.org/jira/browse/KYLIN-2794, and will be released in Apache Kylin 2.2 2017-10-11 15:41 GMT+08:00 s丶影中人* <845286...@qq.com>: > When i merge the segment encounter error, how can i solve it. Please... > Log as follows: > > 2017-10-11 15:24:56,139 ERROR [pool-9-thread-10

Re: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Billy Liu
Hi Kumar, Could you paste more Kafka Consumer related log in kylin.log? And also check from the Kafka broker side, if the Kylin client has connected to Broker. 2017-10-12 14:29 GMT+08:00 Kumar, Manoj H : > Building the Cube from Kylin UI - Although Messages are there in Kafka > topic but Kylin i