RE: help to install kylin out of cdh cluster with kerberos enabled (withou install hive/hbase gateway in kylin servers)

Chengjun – Pls. ensure you have hadoop client set up done at Standalone machine & CLI should working from that machine – hive,spark etc. Unix SA has to set up that machine & then kylin services will run on that machine. Regards, Manoj From: ShaoFeng Shi [mailto:shaofeng...@apache.org] Sent:

RE: Kylin 2.3.1 - Error at #5 Step Name: Build Dimension Dictionary

lin.log to see how the metadata becomes corrupted. I guess there must be some HDFS error earlier in the log, maybe the HDFS is not stable at that moment etc.. On Wed, Aug 8, 2018 at 12:23 PM Kumar, Manoj H mailto:manoj.h.ku...@jpmorgan.com>> wrote: Can someone suggest on this? Wha

Kylin 2.3.1 - Error at #5 Step Name: Build Dimension Dictionary

Can someone suggest on this? Whats wrong here? java.io.IOException: Failed to read resource at /table_snapshot/DB_RFT_RCMO_RFDA.DRRBUSINESSHIERARCHY/2d660a9f-186d-47d9-b043-1ded145433ba.snapshot at

RE: Kylin performance

Can you pls. explain the issue in detail? Did you run query in "insight" section first? Its working fine there? Regards, Manoj From: Kosmachev, Dmitry [mailto:dkosmac...@luxoft.com] Sent: Tuesday, May 29, 2018 3:47 PM To: user@kylin.apache.org Subject: Kylin performance Hi! We have a strange

RE: Hybrid Cubes Document

oncept difficult to explain. I recommend you to do a test, for example with the learning kylin project ,adding a new measure to the fact table. Regards, Roberto From: Kumar, Manoj H [mailto:manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>] Sent: martes, 24 de abril de 201

RE: Hybrid Cubes Document

better use the Agg Group concept. Regards, Roberto From: Kumar, Manoj H [mailto:manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>] Sent: lunes, 23 de abril de 2018 9:39 To: user@kylin.apache.org<mailto:user@kylin.apache.org> Subject: RE: Hybrid Cubes Document Thanks.. When

RE: Hybrid Cubes Document

Thanks.. Whenever we need to change the Cube Dimensions – To add new Dimension/Column, This Hybrid Model would be efficient??. As this doesn’t need to re-build the previous cube & save the building time. Also, Another use case, Can we use Hybrid Cube Model for below purpose -Cube 1- 5

RE: Need Information on source Type of Apache Kylin

I guess Currently Kylin is being supported only for Hive or Kafka (real time streaming). However, There was some jira for sql-server. Not sure about this. Regards, Manoj -Original Message- From: Devhuti Kumari [mailto:devhuti.kum...@gmail.com] Sent: Monday, April 16, 2018 5:21 PM To:

RE: Re:RE: kylin 2.3.1 - System Cube Tables

9:01 db_rft_rcmo_rfda.HIVE_METRICS_JOB_QA.json -rw--- 1 a_rcmo_nd a_rcmo_grp 1624 Apr 2 09:01 db_rft_rcmo_rfda.HIVE_METRICS_JOB_EXCEPTION_QA.json [cid:image001.png@01D3CC29.C2ABC9C0] Regards, Manoj From: Kumar, Manoj H Sent: Wednesday, April 04, 2018 3:10 PM To: 'user@kylin.apache.org' &

RE: Re:RE: kylin 2.3.1 - System Cube Tables

cs.prefix" configuration in the kylin.properties file. Maybe it is better to use "DEFAULT" for this configuration by default. At 2018-04-02 22:26:56, "Kumar, Manoj H" <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>> wrote: Can it be possible to cr

RE: kylin 2.3.1 - System Cube Tables

Can it be possible to create the table in project Database as we don't have permission to create new databases KYLIN? How can we use the same hive DB used for Kylin Cube? Is there any way to change it? Pls. advise. Regards, Manoj This message is confidential and subject to terms at:

RE: [Announce] Apache Kylin 2.3.1 released

Liu 2018-03-28 17:03 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Pls. advise how can I download 2.3.1 version. I don’t see there https://archive.apache.org/dist/kylin/<https://secureweb.jpmchase.net/readonly/https:/archive.apache.

RE: [Announce] Apache Kylin 2.3.1 released

Pls. advise how can I download 2.3.1 version. I don’t see there https://archive.apache.org/dist/kylin/ [cid:image001.png@01D3C6A1.CAA01740] Regards, Manoj From: Billy Liu [mailto:billy...@apache.org] Sent: Wednesday, March 28, 2018 9:14 AM To: dev ; user

RE: Apache Kylin +Ranger integration

kylin-plugin if you need it urgently. 在 2018年03月26日 02:06, Kumar, Manoj H 写道: Steps are not clear – How to get download the kylin-plugin tar file? Its not there kylin binary tar ball. Also, Does it create new Ranger instance for Kylin? Pls. give one e2e example for getting kylin Cube data entitlement

RE: Apache Kylin +Ranger integration

2 22:52 GMT+08:00 Ted Yu <yuzhih...@gmail.com<mailto:yuzhih...@gmail.com>>: Have you asked on Ranger mailing list ? thanks On Thu, Mar 22, 2018 at 7:41 AM, Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>> wrote: How to get Jar file download? r

RE: Apache Kylin +Ranger integration

How to get Jar file download? ranger-1.0.0-kylin-plugin.tar.gz Regards, Manoj From: Kumar, Manoj H Sent: Thursday, March 22, 2018 8:04 PM To: user@kylin.apache.org Subject: Apache Kylin +Ranger integration Can someone give more details about this - How this will be working for Table level

Apache Kylin +Ranger integration

Can someone give more details about this - How this will be working for Table level entitlements for Cube level data? Pls. give some example to understand In details. Thanks. https://cwiki.apache.org/confluence/display/RANGER/Kylin+Plugin Regards, Manoj This message is confidential and

RE: Apache Kylin

Added to the FAQ, please check the last one: https://kylin.apache.org/docs21/gettingstarted/faq.html<https://secureweb.jpmchase.net/readonly/https:/kylin.apache.org/docs21/gettingstarted/faq.html> 2018-03-15 15:47 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.

RE: Apache Kylin

only/http:/apache-kylin.74782.x6.nabble.com/multiple-user-in-kylin-td3826.html> (I remember this was on docs but didn't find now) 2018-03-15 11:55 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Any updates on this.. apart from Rest API, Do we h

RE: [Announce] Apache Kylin 2.3.0 released

Thanks for sharing this.. I have changed conf. folder from 2.1 to 2.3 (kylin.properties). but didn’t see the dashboard menu on Kylin UI. What do you mean for “Support SQL Server as data source”. Do you have any document or help? [KYLIN-2727] - Introduce cube planner able to select

RE: YARN Queues and Kylin

It will be for all cubes as these properties are defined at Kylin levels. Sent with BlackBerry Work (www.blackberry.com) From: roberto.tar...@stratebi.com Sent: 23-Feb-2018 7:47 PM To: user@kylin.apache.org Subject: YARN Queues and Kylin Hi, There is any way to

RE: Use impala for intermediate table

N-3125<https://secureweb.jpmchase.net/readonly/https://issues.apache.org/jira/browse/KYLIN-3125> SparkSQL should be more general than Impala. You can take a try. 2018-02-22 19:31 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Can we

Use impala for intermediate table

Can we use Impala for getting #1 step in Cube building - I believe Impala is faster than hive, it takes time to get first done using hive. Is there way where we can use it. Pls. advise. Regards, Manoj This message is confidential and subject to terms at:

RE: apache kylin 2.1 - Spark Cube Building

From: Kumar, Manoj H Sent: Wednesday, February 07, 2018 9:51 AM To: 'user@kylin.apache.org' <user@kylin.apache.org> Subject: RE: apache kylin 2.1 - Spark Cube Building Yes I did that.. I will come back with more logs. Regards, Manoj From: ShaoFeng Shi [mailto:shaofeng...@apache.org

RE: apache kylin 2.1 - Spark Cube Building

still not good, then you need a deep tunning. 2018-02-06 12:43 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: While running Spark Cube process, I noticed that this is taking other Cube tables into the consideration , Rather it should t

RE: optimal parameters

21:41 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Any inputs on this…. Its very important to have large no of columns in Tableau worksheet. Pls. advise how can I achieve it? Regards, Manoj From: Kumar, Manoj H Sent: Monday, Februar

apache kylin 2.1 - Spark Cube Building

While running Spark Cube process, I noticed that this is taking other Cube tables into the consideration , Rather it should take the cube which it isdoing. Not sure why its taking data model of other cubes. Normally its being noticed that Spark is taking almost same time as Maprecuce is taking.

RE: optimal parameters

Any inputs on this…. Its very important to have large no of columns in Tableau worksheet. Pls. advise how can I achieve it? Regards, Manoj From: Kumar, Manoj H Sent: Monday, February 05, 2018 9:58 AM To: 'user@kylin.apache.org' <user@kylin.apache.org> Subject: RE: optimal para

RE: optimal parameters

Or is it possible to use mandatory dimensions instead of join/hierarchical one. In that case, Cube wont be exploded as such. Pls. advise. Can I put mandatory – 60 Hierarchy – 20 Regards, Manoj From: Kumar, Manoj H Sent: Saturday, February 03, 2018 10:40 AM To: 'user@kylin.apache.org' <u

RE: optimal parameters

ta set with a simpler Cube first, and then increase that based on the performance. 2018-02-02 18:17 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Any updates on this?? How to process 450 milions of records in one partition – fact table has this muc

RE: Manager employee hierarchy in Kylin

th the dimension table. Then use the view as the only table for the model and Cube. In the cube, you still have the chance to specify "manager" and "employee" as a hierarchy in the aggregation group settings. 2018-02-02 11:44 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan

optimal parameters

Hi Folks - Need your inputs for optimizing the kylin Cube build process - We have approx.. 450 millions of records in one Partition & 80-90 Dimensions to be picked up from the tables. Can you pls. advise on this? What would be optimal way of running the jobs.We have Cloudera cluster of 16 nodes

Apache Kylin - Loading no. dimension

I have requirement to load 50+ dimensions in the Cube. While doing its saying that Aggregation group 0 has too many combinations, use 'mandatory'/'hierarchy'/'joint' to optimize; or update 'kylin.cube.aggrgroup.max-combination' to a bigger value. I have below value set for aggrgroup. Pls.

RE: Optimize Cube Build process

00 Alberto Ramón <a.ramonporto...@gmail.com<mailto:a.ramonporto...@gmail.com>>: How many process are you runing in parallel? In build cube step On 1 Feb 2018 7:39 a.m., "Kumar, Manoj H" <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>> wrote: We have 1

RE: Optimize Cube Build process

many nodes do you have? how many RAM and CPU do you have per node? On 31 January 2018 at 05:07, Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>> wrote: It has close to 68 mapper & reducers 500.. It keeps running on this. Pls. advise. [cid:imag

RE: Optimize Cube Build process

It has close to 68 mapper & reducers 500.. It keeps running on this. Pls. advise. [cid:image001.png@01D39A7F.844561E0] Regards, Manoj From: Kumar, Manoj H Sent: Wednesday, January 31, 2018 9:24 AM To: 'user@kylin.apache.org' <user@kylin.apache.org> Subject: Optimize Cube Build process

Optimize Cube Build process

Hi Folks - I have close to 33 million of fact data to be processed, Data is having lot of unique/Distinct values such Loan_unique_code, Facility_code,card_id such.. Dimension looks up are made of these. Fact table - 33 millions Looks up tables having to 3 to 4 millions Cube build type I have

RE: Towards Kylin 2.3

oint: https://issues.apache.org/jira/browse/KYLIN<https://secureweb.jpmchase.net/readonly/https:/issues.apache.org/jira/browse/KYLIN> 2018-01-29 13:16 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Not yet I have not raised it.. Pls. let me

RE: Towards Kylin 2.3

mar, Thanks for the inputs. Do we have some JIRAs on this? 2018-01-29 13:11 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: I would like to add following -How to enable to custom rule for Data transformation – while creating the

RE: Towards Kylin 2.3

I would like to add following -How to enable to custom rule for Data transformation – while creating the data model, There should be some way user Define the rules on data being selected. Before building the cube, some rules needs to be applied based on User. Most of OLAP solution

RE: Kylin Cube Rest API for Python

here: https://github.com/Kyligence/kylinpy<https://secureweb.jpmchase.net/readonly/https:/github.com/Kyligence/kylinpy> 2018-01-12 19:46 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Can someone give demo command for Python for fetc

RE: Kylin Cube Rest API for Python

Can someone give demo command for Python for fetching the data from Cube- Just like we have Curl Command for Unix. I am using requests package to get rest API. Regards, Manoj From: Kumar, Manoj H Sent: Friday, January 12, 2018 4:40 PM To: user@kylin.apache.org Subject: Kylin Cube Rest API

Kylin Cube Rest API for Python

I was going through below link - I didn't find set.sh script which does for Python. Can you pls. advise how can we use Python rest API for Kylin Cube query. Thanks. http://kylin.apache.org/docs/tutorial/kylin_client_tool.html Regards, Manoj This message is confidential and subject to terms

RE: cachesync.Broadcaster:172 : error running wiping java.lang.IllegalArgumentException

Whats JVM size given for Kylin? Try with 16 GB Memory mentioned in setenv.sh file. You need to use max. JVM for loading billions of data. Regards, Manoj From: Ruslan Dautkhanov [mailto:dautkha...@gmail.com] Sent: Tuesday, January 09, 2018 12:59 PM To: user@kylin.apache.org Subject: Re:

Query Push Down

Using Apache kylin 2.1 binary & trying to use Query Push method. Can someone help on below Error? What could be reason for getting Error? Error - Illegal character in path at index 89: hive2://dummyhost:0/db_rft_rcmo_rfda;principal=hive/_h...@naeast.ad.jpmorganchase.com Properties File

RE: User query from Hbase(Cuboid)

ppen at query time, the performance would be impacted. 2017-12-18 12:19 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Can you pls. advise on this case – I have Cube built on for below case – It has 234 dimension(224 dimensions are

RE: "User 'ADMIN' does not exist" issue

Pls. check Hbase processes - Regionserver. Normally this comes when hbase is not running properly. Regards, Manoj From: Sunwei [mailto:sun...@rongcapital.cn] Sent: Monday, December 18, 2017 1:10 PM To: user@kylin.apache.org Subject: "User 'ADMIN' does not exist" issue Hi all: I'm

RE: Different backend storage (columnar) - Kylin Improvement

Can we include these two points in upcoming release version - Making Kylin Compatible with Spark QL instead of Apache Calcite & having another Cube Storage apart from Hbase. Currently its supporting only Hbase rather its having support for columnar Regards, Manoj From: prasanna lakshmi

RE: Dups records

has been asked several times before. 2017-12-08 20:45 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Can someone give advise on this urgently? These are columns on Lookup table? BUnodeName1 , BUnodeName2 , BUnodeName3 , BUnodeName4

Dups records

Getting Dups record error while building dimension cuboids TSLGENBUHIERARCHY Table has unique set of records of comprising from ID 2 to 13. I have one look up table which has data of Flatten Hierarchy & All are having derived dimension. Can you pls. help in why I am getting the Dups error?

RE: Apache kylin 2.1 on Spark

sing HDP version and I removed all other configuratin settings except these two --conf spark.master=yarn --conf spark.hadoop.yarn.timeline-service.enabled=false Take your command and try it out with these properties ,may be it will help full to you. On Mon, Dec 4, 2017 at 9:46 AM, Kumar,

RE: Apache kylin 2.1 on Spark

ill help full to you. On Mon, Dec 4, 2017 at 9:46 AM, Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>> wrote: Thanks to both of you for your advice on this. I tried out with command line but its getting error out – Pls. advise. From Jar file kylin-job-2.1

RE: Apache kylin 2.1 on Spark

by using configuration spark in yarn mode only. Remove all other conf settings in that command. if it is successful then you comment all those properties in kylin.properties file of kylin/conf folder. On Nov 30, 2017 3:01 PM, "Kumar, Manoj H" <manoj.h.ku...@jpmorgan.com<m

RE: Apache kylin 2.1 on Spark

-conf.spark.yarn.am.extraJavaOptions=-Dhdp.version=current kylin.engine.spark-conf.spark.executor.extraJavaOptions=-Dhdp.version=current Regards, Manoj From: Kumar, Manoj H Sent: Thursday, November 30, 2017 4:53 PM To: 'user@kylin.apache.org' Subject: RE: Apache kylin 2.1 on Spark Can you pls. tell how

Apache kylin 2.1 on Spark

Pls. advise on this as I am running Cube building process using Spark Engine. What setting is missing here? kylin.env.hadoop-conf-dir=/etc/hive/conf 224 # 225 ## Estimate the RDD partition numbers 226 kylin.engine.spark.rdd-partition-cut-mb=100 227 # 228 ## Minimal partition numbers of rdd 229

Re: Please set kylin.env.hdfs-working-dir in kylin.properties

: Please set kylin.env.hdfs-working-dir in kylin.properties Thanks manoj for reply. It's not commented in kylin.properties file. I double checked it. i could not locate this ".check-in.sh" file ... Can you pls post it clearly. On Tue, Nov 28, 2017 at 7:35 PM, Kumar, Manoj H <m

Re: Please set kylin.env.hdfs-working-dir in kylin.properties

Pls ensure that is not commented out in kylin.properties file. Also you can force the directory path in .check-in.sh file. Sent with BlackBerry Work (www.blackberry.com) From: Prasanna Sent: 28-Nov-2017

RE: 回复：RE: Apache Kylin - Hbase Cube Name Space

Below mail is for “Shi ShaoFeng”. Regards, Manoj From: Kumar, Manoj H Sent: Monday, November 27, 2017 7:59 PM To: user@kylin.apache.org Subject: RE: 回复：RE: Apache Kylin - Hbase Cube Name Space I am not able send the mail to your id – Its getting bounced .. Do you have any webmail or Gmail id

RE: 回复：RE: Apache Kylin - Hbase Cube Name Space

Name Space I have no idea with this error. What's your Hadoop release & version, CDH or other? 2017-11-27 16:50 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Apache kylin 2.1 version I am using.. While building the package, Getting b

RE: 回复：RE: Apache Kylin - Hbase Cube Name Space

r 27, 2017 4:12 PM To: user Subject: Re: 回复：RE: Apache Kylin - Hbase Cube Name Space I have no idea with this error. What's your Hadoop release & version, CDH or other? 2017-11-27 16:50 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Apach

RE: 回复：RE: Apache Kylin - Hbase Cube Name Space

Subject: Re: 回复：RE: Apache Kylin - Hbase Cube Name Space Hi Manoj, Only replace a jar may not work; You need to build a new binary package. What's your Kylin version and Hadoop/HBase release/version? 2017-11-27 16:10 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:mano

RE: 回复：RE: Apache Kylin - Hbase Cube Name Space

1436 at org.apache.kylin.storage.hbase.steps.CubeHTableUtil.createHTable(CubeHTableUtil.java:105) 1437 at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:103) Regards, Manoj From: Kumar, Manoj H Sent: Friday, November 24, 2017 9:46 AM To: user@kylin.apache.org Subject: RE: 回复：RE: Apache Kylin - Hbase Cube

RE: 回复：RE: Apache Kylin - Hbase Cube Name Space

namespace feature, and I build the package successfully. -- 原始邮件 -- 发件人: "Kumar, Manoj H";<manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>; 发送时间: 2017年11月24日(星期五) 中午11:56 收件人: "user@kylin.apache.org<mailto:user@kylin.apac

RE: Apache Kylin - Hbase Cube Name Space

ixed asap. Appreciate your faster response in this regard. Regards, Manoj From: Kumar, Manoj H Sent: Thursday, November 23, 2017 8:08 PM To: user@kylin.apache.org Subject: RE: Apache Kylin - Hbase Cube Name Space How to do the patch.. I cant built it locally as This project is not added to JPMC M

RE: Apache Kylin - Hbase Cube Name Space

ylin - Hbase Cube Name Space Hi Manoj, This feature is not released yet, see: https://issues.apache.org/jira/browse/KYLIN-2846 But the patch is available; you can build a new Kylin binary package by your own with the patches. 2017-11-23 21:49 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmor

Apache Kylin - Hbase Cube Name Space

/docs21/howto/howto_cleanup_storage.html> clean up cli<https://kylin.apache.org/docs21/howto/howto_cleanup_storage.html>. 2017-11-22 11:13 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Np Mind, I got confused with Cube’s Partit

RE: How to Update the Cube Structure

? 2017-11-22 1:12 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Thanks… one quick question – How to make intermediate flat table partitioned one?? Do we have any parameter in kylin.properties? Regards, Manoj From: ShaoFeng Shi [mai

RE: How to Update the Cube Structure

This document can help: https://kylin.apache.org/docs21/howto/howto_optimize_build.html 2017-11-21 21:36 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Thanks for the inputs.. It make sense.. As now I am running on Dev Cluster & need

RE: How to Update the Cube Structure

uild it. 2017-11-21 14:53 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: In case of Data Source table has DDL changes – either new Column added or Existing Column data type changed. How Can we do Cube data model update & reflecting new colu

How to Update the Cube Structure

17-11-20 14:00 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: I am installing kyline 2.10 on Dev Cluster(Cloudera) . Although I have given 777 permission on kylin Folder but still giving error. Can you pls. help on this? Whats missing here?

Sqoop Error

Can someone help on resolving this sqoop Error? Running Sqoop command from Cloudere Manager. Although I have set up hive home but still its giving Error. 17/11/20 07:00:58 WARN hive.TableDefWriter: Column qtdAmountUSDE had to be cast to a less precise type in Hive 17/11/20 07:00:58 INFO

RE: Apache Kyine - Hbase set up not working

Both issues have been resolved.. It was related to HBASE Namespace. Regards, Manoj From: Kumar, Manoj H Sent: Monday, November 20, 2017 12:40 PM To: user@kylin.apache.org Subject: RE: Apache Kyine - Hbase set up not working Importance: High Pls. advise on this - what needs to be done. Some

RE: Apache Kyine - Hbase set up not working

sorHost$11.call(MasterCoprocessorHost.java:216) Regards, Manoj From: Kumar, Manoj H Sent: Monday, November 20, 2017 11:31 AM To: user@kylin.apache.org Subject: Apache Kyine - kylin.env.hdfs-working-dir I am installing kyline 2.10 on Dev Cluster(Cloudera) . Although I have given 777 permissio

Apache Kyine - kylin.env.hdfs-working-dir

I am installing kyline 2.10 on Dev Cluster(Cloudera) . Although I have given 777 permission on kylin Folder but still giving error. Can you pls. help on this? Whats missing here? -bash-4.1$ hdfs dfs -mkdir /tenants/rft/rcmo/kylin -bash-4.1$ hdfs dfs -chmod 777 /tenants/rft/rcmo/kylin Kyline

RE: Cube Error - Kyin 2.1 version

select to use "integer" encoding; but in the source table, it has invalid value like 'undefined', causing the encoding error. 2017-11-16 19:57 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: While Cube building It has got error out – Ste

RE: Cube Error - Kyin 2.1 version

While Cube building It has got error out – Step #6 – Create HT table.. Can someone Advise on this? What kind of data type Error is this? java.lang.NumberFormatException: For input string: "undefined" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)

RE: Cube building Error - Kyin 2.1 version

When I changed to Normal Dimension type it worked.. Whereas for Derived Dimension type it was giving row key mismatch. Why is it like that? Derived Dimension type should be supported. Regards, Manoj From: Kumar, Manoj H Sent: Thursday, November 16, 2017 4:39 PM To: user@kylin.apache.org

Cube building Error - Kyin 2.1 version

Can you help on this? I have 11 dimensions selected as Row key is also 11 showing up on UI. What is Error about? Pls advise. Error Message RowKey columns count (11) doesn't match dimensions columns count (9) Regards, Manoj This message is confidential and subject to terms at:

RE: Apache Kylin - Driver/Connector for Cognos BI Tool

Tool Hi Kumar, What's your Cognos version and platform? Here is a reference on how to connect with Kylin from Cognos: http://docs.kyligence.io/v2.5/en/integration/cognos.en.html 2017-11-14 19:35 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>:

Apache Kylin - Driver/Connector for Cognos BI Tool

Can someone share the details for how to get connected with Congnos BI tool? I didn’t find any details about this. Thanks. Regards, Manoj This message is confidential and subject to terms at: http://www.jpmorgan.com/emaildisclaimer including on confidentiality, legal privilege, viruses and

RE: Apache Kylin - Does it take input data from Parquet file format

le to fetch the new data incrementally from this table. Hive provides the logic layer over the physical model, which is recommended. 2017-11-14 14:30 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Pls. advise on this – Input source of da

Apache Kylin - Does it take input data from Parquet file format

Pls. advise on this - Input source of data - Can it from Parquet File format instead of Hive table? Upstream system generating the File format as output. Pls. suggest. This will be important features to have it. Manoj This message is confidential and subject to terms at:

Does Apache Kylin Support MDX Queries used in OLAP

Can someone advise on this? How can we use MDX query in Apache Kylin? Thanks. Manoj This message is confidential and subject to terms at: http://www.jpmorgan.com/emaildisclaimer including on confidentiality, legal privilege, viruses and monitoring of electronic messages. If you are not the

Set up Development environment at intelliji

Can you pls. give step by step to do Dev. Set up of Apache Kylin? Since I am not from Java Background, Pls. give the complete step so that It helps to do the my local set up? How to give reference of Hadoop environment(Cloudera VM) at my Laptop? Spark home,hive,Hbase etc. Pls. give us complete

How to drop the segments

Can you pls. tell how to drop the Cube segment from backend? While re-running the Cube build, I need to drop the older segments? I am using 2.1 Apache Kylin. Regards, Manoj This message is confidential and subject to terms at: http://www.jpmorgan.com/emaildisclaimer including on

RE: Kylin UI is not coming up

in kylin.properties, something like "kylin_test@hbase" 2017-10-17 18:28 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: Can someone help on this? At Kylin.log file, Seeing below Error? Hbase,HIVE & Zookeeper is ru

RE: Kafka Streaming data - Error while building the Cube

fka consumer. Check which topic and how many partitions you got. 2017-10-12 23:19 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>: I guess KafkaSource Class file where it has enrichSourcePartitionBeforeBuild() to get partition values. There its

RE: Kafka Streaming data - Error while building the Cube

I guess KafkaSource Class file where it has enrichSourcePartitionBeforeBuild() to get partition values. There its getting Error out. Do we know how can we test out to find why its coming as 0 for start & end offset? Regards, Manoj From: Kumar, Manoj H Sent: Thursday, October 12, 2017 3:3

RE: Kafka Streaming data - Error while building the Cube

，but got 0 message. Could you check if the topic has incoming message: bin/kafka-console-consumer.sh --zookeeper localhost:2181 --bootstrap-server localhost:9092 --topic kylin_demo 2017-10-12 17:19 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com<mailto:manoj.h.ku...@jpmorgan.com>>

RE: Kafka Streaming data - Error while building the Cube

.apache.kylin.source.kafka.KafkaSource.enrichSourcePartitionBeforeBuild(KafkaSource.java:134) at org.apache.kylin.rest.service.JobService.submitJobInternal(JobService.java:236) Regards, Manoj From: Billy Liu [mailto:billy...@apache.org] Sent: Thursday, October 12, 2017 1:06 PM To: user Subj

Kafka Streaming data - Error while building the Cube

Building the Cube from Kylin UI - Although Messages are there in Kafka topic but Kylin is not able read the offset. Can someone help on this? 2017-10-11 20:50:42,573 INFO [http-bio-7070-exec-8] utils.AppInfoParser:83 : Kafka version : 0.10.2-kafka-2.2.0 2017-10-11 20:50:42,573 INFO