RE: Apache kylin 2.1 on Spark

2017-12-04 Thread Kumar, Manoj H
lakshmi [mailto:prasannapadar...@gmail.com] Sent: Monday, December 04, 2017 10:10 AM To: user@kylin.apache.org Subject: Re: Apache kylin 2.1 on Spark Hi Manoj, This is my sample query when i am using kylin2.10 and above. export HADOOP_CONF_DIR=/usr/hdp/2.4.3.0-227/hadoop/conf && /usr/loc

RE: Apache kylin 2.1 on Spark

2017-12-03 Thread prasanna lakshmi
nf -output > hdfs://sfpdev/tenants/rft/rcmo/kylin/ns_rft_rcmo_creg_ > poc-kylin_metadata/kylin-c94a7679-47b7-4aae-9f44- > 5d89c683b3b3/DRR_CUBE_SAPRK_1/cuboid/ -cubename DRR_CUBE_SAPRK_1 > > > > > > > > Regards, > > Manoj > > > > *From:*

RE: Apache kylin 2.1 on Spark

2017-12-03 Thread Kumar, Manoj H
K_1/cuboid/ -cubename DRR_CUBE_SAPRK_1 Regards, Manoj From: prasanna lakshmi [mailto:prasannapadar...@gmail.com] Sent: Monday, December 04, 2017 10:10 AM To: user@kylin.apache.org Subject: Re: Apache kylin 2.1 on Spark Hi Manoj, This is my sample query when i am using kylin2.10 and abov

Re: Apache kylin 2.1 on Spark

2017-12-03 Thread prasanna lakshmi
> > > Error: Unrecognized option: -className > > > > Regards, > > Manoj > > > > *From:* prasanna lakshmi [mailtoprasannapadar...@gmail.com] > *Sent:* Saturday, December 02, 2017 10:29 PM > *To:* user@kylin.apache.org > *Subject:* Re: Apache kylin 2.1

RE: Apache kylin 2.1 on Spark

2017-12-03 Thread Kumar, Manoj H
Error: Unrecognized option: -className Regards, Manoj From: prasanna lakshmi [mailto:prasannapadar...@gmail.com] Sent: Saturday, December 02, 2017 10:29 PM To: user@kylin.apache.org Subject: Re: Apache kylin 2.1 on Spark Hi Manoj As part of my experience try the same command in prompt by

Re: Apache kylin 2.1 on Spark

2017-12-02 Thread prasanna lakshmi
Hi Manoj As part of my experience try the same command in prompt by using configuration spark in yarn mode only. Remove all other conf settings in that command. if it is successful then you comment all those properties in kylin.properties file of kylin/conf folder. On Nov 30, 2017 3:01 PM, "Kumar

Re: Apache kylin 2.1 on Spark

2017-12-02 Thread ShaoFeng Shi
=-Dhdp.version=current > kylin.engine.spark-conf.spark.yarn.am.extraJavaOptions=-Dhdp.version=current > kylin.engine.spark-conf.spark.executor.extraJavaOptions=- > Dhdp.version=current > > > > Regards, > > Manoj > > > > *From:* Kumar, Manoj H > *Sent:* Thursday, November 30, 20

RE: Apache kylin 2.1 on Spark

2017-11-30 Thread Kumar, Manoj H
-conf.spark.yarn.am.extraJavaOptions=-Dhdp.version=current kylin.engine.spark-conf.spark.executor.extraJavaOptions=-Dhdp.version=current Regards, Manoj From: Kumar, Manoj H Sent: Thursday, November 30, 2017 4:53 PM To: 'user@kylin.apache.org' Subject: RE: Apache kylin 2.1 on Spark Can you pls. tel

RE: Apache kylin 2.1 on Spark

2017-11-30 Thread Kumar, Manoj H
6) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) - Regards, Manoj From: Kumar, Manoj H Sent: Thursday, November 30, 2017 3:01 PM To: 'user@kylin.apache.org' Subject: Apache kylin 2.1 on Spark Pls. advise on this as I am running Cube building process using Spark Engine. What setting is missing

Apache kylin 2.1 on Spark

2017-11-30 Thread Kumar, Manoj H
Pls. advise on this as I am running Cube building process using Spark Engine. What setting is missing here? kylin.env.hadoop-conf-dir=/etc/hive/conf 224 # 225 ## Estimate the RDD partition numbers 226 kylin.engine.spark.rdd-partition-cut-mb=100 227 # 228 ## Minimal partition numbers of rdd 229 ky