Re: Apache iceberg and hive comparison as datasource for kylin

e already working on > it. > > On Sat, Jul 13, 2024 at 5:25 PM Nam Đỗ Duy wrote: > > > Dear Sir / Madam > > > > Can anyone help me with this question... thank you very much > > > > > > On Thu, 9 May 2024 at 09:37 Nam Đỗ Duy wrote: > > > &

Re: Apache iceberg and hive comparison as datasource for kylin

Dear Sir / Madam Can anyone help me with this question... thank you very much On Thu, 9 May 2024 at 09:37 Nam Đỗ Duy wrote: > Dear Dev Team > > I read this blog and it seems to be more interesting that iceberg has more > features than hive > > [image: image.png] > &

Re: Does Kylin 5 run on HDP 3.1.4

pt to HDP 3.1 > > On Wed, Jun 19, 2024 at 10:24 AM Nam Đỗ Duy > wrote: > > > Dear Sir/Madam > > > > I have above question in the title regarding installation of Kylin 5 on > > HDP3.1.4. Our Team has HDP 3.1.4 already setup so could you please let me > &

Does Kylin 5 run on HDP 3.1.4

Dear Sir/Madam I have above question in the title regarding installation of Kylin 5 on HDP3.1.4. Our Team has HDP 3.1.4 already setup so could you please let me know whether Kylin 5 is compatible on HDP 3.1.4 ? Thank you very much and best regards

Apache iceberg and hive comparison as datasource for kylin

Dear Dev Team I read this blog and it seems to be more interesting that iceberg has more features than hive [image: image.png] Do you support using iceberg as data source for kylin? Hive vs Iceberg: When to migrate to Apache Iceberg (starburst.io)

Re: How to query the Cube via API and use the dataset for other purpose

JSON val data = (parsedJson \ "results").extract[List[List[Any]]] // convert data to RDD[Row] val rowsRDD = spark.sparkContext.parallelize(data.map(row => Row.fromSeq(row.map(_.asInstanceOf[AnyRef] val df = spark.createDataFrame(rowsRDD, schema) df.sh

Re: How to query the Cube via API and use the dataset for other purpose

Dear Sirs/Madames Could anyone here help me to figureout the way to use scala to query an select SQL against kylin cube via API then turn that table result into a dataframe in scala for other purpose? Thank you so much for your time! Best regards On Fri, 29 Mar 2024 at 17:52 Nam Đỗ Duy wrote

How to query the Cube via API and use the dataset for other purpose

Hi Xiaoxiang, Sir & Madames, I use the following code to query the cube via API but I cannot use the result as a dataframe, could you suggest a way to do that because it is very important for our project. Thanks and best regards === import org.apache.spark.sql.{D

Re: Pinot/Kylin/Druid quick comparision

in5 would be around July this year if everything goes well. > > Cheers > Yang > > On Tue, Mar 5, 2024 at 6:54 PM Nam Đỗ Duy wrote: > >> Hello Xiaoxiang, >> >> How are you, my boss is very interested in Kylin 5. so he would like to >> know when

Re: Pinot/Kylin/Druid quick comparision

Hello Xiaoxiang, How are you, my boss is very interested in Kylin 5. so he would like to know when Kylin 5 will be released...could you please provide an estimation? Thank you very much and best regards On Thu, 18 Jan 2024 at 10:05 Nam Đỗ Duy wrote: > Good morning Xiaoxiang, hope you

Re: Pinot/Kylin/Druid quick comparision

for > authentication, one for authorization. So they cannot replace each other. > Ranger can integrate with Kerberos, please check ranger's website for > information. > > > With warm regard > Xiaoxiang Yu > > > > On Sat, Dec 9, 2023 at 8:

Re: ACID with Hive/Kylin

; 2. not create a bitmap measure on these columns, so these columns won't be > built into dict > > ---- > With warm regard > Xiaoxiang Yu > > > > On Tue, Dec 12, 2023 at 12:11 PM Nam Đỗ Duy > wrote: > > > Dear Xiaoxiang, Sirs/Mada

ACID with Hive/Kylin

Dear Xiaoxiang, Sirs/Madams I face an issue with deleting data of user according to GPDR-like policy which means when user send request to delete their personal data, we need to delete it from all system, that means to delete data: 1- from Kylin index (cube) 2- from Hive 3- from HDFS Have you ha

Re: Pinot/Kylin/Druid quick comparision

ace each other. > Ranger can integrate with Kerberos, please check ranger's website for > information. > > > With warm regard > Xiaoxiang Yu > > > > On Sat, Dec 9, 2023 at 8:01 AM Nam Đỗ Duy wrote: > > > Thank you Xiaoxiang for you

Re: Pinot/Kylin/Druid quick comparision

wrote: > I guess the release date should be 2024/01 . > Do you have any suggestions/wishes for kylin 5(except real-time feature)? > > > With warm regard > Xiaoxiang Yu > > > > On Thu, Dec 7, 2023 at 3:44 PM Nam Đỗ Duy wrote: > >> T

Re: Pinot/Kylin/Druid quick comparision

.0/docs/development/roadmap > > > With warm regard > Xiaoxiang Yu > > > > On Wed, Dec 6, 2023 at 6:53 PM Nam Đỗ Duy wrote: > >> Hi Xiaoxiang, tomorrow is the main presentation between Kylin and Druid in >> my team. >> >> I found this article and would lik

Re: Pinot/Kylin/Druid quick comparision

)? <https://kylin.apache.org/blog/2018/12/12/why-did-meituan-develop-kylin-on-druid-part1-of-2/> On Wed, Dec 6, 2023 at 9:34 AM Nam Đỗ Duy wrote: > Thank you very much for your prompt response, I still have several > questions to seek for your help later. > > Best regards a

Re: Pinot/Kylin/Druid quick comparision

his situation to reverse direction. > >> > >> On Tue, Dec 5, 2023 at 9:02 AM Xiaoxiang Yu wrote: > >> > >>> The default branch is for 4.X which is a maintained branch, the active > >>> branch is kylin5. > >>> I will change the defaul

Re: Pinot/Kylin/Druid quick comparision

nch, the active > branch is kylin5. > I will change the default branch to kylin5 later. > > > With warm regard > Xiaoxiang Yu > > > > On Tue, Dec 5, 2023 at 9:12 AM Nam Đỗ Duy wrote: > >> Hi Xiaoxiang, Sirs / Madams >> >> Ca

Re: Pinot/Kylin/Druid quick comparision

st can be amortized over each query, > so it is the most economical. > > --- Translated with DeepL.com (free version) > > > > With warm regard > Xiaoxiang Yu > > > > On Mon, Dec 4, 2023 at 3:16 PM Nam Đỗ Duy wrote: > >> Thank yo

Re: Pinot/Kylin/Druid quick comparision

g-running > job. This feature is based on Spark Streaming, so you need knowledge of > it. > > I am curious about what is the maximum time-lag your customers > can tolerate? > Personally, I guess minute level time-lag is ok for most cases. > > >

Re: Pinot/Kylin/Druid quick comparision

ter than Druid. > > > I don't know Pinot, so I have nothing to say about it. > Hope to help you, or you are free to share your opinion. > > > With warm regard > Xiaoxiang Yu > > > > On Fri, Dec 1, 2023 at 11:11 AM Nam Đỗ Duy wrot

Pinot/Kylin/Druid quick comparision

Dear Xiaoxiang, Sirs/Madams, May I post my boss's question: What are the pros and cons of the OLAP platform Kylin compared to Pinot and Druid? Please kindly let me know Thank you very much and best regards

Re: How to reflect last hour data into Hive and Kylin Insights query window

huanlan.zhihu.com/p/100131550 > > https://cn.kyligence.io/blog/kylin-chinagreentown-user-portrait-2/ > > > > > https://cn.kyligence.io/blog/apache-kylin-count-distinct-application-in-user-behavior-analysis/ > > https://www.infoq.cn/article/xZYe1DUopNA9CzLwau3O > >

Re: How to reflect last hour data into Hive and Kylin Insights query window

park-sql/spark-shell should be the same as your > saw in Kylin insight page. If there are different results for the same > query, > which should not happen, please let me know. > > Hope you can fix your problem soon. > > > With warm regard > Xiao

How to use measure of Kylin in query

Dear Sir / Madam I've searched the web but cannot find the way to use measures of Kylin, for example, with this quote from the URL of document, it seems that the measure's magic is as follows: "I write query normally to query the desired colummn and Kylin uses the index mechanism to accelerate qu

Re: How to reflect last hour data into Hive and Kylin Insights query window

is : 5112 > > So, it is clear that the second query incremental data can be found by the > Kylin query engine. > > Finally, to make good use of Kylin in real use cases, good knowledge of > Apache Spark > and Apache Hadoop is a must-to-have. > > -------- &

Re: How to reflect last hour data into Hive and Kylin Insights query window

in can answer queries by > reading the special Index/Cuboid files, and the query will be accelerated. > > > ---- > With warm regard > Xiaoxiang Yu > > > > On Fri, Nov 17, 2023 at 4:36 PM Nam Đỗ Duy wrote: > > > Hi Xiaoxiang, > > >

Re: How to reflect last hour data into Hive and Kylin Insights query window

From ：Xiaoxiang Yu > > > > > > At 2023-11-17 09:48:55, "Nam Đỗ Duy" wrote: > >Hello Team, hello Xiaoxiang, can you please help me with this urgent > >issue... > > > >(this is public email group so in general I neglect your specific name > fr

Re: How to reflect last hour data into Hive and Kylin Insights query window

, 2023 at 2:59 PM Nam Đỗ Duy wrote: > Dear Dev Team, please kindly advise this scenario > > 1. I have a fact table and I use Kylin insights window to query it and get > 5 million rows. > > 2. Then I use following command to load X rows (last hour data) from > parquet into Hiv

How to reflect last hour data into Hive and Kylin Insights query window

Dear Dev Team, please kindly advise this scenario 1. I have a fact table and I use Kylin insights window to query it and get 5 million rows. 2. Then I use following command to load X rows (last hour data) from parquet into Hive table LOAD DATA LOCAL INPATH '/opt/LastHour/factUserEventDF_2023_11_

Re: Default Hive user/password of docker Kylin 5.0

Xiaoxiang Yu wrote: > > https://github.com/apache/kylin/blob/8de5c7a7121dc37729a12ee231041f8d89d1494c/dev-support/release-manager/standalone-docker/all_in_one/entrypoint.sh#L83C48-L83C48 > > > With warm regard > Xiaoxiang Yu > > > > On Mon,

Re: Why we choose Kylin

660fdbc7d2 > > > With warm regard > Xiaoxiang Yu > > > > On Tue, Nov 14, 2023 at 1:42 PM Nam Đỗ Duy wrote: > > > Thank you Xiaoxiang for your reply > > > > This may be final question for our Board of Management to decide to use &

Re: Why we choose Kylin

ies, it can be searched. Besides, we > communicate by email or zoom. > > With warm regard > Xiaoxiang Yu > > > > On Tue, Nov 14, 2023 at 12:27 AM Nam Đỗ Duy > wrote: > > > Hi Xiaoxiang, > > > > Please kindly let us know:

Re: Why we choose Kylin

x27;t know if it still works at the moment. I think it needs some > test and modification > to make these work with Kylin 5. > > > > ---- > With warm regard > Xiaoxiang Yu > > > > On Mon, Nov 13, 2023 at 10:00 AM Nam Đỗ Duy > wrote: >

Default Hive user/password of docker Kylin 5.0

Dear Team, I am using scala to connect to Hive after install Kylin docker 5.0, please kindly tell me the default HIVE user/password to fill to this code: Thank you very much and best regards // JDBC URL to connect to Hive val jdbcURL = "jdbc:hive2://localhost:1/your_database" // Hive connec

Re: Why we choose Kylin

me > test and modification > to make these work with Kylin 5. > > > > ---- > With warm regard > Xiaoxiang Yu > > > > On Mon, Nov 13, 2023 at 10:00 AM Nam Đỗ Duy > wrote: > > > Hi Xiaoxiang > > > > Regarding the reason why we should ch

Re: MDX in kylin 5.0

ion is not suitable for dev mailing list, could you > use mailing list instead? > > > With warm regard > Xiaoxiang Yu > > > > On Mon, Nov 13, 2023 at 8:34 AM Nam Đỗ Duy wrote: > > > Dear Sir/Madam > > > > I found documents o

Re: Why we choose Kylin

kylin.apache.org/blog/ > > > > With warm regard > Xiaoxiang Yu > > > > On Fri, Nov 3, 2023 at 4:12 PM Nam Đỗ Duy wrote: > > > Dear Sir/Madam > > > > I am persuading my company to use Kylin as OLAP platform. > > > > Could you please give some f

MDX in kylin 5.0

Dear Sir/Madam I found documents on MDX on version 4.x and would like you to let me know whether MDX is still available in version 5.0? Thank you very much

Re: Integrate Power BI report server with kylin

s you can make it correct in a new and clean env (or latest OS > version). > > With warm regard > Xiaoxiang Yu > > > > On Thu, Nov 9, 2023 at 3:30 PM Nam Đỗ Duy wrote: > > > Thank you Xiaoxiang, both the link you sent me and chatgpt told me

Re: Integrate Power BI report server with kylin

its display language can not change > to English.) > [image: check-visual-c++-windows.jpeg] > > > > With warm regard > Xiaoxiang Yu > > > > On Wed, Nov 8, 2023 at 4:00 PM Nam Đỗ Duy wrote: > >> Hi Xiaoxiang, >> >&g

Re: Integrate Power BI report server with kylin

erbi-desktop-windows-1.jpeg > 2. Step 6, Power BI Desktop, > > https://kylin.apache.org/images/Kylin-ODBC-DSN/odbc-kylin5-powerbi-desktop-windows-2.jpeg > > Hope this reply will help you fix your problem. > > > With warm regard > Xia

Re: Integrate Power BI report server with kylin

ow any helpful message. > > Here are some of my screenshots: > 1. Step 5, ODBC DSN Configuration, > > https://kylin.apache.org/images/Kylin-ODBC-DSN/odbc-kylin5-powerbi-desktop-windows-1.jpeg > 2. Step 6, Power BI Desktop, > > https://kylin.apache.org/images

Re: Integrate Power BI report server with kylin

nother driver from > https://download.kyligence.io/#/download have > another try ? > > With warm regard > Xiaoxiang Yu > > > > On Tue, Nov 7, 2023 at 5:58 PM Nam Đỗ Duy wrote: > >> Thank you Xiaoxiang, please see the attached photo and advise

Re: Integrate Power BI report server with kylin

are the > same API, metadata, and the core design . > > With warm regard > Xiaoxiang Yu > > > > On Tue, Nov 7, 2023 at 5:40 PM Nam Đỗ Duy wrote: > > > Hi Xiaoxiang, > > > > In order to use Kylin ODBC, do I need to buy sepa

Re: Integrate Power BI report server with kylin

oks/v4.6/en/Analyst-and-Business-Users-Guide/integration/ > > > > With warm regard > Xiaoxiang Yu > > > > On Tue, Nov 7, 2023 at 3:14 PM Nam Đỗ Duy wrote: > > > Dear Sir/Madam > > > > Our company is using report server on prem

Re: Integrate Power BI report server with kylin

Analyst-and-Business-Users-Guide/integration/ > > > > With warm regard > Xiaoxiang Yu > > > > On Tue, Nov 7, 2023 at 3:14 PM Nam Đỗ Duy wrote: > > > Dear Sir/Madam > > > > Our company is using report server on premise. Please ad

Integrate Power BI report server with kylin

Dear Sir/Madam Our company is using report server on premise. Please advise me the integration guidelines in two scenarios: 1. POC period: Power BI report server: Windows 10 Kylin 5.0 in docker file downloaded from official kylin website 2. Development period: Power BI report server: Windows 10

Re: Why we choose Kylin

che.org/confluence/display/KYLIN/Why+did+Youzan+choose+Kylin+4 > - https://kylin.apache.org/blog/ > > > > With warm regard > Xiaoxiang Yu > > > > On Fri, Nov 3, 2023 at 4:12 PM Nam Đỗ Duy wrote: > > > Dear Sir/Madam > > > > I am p

Why we choose Kylin

Dear Sir/Madam I am persuading my company to use Kylin as OLAP platform. Could you please give some fact or some document to my presentation about the reason why we should choose Kylin comparing with other OLAP platform. Thank you very much

[Kylin 5] Can I create a model with fact table only?

Dear Sir/Madam When I create model with inner join between fact and dim, the rows will reduce So there are cases I need to query full rows in Fact table, how can I create a model with fact table only so that I can do my queries against full rows of fact table? Thank you very much

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

fast > the build index job is completed. > > > > With warm regard > Xiaoxiang Yu > > > > On Thu, Nov 2, 2023 at 2:10 PM Nam Đỗ Duy wrote: > > > Hi Xiaoxiang > > > > My case is not in date range and I need to do daily. &g

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

please send me your query diagnostic package which includes your metadata, > query, and logs. > > For the second question, I am not sure at the moment. > > > > With warm regard > Xiaoxiang Yu > > > > On Thu, Nov 2, 2023 at 10:33 AM Nam

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

ation > . > > If not, create a new segment and build index, refer to : > https://kylin.apache.org/5.0/docs/modeling/load_data/by_date > > > With warm regard > Xiaoxiang Yu > > > > On Thu, Nov 2, 2023 at 11:57 AM Nam Đỗ Duy wrote: > &

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

for > your use cases. > > > > With warm regard > Xiaoxiang Yu > > > > On Thu, Nov 2, 2023 at 10:50 AM Nam Đỗ Duy wrote: > >> The query is too fast, less than a second, can you make it a little bit >> slower so that I can see it

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

The query is too fast, less than a second, can you make it a little bit slower so that I can see it clearly 😀😀 [image: image.png] On Thu, Nov 2, 2023 at 9:32 AM Nam Đỗ Duy wrote: > Thank you Xiaoxiang for the guideline. Will definitely read it carefully. > Kindly help the following que

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

t; your Index(your query on [colA, colB], but your index contains more columns > than colA and colB), you can add some aggregate groups(or smaller Table > Index) to optimize the query performance. > > > > ------------ > With warm regard > Xiaoxiang Yu > >

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

gt; to lose some rows when compared to pattern 'A inner join B'. > So the Model 'sample_ssb' will be excluded to serve your query. > > That is to say, you need to create a new model that is similar to Model > 'sample_ssb', > but with additional tables r

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

fic date range, is "not precomputed", and can join with segments at > runtime . > > - https://kylin.apache.org/5.0/docs/snapshot/snapshot_management > - > https://kylin.apache.org/5.0/docs/modeling/load_data/segment_operation_settings/intro > > -------- &g

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

> With warm regard > Xiaoxiang Yu > > > > On Wed, Nov 1, 2023 at 3:24 PM Nam Đỗ Duy wrote: > >> Hi Xiaoxiang, sorry if I made you confused (Anyway, it is just a question >> of a beginner) >> >> "obviously" means &

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

From my side, I cannot understand why you say Kylin 4 is 'very obviously'. > Can you give an example? > From the source code, the basic logic of choosing the right cube/model are > similar. > > With warm regard > Xiaoxiang Yu > > > > On Wed, No

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

0/docs/operations/system-operation/diagnosis/#generate-query-diagnosis-package-in-web-ui >> >> By the way, you need to analyse the cause by reading kylin.query.log, not >> the kylin.log, >> refer to https://kylin.apache.org/5.0/docs/operations/logs/system_log >> >>

Re: OLAP functionalities in Kylin 5.0 seems not yet working for me

,please go to "Settings" - > "Resources" - "Advanced", make sure you have allocated 40GB+ disk space to > the docker container. > 4. Checking the available disk space of your container by `df -h`, > make sure the 'Use%' of 'overlay' i

OLAP functionalities in Kylin 5.0 seems not yet working for me

Dear Sir/Madam, I have a fact with 500million rows then I build model, index according to the website help. I chose full incremental because this is the first times I load data I create both index types Aggregate group index, table index as photo attached. But the query always failed after time

Re: Query timeout and pushdown

g Yu* > > > > At 2023-10-28 14:28:21, "Nam Đỗ Duy" wrote: > >Dear Sir/Madam > > > >Can you please advise to pass this error which happened many times with me: > > > >The query exceeds the set time limit of 300s. Current step: Collecting > >dataset of push-down. > >

Re: What is the default account name/pass for mysql in kylin docker

g doc: > https://kylin.apache.org/5.0/docs/modeling/manual_modeling ? > > > > -- > *Best wishes to you ! * > *From ：**Xiaoxiang Yu* > > > At 2023-10-28 20:11:19, "Nam Đỗ Duy" wrote: > > Hello Xiaoxiang > > I have created plenty of index but why

Re: What is the default account name/pass for mysql in kylin docker

Hello Xiaoxiang I have created plenty of index but why it is very slow query and it still showed "No model index built": [image: image.png] [image: image.png] On Thu, Oct 19, 2023 at 5:10 PM Nam Đỗ Duy wrote: > Thank you for sharing. > > I have one very important quest

Query timeout and pushdown

Dear Sir/Madam Can you please advise to pass this error which happened many times with me: The query exceeds the set time limit of 300s. Current step: Collecting dataset of push-down.

Re: What is the default account name/pass for mysql in kylin docker

t; *From ：**Xiaoxiang Yu* > > > > At 2023-10-18 22:38:51, "Nam Đỗ Duy" wrote: > >Hello ShaoFeng > > > >Thank you for your email. > > > >I am a bit confused when the cube is no more. > > > >Then how can I utilize the power of mul

Re: What is the default account name/pass for mysql in kylin docker

少锋 > Apache Kylin PMC, > Apache Incubator PMC, > Email: shaofeng...@apache.org > > Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html > Join Kylin user mail group: user-subscr...@kylin.apache.org > Join Kylin dev mail group: dev-subscr...@kylin.apache.org >