Re: [VOTE] Release apache-kylin-2.5.0 (RC2)

2018-09-13 Thread Luke Han 
+1 binding

maven test passed

Best Regards!
-

Luke Han


On Thu, Sep 13, 2018 at 11:22 AM Zhong, Yanghong  wrote:

> mvn clean test, passed
>
> +1 binding
>
> My environment:
> Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
> 2018-06-18T02:33:14+08:00)
> Maven home: /Users/yangzhong/Software/apache-maven-3.5.4
> Java version: 1.8.0_66, vendor: Oracle Corporation, runtime:
> /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "mac os x", version: "10.11.6", arch: "x86_64", family: "mac"
>
> Best regards,
> Yanghong Zhong
>
> On 9/13/18, 1:53 PM, "ShaoFeng Shi"  wrote:
>
> Hi all,
>
> I have created a build for Apache Kylin 2.5.0, release candidate 2. The
> difference between RC1 and RC2 is just changing the scala-maven-plugin
> version from 3.4.2 to 3.4.1.
>
> Changes highlights:
>
> [KYLIN-2565] - Support Hadoop 3.0
> [KYLIN-3033] - Support HBase 2.0
> [KYLIN-2998] - Kill spark app when cube job was discarded
> [KYLIN-3370] - Enhanced segment pruning
> [KYLIN-3488] - Support MySQL as Kylin metadata storage
> [KYLIN-3418] - User interface for Hybrid model
> [KYLIN-3419] - Upgrade to Java 8
> [KYLIN-3421] - Improve job scheduler fetch performance
> [KYLIN-3427] - Convert to HFile in Spark
> [KYLIN-3441] - Merge cube segments in Spark
> [KYLIN-3442] - Fact distinct columns in Spark
> [KYLIN-3453] - Improve cube size estimation for TOPN, COUNT DISTINCT
> [KYLIN-3457] - Distribute by multi columns if not set distribute column
> [KYLIN-3471] - Merge dictionary and statistics on Yarn
> [KYLIN-3480] - Change the conformance of calcite from default to
> lenient
> [KYLIN-3491] - Improve the cube building process when using global
> dictionary
> [KYLIN-3521] - Enable Cube Planner by default
>
> Thanks to everyone who has contributed to this release.
> Here are release notes:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fsecure%2FReleaseNote.jspa%3FprojectId%3D12316121%26version%3D12343540data=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018sdata=jfiVgq93KvjoHS3vPOvQ0zwNKvQ0zra%2BLSA3UXETTFs%3Dreserved=0
>
> The commit to being voted upon:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fkylin%2Fcommit%2F158f8768debe99746c66e516e4596707a476d7d6data=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018sdata=KEswnV3B6xlNosSIjKs7%2BVj1pX0DkucFbtapf63PPTQ%3Dreserved=0
>
> Its hash is 158f8768debe99746c66e516e4596707a476d7d6.
>
> The artifacts to be voted on are located here:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fkylin%2Fapache-kylin-2.5.0-rc2%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018sdata=MYMl8ARJfGgj9HLijudmnXrBmzrhG9cq3mkB64t9Eeg%3Dreserved=0
>
> The hashes of the artifacts are as follows:
> apache-kylin-2.5.0-source-release.zip.sha256
> 7035bf753b0e3de86f1cd663ff3b44381be5452a44de6cc1089cabf73da6bee4
>
> A staged Maven repository is available for review at:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachekylin-1055%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018sdata=a8V2REf8TmWEEGK67aar65ZGwgSlpDW70nnW5vIdexQ%3Dreserved=0
>
> Release artifacts are signed with the following key:
>
> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fshaofengshi.ascdata=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018sdata=0LuqMqVK9ZvZmNS6510aiTjS8BjlWUeXPa8EDVEiYD8%3Dreserved=0
>
> Please vote on releasing this package as Apache Kylin 2.5.0.
>
> The vote is open for the next 72 hours and passes if a majority of
> at least three +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Kylin 2.5.0
> [ ]  0 I don't feel strongly about it, but I'm okay with the release
> [ ] -1 Do not release this package because...
>
> Please note, from this version, Kylin need Java 8+ and Maven 3.5.3+.
>
> Here is my vote:
>
> +1 (binding)
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
>

Need learning resources and small sample projects

2018-09-13 Thread Asim Ali 
Hi All,
I am new in Kylin and Hadoop, and trying to learn Kylin.
Can you suggest any learning material or small examples which help me
clarify concepts and give me some practice for Kylin.
There is limited learning resources available on Kylin.
Thanks

Asim Ali
*Software Developer*

Email: a...@easyemployer.com 

Phone: 1300 855 642 <1300855642>
Website: www.easyemployer.com

[image: easyemployer] 


On Tue, 11 Sep 2018 at 16:31, ShaoFeng Shi  wrote:

> Hi Neethu,
>
> You're correct; If need new dimension/measure be available for history
> data, then hybrid doesn't fit; You need to clone to a new Cube, add the
> dimension/measures, and then rebuild it.
>
>
> mvneethu  于2018年9月11日周二 下午12:28写道：
>
> > Hi,
> >
> > Thanks for your response. But in hybrid model, it says that the cube 1
> will
> > not be built anymore and will only be queried. But in my usecase the new
> > measures and dimensions has to built for the historical period also. In
> > that
> > case, hybrid doesn't fit right? Please clarify
> >
> > Thanks,
> > Neethu
> >
> > --
> > Sent from: http://apache-kylin.74782.x6.nabble.com/
> >
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>

Re: [VOTE] Release apache-kylin-2.5.0 (RC2)

2018-09-13 Thread Zhong, Yanghong 
mvn clean test, passed

+1 binding

My environment:
Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 
2018-06-18T02:33:14+08:00)
Maven home: /Users/yangzhong/Software/apache-maven-3.5.4
Java version: 1.8.0_66, vendor: Oracle Corporation, runtime: 
/Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.11.6", arch: "x86_64", family: "mac"

Best regards,
Yanghong Zhong

On 9/13/18, 1:53 PM, "ShaoFeng Shi"  wrote:

Hi all,

I have created a build for Apache Kylin 2.5.0, release candidate 2. The
difference between RC1 and RC2 is just changing the scala-maven-plugin
version from 3.4.2 to 3.4.1.

Changes highlights:

[KYLIN-2565] - Support Hadoop 3.0
[KYLIN-3033] - Support HBase 2.0
[KYLIN-2998] - Kill spark app when cube job was discarded
[KYLIN-3370] - Enhanced segment pruning
[KYLIN-3488] - Support MySQL as Kylin metadata storage
[KYLIN-3418] - User interface for Hybrid model
[KYLIN-3419] - Upgrade to Java 8
[KYLIN-3421] - Improve job scheduler fetch performance
[KYLIN-3427] - Convert to HFile in Spark
[KYLIN-3441] - Merge cube segments in Spark
[KYLIN-3442] - Fact distinct columns in Spark
[KYLIN-3453] - Improve cube size estimation for TOPN, COUNT DISTINCT
[KYLIN-3457] - Distribute by multi columns if not set distribute column
[KYLIN-3471] - Merge dictionary and statistics on Yarn
[KYLIN-3480] - Change the conformance of calcite from default to lenient
[KYLIN-3491] - Improve the cube building process when using global
dictionary
[KYLIN-3521] - Enable Cube Planner by default

Thanks to everyone who has contributed to this release.
Here are release notes:

https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fsecure%2FReleaseNote.jspa%3FprojectId%3D12316121%26version%3D12343540data=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018sdata=jfiVgq93KvjoHS3vPOvQ0zwNKvQ0zra%2BLSA3UXETTFs%3Dreserved=0

The commit to being voted upon:

https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fkylin%2Fcommit%2F158f8768debe99746c66e516e4596707a476d7d6data=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018sdata=KEswnV3B6xlNosSIjKs7%2BVj1pX0DkucFbtapf63PPTQ%3Dreserved=0

Its hash is 158f8768debe99746c66e516e4596707a476d7d6.

The artifacts to be voted on are located here:

https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fkylin%2Fapache-kylin-2.5.0-rc2%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018sdata=MYMl8ARJfGgj9HLijudmnXrBmzrhG9cq3mkB64t9Eeg%3Dreserved=0

The hashes of the artifacts are as follows:
apache-kylin-2.5.0-source-release.zip.sha256
7035bf753b0e3de86f1cd663ff3b44381be5452a44de6cc1089cabf73da6bee4

A staged Maven repository is available for review at:

https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachekylin-1055%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018sdata=a8V2REf8TmWEEGK67aar65ZGwgSlpDW70nnW5vIdexQ%3Dreserved=0

Release artifacts are signed with the following key:

https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fshaofengshi.ascdata=02%7C01%7Cyangzhong%40ebay.com%7Ca764eefe81584b1bf37108d6193d3a24%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636724148150769018sdata=0LuqMqVK9ZvZmNS6510aiTjS8BjlWUeXPa8EDVEiYD8%3Dreserved=0

Please vote on releasing this package as Apache Kylin 2.5.0.

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PMC votes are cast.

[ ] +1 Release this package as Apache Kylin 2.5.0
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...

Please note, from this version, Kylin need Java 8+ and Maven 3.5.3+.

Here is my vote:

+1 (binding)

-- 
Best regards,

Shaofeng Shi 史少锋