Re: Kylin with Parquet

2020-06-14 Thread ShaoFeng Shi
Hi Manish, As parquet support encoding, Kylin doesn't need to do that anymore; That means, it is possible to read the origin values directly from the cube files. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/getting

Re: Kylin with Parquet

2020-06-13 Thread Manish Jain
It make sense. Are we also planning to change storage encoding or it will remain the same? Will we able read data using normal Hive/Presto queries or it will require Kylin reader only ?! On Sun, 14 Jun 2020 at 7:42 AM, ShaoFeng Shi wrote: > This is a good question; > > One of the purposes of dev

Re: Kylin with Parquet

2020-06-13 Thread ShaoFeng Shi
This is a good question; One of the purposes of developing the parquet storage is to overcome the limitations of HBase, which also means, to replace HBase; If the new storage is successful, we may stop to maintain the HBase engine. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng.

Re: Kylin with Parquet

2020-06-13 Thread Manish Jain
Ok, thanks. On Sat, 13 Jun 2020 at 8:15 PM, Liukaige wrote: > Hey Manish, > > The new Parquet storage is almost ready but has not been released yet. In > one installation you can only choose one of them, not both together. > I guess the community will continue to maintain HBase version for a whi

Re: Kylin with Parquet

2020-06-13 Thread Liukaige
Hey Manish, The new Parquet storage is almost ready but has not been released yet. In one installation you can only choose one of them, not both together. I guess the community will continue to maintain HBase version for a while. But it will be deprecated in the future. Best Regards, Kai Manish

Kylin with Parquet

2020-06-12 Thread Manish Jain
Is Kylin supports storage in Parquet now instead of HBase ? Or it supports both Parquet and Hbase ? -- Best Regards, Manish Jain