Re: what is your typical size of tablet.

2017-08-30 Thread Jean-Daniel Cryans
Hi Denis, I don't directly manage Kudu clusters but what I've seen ranges anywhere from 0 bytes to 100GB. I wouldn't recommend going much higher than this because re-replicating 100GB takes a _long_ time, although it should be a little better in upcoming 1.5.0 thanks to Hao's work. Sweet spot is

DMP/CDP Profile Store

2017-08-30 Thread Benjamin Kim
I was wondering has anyone worked on a DMP/CDP for storing user and customer profiles in Kudu. Each user will have their base ID's aka identity graph along with statistics based on their attributes along with tables for these attributes grouped by category. Please let me know what you think of my

Re: Why per tablet server 's upper limit is 4TB.

2017-08-30 Thread Denis Bolshakov
Mike Percy answers to @kinglee (from Kudu Slack channel) there are multiple issues that interact but one issue is that if you have many tablets you will use many threads. Adar has been focusing on improving density lately and trying to quantify the scaling limits. On 30 August 2017 at 13:22,