Re: [Discussion] Blocklet DataMap caching in driver

2018-06-22 Thread kanaka kumar avvaru
Hi Manish, Thanks for proposing configured columns for min max cache. This will help customers who has large data but only few columns are used for filter condition. +1 for the solution 1. Regards, Kanaka On Fri, Jun 22, 2018 at 11:39 AM, manishgupta88 wrote: > Thanks Ravi for the feedback.

Re: query carbondata by presto got error : tableCacheModel.carbonTableshould not be null

2018-06-22 Thread 陈星宇
hi, on cluster. see error log as below: 2018-06-22T15:49:31.577+0800INFOquery-execution-4234 com.facebook.presto.event.query.QueryMonitorTIMELINE: Query 20180622_074931_07271_ehasj :: Transaction:[3f6d5c62-045c-4638-b2dd-4025dddb2550] :: elapsed 12ms :: planning 3ms ::

Re: query carbondata by presto got error : tableCacheModel.carbonTable should not be null

2018-06-22 Thread Bhavya Aggarwal
Hi, Are you running it on local or cluster, it should not come but if you will send the stack trace we can resolve it. Regards Bhavya On Fri, Jun 22, 2018 at 12:51 PM, 陈星宇 wrote: > hi , > i query carbondata by presto, but got error : tableCacheModel.carbonTable > should not be null > any idea

query carbondata by presto got error : tableCacheModel.carbonTable should not be null

2018-06-22 Thread 陈星宇
hi , i query carbondata by presto, but got error : tableCacheModel.carbonTable should not be null any idea for this issue? chenxingyu

Re: S3 support

2018-06-22 Thread David CaiQiang
Hi Kunal, I have some questions. *Problem(Locking):* Does the memory lock support that the multiple drivers concurrently load data to the same table? maybe it should note this limitation. *Problem(Write with append mode):* 1. atomicity After the overwrite operation failed, maybe the

Re: [Discussion] Blocklet DataMap caching in driver

2018-06-22 Thread manishgupta88
Thanks Ravi for the feedback. I completely agree with you that we need to develop the second solution ASAP. Please find my response below for your queries. 1. what if the query comes on noncached columns, will it start read from disk in driver side for minmax ? - If query is on a non-cached