This is a new change introduced in 1.5.3, JIRA is:
https://issues.apache.org/jira/browse/KYLIN-1787

In a short, it tries to avoid scanning too many rows (1 million) in one
query. But the threshold wasn't externalized as a parameter. @Tianshuo,
would you mind to contribute a patch?

Besides, the query has "limit 1" but Kylin didn't smartly aware that.

@Tian sheng, what's the SQL query looks like in your case?

2016-08-02 21:14 GMT+08:00 张天生 <[email protected]>:

> I meet the same question. In 1.5.2.1 version it worked fine, but switched
> 1.5.3 it ofter report this error.
>
> 赵天烁 <[email protected]>于2016年8月2日周二 上午11:57写道:
>
>> yes, it is 1.5.3,after limit the date range to a week,it still cost about
>> 7 second to response, is there any way to get the query execute detail just
>> like the diagnosis log?
>>
>> ------------------------------
>>
>> 赵天烁
>>
>> Kevin Zhao
>>
>> *[email protected] <[email protected]>*
>>
>>
>>
>> 珠海市魅族科技有限公司
>>
>> MEIZU Technology Co., Ltd.
>>
>> 广东省珠海市科技创新海岸魅族科技楼
>>
>> MEIZU Tech Bldg., Technology & Innovation Coast
>>
>> Zhuhai, 519085, Guangdong, China
>>
>> meizu.com
>>
>>
>> *From:* ShaoFeng Shi <[email protected]>
>> *Date:* 2016-08-01 20:20
>> *To:* user <[email protected]>
>> *Subject:* Re: Scan row count exceeded threshold
>>
>> are you on 1.5.3? If not, suggest to upgrade and then retry it. Besides,
>> you can add some "where" contition to reduce the records to scan, as the
>> error message mentioned.
>>
>> 2016-08-01 15:37 GMT+08:00 赵天烁 <[email protected]>:
>>
>>> recently I got the following error while execute query on a cube which
>>> is not that big( about 400mb, 20milion record)
>>> ==================
>>> Error while executing SQL "select FCRASHTIME,count(1) from
>>> UXIP.EDL_FDT_OUC_UPLOAD_FILES group by FCRASH_ANALYSIS_ID,FCRASHTIME limit
>>> 1": Scan row count exceeded threshold: 10000000, please add filter
>>> condition to narrow down backend scan range, like where clause.
>>>
>>> I guess what  it scan were the intermediate result, but It doesn't any
>>> order by,also the result count is limit to just 1.so it could scan to
>>> find any record with those two dimension and wala.
>>> waiting kylin expert to give me some detail on that.
>>> btw how to configure that threshold, any properties in kylin.properties?
>>> ------------------------------
>>>
>>> 赵天烁
>>>
>>> Kevin Zhao
>>>
>>> *[email protected] <[email protected]>*
>>>
>>>
>>>
>>> 珠海市魅族科技有限公司
>>>
>>> MEIZU Technology Co., Ltd.
>>>
>>> 广东省珠海市科技创新海岸魅族科技楼
>>>
>>> MEIZU Tech Bldg., Technology & Innovation Coast
>>>
>>> Zhuhai, 519085, Guangdong, China
>>>
>>> meizu.com
>>>
>>
>>
>>
>> --
>> Best regards,
>>
>> Shaofeng Shi
>>
>>


-- 
Best regards,

Shaofeng Shi

Reply via email to