[ 
https://issues.apache.org/jira/browse/KYLIN-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3635:
--------------------------------
    Description: As titled; Received reporting that percentile result is wrong 
when using Spark engine. Checked the code and found the object was reused and 
not reset, the problem won't happen on normal MR as it would be serialized 
before next call, but would be a problem on Spark, as the object was cached 
in-memory and be serialized later.  (was: As titled; Received reporting that 
percentile result is wrong when using Spark engine. Checked the code and found 
the implementation is not thread safe, the problem won't happen on normal MR as 
it is single threaded, but would be problem on Spark.)

> Percentile calculation on Spark engine is not thread safe
> ---------------------------------------------------------
>
>                 Key: KYLIN-3635
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3635
>             Project: Kylin
>          Issue Type: Bug
>    Affects Versions: v2.3.0, v2.3.1, v2.4.0, v2.3.2, v2.4.1, v2.5.0
>            Reporter: Shaofeng SHI
>            Priority: Major
>
> As titled; Received reporting that percentile result is wrong when using 
> Spark engine. Checked the code and found the object was reused and not reset, 
> the problem won't happen on normal MR as it would be serialized before next 
> call, but would be a problem on Spark, as the object was cached in-memory and 
> be serialized later.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to