[ https://issues.apache.org/jira/browse/KYLIN-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shaofeng SHI updated KYLIN-3635: -------------------------------- Description: As titled; Received reporting that percentile result is wrong when using Spark engine. Checked the code and found the object was reused and not reset, the problem won't happen on normal MR as it would be serialized before next call, but would be a problem on Spark, as the object was cached in-memory and be serialized later. (was: As titled; Received reporting that percentile result is wrong when using Spark engine. Checked the code and found the implementation is not thread safe, the problem won't happen on normal MR as it is single threaded, but would be problem on Spark.) > Percentile calculation on Spark engine is not thread safe > --------------------------------------------------------- > > Key: KYLIN-3635 > URL: https://issues.apache.org/jira/browse/KYLIN-3635 > Project: Kylin > Issue Type: Bug > Affects Versions: v2.3.0, v2.3.1, v2.4.0, v2.3.2, v2.4.1, v2.5.0 > Reporter: Shaofeng SHI > Priority: Major > > As titled; Received reporting that percentile result is wrong when using > Spark engine. Checked the code and found the object was reused and not reset, > the problem won't happen on normal MR as it would be serialized before next > call, but would be a problem on Spark, as the object was cached in-memory and > be serialized later. -- This message was sent by Atlassian JIRA (v7.6.3#76005)