[
https://issues.apache.org/jira/browse/KYLIN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17762649#comment-17762649
]
ASF subversion and git services commented on KYLIN-5699:
--------------------------------------------------------
Commit 352e7f68bc16da256d8202770f5c578b8ed91aae in kylin's branch
refs/heads/kylin5 from Yu Gan
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=352e7f68bc ]
KYLIN-5699 support special character for computed column
> Support special character for bitmap measure column & computed column
> ---------------------------------------------------------------------
>
> Key: KYLIN-5699
> URL: https://issues.apache.org/jira/browse/KYLIN-5699
> Project: Kylin
> Issue Type: Improvement
> Components: Modeling
> Affects Versions: 5.0-beta
> Reporter: Yaguang Jia
> Assignee: Yaguang Jia
> Priority: Critical
> Fix For: 5.0.0
>
>
> *Root Cause*
> The Spark org.apache.spark.sql.functions.expr function cannot recognize
> special characters such as Chinese characters and needs to be enclosed in
> backticks.
> *Dev Design*
> Identify the places where expr is called and add compatibility handling for
> special characters:
> Build the computable column
> {code:java}
> FlatTableAndDictBase#concatCCs{code}
> Build dictionary
> {code:java}
> DFBuilderHelper#selectColumnsInTable, DFBuilderHelper#chooseSuitableCols{code}
> Build dictionary
> {code:java}
> DFDictionaryBuilder#wrapCol{code}
>
> ----
>
> *Root Cause*
> Spark {{org.apache.spark.sql.functions.expr}} 函数不能识别中文等特殊字符，需要用反引号包裹。
> *Dev Design*
> 找出 expr 调用处，增加对特殊字符的兼容处理：
> # 构建可计算列 {{FlatTableAndDictBase#concatCCs}}
> # 构建字典
> {{{}DFBuilderHelper#selectColumnsInTable{}}}、{{{}DFBuilderHelper#chooseSuitableCols{}}}
> # 构建字典 {{DFDictionaryBuilder#wrapCol}}
> {{}}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
