[jira] [Created] (KYLIN-5699) Support special character for bitmap measure column & computed column

[Yaguang Jia (Jira)]

Yaguang Jia created KYLIN-5699:
----------------------------------

             Summary: Support special character for bitmap measure column & 
computed column
                 Key: KYLIN-5699
                 URL: https://issues.apache.org/jira/browse/KYLIN-5699
             Project: Kylin
          Issue Type: Improvement
          Components: Modeling
    Affects Versions: 5.0-alpha
            Reporter: Yaguang Jia
            Assignee: Yaguang Jia
             Fix For: 5.0-beta


*Root Cause*
The Spark org.apache.spark.sql.functions.expr function cannot recognize special 
characters such as Chinese characters and needs to be enclosed in backticks.
*Dev Design*
Identify the places where expr is called and add compatibility handling for 
special characters:
Build the computable column 
{code:java}
FlatTableAndDictBase#concatCCs{code}

Build dictionary 
{code:java}
DFBuilderHelper#selectColumnsInTable, DFBuilderHelper#chooseSuitableCols{code}

Build dictionary 
{code:java}
DFDictionaryBuilder#wrapCol{code}
 
----
 

*Root Cause*

Spark {{org.apache.spark.sql.functions.expr}} 函数不能识别中文等特殊字符，需要用反引号包裹。

*Dev Design*

找出 expr 调用处，增加对特殊字符的兼容处理：
 # 构建可计算列 {{FlatTableAndDictBase#concatCCs}}

 # 构建字典 
{{{}DFBuilderHelper#selectColumnsInTable{}}}、{{{}DFBuilderHelper#chooseSuitableCols{}}}

 # 构建字典 {{DFDictionaryBuilder#wrapCol}}

{{}}
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)