Yaguang Jia created KYLIN-5699: ---------------------------------- Summary: Support special character for bitmap measure column & computed column Key: KYLIN-5699 URL: https://issues.apache.org/jira/browse/KYLIN-5699 Project: Kylin Issue Type: Improvement Components: Modeling Affects Versions: 5.0-alpha Reporter: Yaguang Jia Assignee: Yaguang Jia Fix For: 5.0-beta
*Root Cause* The Spark org.apache.spark.sql.functions.expr function cannot recognize special characters such as Chinese characters and needs to be enclosed in backticks. *Dev Design* Identify the places where expr is called and add compatibility handling for special characters: Build the computable column {code:java} FlatTableAndDictBase#concatCCs{code} Build dictionary {code:java} DFBuilderHelper#selectColumnsInTable, DFBuilderHelper#chooseSuitableCols{code} Build dictionary {code:java} DFDictionaryBuilder#wrapCol{code} ---- *Root Cause* Spark {{org.apache.spark.sql.functions.expr}} 函数不能识别中文等特殊字符,需要用反引号包裹。 *Dev Design* 找出 expr 调用处,增加对特殊字符的兼容处理: # 构建可计算列 {{FlatTableAndDictBase#concatCCs}} # 构建字典 {{{}DFBuilderHelper#selectColumnsInTable{}}}、{{{}DFBuilderHelper#chooseSuitableCols{}}} # 构建字典 {{DFDictionaryBuilder#wrapCol}} {{}} -- This message was sent by Atlassian Jira (v8.20.10#820010)