[
https://issues.apache.org/jira/browse/KYLIN-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17788285#comment-17788285
]
ASF subversion and git services commented on KYLIN-5723:
--------------------------------------------------------
Commit 4753eb92cd72d548aeef89f673262c90fe6c717e in kylin's branch
refs/heads/kylin5 from Mingming Ge
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=4753eb92cd ]
KYLIN-5723 optimize KylinConfigExt
> Optimize Calcite plan to convert spark logical plan
> ---------------------------------------------------
>
> Key: KYLIN-5723
> URL: https://issues.apache.org/jira/browse/KYLIN-5723
> Project: Kylin
> Issue Type: Improvement
> Affects Versions: 5.0-beta
> Reporter: Hongrong Cao
> Assignee: Hongrong Cao
> Priority: Major
> Fix For: 5.0.0
>
>
> The problem with calcite plan to spark LogicalPlan is that it uses the
> DataFrame interface, which means that it parses and builds the LogicalPlan at
> the same time.
> During the process of calcite plan to spark plan, the select agg and other
> operators execute the following methods, where the execution of
> qe.assertAnalyzed() is of interest
> {quote}def ofRows(sparkSession: SparkSession, logicalPlan: LogicalPlan):
> DataFrame =
> sparkSession.withActive {
> val qe = sparkSession.sessionState.executePlan(logicalPlan)
> qe.assertAnalyzed()
> new Dataset[Row](qe, RowEncoder(qe.analyzed.schema))
> }
> {quote}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
