FlinkSQL??????????????????????????????ExecNodeGraph????????SameRelObjectShuttle??SubplanReuseShuttle????????????????

???? Tue, 23 Nov 2021 23:55:30 -0800

Hi??


??????FlinkSQL??????????????ExecNodeGraph????????????optimizedRelNodes????


??????????SameRelObjectShuttle Rewrite same rel object to different rel objects.
e.g.
&nbsp; &nbsp; &nbsp; Join&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Join
&nbsp; &nbsp; &nbsp;/&nbsp; &nbsp; \&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;/&nbsp; &nbsp; \
&nbsp;Filter1 Filter2&nbsp; &nbsp; &nbsp;=&gt;&nbsp; &nbsp; &nbsp;Filter1 
Filter2
&nbsp; &nbsp; &nbsp;\&nbsp; &nbsp;/&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;|&nbsp; &nbsp; &nbsp; |
&nbsp; &nbsp; &nbsp; Scan&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 
&nbsp; &nbsp; Scan1&nbsp; &nbsp; Scan2



??????????SubplanReuseShuttle
&nbsp; &nbsp; &nbsp; &nbsp;Join&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 
&nbsp; &nbsp; &nbsp; &nbsp; Join
&nbsp; &nbsp; &nbsp;/&nbsp; &nbsp; &nbsp; \&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 
&nbsp; &nbsp; &nbsp; &nbsp; /&nbsp; &nbsp; &nbsp; \
&nbsp;Filter1&nbsp; Filter2&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Filter1&nbsp; 
Filter2
&nbsp; &nbsp; |&nbsp; &nbsp; &nbsp; &nbsp; |&nbsp; &nbsp; &nbsp; &nbsp; 
=&gt;&nbsp; &nbsp; &nbsp; &nbsp;\&nbsp; &nbsp; &nbsp;/
&nbsp;Project1 Project2&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Project1
&nbsp; &nbsp; |&nbsp; &nbsp; &nbsp; &nbsp; |&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; |
&nbsp; Scan1&nbsp; &nbsp; Scan2&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 
&nbsp;Scan1

val shuttle = new SameRelObjectShuttle()
val relsWithoutSameObj = optimizedRelNodes.map(_.accept(shuttle))
// reuse subplan
val reusedPlan = SubplanReuser.reuseDuplicatedSubplan(relsWithoutSameObj, 
config)
// convert FlinkPhysicalRel DAG to ExecNodeGraph
val generator = new ExecNodeGraphGenerator()
????????????????????

FlinkSQL??????????????????????????????ExecNodeGraph????????SameRelObjectShuttle??SubplanReuseShuttle????????????????

回复