[
https://issues.apache.org/jira/browse/IMPALA-13533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Smith updated IMPALA-13533:
-----------------------------------
Description:
Add backend support for CTE plans.
* Add PlanNode/ExecNode for CTE producer, consumer, and sequence nodes.
* Implement backend node-local dataflow from CTE producers to consumers. Use a
shared buffer for CTE producer results until each consumer is ready to process
them; initially this will be a batch operation, where CTE producer puts all
results into the buffer, then consumers can start reading them.
* Should be able to execute all TPC-DS queries.
For distributed plans: generate CTE producer fragments, removing SequenceNodes.
CTE buffer must remain active until all consumers have finished reading.
was:
Add backend support for CTE plans.
* Add PlanNode/ExecNode for CTE producer, consumer, and sequence nodes.
* Implement backend node-local dataflow from CTE producers to consumers. Use
BufferedTupleStream to buffer CTE producer results until each consumer is ready
to process them; initially this will be a batch operation, where CTE producer
puts all results into the BufferedTupleStream, then consumers can start reading
them.
* Should be able to execute all TPC-DS queries.
> Execute CTE plans
> -----------------
>
> Key: IMPALA-13533
> URL: https://issues.apache.org/jira/browse/IMPALA-13533
> Project: IMPALA
> Issue Type: Sub-task
> Components: Backend
> Reporter: Michael Smith
> Assignee: Michael Smith
> Priority: Major
>
> Add backend support for CTE plans.
> * Add PlanNode/ExecNode for CTE producer, consumer, and sequence nodes.
> * Implement backend node-local dataflow from CTE producers to consumers. Use
> a shared buffer for CTE producer results until each consumer is ready to
> process them; initially this will be a batch operation, where CTE producer
> puts all results into the buffer, then consumers can start reading them.
> * Should be able to execute all TPC-DS queries.
> For distributed plans: generate CTE producer fragments, removing
> SequenceNodes. CTE buffer must remain active until all consumers have
> finished reading.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
