Andy Grove created ARROW-12064:
----------------------------------

             Summary: [Rust] [DataFusion] Make DataFrame extensible
                 Key: ARROW-12064
                 URL: https://issues.apache.org/jira/browse/ARROW-12064
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Rust - DataFusion
            Reporter: Andy Grove
            Assignee: Andy Grove


The DataFrame implementation currently has two types of logic:
 # Logic for building a logical query plan
 # Logic for executing a query using the DataFusion context

We can make DataFrame more extensible by having it always delegate to the 
context for execution, allowing the same DataFrame logic to be used for local 
and distributed execution.

We will likely need to introduce a new ExecutionContext trait with different 
implementations for DataFusion and Ballista.

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to