Opened https://issues.apache.org/jira/browse/SPARK-3462
I'll take a look at ColumnPruning and see what I can do On Tue, Sep 9, 2014 at 12:46 PM, Michael Armbrust <[email protected]> wrote: > On Tue, Sep 9, 2014 at 10:17 AM, Cody Koeninger <[email protected]> > wrote: >> >> Is there a reason in general not to push projections and predicates down >> into the individual ParquetTableScans in a union? >> > > This would be a great case to add to ColumnPruning. Would be awesome if > you could open a JIRA or even a PR :) >
