Re: directory pruning and UDFs

Hi, It's here: https://issues.apache.org/jira/browse/DRILL-3838 hopefully this can be accommodated soon :). Regards, -Stefan On Wed, Sep 23, 2015 at 5:21 PM, Jacques Nadeau wrote: > Hey Stefan, > > Yes, this makes a lot of sense and seems reasonable. We've talked about

Re: directory pruning and UDFs

Hey Stefan, Yes, this makes a lot of sense and seems reasonable. We've talked about providing the simple filename as a virtual attribute. It seems like we should also provide a full path attribute (from the root of the workspace). Can you open a JIRA for this? It isn't something that is supported

Re: directory pruning and UDFs

Can you also provide some examples of what you are trying to accomplish? It seems like you might be saying that you want a virtual attribute for the entire path rather than individual pieces? Also remember that partition pruning can also be done if you're using Parquet files without all the dirN

directory pruning and UDFs

Hi, I have been writing a few simple utility functions for Drill and staring at the cumbersome dirN conditions required to take advantage of directory pruning. Would it be possible to allow UDFs to throw fileOutOfScope and directoryOutOfScope exceptions that would allow me to a) write a failry

Re: directory pruning and UDFs

Stefan, What you say sounds intriguing. Can you show an example of how it would look? On Thu, Sep 17, 2015 at 10:42 AM, Stefán Baxter wrote: > Hi, > > I have been writing a few simple utility functions for Drill and staring at > the cumbersome dirN conditions