Ted refers to source code transformation. Drill gains its speed from value vectors. However, VVs are a far cry from the row-based interface that most mere mortals are accustomed to using. Since VVs are very type specific, code is typically generated to handle the specifics of each type. Accessing VVs in Jython may be a bit of a challenge because of the "impedence mismatch" between how VVs work and the row-and-column view expected by most (non-Drill) developers.
I wonder if we've considered providing a row-oriented "facade" that can be used by roll-your own data sources and user-defined row transforms? Might be a hiccup in the fast VV pipeline, but might be handy for users willing to trade a bit of speed for convenience. With such a facade, the Jython row transforms that John mentions could be quite simple. On Thu, Jun 16, 2016 at 10:36 AM, Ted Dunning <ted.dunn...@gmail.com> wrote: > Since UDF's use source code transformation, using Jython would be > difficult. > > > > On Thu, Jun 16, 2016 at 9:42 AM, Arina Yelchiyeva < > arina.yelchiy...@gmail.com> wrote: > > > Hi Charles, > > > > not that I am aware of. Proposed solution doesn't invent anything new, > just > > adds possibility to add UDFs without drillbit restart. But contributions > > are welcomed. > > > > On Thu, Jun 16, 2016 at 4:52 PM Charles Givre <cgi...@gmail.com> wrote: > > > > > Arina, > > > Has there been any discussion about making it possible via Jython or > > > something for users to write simple UDFs in Python? > > > My ideal would be to have this capability integrated in the web GUI > such > > > that a user could write their UDF (in Python) right there, submit it > and > > it > > > would be deployed to Drill if it passes validation tests. > > > —C > > > > > > > > > > On Jun 16, 2016, at 09:34, Arina Yelchiyeva < > > arina.yelchiy...@gmail.com> > > > wrote: > > > > > > > > Hi all! > > > > > > > > I have created Jira to allow dynamic UDFs support in Drill ( > > > > https://issues.apache.org/jira/browse/DRILL-4726). There is a link > to > > > > design document in Jira description. > > > > Comments or suggestions are welcomed. > > > > > > > > Kind regards > > > > Arina > > > > > > > > >
