[jira] [Created] (DRILL-3515) Querying directories with non-data files fails

2015-07-20 Thread JIRA
Stefán Baxter created DRILL-3515: Summary: Querying directories with non-data files fails Key: DRILL-3515 URL: https://issues.apache.org/jira/browse/DRILL-3515 Project: Apache Drill Issue

[jira] [Created] (DRILL-3519) Update UDFs to avoid requiring fully qualified class names

2015-07-20 Thread Jacques Nadeau (JIRA)
Jacques Nadeau created DRILL-3519: - Summary: Update UDFs to avoid requiring fully qualified class names Key: DRILL-3519 URL: https://issues.apache.org/jira/browse/DRILL-3519 Project: Apache Drill

Re: drill user experience

2015-07-20 Thread Ted Dunning
On Mon, Jul 20, 2015 at 8:45 AM, Stefán Baxter ste...@activitystream.com wrote: It's fair to add that the document, once read aft-the-fact, already mentions some of the things that still caused me problems (?user problem?). Yes. I read the document and found the pieces that you mention. But

[GitHub] drill pull request: DRILL-3122: Changing a session option to defau...

2015-07-20 Thread jaltekruse
Github user jaltekruse commented on the pull request: https://github.com/apache/drill/pull/92#issuecomment-122968551 +1 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[jira] [Created] (DRILL-3521) [umbrella] Review switch statements throughout codebase to add default cases where there are none

2015-07-20 Thread Jason Altekruse (JIRA)
Jason Altekruse created DRILL-3521: -- Summary: [umbrella] Review switch statements throughout codebase to add default cases where there are none Key: DRILL-3521 URL:

[GitHub] drill pull request: Enhanced logging and associated code hygiene

2015-07-20 Thread jaltekruse
Github user jaltekruse commented on a diff in the pull request: https://github.com/apache/drill/pull/93#discussion_r35031355 --- Diff: common/src/main/java/org/apache/drill/common/config/DrillConfig.java --- @@ -44,26 +46,33 @@ import com.google.common.collect.ImmutableList;

Re: drill user experience

2015-07-20 Thread Stefán Baxter
Hi Ted .. and others, I'm here and willing to help. It's fair to add that the document, once read aft-the-fact, already mentions some of the things that still caused me problems (?user problem?). It's also fair to add that I'm not going anywhere :) I like this project too much to have a few

[jira] [Created] (DRILL-3517) Add a UDF development FAQ

2015-07-20 Thread Jacques Nadeau (JIRA)
Jacques Nadeau created DRILL-3517: - Summary: Add a UDF development FAQ Key: DRILL-3517 URL: https://issues.apache.org/jira/browse/DRILL-3517 Project: Apache Drill Issue Type: Sub-task

Re: drill user experience

2015-07-20 Thread Jim Scott
To iterate on Ted's point... and to note, this is not disagreement from Jacques point... There are a core set of capabilities within Drill that need to have fantastic documentation... 1. User documentation for how to write queries - I personally feel this is very good and continues to get

[jira] [Created] (DRILL-3520) Provide better logging around UDF loading and module loading

2015-07-20 Thread Jacques Nadeau (JIRA)
Jacques Nadeau created DRILL-3520: - Summary: Provide better logging around UDF loading and module loading Key: DRILL-3520 URL: https://issues.apache.org/jira/browse/DRILL-3520 Project: Apache Drill

Re: drill user experience

2015-07-20 Thread Pinaki Mukerji
Agree with points made by Jacques. Let's create the JIRA as/when they come up. And will have the Drill team to address them. On Mon, Jul 20, 2015 at 9:18 AM, Jacques Nadeau jacq...@dremio.com wrote: FYI, I hijacked Ted's DRILL-3516 [1] to create a number of subtasks to improve UDF experience.

drill user experience

2015-07-20 Thread Ted Dunning
We just had Stefan over on the user@drill list stick with us through thick and thin to get a very simple UDF up. He isn't a dolt by any means, but here is his signature on email describing his state of mind: Regards, -Stefan (*not the happiest camper*) The only reason that this guy is still

Re: drill user experience

2015-07-20 Thread Jacques Nadeau
FYI, I hijacked Ted's DRILL-3516 [1] to create a number of subtasks to improve UDF experience. The issue really falls into two categories: - Better documentation - Less sharp edges [1] https://issues.apache.org/jira/browse/DRILL-3516 On Mon, Jul 20, 2015 at 9:08 AM, Jim Scott

[jira] [Created] (DRILL-3516) UDF documentation doesn't get people where they need to be

2015-07-20 Thread Ted Dunning (JIRA)
Ted Dunning created DRILL-3516: -- Summary: UDF documentation doesn't get people where they need to be Key: DRILL-3516 URL: https://issues.apache.org/jira/browse/DRILL-3516 Project: Apache Drill

Re: drill user experience

2015-07-20 Thread Jacques Nadeau
Ted, - I've heard from a number of people that Drill's documentation is one of the best of all Hadoop-related projects - There are--and will always be--places where the documentation could be improved. - The people working on documentation have always been very responsive to feedback and that

[jira] [Created] (DRILL-3518) Do a better job of providing conceptual overview to UDF creation

2015-07-20 Thread Jacques Nadeau (JIRA)
Jacques Nadeau created DRILL-3518: - Summary: Do a better job of providing conceptual overview to UDF creation Key: DRILL-3518 URL: https://issues.apache.org/jira/browse/DRILL-3518 Project: Apache

Re: Review Request 36210: DRILL-3341: Move OperatorWrapper list and FragmentWrapper list creation to ProfileWrapper ctor

2015-07-20 Thread Jason Altekruse
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36210/#review92328 --- Ship it! Ship It! - Jason Altekruse On July 13, 2015, 11:08

[GitHub] drill pull request: Enhanced logging and associated code hygiene

2015-07-20 Thread jaltekruse
Github user jaltekruse commented on a diff in the pull request: https://github.com/apache/drill/pull/93#discussion_r35042822 --- Diff: common/src/main/java/org/apache/drill/common/config/DrillConfig.java --- @@ -138,34 +155,77 @@ public static DrillConfig create(Properties

Re: [GitHub] drill pull request: Enhanced logging and associated code hygiene

2015-07-20 Thread Jim Scott
To make the topic even that much more annoying to discuss, a static final variable in java is typically noted in all UPPER CASE... I would vote for this notation and any of the following would be my personal preference, but I am not a committer... s private static final Logger logger =

[GitHub] drill pull request: Enhanced logging and associated code hygiene

2015-07-20 Thread jaltekruse
Github user jaltekruse commented on a diff in the pull request: https://github.com/apache/drill/pull/93#discussion_r35031778 --- Diff: common/src/main/java/org/apache/drill/common/config/DrillConfig.java --- @@ -44,31 +46,37 @@ import com.google.common.collect.ImmutableList;

Re: [DISCUSS] Allowing the option to use github pull requests in place of reviewboard

2015-07-20 Thread Ted Dunning
On Mon, Jul 20, 2015 at 11:23 AM, Jason Altekruse altekruseja...@gmail.com wrote: I will be opening an infra ticket if there is not already one to request these comments also be reflected if possible. Good catch.

Re: Review Request 36558: DRILL-3492: Add support for encoding/decoding of 'double' to/from OrderedBytes format

2015-07-20 Thread Aditya Kishore
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36558/#review92346 --- contrib/storage-hbase/pom.xml (lines 105 - 122)

[GitHub] drill pull request: DRILL-2818, DRILL-3496: Enhanced logging and a...

2015-07-20 Thread dsbos
Github user dsbos commented on a diff in the pull request: https://github.com/apache/drill/pull/93#discussion_r35053796 --- Diff: common/src/main/java/org/apache/drill/common/logical/FormatPluginConfigBase.java --- @@ -27,11 +27,20 @@ static final org.slf4j.Logger logger =

Testing a UDF

2015-07-20 Thread Jim Scott
Are there any unit tests which I can copy from in the drill project that will allow me to test my UDF that I am creating without the need to do a full build, package and deploy to test it? I ask since there is code being generated to package it, and this is kind of SUPER important :-) Thanks!

Review Request 36630: DRILL-3503: Make PruneScanRule pluggable

2015-07-20 Thread Mehant Baid
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36630/ --- Review request for drill and Aman Sinha. Bugs: DRILL-3503

[GitHub] drill pull request: DRILL-2818, DRILL-3496: Enhanced logging and a...

2015-07-20 Thread dsbos
Github user dsbos commented on a diff in the pull request: https://github.com/apache/drill/pull/93#discussion_r35052980 --- Diff: common/src/main/java/org/apache/drill/common/config/DrillConfig.java --- @@ -138,34 +155,77 @@ public static DrillConfig create(Properties

[GitHub] drill pull request: DRILL-2818, DRILL-3496: Enhanced logging and a...

2015-07-20 Thread dsbos
Github user dsbos commented on a diff in the pull request: https://github.com/apache/drill/pull/93#discussion_r35052392 --- Diff: common/src/main/java/org/apache/drill/common/config/DrillConfig.java --- @@ -90,7 +97,8 @@ public DrillConfig(Config config, boolean enableServer) {

[GitHub] drill pull request: DRILL-2818, DRILL-3496: Enhanced logging and a...

2015-07-20 Thread dsbos
Github user dsbos commented on a diff in the pull request: https://github.com/apache/drill/pull/93#discussion_r35053589 --- Diff: common/src/main/java/org/apache/drill/common/config/DrillConfig.java --- @@ -115,19 +124,26 @@ public static DrillConfig forClient() { * p

[GitHub] drill pull request: DRILL-2818, DRILL-3496: Enhanced logging and a...

2015-07-20 Thread dsbos
Github user dsbos commented on a diff in the pull request: https://github.com/apache/drill/pull/93#discussion_r35054916 --- Diff: common/src/main/java/org/apache/drill/common/config/DrillConfig.java --- @@ -138,34 +154,83 @@ public static DrillConfig create(Properties

question about UDF optimization

2015-07-20 Thread Ted Dunning
*Summary:* Drill is very aggressive about optimizing away calls to functions with constant arguments. I worry that could extend to per record batch optimization if I accidentally have constant values and even if that doesn't happen, it is a pain in the ass now largely because Drill is clever

Re: question about UDF optimization

2015-07-20 Thread Jacques Nadeau
There is an annotation on the function template. I don't have a laptop close but I believe it is something similar to isRandom. It basically tells Drill that this is a nondeterministic function. I will be more specific once I get back to my machine if you don't find it sooner. Jacques *Summary:*

Re: Kerberos

2015-07-20 Thread Parth Chandra
We haven't really tried this, though it seems likely that it should work. Can you post your results if you do try it? Parth On Mon, Jul 20, 2015 at 10:55 AM, Timothy Chen tnac...@gmail.com wrote: Hi all, Does Drill able to authenticate via Kerberos when contacting HDFS now? Tim

[jira] [Created] (DRILL-3522) IllegalStateException from Mongo storage plugin

2015-07-20 Thread Adam Gilmore (JIRA)
Adam Gilmore created DRILL-3522: --- Summary: IllegalStateException from Mongo storage plugin Key: DRILL-3522 URL: https://issues.apache.org/jira/browse/DRILL-3522 Project: Apache Drill Issue

Re: Testing a UDF

2015-07-20 Thread Ted Dunning
Last I heard, Jason and others were working in that exact area. For now, printf still rules. The good news is that it only takes a few seconds to rebuild and redeploy to a local instance. It takes longer to stop an start sqlline. Sent from my iPhone On Jul 20, 2015, at 17:17, Jim Scott