Re: [ANNOUNCE] New Committer: Padma Penumarthy

2018-06-15 Thread Neeraja Rentachintala
Congrats Padma! On 6/15/18, 9:36 AM, "Aman Sinha" wrote: The Project Management Committee (PMC) for Apache Drill has invited Padma Penumarthy to become a committer, and we are pleased to announce that she has accepted. Padma has been contributing to Drill for about 1 1/2 y

Re: Issue with OBIEE 12c

2017-03-16 Thread Neeraja Rentachintala
You might want to refer to this. https://www.rittmanmead.com/blog/2016/08/using-apache-drill-with-obiee-12c/ On 3/16/17, 8:43 AM, "Di Camillo, Fabrizio" wrote: Hi guru, we are using Apache Drill (1.9) driver for OBIEE 12c (64 bit). Some queries failed with this error: [nQS

Re: [DISCUSS] Apache Drill Version after 1.9.0, etc.

2016-11-29 Thread Neeraja Rentachintala
+1 on continuing to 1.10 version after 1.9 release. On Mon, Nov 28, 2016 at 7:49 PM, Aman Sinha wrote: > (A) I am leaning to 1.10 for the reasons already mentioned in your email. > (B) sounds good. > (C) Does it matter if there are a few commits in master branch already ? > What's the implicati

Re: Dynamic UDFs support

2016-07-21 Thread Neeraja Rentachintala
atures that require coordination. > Some > > other tools solve this problem with a data dictionary (or “metastore"). > > Alas, Drill does not have such a concept. So a seemingly simple feature > > like dynamic UDF becomes a major design challenge to get right. > > >

Re: Dynamic UDFs support

2016-07-21 Thread Neeraja Rentachintala
t;>> 4. Authorization model mentioned by Julia and John > >>>>>>>>>> If user won't have rights to copy jars to UDF classpath, which > can > >>>> be > >>>>>>>>>> restricted by file system, he won't be able

Re: Drill plugin for Kafka

2016-07-13 Thread Neeraja Rentachintala
Great Anil. Thanks. On Wed, Jul 13, 2016 at 9:02 PM, AnilKumar B wrote: > Thanks Parth. Created the https://issues.apache.org/jira/browse/DRILL-4779 > > Like Mongo storage plugin contribution, Kamesh and me would like to start > working on this feature. > > Thanks & Regards, > B Anil Kumar. > >

Re: Implement "DROP TABLE IIF EXISTS" statement

2016-07-01 Thread Neeraja Rentachintala
sounds good. We need to clear document this - specifically the Hive UDF IF syntax issue. -Neeraja On Fri, Jul 1, 2016 at 11:07 AM, Vitalii Diravka wrote: > Agree with the last decision to use "IF EXISTS" statement and `if` udf with > backticks. > It is acceptable option. > > Thank you for valua

Re: -ERROR [HY000] [MapR][Drill] (1040) Drill failed to execute the query

2016-06-28 Thread Neeraja Rentachintala
Drill doesn't support SELECT INTO syntax currently. You need to use Create Table As. On Tue, Jun 28, 2016 at 11:30 PM, Omkar Pathallapalli wrote: > Hi team, > > When i issued query in apache drill iam getting this error how can i > resolve this > > ERROR [HY000] [MapR][Drill] (1040) Drill failed

Re: [VOTE] Release Apache Drill 1.7.0 rc0

2016-06-26 Thread Neeraja Rentachintala
+1 Downloaded the binary and tried few tutorials. On Saturday, June 25, 2016, Jinfeng Ni wrote: > +1 > > Did a full maven build from source code. > Run yelp tutorial queries against sample json dataset > Run ~10 tpcds queries and checked query profile through webui > Test maven artifacts with a

Re: Dynamic UDFs support

2016-06-21 Thread Neeraja Rentachintala
l is notified of the change and does the > same > > download process. Clean-up is needed at some point to remove ZK entries > if > > the udf jar becomes statically available on the next launch. That needs > > more thought. > > > > We’d still need the phases m

Re: Dynamic UDFs support

2016-06-20 Thread Neeraja Rentachintala
This will need to work with YARN (Once Drill is YARN enabled, I would expect a lot of users using it in conjunction with YARN). Paul, I am not clear why this wouldn't work with YARN. Can you elaborate. -Neeraja On Mon, Jun 20, 2016 at 7:01 PM, Paul Rogers wrote: > Good enough, as long as we doc

Drill & Caravel

2016-05-12 Thread Neeraja Rentachintala
Hi Folks Caravel is nice visualization tool recently open sourced by airbnb. Did anyone try to integrate Drill and/or interested in contributing to making this work with Drill. https://github.com/airbnb/caravel -Thanks Neeraja

Re: Proposal: Create v2 branch to work on breaking changes

2016-04-12 Thread Neeraja Rentachintala
aviors and a number of other > > things. > > > > I for one vote for moving forward and making sure that the 2.x branch is > > the highest quality and best version of Drill yet rather than focusing on > > minimizing the upgrade cost. All upgrades are a cost/benefit

Re: Proposal: Create v2 branch to work on breaking changes

2016-04-12 Thread Neeraja Rentachintala
ined set of 1.x version clients when Drill 2.0 version is out. > > > > I'm asking you to be concrete on why. There is definitely a cost to > > maintaining this compatibility. What are the real costs if we don't? > > > > -- > > Jacques Nadeau > > CTO

Re: Proposal: Create v2 branch to work on breaking changes

2016-04-06 Thread Neeraja Rentachintala
ions. Anything beyond this needs to have a very public cost/benefit > tradeoff. In other words, please expose your thinking 100x more so that we > can all understand the ramifications of different strategies. > > thanks! > Jacques > > > > > > -- > Jacques Nadeau &

Re: Proposal: Create v2 branch to work on breaking changes

2016-04-05 Thread Neeraja Rentachintala
Sorry for coming back to this thread late. I have some feedback on the compatibility aspects of 2.0. We are working with a variety of BI vendors to certify Drill and provide native connectors for Drill. Having native access from BI tools helps with seamless experience for the users with performanc

Re: Embedded Hazelcast for a distributed Drill cluster

2016-03-28 Thread Neeraja Rentachintala
Its not currently used as far as I know. Drill used this at some point, but we removed it due to issues in multicast/subnet scenarios in Drill distributed mode. -Neeraja On Mon, Mar 28, 2016 at 12:49 PM, Pradeeban Kathiravelu < kk.pradee...@gmail.com> wrote: > Hi, > [1] states that Drill uses Ha

Re: Failure Behavior

2016-03-26 Thread Neeraja Rentachintala
As far as I know, there is no failure handling in Drill. The query dies. On Sat, Mar 26, 2016 at 7:52 AM, John Omernik wrote: > With distributed Drill, what is the expected/desired bit failure behavior. > I.e. if you are running, and certain fragments end up on a node with a bit > in a flaky sta

Re: Working with Case-Sensitive Data-sources

2016-03-14 Thread Neeraja Rentachintala
How is this handled for MongoDB storage plugin, which I believe a case sensitive DB as well? On Mon, Mar 14, 2016 at 4:27 PM, Jacques Nadeau wrote: > I don't think it is that simple since there are some types of things that > we can't pushdown that will cause inconsistent results. > > For exampl

Re: Parallelization & Threading

2016-02-29 Thread Neeraja Rentachintala
Jacques can you provide more context on what user/customer problem these changes that you & Hanifi discussed are trying to solve. Is it part of the better resource utilization or concurrency/multi tenancy handling or both. It will help to understand that as a background for the discussion. -Neeraj

Re: [DISCUSS] New Feature: Drill Client Impersonation

2016-02-23 Thread Neeraja Rentachintala
; >> enhancement only, where you’ve pointed out a better way. I addressed > >> your comments on the doc. > >> > >> Thank you, > >> Sudheesh > >> > >>> On Feb 22, 2016, at 9:49 AM, Jacques Nadeau > wrote: > >>> > >>&

Re: [DISCUSS] New Feature: Drill Client Impersonation

2016-02-22 Thread Neeraja Rentachintala
tood the design document. > > > > I thought this was how the user would be changed: "Provide a way to > change > > the user after the connection is made (details) through a session option" > > > > Did I miss something? > > > > > >

Re: [DISCUSS] New Feature: Drill Client Impersonation

2016-02-22 Thread Neeraja Rentachintala
Jacques, I think the current proposal by Sudheesh is an API level change to pass this additional end user id during the connection establishment. Can you elaborate what you mean by random query. -Neeraja On Sun, Feb 21, 2016 at 5:07 PM, Jacques Nadeau wrote: > Sudheesh, thanks for putting this

Re: resource manager proposal -- initial write-ups

2016-01-20 Thread Neeraja Rentachintala
Hanifi thanks for putting this together. Seems like the doc has only view rights. Can you share it such that we can add comments. -thanks On Wed, Jan 20, 2016 at 10:59 AM, Hanifi GUNES wrote: > Folks, > > I have been working on designing the new resource manager. I have a > *moving* > design do

Re: [VOTE] Release Apache Drill 1.3.0 (rc2)

2015-11-12 Thread Neeraja Rentachintala
Same question as Steven. What is the impact. It seemed from the bug the impact is both wrong results and partition pruning not working. Drill is a generally available project now and there are users who created millions of parquet files using previous version of Drill. Hence I think is a release bl

Re: Query a field with empty list

2015-11-02 Thread Neeraja Rentachintala
Empty list sounds like the appropriate thing. What would be the result of we do flatten on this list? I think user should get a row back in the results. On Mon, Nov 2, 2015 at 11:53 AM, Hsuan Yi Chu wrote: > I agree. I think in any context, empty list should appear as [] in the > result. > > A

Drill storage plugins and readiness status in docs

2015-10-29 Thread Neeraja Rentachintala
Hi All Recently Drill eco system is expanding with several new storage plugins being added and/or proposed taking it beyond Hadoop. Just to make the consumption easier for users, I am thinking that we should at least at high level document the readiness status of the plugins from a quality perspec

Re: Request for more feedback on "Support the Ability to Identify And Skip Records" design

2015-10-27 Thread Neeraja Rentachintala
; > > -- Zelaine > > > > On Mon, Oct 26, 2015 at 4:05 PM, Hsuan Yi Chu > wrote: > > > > > Hi, > > > > > > Luckily, we will have hang-out tomorrow. > > > > > > Maybe we could have an example to elaborate how .drill can be used

Re: Request for more feedback on "Support the Ability to Identify And Skip Records" design

2015-10-26 Thread Neeraja Rentachintala
Jacques I have responded to one of your comments on the doc. can you pls review and comment. I am not clear on the approach you are suggesting using .drill and what would that mean to user experience. It would be great if you can add an example. Similar to other thread (initiated by Julien) we hav

Re: select from table with options

2015-10-21 Thread Neeraja Rentachintala
query on > the other end is not analyst friendly > > We should definitely keep .drill in mind while design this. > Although I'm thinking we should probably discuss .drill on a separate > thread. > > > > On Wed, Oct 21, 2015 at 3:55 PM, Neeraja Rentachintala < &

Re: select from table with options

2015-10-21 Thread Neeraja Rentachintala
Another alternative to do this to specify a metadata file (.drill files) that came up in some of the earlier discussions to solve similar use cases. Rather than centrally defining configurations in storage plugin (which is what Drill does today), .drill files allow more granularity , potentially at

Re: [VOTE] Release Apache Drill 1.2.0 RC3

2015-10-14 Thread Neeraja Rentachintala
+1 (non-binding) Downloaded the tar and exercised the yelp tutorials. On Wed, Oct 14, 2015 at 3:33 PM, Jinfeng Ni wrote: > +1 > > 1. Download source and binary tar ball. Do a full maven build from source. > 2. Run yelp queries listed at Apache Drill doc [1]. > 3. Checked profiles through Web UI.

Re: [VOTE] Release Apache Drill 1.2.0 RC2

2015-10-09 Thread Neeraja Rentachintala
+1 (non-binding) Tested embedded mode using yelp JSON tutorials from https://drill.apache.org/docs/tutorials-introduction/ thanks Neeraja On Thu, Oct 8, 2015 at 2:08 PM, Abdel Hakim Deneche wrote: > Hi all, > > I'm enjoying the release management so much that I decided to propose a > third RC

Re: Refresh Table Metadata : Cache file owner

2015-09-21 Thread Neeraja Rentachintala
yes, having Drill process being the owner of the metadata cache makes sense since the goal of the cache is to speed up planning time. However Drill should not leak any information the user doesn't have access to as a result of this. Specifically we need to ensure the metadata queries/queries when i

Re: [DISCUSS] Drop table support

2015-08-05 Thread Neeraja Rentachintala
t;> Ramana >>> >>> >>> On Wed, Aug 5, 2015 at 11:03 AM, Mehant Baid >>> wrote: >>> >>> I agree, it is definitely restrictive. We can lift the restriction for >>>> being able to drop a table (when security is off) only if the Drill

Re: [DISCUSS] Drop table support

2015-08-05 Thread Neeraja Rentachintala
I think enabling drop only when security is enabled is too restrictive. On Wed, Aug 5, 2015 at 12:46 PM, Ted Dunning wrote: > On Wed, Aug 5, 2015 at 11:54 AM, Mehant Baid > wrote: > > > To prevent any catastrophic drops checking for homogenous file formats > > makes sure that at least the direc

Re: [DISCUSS] Drop table support

2015-08-04 Thread Neeraja Rentachintala
most files and checking for permissions might not suffice. So when security isn't enabled the proposal is to delete only those files that are owned (created) by the Drill user./ On Fri, Jul 31, 2015 at 12:09 AM, Ted Dunning wrote: > On Thu, Jul 30, 2015 at 4:56 PM, Neeraja

Re: [DISCUSS] Drop table support

2015-07-30 Thread Neeraja Rentachintala
Few questions/comments inline. On Thu, Jul 30, 2015 at 2:53 PM, mehant baid wrote: > Based on the discussion in the hangout I wanted to start a thread around > Drop table support. > > Couple of high level points about what is planned to be supported > > 1. In the first iteration Drop table will

Re: Unable to run drill...

2015-06-12 Thread Neeraja Rentachintala
What error are you getting On Friday, June 12, 2015, Mehul Trivedi wrote: > + dev@drill.apache.org > > Deva team - anybody can help? > > Mehul Trivedi > trivedimeh...@gmail.com > +91.999.875.1555 > > On Fri, Jun 12, 2015 at 8:20 PM, Mehul Trivedi > > wrote: > > > Hello Jacques > > > > Sorry t

Re: question about correlated arrays and flatten

2015-05-29 Thread Neeraja Rentachintala
Ted can you pls give an example with few data elements in a, b and the expected output you are looking from the query. -Neeraja On Fri, May 29, 2015 at 6:43 AM, Ted Dunning wrote: > I have two arrays. Their elements are correlated times and values. I > would like to flatten them into rows, ea

Re: DrillBits Communication

2015-05-27 Thread Neeraja Rentachintala
Sanjeev If you are new to Drill, I suggest looking at the high level architecture doc below to get started. http://drill.apache.org/architecture/ With respect to user interacting with drillbit, the following documentation will give you some idea. https://cwiki.apache.org/confluence/display/DRILL/Dr

Re: [VOTE][RESULT] Release Apache Drill 1.0.0 (rc1)

2015-05-18 Thread Neeraja Rentachintala
great achievement. Congrats team. On Mon, May 18, 2015 at 9:42 PM, Aditya wrote: > Great milestone!!! One of many more to come!!! > > On Mon, May 18, 2015 at 9:27 PM, Ted Dunning > wrote: > > > > > Awesome work all round. > > > > Sent from my iPhone > > > > > On May 18, 2015, at 20:49, Abhishek

Re: [VOTE] Release Apache Drill 1.0.0 (rc1)

2015-05-15 Thread Neeraja Rentachintala
+1 (non-binding) - Downloaded the tar - Tried tutorials from drill.apache.org/docs/tutorials -thanks On Fri, May 15, 2015 at 8:03 PM, Jacques Nadeau wrote: > Hey Everybody, > > I'm happy to propose a new release of Apache Drill, version 1.0.0. This is > the second release candidate (rc1). It

Re: [VOTE] Release Apache Drill 1.0.0

2015-05-15 Thread Neeraja Rentachintala
+1 (non-binding) Downloaded the tar and tried few tutorials from drill.apache.org/docs/tutorials. Worked like a charm. Congratulations. -Neeraja On Fri, May 15, 2015 at 1:33 AM, Ramana Inukonda wrote: > +1(Non-Binding) > >1. Downloaded source, built using mvn clean install -U -DskipTests >

Re: Things are looking pretty good, let's do a 1.0 vote soon

2015-05-13 Thread Neeraja Rentachintala
awesome. Congratulations to the team. On Tue, May 12, 2015 at 5:54 PM, Ted Dunning wrote: > This is huge! (Premature) congratulations to the team. > > Real congrats on account when it gets out the door. > > Pom poms all around. > > > > On Tue, May 12, 2015 at 9:56 PM, Jacques Nadeau > wrote: >

Re: Should we make dir* columns only exist when requested?

2015-04-23 Thread Neeraja Rentachintala
Exposing directories in select * queries enable data discovery rather than assuming knowledge on user front. Making dir as an array could be a good option to avoid the multi column issue. -Neeraja On Thu, Apr 23, 2015 at 3:57 PM, Ted Dunning wrote: > I would propose that dir be an array that co

Re: Should we make dir* columns only exist when requested?

2015-04-23 Thread Neeraja Rentachintala
what do you mean by alter data returned based how you select directory. can you give an example. On Thu, Apr 23, 2015 at 2:34 PM, Jacques Nadeau wrote: > Hey guys, > > I've been thinking that always showing dir# columns seems to alter data > returned from Drill depending on how you select the d

Re: Please join us tomorrow for our Google Hangout weekly meeting - 10am Pacific time

2015-01-19 Thread Neeraja Rentachintala
Yash Thanks. Do you have a document on how to develop storage plugin for Drill and the steps involved. -thanks Neeraja On Mon, Jan 19, 2015 at 7:30 PM, Yash Sharma wrote: > Hi Jason/All > I would be there for the hangout today. > We would be discussing on the Cassandra storage plugin with a dem

Re: [VOTE] Release Apache Drill 0.7.0 (rc1)

2014-12-18 Thread Neeraja Rentachintala
+1 (non-binding) Tried the tar with few simple queries on JSON. -Neeraja On Thu, Dec 18, 2014 at 7:24 PM, Julian Hyde wrote: > > Downloaded source, built on JDK 1.7 and Mac OS, started command line and > ran some queries. Logged a minor bug [ > https://issues.apache.org/jira/browse/DRILL-1898 ],

Re: [VOTE] Release Apache Drill 0.7.0

2014-12-16 Thread Neeraja Rentachintala
+1(non-binding) On Tue, Dec 16, 2014 at 12:15 AM, Mehdi Chitforoosh < mehdichitforo...@gmail.com> wrote: > > +1 > > On Tue, Dec 16, 2014 at 10:14 AM, Yash Sharma wrote: > > > > +1 > > > > - Source and binaries present > > - Source and Binaries contain README, NOTICE, LICENSE Files. > > - Source c

Re: We're now a TLP

2014-12-04 Thread Neeraja Rentachintala
Andrew This is an awesome article and a great validation for the value proposition Drill is trying offer. Thank you. -Neeraja On Wed, Dec 3, 2014 at 8:16 AM, Andrew Brust < andrew.br...@bluebadgeinsights.com> wrote: > Here's the piece: > > http://research.gigaom.com/2014/12/apache-drill-drills-u