Re: Article on how to use Apache Drill with Oracle's BI tool, OBIEE

Hi Robin This is great. thanks for putting it together. Bridget Bevens takes care of the docs and can help publishing this on the site. thanks Neeraja On Mon, Aug 22, 2016 at 4:08 AM, Robin Moffatt < robin.moff...@rittmanmead.com> wrote: > Hi, > I've written an article on how to use Apache

Drill on Azure

Just happened to see this great set of comprehensive blog/tutorials on how to deploy Drill on Azure and use it with a variety of sources on Azure. Wanted to share the link with the other users that might be interested in this topic.

Re: Drill view in shell mode

If you want to see a list of views created, you can use 'show tables' in the workspace. On Thu, Jul 28, 2016 at 5:05 AM, Santosh Kulkarni < santoshskulkarn...@gmail.com> wrote: > How to see a view created in Drill Explorer thru Drill shell? Is there any > any command for Drill views? > > Thanks,

Re: Connecting to Drill ODBC DSN takes exceptionally long time

Andries did a great job on putting together the material below on this topic. This info will be helpful to you to optimize metadata access experience from Tableay. Additionally make sure you are using the Tableau TDC file that ships with Drill ODBC drier.

Re: MapR ODBC driver

Steve The Apache distribution of Drill does not have a open source version of ODBC driver. There is however a JDBC driver that is available that you can use to connect to Drill from BI tools. The ODBC driver you mentioned below is provided by Simba and the license restrictions indicate that it

Re: How to query array in Hbase

You can use Convert_to/Convert_from functions with JSON encoding if it is JSON data. Once you can get hold of the JSON string, you can use repeated_contains to check for the existence of an element. On Sun, Jul 3, 2016 at 9:47 PM, GameboyNO1 <7304...@qq.com> wrote: > Hi, > > > I put an array in

Re: Drill taking way too long to plan query

You might want to enable metadata caching and see if it helps. https://drill.apache.org/docs/optimizing-parquet-metadata-reading/ On Thu, Jun 23, 2016 at 1:36 PM, Tanmay Solanki wrote: > Below is the plan. The amount of files is ~213000 files of parquet data. > >

Re: Is this normal view behavior?

This is a bug. On Thu, Jun 23, 2016 at 1:32 PM, rahul challapalli < challapallira...@gmail.com> wrote: > This looks like a bug. If you renamed the dir0 column as p_day, then you > should see that in sqlline as well. And I have never seen > "_DEFAULT_COL_TO_READ_" > before. Can you file a jira? >

Re: Drill on Phoenix

Alex can yo briefly describe your use case for using Drill with Phoenix. On Thu, Jun 16, 2016 at 10:42 AM, James Taylor wrote: > Yes, we've created a new Phoenix storage plugin for Drill here[1], and > there's a good presentation put together by Jacques on here[2] that

Re: Apache Drill, Query PostgreSQL text or Jsonb as if it were from a json storage type?

There is ability to do retrieve JSON fields using the convert_to function in Drill. Check the following doc. https://drill.apache.org/docs/data-type-conversion/#convert_to-and-convert_from On Wed, May 25, 2016 at 9:26 AM, Andrew Evans wrote: > Drill Members, >

Re: Drill Views and Typed Columns

Both are options (and thats how the bI tools work with Drill today) - Views with explicit Casts - Will return schema definitions as part show schemas/describe table/show columns queries. - Limit 0 queries - This will be good as well if we can modify Caravel to issue such queries (this is what

Re: Drill & Caravel

John Great. Can we briefly look at this during hang out tomorrow. On Mon, May 16, 2016 at 12:26 PM, John Omernik wrote: > AWESOME! Yep, that works and I like it better than using sys.options. Now > to dive in and play with the Dialect. > > Note, I will be uploading an

Drill & Caravel

el? What subset of features from a RDBMS ORM is meaningfull, > >>>> feasable > >>>> > and usefull to map to Drill. This sounds like a broad general > >>>> question. I > >>>> > am sure there are orms from other language camps t

Re: Drill & Caravel

; > > I Hi Neeraja, > > > > > > I am interested in contributing if integration is not available. > > > Kindly let me know > > > > > > Regards, > > > Nirav > > > > > > On Thu, May 12, 2016 at 9:19 PM, Neeraja Rentachintal

Drill & Caravel

Hi Folks Caravel is nice visualization tool recently open sourced by airbnb. Did anyone try to integrate Drill and/or interested in contributing to making this work with Drill. https://github.com/airbnb/caravel -Thanks Neeraja

Re: Question on nested JSON behavior

Actually I agree with Jiang. The result does seem unintuitive. If it is a file with just a list, it does still make sense to return the ids in that list as an array unless the user has configured Drill to automatically flatten the first level. Does anyone know how does the other systems behave for

Re: Apache Drill - Read Java Objects

Jorge can you give an example of what you are looking to accomplish here. Based on your description, it seems to me that you might be able to use the functions listed here. https://drill.apache.org/docs/supported-data-types/#data-types-for-convert_to-and-convert_from-functions On Wed, Feb 24,

Re: [DISCUSS] New Feature: Drill Client Impersonation

written the change user as a session option as part of the > >> enhancement only, where you’ve pointed out a better way. I addressed > >> your comments on the doc. > >> > >> Thank you, > >> Sudheesh > >> > >>> On Feb 22, 2016, at 9:4

Re: [DISCUSS] New Feature: Drill Client Impersonation

something? > > > > > > > > > > > > > > -- > > Jacques Nadeau > > CTO and Co-Founder, Dremio > > > > On Mon, Feb 22, 2016 at 9:06 AM, Neeraja Rentachintala < > > nrentachint...@maprtech.com> wrote: > > > &g

Re: REFRESH TABLE METADATA - Access Denied

John What is the JIRA# where you are adding more info. -thanks On Mon, Feb 15, 2016 at 11:10 AM, John Omernik wrote: > Arg, this problem is crazy. (I'll put this in the JIRA too) So after > waiting a while, and loading more data. I tried to refresh table metadata > on the

Re: Query Planning and Directory Pruning

Yes, Drill-3759 covers it. This is a high priority enhancement that we are trying to get to in the next couple of releases. -Neeraja On Tue, Feb 9, 2016 at 7:32 AM, John Omernik wrote: > This one seems to cover it: > > https://issues.apache.org/jira/browse/DRILL-3759 > > > >

Re: Analyse web server logs in Drill

can you share a sample of the file. If it is JSON, you can query it directly. On Sat, Feb 6, 2016 at 4:25 PM, David Asfaha wrote: > Hi, > > I would like to analyse web server logs using Drill. Is there anyway to > analyse them directly as if they were json files? > >

Re: Bug or Feature?

John What happens if you do the select query with no filter. The scenario you explained does seem like an unexpected behavior. -Neeraja On Thu, Feb 4, 2016 at 8:21 AM, John Omernik wrote: > Prior to posting a JIRA, I thought I'd toss this here: > > If I have a directory:

Re: directory create CTAS behaviour

What would you like to see instead of directory. On Thursday, January 14, 2016, Leon Clayton wrote: > Hello All > > Is it possible to change this behaviour. By default, a directory is > created, using the exact table name specified in the CTAS statement. I > don’t want a

Re: query plan caching?

Query plan caching is typically very useful if you have reporting type of queries where the query patterns are fixed and vary mostly on filter conditions. For adhoc queries or data exploration use cases where there may not be fixed query patterns, this technique is not frequently useful. Similar

Re: Your Webinar is Starting - It's Time to Log In!

yes, we will share the slides and the recording. -thanks On Fri, Nov 13, 2015 at 9:31 AM, Sun, Zhan wrote: > Hi, > > > > Thank you for providing this great seminar on Drill today. Could you > please help share the slides? > > > > Thanks, > > Jonathan > >

Re: REFRESH TABLE METADATA - Access Denied

> by mapr:mapr. Here's my drill-override.conf: > >>>> > >>>> drill.exec: { > >>>> cluster-id: "vgonzalez_drill-drillbits", > >>>> zk.connect: > >>>> > >>>> > "ip-172-16-2-36.ec2.

Re: REFRESH TABLE METADATA - Access Denied

This doesn't make sense and seems like a bug. I think the right behavior is for the Drillbit to access the cache as Drillbit user at the query time (there is no user level metadata cache in Drill at this point). On Fri, Nov 6, 2015 at 6:57 AM, John Omernik wrote: > I ran

Re: Drill ETL: Views are Less than impressive

John , you mentioned the following. If you are trying to incrementally load one day worth of data to existing Parquet table, wouldn't that be a new partition/directory for every day rather than overwriting an existing partition. INSERT OVERWRITE TABLE mytable (partition=2015-01-01) select field1,

Re: Security with Storage Plugins

Hi John Can you please elaborate on what you mean by authentication to the source system is going to be wide open in Drill. Drill is a query layer on data sources and will respect the underlying storage permissions without having to manage centralized security permissions at Drill layer through

Re: CTAS over empty file throws NPE

Hsuan Is there is a JIRA for this? On Thu, Oct 22, 2015 at 10:11 AM, Hsuan Yi Chu wrote: > Hi, > This is known issue. It is because there is no schema with empty.tsv file. > > I think Daniel might be trying to address this issue. > > Thanks for bringing this up. > > On Wed,

Re: MapR Drill 1.2 Package

er 10,000 tests developed over the course of > several months, this framework is available for developers in the community > to continue to maintain the enterprise quality of the Apache Drill project > and accelerate community-driven innovation. > > “Releasing the test frameworks demon

Re: [VOTE] Release Apache Drill 1.2.0 RC2

+1 (non-binding) Tested embedded mode using yelp JSON tutorials from https://drill.apache.org/docs/tutorials-introduction/ thanks Neeraja On Thu, Oct 8, 2015 at 2:08 PM, Abdel Hakim Deneche wrote: > Hi all, > > I'm enjoying the release management so much that I decided

Re: JDBC driver for MySQL - storage plugin config and push down ?

Andrew thanks for the update. Also is it possible for you to share a brief set of instructions on how to configure/use this plugin with a database , lets say mysql (or postgres or ..). There have been few question on the threads around this and could benefit from a quick summary. -Neeraja On

Drill custom aggregate functions

https://drill.apache.org/docs/developing-an-aggregate-function/ See the customer aggregate functions are marked as alpha and experimental usage only. What features or aspects are missing to make this a 'ready to deploy in production' capability. Appreciate response. thanks -Neeraja

Drill WITH clause syntax

Team Is this a valid Drill syntax (i.e 2 tables in with clause). WITH X1 AS (SELECT city, AVG(review_count) AS city_reviews_avg FROM `business.json` GROUP BY city), X2 AS (SELECT X1.city, X1.city_reviews_avg, MAX(X1.city_reviews_avg) OVER () AS city_reviews_avg_max FROM X1) SELECT X2.city,

Re: Parquet Partitions

John Both would work i.e query partitioned directories directly using file system storage plug in or via Hive table. On Wed, Aug 5, 2015 at 8:58 AM, John Omernik j...@omernik.com wrote: After reading about Parquet Partition Pruning in Drill 1.1, I was wondering if there is still partitioning

Re: Drill 1.1 on Hive 1.2? (No results on hive tables!)

Yes, Drill 1.1 supports hive 1.0. On Wednesday, July 29, 2015, Adrià Vilà av...@datknosys.com wrote: Hi everyone, Have installed and configured correctly hive storage plugin and it 's possible to list hive databases and view hive tables schema (describe table returns the right result), but

Re: Querying Apache Spark Generated Parquet

Hi Do you still see this issue. Can you share a sample parquet file where you see problem. On Thursday, July 16, 2015, Jacques Nadeau jacq...@dremio.com wrote: Can you create a JIRA and post a small sample file that illustrates the problem? On Thu, Jul 16, 2015 at 2:12 AM, Usman Ali

Re: Querying multiple TSV or CSV files at once?

What is the error that you are seeing? Can you simply point it to the directory (without *.csv) to see if it helps. On Sun, Feb 8, 2015 at 10:33 AM, Minnow Noir minnown...@gmail.com wrote: I'm trying to do ad-hoc exploration/analysis over multiple files without having to concatenate them.

Re: Looking For Drill REST API Doc.

Refer to below https://issues.apache.org/jira/browse/DRILL-77 The google doc in this JIRA has info on the REST APIs. -Neeraja On Wed, Dec 10, 2014 at 9:42 PM, mufy mufeed.us...@gmail.com wrote: Is there a formal Drill REST APIs reference document that can be shared with customers? ---