Re: Convert Hbase Values from Bytes to Actual Strings

2015-07-31 Thread Jacques Nadeau
Got it. Was just concerned that the person might be confused by your example using CAST when we were talking about CONVERT. I think we need to come up with a simpler/clearer way to express the differences since people keep tripping up on this. -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri

Re: Convert Hbase Values from Bytes to Actual Strings

2015-07-31 Thread Carol McDonald
the point I was trying to make is : The good news is, Drill does provide a nice simple way to abstract these details away. You simply create a view on top of HBase [1]. The view can contain the physical conversions. Then users can interact with the view rather than the underlying table. On Fri,

Re: Drill OOM

2015-07-31 Thread Bob Rumsby
Note that not all operations can run in memory: http://drill.apache.org/docs/sort-based-and-hash-based-memory-constrained-operators/ On Fri, Jul 31, 2015 at 4:43 PM, George Lu wrote: > Hi all, > > When I run query Drill in JDBC, I met "Query failed: RESOURCE ERROR: One or > more nodes ran out of

Drill OOM

2015-07-31 Thread George Lu
Hi all, When I run query Drill in JDBC, I met "Query failed: RESOURCE ERROR: One or more nodes ran out of memory while executing the query." Any idea why this will happen, as I saw from documentation Drill will use disk if memory is used up. Thanks, George Lu

Re: querying a specific time period

2015-07-31 Thread James Sun
Cool, Thanks Andries. I have tried both methods and they worked great. -James > On Jul 31, 2015, at 10:46, Andries Engelbrecht > wrote: > > Very true :-) > > a key point to note is that between will be inclusive of the comparison > values, where < and > will exclude the comparison values. >

Re: querying a specific time period

2015-07-31 Thread Andries Engelbrecht
Very true :-) a key point to note is that between will be inclusive of the comparison values, where < and > will exclude the comparison values. —Andries > On Jul 31, 2015, at 10:42 AM, Jacques Nadeau wrote: > > Oh yeah, between... That is much nicer than mine. > > A tool isn't useful unti

Re: querying a specific time period

2015-07-31 Thread Jacques Nadeau
Oh yeah, between... That is much nicer than mine. A tool isn't useful until you can do something at least three ways :) -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Jul 31, 2015 at 10:40 AM, Andries Engelbrecht < aengelbre...@maprtech.com> wrote: > James, > > you can also use > where

Re: querying a specific time period

2015-07-31 Thread Andries Engelbrecht
James, you can also use where cast(`time` as time) between time '18:00:00' and time '23:00:00’ As a side note, it is not good to have a column named time or most of the common reserved keywords in SQL. —Andries > On Jul 31, 2015, at 9:49 AM, James Sun wrote: > > Thanks Jacques ! > > -Jam

Re: querying a specific time period

2015-07-31 Thread James Sun
Thanks Jacques ! -James > On Jul 31, 2015, at 09:48, Jason Altekruse wrote: > > You also could use the date-part function. > > http://drill.apache.org/docs/date-time-functions-and-arithmetic/#date_part-syntax > > On Fri, Jul 31, 2015 at 9:47 AM, Jacques Nadeau wrote: > >> I would think you

Re: querying a specific time period

2015-07-31 Thread Jason Altekruse
You also could use the date-part function. http://drill.apache.org/docs/date-time-functions-and-arithmetic/#date_part-syntax On Fri, Jul 31, 2015 at 9:47 AM, Jacques Nadeau wrote: > I would think you could cast to time and then provide a time boundary. > > I don't remember the exact syntax but

Re: querying a specific time period

2015-07-31 Thread Jacques Nadeau
I would think you could cast to time and then provide a time boundary. I don't remember the exact syntax but something like WHERE CAST(`time` as TIME) > TIME '18:00:00' and CAST(`time` as TIME) < TIME '23:00:00' -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Jul 31, 2015 at 9:29 AM, James

querying a specific time period

2015-07-31 Thread James Sun
Hi, I have a week worth of data in a view and there is already a date column: select `time` from dfs.views.`mytbl` limit 5; ++ | time | ++ | 2011-04-24 22:21:19.0 | | 2011-04-24 22:21:24.0 | | 2011-04-24 22:21:28.0 | | 2011-04-

Re: Convert Hbase Values from Bytes to Actual Strings

2015-07-31 Thread Jacques Nadeau
Carol, your statements are misleading. There are some situations where people have stored in HBase encoded as text. In other cases, they've used a straight binary encoding. CAST is used generally used when the data is already encoded as a UTF8 string. Otherwise, the user should use CONVERT_FROM

Re: coversion to parquet from TSV files (CTAS) fails

2015-07-31 Thread Abhishek Girish
Hello Uwe, By default Drill temporary files & other data such as query profiles and configuration files are written to the local file system. To configure this refer to http://drill.apache.org/docs/persistent-configuration-storage/ (for configuration storage) and https://drill.apache.org/docs/star

Re: Please add my mail to your update list for drill

2015-07-31 Thread Abhishek Girish
Hello David, If you are able to send a mail to the mailing list, I'm sure you are already subscribed. For reference, you could take a look at http://drill.apache.org/mailinglists/ for details on how to subscribe. Coming to querying relational data sources via JDBC, there is some work going in tha

Re: Convert Hbase Values from Bytes to Actual Strings

2015-07-31 Thread Carol McDonald
This blog shows an example using REST , drill , and HBase. In this example a view converts the HBase byte values to strings https://www.mapr.com/blog/how-use-sql-hadoop-drill-rest-json-nosql-and-hbase-simple-rest-client 0: jdbc:drill:> use dfs.mydata; create or replace view prodview as SELECT

Re: Integration of Apache_drill with mysql

2015-07-31 Thread Tugdual Grall
Hi, It should still work with Drill 1.1, as the storage engine APU has not changed. Also this storage plugin is today more a proof a concept and some things must be done to reach production quality (contributions are welcome). You can find some JIRA here: https://issues.apache.org/jira/browse/

Re: Integration of Apache_drill with mysql

2015-07-31 Thread Kristine Hahn
Fabian--the README says to use Drill 0.9. Is that just not updated? Thanks! Kristine Hahn Sr. Technical Writer 415-497-8107 @krishahn skype:krishahn On Fri, Jul 31, 2015 at 2:54 AM, Fabian Wilckens wrote: > Hi Pankaj, > > have a look: https://github.com/mapr-emea/apache-drill-jdbc-plugin > > >

Please add my mail to your update list for drill

2015-07-31 Thread dlei48
Hello, I'm trying too connect drill to traditional database like Oracle, Teradata, Sybase, SQL Server etc., but not success yet. Where can I found the relative info for thisissue? Please let me know. Regards, David Lei

RE: coversion to parquet from TSV files (CTAS) fails

2015-07-31 Thread Geercken, Uwe
Abdelhakim, Looking a bit further, I saw that my /tmp folder on the drillbit ran out of diskspace - it was not the NFS share which I though initially. Can you point me to the configuration where the location for temporary files is defined? I would like to change it but don't know where. Meanwhi

Re: Integration of Apache_drill with mysql

2015-07-31 Thread Stefán Baxter
Hi Fabian and thank you for sharing, Do you know if this would work, without much effort, with Drill 1.1 ? Regards, -Stefán On Fri, Jul 31, 2015 at 9:54 AM, Fabian Wilckens wrote: > Hi Pankaj, > > have a look: https://github.com/mapr-emea/apache-drill-jdbc-plugin > > > On Fri, Jul 31, 2015 at

Re: Integration of Apache_drill with mysql

2015-07-31 Thread Fabian Wilckens
Hi Pankaj, have a look: https://github.com/mapr-emea/apache-drill-jdbc-plugin On Fri, Jul 31, 2015 at 9:25 AM, rahul challapalli < challapallira...@gmail.com> wrote: > Hi Pankaj, > > I am glad you had a good first experience with Drill. > > As of now drill does not have a JDBC storage plugin. T

Re: Integration of Apache_drill with mysql

2015-07-31 Thread rahul challapalli
Hi Pankaj, I am glad you had a good first experience with Drill. As of now drill does not have a JDBC storage plugin. This is required to query data in mysql, postgres or any RDBMS. There has been some work done on this but it is not complete yet. - Rahul On Thu, Jul 30, 2015 at 5:51 AM, Pankaj

Integration of Apache_drill with mysql

2015-07-31 Thread Pankaj Pandey
Hello Team, First of all i would like to say thanks for introducing apache drill into picture. :) Its really very good.I have already tested apache drill with mongodb and hbase. Now,i want to test the apache drill functionality with mysql database but i am not getting any documents for the same. So