Re: Query dates in parquet file created by Spark job?

2016-10-01 Thread Minnow Noir
lly, once DRILL-4203 > is fixed, the issue you saw will be fixed as well. > > > [1] https://issues.apache.org/jira/browse/DRILL-4203 > > > On Fri, Sep 30, 2016 at 6:26 PM, Minnow Noir wrote: > > I'm trying to process data using Spark and then query it using Drill. >

Query dates in parquet file created by Spark job?

2016-09-30 Thread Minnow Noir
I'm trying to process data using Spark and then query it using Drill. When I create a parquet file using a Spark 1.6.1 job, and then try to query it in Drill 1.8.0, I notice that the dates are in an unknown format. All string and other types seem fine. I'm using the java.sql.Date class because I g

Re: Return data rows *with* summary rows in Drill?

2015-10-29 Thread Minnow Noir
the right way is to use partition by and > not order by in the windows functions. > > —Andries > > > > > On Oct 29, 2015, at 8:27 AM, Minnow Noir wrote: > > > > Thanks Andries. > > > > For this task, we need summary rows, akin to this: > > >

Re: Return data rows *with* summary rows in Drill?

2015-10-29 Thread Minnow Noir
ill:> select sum(order_total) from orders where state = 'ak'; > +-+ > | EXPR$0 | > +-+ > | 16703 | > ++ > > 0: jdbc:drill:> select Count(*) from orders where state = 'ak'; > +-+ > | EXPR$0 | > +-+ > |

Return data rows *with* summary rows in Drill?

2015-10-28 Thread Minnow Noir
I'm trying to query a table in Drill and return a result set that combines grouping with the granular rows such that the rows for each group has a summary row. Is there anything in Drill that supports returning a summary row for each group of returned rows? For example, imagine a sales table with

Re: Drill 0.9 slowness/hanging

2015-05-11 Thread Minnow Noir
the > location path, but you can rather just directly point to the maprfs > directory. > > See the sample I posted vs the storage plug in you had configured. > > The default DFS plugin should also show you the correct config info. > > —Andries > > On May 11, 2015,

Re: Drill 0.9 slowness/hanging

2015-05-11 Thread Minnow Noir
; > > "type": "file", > > > "enabled": true, > > > "connection": “maprfs:///", > > > "workspaces": { > > >"schema1": { > > > "location": "/user/theUser/test",

Re: Drill 0.9 slowness/hanging

2015-05-11 Thread Minnow Noir
workspaces": { > > >"schema1": { > > > "location": "/user/theUser/test", > > > "writable": true, > > > "defaultInputFormat": null > > >} > > > }, > >

Re: Drill 0.9 slowness/hanging

2015-05-11 Thread Minnow Noir
tion": "/user/theUser/test", > > "writable": true, > > "defaultInputFormat": null > >} > > }, > > > —Andries > > > On May 11, 2015, at 5:07 PM, Minnow Noir wrote: > > > Hanifi: The web UI is e

Re: Drill 0.9 slowness/hanging

2015-05-11 Thread Minnow Noir
plugin. Abdel: There are no errors in the logs. On Mon, May 11, 2015 at 7:22 PM, Hanifi Gunes wrote: > I would be interested in knowing where the time has been spent. Can you > inspect query profile from web ui for `show databases` and let us know how > the profile looks like? > > On

Re: Drill 0.9 slowness/hanging

2015-05-11 Thread Minnow Noir
en the particular 0.9 bit is idle? > > -Hanifi > > On Mon, May 11, 2015 at 3:53 PM, Minnow Noir wrote: > > > Experiencing some slowness after upgrading one of our servers from 0.8 to > > 0.9. In particular, despite restarting the Drillbit, and even the > server, > > s

Drill 0.9 slowness/hanging

2015-05-11 Thread Minnow Noir
Experiencing some slowness after upgrading one of our servers from 0.8 to 0.9. In particular, despite restarting the Drillbit, and even the server, several times, the Drill web UI and sqlline are both so slow as to be unusable. For example, doing a show databases hangs indefinitely, until I CTRL-

Reset/delete storage plugins (file)?

2015-05-05 Thread Minnow Noir
After upgrading to 0.9 today and then later editing my storage plugins, I have been unable to start drill. I was able to use drill 0.9 for several hours, but then used the web app to edit the storage plugins to point to a new directory. The update button did nothing when I clicked it, despite try

Re: Dates from CSV files in WHERE clauses?

2015-02-15 Thread Minnow Noir
; ++ > | EXPR$0 | > ++ > | 2014-01-01 | > | 2010-01-02 | > | 2010-01-03 | > | 2010-01-04 | > ++ > 4 rows selected (0.145 seconds) > > > > On Thu, Feb 12, 2015 at 3:13 PM, Steven Phillips > wrote: > > >

Re: Right() function in 0.7

2015-02-15 Thread Minnow Noir
ds) > > > select *`left`*('blahblah',2) from sys.options limit 1; > ++ > | EXPR$0 | > ++ > | bl | > +----+ > 1 row selected (0.039 seconds) > > Regards, > Abhishek > > On Fri, Feb 13, 2015 at 6:59 PM, Minnow Noir wrote:

Right() function in 0.7

2015-02-13 Thread Minnow Noir
right() is documented on the wiki ( https://cwiki.apache.org/confluence/display/DRILL/SQL+Functions, last edited 6 weeks ago), but doesn't seem to be a valid function: use sys; 0: jdbc:drill:zk=local> select right("blahblah",2) from version; Query failed: Query failed: Failure parsing SQL. Encount

Re: Dates from CSV files in WHERE clauses?

2015-02-12 Thread Minnow Noir
Yes. On Feb 12, 2015 5:36 PM, "Steven Phillips" wrote: > did you try the form: > where columns[2] > date '2010-01-01' > > On Thu, Feb 12, 2015 at 2:28 PM, Aditya wrote: > > > In a CSV file, every field is a VARCHAR. > > > > On Thu, Feb 12,

Dates from CSV files in WHERE clauses?

2015-02-12 Thread Minnow Noir
I'm trying to write a WHERE clause that returns rows from a CSV file where the value of the date column is greater or less than a comparison value (e.g., where columns[2] > '2010-01-01'). It looks like Drill cannot automatically infer date values in CSV files, and that one must manually/explicitly

Re: Querying multiple TSV or CSV files at once?

2015-02-12 Thread Minnow Noir
0] = 'Zoological > Journal of the Linnean') OR (COLUMNS[0] = 'zero temperatures')) > AND (COLUMNS[1] = '1998')); > > The output lists ngrams from both files. > > ++ | columns | ++ | ["Zoological > Jou

Re: Error using sum on numeric data -- Only COUNT aggregate function supported for Boolean type

2015-02-09 Thread Minnow Noir
ly be able to perform the sum without the cast. > > --Andries > > > > > On Feb 8, 2015, at 7:44 PM, Minnow Noir wrote: > > > > That works with the file that has no row header, Sudhakar. > > > >> On Sun, Feb 8, 2015 at 10:34 PM, Sudhakar Thota > wrote: > &

Re: Error using sum on numeric data -- Only COUNT aggregate function supported for Boolean type

2015-02-08 Thread Minnow Noir
That works with the file that has no row header, Sudhakar. On Sun, Feb 8, 2015 at 10:34 PM, Sudhakar Thota wrote: > May be you have to cast it to integer. > > Sudhakar Thota > Sent from my iPhone > > > On Feb 8, 2015, at 6:54 PM, Minnow Noir wrote: > > > >

Re: Error using sum on numeric data -- Only COUNT aggregate function supported for Boolean type

2015-02-08 Thread Minnow Noir
e...@maprtech.com> wrote: > You need to filter out the header line on the CSV file as you are trying > to sum a string in column1. > > > —Andries > > > On Feb 8, 2015, at 6:12 PM, Minnow Noir wrote: > > > I'm trying to perform a basic query in order to lear

Error using sum on numeric data -- Only COUNT aggregate function supported for Boolean type

2015-02-08 Thread Minnow Noir
I'm trying to perform a basic query in order to learn Drill, but getting an the error message in the subject line. I created a dead simple CSV file on disk. Note that Sales values are not quoted. cat test.csv Employee,Sales Ed,100 Pete,200 Ed,100 Pete,400 When I query it without performing a s

Re: Getting query result data out -- non-interactive querying?

2015-02-08 Thread Minnow Noir
27 PM, Aditya wrote: > > > Please see > > > https://cwiki.apache.org/confluence/display/DRILL/CREATE+TABLE+AS+%28CTAS%29+Command > > > > On Sun, Feb 8, 2015 at 10:47 AM, Minnow Noir > wrote: > > > >> I'm trying to extract query results as CSV for inge

Re: Querying multiple TSV or CSV files at once?

2015-02-08 Thread Minnow Noir
FROM myfilesWHERE (((COLUMNS[0] = 'Zoological > Journal of the Linnean') OR (COLUMNS[0] = 'zero temperatures')) > AND (COLUMNS[1] = '1998')); > > The output lists ngrams from both files. > > ++ | columns | ++ | ["

Re: Connect to drillbit in VM from desktop Squirrel?

2015-02-08 Thread Minnow Noir
ing SquirreL with JDBC. JDBC connects via ZooKeeper. > It may be best to consider using the Drill SandBox if you would like to > use SQuirreL, > > What is on the VM where you run Drill? If it is running Amabri do you have > ZK running on it? > > > > —Andries > > > >

Re: Querying multiple TSV or CSV files at once?

2015-02-08 Thread Minnow Noir
re's how: > "Query Multiple Files in a Directory" at the end of the attached PDF. > Please overlook the code formatting and some links that didn't copy/paste > well. > > On Sun, Feb 8, 2015 at 12:35 PM, Minnow Noir wrote: > >> "Failure while runnin

Re: Querying multiple TSV or CSV files at once?

2015-02-08 Thread Minnow Noir
8, 2015 at 3:21 PM, Neeraja Rentachintala < nrentachint...@maprtech.com> wrote: > What is the error that you are seeing? > Can you simply point it to the directory (without *.csv) to see if it > helps. > > > On Sun, Feb 8, 2015 at 10:33 AM, Minnow Noir wrote: > > >

Connect to drillbit in VM from desktop Squirrel?

2015-02-08 Thread Minnow Noir
I am trying to access a drill bit running in a VM from Squirrel on my desktop. I'm unsure of the Squirrel alias syntax, and having an issue troubleshooting because I can't access the web interface on 8047 in the VM. I'm trying this on a VM before worrying about deploying it into a real cluster.

Getting query result data out -- non-interactive querying?

2015-02-08 Thread Minnow Noir
I'm trying to extract query results as CSV for ingestion into another tool. There's no obvious way in sqlline, the web UI, or the docs to extract query results as CSV (or other formats). sqlline ./test.sql > output.csv doesn't work. Is there a way to pass sqlline a query file and then dump the ou

Querying multiple TSV or CSV files at once?

2015-02-08 Thread Minnow Noir
I'm trying to do ad-hoc exploration/analysis over multiple files without having to concatenate them. New files show up on a regular basis, and creating large, redundant concatenated files seems inelegant for data exploration. I've tried the obvious (... from dfs.`/dir/*.csv` but that only returns

Re: Drill 0.7 | Every query hangs

2015-01-25 Thread Minnow Noir
; > Drill from sources, latest nightly builds can be downloaded from Apache > > build server <https://builds.apache.org/job/drill-scm/>. > > > > This way if you still hit this problem, we can quickly provide debug > > patches to investigate. > > > > aditya.

Re: Drill 0.7 | Every query hangs

2015-01-24 Thread Minnow Noir
> > > > > > > On Fri, Jan 23, 2015 at 5:12 PM, Minnow Noir wrote: > > > I'm trying to follow the "Drill in 10 Minutes" tutorial because Drill > keeps > > hanging. > > > > I have Java 7 installed on my Fedora 20 works

Re: user Digest 24 Jan 2015 03:46:51 -0000 Issue 291

2015-01-24 Thread Minnow Noir
> > > > > > > On Fri, Jan 23, 2015 at 5:12 PM, Minnow Noir wrote: > > > I'm trying to follow the "Drill in 10 Minutes" tutorial because Drill > keeps > > hanging. > > > > I have Java 7 installed on my Fedora 20 works

Drill 0.7 | Every query hangs

2015-01-23 Thread Minnow Noir
I'm trying to follow the "Drill in 10 Minutes" tutorial because Drill keeps hanging. I have Java 7 installed on my Fedora 20 workstation. I downloaded 0.7 and dropped it at /opt/apache-drill-0.7.0/ . When I run Drill per the tutorial, it starts fine: bin/sqlline -u jdbc:drill:zk=local Jan 23, 2