Re: Querying local filesystem directory: How do I access the filename?

DRILL-3425 doesn't seem to be about adding filename information to the directory name information that Drill already provides. Also, other users have requested the addition of the file's simple name to the pathname segments currently available through dir0, dir1, etc. See DRILL-3474 (Filename

Re: directory pruning and UDFs

Hi, It's here: https://issues.apache.org/jira/browse/DRILL-3838 hopefully this can be accommodated soon :). Regards, -Stefan On Wed, Sep 23, 2015 at 5:21 PM, Jacques Nadeau wrote: > Hey Stefan, > > Yes, this makes a lot of sense and seems reasonable. We've talked about > providing the simp

Re: Setting drill.exec.sort.external.spill.directories

How about a symbolic link from the local file system on each node to the node specific tmp dir? A little hacky but workable. You could do that once and then copy the drill config without concern. fyi, many eons ago a file system known as AFS had special vars that would expand in pathnames to ha

Re: Setting drill.exec.sort.external.spill.directories

One question for those in the know: Is there a way to use shell (or other) variables in these options? I'd much prefer $HOSTNAME , as opposed to having to set the variable differently on each node in my cluster. On Thu, Sep 24, 2015 at 5:22 PM, Andy Pernsteiner wrote: > So, I *think* i got t

Re: Setting drill.exec.sort.external.spill.directories

So, I *think* i got things working, I had some inconsistencies on what I would see depending on which user I had launched sqlline as, but I can’t reproduce reliably. In any case, here’s what I put in the config: drill.exec: {   cluster-id: "se1-drillbits",   zk.connect: "10.10.15.10:5181,10.10.

Re: Setting drill.exec.sort.external.spill.directories

Maybe try sort.external.spill.directories: [ "/var/mapr/local/$hostname/drillspill" ], —Andries > On Sep 24, 2015, at 12:38 PM, Andy Pernsteiner > wrote: > > I’m trying to do some experimentation and set the > drill.exec.sort.external.spill.directories value. Since this option appears > as

Setting drill.exec.sort.external.spill.directories

I’m trying to do some experimentation and set the  drill.exec.sort.external.spill.directories value.  Since this option appears as a ‘boot’ option ( https://drill.apache.org/docs/start-up-options/ ) , I believe the right way is to set this in drill-override.conf on each node. I tried doing this

Re: Querying local filesystem directory: How do I access the filename?

Seems like this was brought up in DRILL-3425 and identified as not something that was in the design spec. Chris Matta cma...@mapr.com 215-701-3146 On Thu, Sep 24, 2015 at 2:57 PM, Tim Harper wrote: > So, if the files are in subdirectories, I DO

Re: Querying local filesystem directory: How do I access the filename?

So, if the files are in subdirectories, I DO get dir0, but if I query a single directory with a handful of files, there is no way (it seems) to see any file name information. On Thu, Sep 24, 2015 at 12:32 PM, Tim Harper wrote: > With apache drill, I'm able to query a directory of JSON files just

Querying local filesystem directory: How do I access the filename?

With apache drill, I'm able to query a directory of JSON files just fine, by invoking: select * from file.`/path/to/data` t; All of JSON files are selected, and the data comes as I'd expect. However, no fields are returned describing from which file the data came. I'd like to be able to use this

Re: help with ApacheDrill and S3

Amit and Andries, Thank you for your help. Andries: Putting the key on the public list was not an accident - but thank you for your concern. This is a toy account. Will change the key very very soon. Wanted as many eyes as possible to validate my config info (didn’t know if the problem was

Re: Spotfire server doesn't play nice with Drill 1.1

Mike, The last URL you connect directly to the drillbit not ZK. The single biggest issue I have found with JDBC connectivity through ZK is that the host of the client system didn’t resolve the hostname of the ZK system correctly. Check on the Windows Server if you can ping pangolin, easiest wa

RE: Spotfire server doesn't play nice with Drill 1.1

Andries, Squirrel runs on my laptop: Latitude E6440, Windows 7 Professional SP 1 (64 bit). TSS runs on Windows Server 2008 R2 dedicated to SQL 2008 R2. I found this morning that the connection URL " jdbc:drill:drillbit=pangolin:31010" satisfies TSS. So I don't know why TSS doesn't like the "z

Re: NullPointers in type conversions

Jason, using trim() did the trick: 0: jdbc:drill:> select cast(x.`row_key` as varchar(128)) as `row_key`, CAST(trim(x.`a`.`c1`) as INTEGER) from maprfs.cmatta.`cmatta_test` . . . . . . . > x ; +--+-+ | row_key | EXPR$1 | +--+-+ | row1 | 1 | | row2 |