Re: JSON Service Support for Drill

2015-10-26 Thread Tomer Shiran
This is something we've talked about adding. A few questions that will help us plan: How do you call this API? Is it a GET request which includes the necessary authentication tokens? Is the response a single map as shown below with all the records in the "data" array, regardless of the number of

Re: Security with Storage Plugins

2015-10-26 Thread Tomer Shiran
If the devs didn't lock down the Mongo cluster, then I'm not sure that limiting the number of storage plugins in the Drill cluster can help. At the end of the day, the rouge user could access the Mongo cluster irrespective of Drill, using the Mongo API, or they could even set up their own Drill

Re: Security with Storage Plugins

2015-10-26 Thread Tomer Shiran
Got it Yes, you can certainly have multiple Mongo datastores set up in Drill. Or multiple JDBC datastores, ... On Mon, Oct 26, 2015 at 1:12 PM, John Omernik wrote: > I was just saying that if we are only allowed "one" mongo storage plugin, > (or one of any given type, hbase,

Security with Storage Plugins

2015-10-26 Thread John Omernik
Hey all - On file system based storage plugins, security is straight forward with filesystem permissions etc. How do we secure storage plugins? It would seem we would want a situation where people could not access certain storage plugins especially since authentication to the source system is

Is there an elastic search plugin?

2015-10-26 Thread steven.pomerville
Hello everyone, Is there an elastic search plugin for drill? I found a jira that mentions a pull request for one but the link is broken and I canĀ¹t find anything else about it. https://issues.apache.org/jira/browse/DRILL-3637 Thanks, -Steve

Re: configuring the jdbc storage plugin

2015-10-26 Thread Kristine Hahn
Thanks John, A note about checking that the rdbms server is running is in the docs: http://drill.apache.org/docs/jdbc-storage-plugin/ I suspect that you have to set up a password and not use the default (no password) in the case of MySQL. I'll clarify that in the docs. Turns out my problem was

Re: configuring the jdbc storage plugin

2015-10-26 Thread John Omernik
Kristine - After beating my head against the wall on this issue, the result you are getting appears to be related when your mysql server isn't actually accessible. (Mine wasn't) Once I fixed that issue, then it worked. *Note we could REALLY use some better error messages on the storage plugin

RE: configuring the jdbc storage plugin

2015-10-26 Thread Geercken, Uwe
John, Related to your issue - the server was not accessible - I added Jira https://issues.apache.org/jira/browse/DRILL-3958 last week. It goes in the same direction, when the server is there but the JDBC driver is not. Regards, Uwe -Original Message- From: John Omernik

Drill JDBC: TEXT Issue (DRILL-3956) Any Clever Workarounds?

2015-10-26 Thread John Omernik
JDBC Plugin issue with Text is listed here https://issues.apache.org/jira/browse/DRILL-3956 Anyone know of a work around (for some testing) (A cast or something) I tried removing the TEXT columns from the select and that failed too (it's likely the error/NPE comes in the meta data regardless if

Re: Security with Storage Plugins

2015-10-26 Thread John Omernik
So if I create a JDBC Storage Plugin with JSON below. I now have a storage plugin available to all users in drill. There is no limiting who can use that (that I can tell). So then in this case, I have a user (myuser) who is authenticating to the Mysql server. That means, ALL users of drill will

Re: Drill JDBC: TEXT Issue (DRILL-3956) Any Clever Workarounds?

2015-10-26 Thread John Omernik
Fun fact follow-up: This issue also applies to the "BLOB" data type in MySQL, but I think the calcite fix in the linked JIRA does a "if not known then ANY" fix so it should fix this too. On Mon, Oct 26, 2015 at 12:45 PM, John Omernik wrote: > > JDBC Plugin issue with Text is

Re: Security with Storage Plugins

2015-10-26 Thread Keys Botzum
Identity assertion from drill via jdbc to the underlying database is needed. It's been years since I looked at this but most databases have a way of doing this. The technique was unique to each database in the past. Keys ___ Keys Botzum Senior Principal Technologist

Re: Security with Storage Plugins

2015-10-26 Thread Neeraja Rentachintala
Hi John Can you please elaborate on what you mean by authentication to the source system is going to be wide open in Drill. Drill is a query layer on data sources and will respect the underlying storage permissions without having to manage centralized security permissions at Drill layer through