Re: Drill and Kerberos

2018-04-18 Thread Chun Chang
Hi Asim, You can send me private email asking specific questions related to your Drill Kerberos setup. I will try to answer them. Thanks, Chun From: Asim Kanungo Sent: Wednesday, April 18, 2018 5:50:44 PM To: user@drill.apache.org

Re: Question about how Drill optimizes the queries and splits the loads in HDFS cluster?

2017-11-07 Thread Chun Chang
Yes, data locality is considered in deciding which drillbit gets to work on what. From: LittleCho Sent: Tuesday, November 7, 2017 6:21:29 AM To: user@drill.apache.org Subject: Question about how Drill optimizes the queries and splits the

Re: describe query support? (catalog metadata, etc)

2017-10-19 Thread Chun Chang
terpret a flat > file. > — C > On Oct 18, 2017, at 15:20, Chun Chang <cch...@mapr.com> wrote: > > There were discussions on the need of building a catalog for drill. But I > don't think that's the focus right now. And I am not sure the community will ever decide to go

Re: describe query support? (catalog metadata, etc)

2017-10-18 Thread Chun Chang
There were discussions on the need of building a catalog for drill. But I don't think that's the focus right now. And I am not sure the community will ever decide to go in that direction. For now, you best bet is to create views on top of your JSON/CSV data.

Re: user mixed up problem

2017-10-16 Thread Chun Chang
Hi 查道德 From what you described, it looks like a bug to me. Please file a JIRA with the description you've given here and provide relevant drillbit logs. This will help getting this issue resolved early. Thanks, Chun From: 查道德 Sent:

Re: Querying Parquet files in 2.0 format

2017-09-21 Thread Chun Chang
This is a known issue. Drill currently has trouble reading Parquet files written in 2.0 format. From: Oscar Torreño Sent: Thursday, September 21, 2017 12:32:58 AM To: user@drill.apache.org Subject: Querying Parquet files in 2.0 format Hi

Re: Can we Import the HDFS Query results to Any RDBMS using Apache Drill

2017-05-26 Thread Chun Chang
You can easily write a simple program to query using drill and load the results into RDBMS. From: Abhishek Girish Sent: Thursday, May 25, 2017 10:13:46 AM To: user@drill.apache.org Subject: Re: Can we Import the HDFS Query results to Any

Re: DRILL-4602

2016-12-22 Thread Chun Chang
You might want to clone drill source and apply the patch. Or someone on the list maybe able to build for you. On Wed, Dec 21, 2016 at 5:51 PM, Jan wrote: > folks Hello; > > we are running into DRILL-4602 when trying to access Avro files on S3.I've > seen the patch for

Re: Impersonation with Drill Web Console or REST API

2016-12-21 Thread Chun Chang
Aki, I tried myself and seems working for me too. The "not supported" probably means "no formal QA testing". On Wed, Dec 21, 2016 at 10:08 AM, Akihiko Kusanagi wrote: > Hi, > > The 'Impersonation Support' table In the following page says that > impersonation > is not

Re: [Drill 1.9.0] : [CONNECTION ERROR] :- (user client) closed unexpectedly. Drillbit down?

2016-12-20 Thread Chun Chang
I am pretty sure this is the same as DRILL-4708. On Tue, Dec 20, 2016 at 10:27 AM, Sudheesh Katkam wrote: > Is the drillbit service (running on datanodeN/10.*.*.5:31010) actually > down when the error is seen? > > If not, try lowering parallelism using these two session

Re: Not able to setup PAM authentication properly

2016-11-10 Thread Chun Chang
Try to add your account that you use to start drill as part of shadow group. Let us know if this works. On Thu, Nov 10, 2016 at 2:40 AM, Hotz-Behofsits, Christian < christian.hotz-behofs...@wu.ac.at> wrote: > Hi, > > I configured my drillbit to support PAM Authentication (which works). But > If

Re: question about drill storage plugin

2016-10-31 Thread Chun Chang
Sheng, Your question may be more appropriate for d...@drill.apache.org. Try that mailing list as well. On Mon, Oct 31, 2016 at 12:05 AM, Tan Sheng 谈晟 wrote: > Hi, > > We are a Chinese company(Shanghai Automotive Industry Corporation(Group)), > and we extending drill

Re: Connecting to Drill Programmatically in embedded mode on Windows

2016-10-14 Thread Chun Chang
It should be possible. Take a look at how sqlline does it. On Fri, Oct 14, 2016 at 10:30 AM, Anton Kravchenko < kravchenko.anto...@gmail.com> wrote: > Hi there, > > Just to make sure, It looks like connecting to Drill Programmatically in > embedded mode is not supported on Windows (have not

Re: PAM Authentication in Embedded Mode

2016-10-14 Thread Chun Chang
ctory where you installed your JPAM On Fri, Oct 14, 2016 at 12:43 AM, Muthu pandi <panditherocks...@gmail.com> wrote: > Hello Chun Chang > > Thanks for your reply. I need some information:- Please > help. > > 1) How to assigning proper ACLs..? > > 2)

Re: PAM Authentication in Embedded Mode

2016-10-13 Thread Chun Chang
<panditherocks...@gmail.com> wrote: > Hello Chun Chang > Thanks for replying. I have follow your steps > and its working for me. I have one doubt if my Ubuntu machine have 3 or 4 > users, then can i give permission for only selected user to start the > drill. &g

Re: drill distributed mode on Windows: No DrillbitEndpoint can be found

2016-10-12 Thread Chun Chang
It may not work out of the box but in theory it should work. May need to model sqlline.bat file and create a windows version of drillbit.sh. On Wed, Oct 12, 2016 at 10:17 AM, Anton Kravchenko < kravchenko.anto...@gmail.com> wrote: > Hi there, > > I wonder if Apache Drill is supported in

Re: PAM Authentication in Embedded Mode

2016-10-12 Thread Chun Chang
That's one of your Linux user and password on that machine. On Wed, Oct 12, 2016 at 12:27 AM, Muthu pandi <panditherocks...@gmail.com> wrote: > Hello Chun Chang > Thanks for reply. I want to know where to provide username > and password.? > > If i fire this

Re: PAM Authentication in Embedded Mode

2016-10-11 Thread Chun Chang
Have not tried myself (have tried cluster mode) but should work. Give the following a try. 1. first install PAM lib module. For example, I have it installed at /opt/pam [root@node120 conf]# ls -l /opt/pam/ total 36 -rw-r--r--. 1 root root 33015 Oct 4 16:24 libjpam.so 2. modify drill-env.sh and

Re: Fetch queries status from drill prompt

2016-08-18 Thread Chun Chang
Anup, I believe only when a query is in a "terminal", i.e. cancelled/completed/failed state, then it is written to the drillbit_queries.json file on the foreman node. If what you want to do is monitoring queries running on your cluster, your best bet is to configure your cluster to store profile

Re: user impersonation bypass

2016-08-15 Thread Chun Chang
Scott, Make sure you have impersonation enabled on every cluster node (drillbit). Specifically, check the configuration on the drillbit you connected directly. In theory, connecting through ZK or direct should have no effect on impersonation. On Mon, Aug 15, 2016 at 1:31 PM, scott

Re: User Impersonation

2016-06-30 Thread Chun Chang
Impersonation against local file system is not supported. If you are running against hdfs, please take a look at drillbit.log or post relevant part here. On Thu, Jun 30, 2016 at 8:12 AM, scott wrote: > Hi, > I am having trouble getting Impersonation to work. Using Drill

Re: Drill - Hive - Kerberos

2016-06-17 Thread Chun Chang
Hi Joseph, Are you running DRILL on a secure cluster? I had success with the following storage plugin configuration with MapR distribution, SQL standard authorization with Kerberos: hive storage plugin: { "type": "hive", "enabled": true, "configProps": { "hive.metastore.uris":

Re: Storage plugin for Cassandra and ElasticSearch

2016-06-08 Thread Chun Chang
Hi Santosh, I have not closely followed the community but as far as I know, I don't think there is plugin for Cassandra or ElasticSearch currently available. If someone is working on developing one, would like to hear about it. Thanks, Chun On Tue, Jun 7, 2016 at 7:59 PM, Santosh Kulkarni <

Re: Stopping Drillbit and preventing it from restarting automatically on MapR sandbox

2015-04-29 Thread Chun Chang
Actually it should be: maprcli node services -name drill-bits -action stop -nodes `hostname -f` Sorry about that. On Tue, Apr 28, 2015 at 6:01 PM, Chun Chang cch...@maprtech.com wrote: Run the following cmd to stop the old drillbit: maprcli node services -name Drill -action stop -nodes

Re: WHERE clause with nested JSON data

2015-04-01 Thread Chun Chang
Hi Subhajit, Possible for you to attach a sample of your dataset? I want to try the query with your dataset. Thanks, Chun On Tue, Mar 31, 2015 at 11:53 AM, Jason Altekruse altekruseja...@gmail.com wrote: The error message indicates that this is a planning bug. Please try to look to see if