Re: Problem with HDFS Encryption.

2016-06-27 Thread Kidong Lee
Hi Parth, thanks for your advice. I solved the problem. The problem was that the drill user which run drill did not know HADOOP_HOME env, thus drill could not read my hadoop site.xml confs. I have exported HADOOP_HOME explicitly with drill user and run drill, it works fine!!! - Kidong.

Re: Problem with HDFS Encryption.

2016-06-27 Thread Parth Chandra
You might need to make sure these files are in the Drill classpath. You could create a link to these files (or a copy) in your DRILL_HOME/conf directory and try. On Mon, Jun 27, 2016 at 4:45 PM, Kidong Lee wrote: > Yes, I did. I have also tested my parquet file which reside

Re: Problem with HDFS Encryption.

2016-06-27 Thread Kidong Lee
Yes, I did. I have also tested my parquet file which reside in the encryption zone and can be read with hive and parquet tool. - kidong 2016년 6월 28일 화요일, Parth Chandra님이 작성한 메시지: > Hi Kidong, > > I haven't tried this myself, but my guess is that the KMS settings need >

Suggestions for Hangout Topics for 06/28/16

2016-06-27 Thread Sudheesh Katkam
If you have any suggestions for hangout topics for tomorrow, you can add it to this thread. We will also ask around at the beginning of the hangout for any topics. The goal is to try to cover whatever possible during the 1 hr. Thank you, Sudheesh

Re: Problem with HDFS Encryption.

2016-06-27 Thread Parth Chandra
Hi Kidong, I haven't tried this myself, but my guess is that the KMS settings need to be provided at the HDFS layer not in the drill storage plugin. Specify hadoop.security.key.provider.path in core-site Specify dfs.encryption.key.provider.uri in hdfs-site Or did you already do that?

Re: Enable or Disable multiple storage plugin at a time

2016-06-27 Thread Parth Chandra
You can enable/disable plugins from the GUI. See here for more: https://drill.apache.org/docs/plugin-configuration-basics/ On Mon, Jun 27, 2016 at 4:03 AM, Sanjiv Kumar wrote: > Is it possible to enable or disable multiple storage plugins at a time > through web console.

Re: Is this normal view behavior?

2016-06-27 Thread John Omernik
Given the JIRA/Additional information, was anyone else able to reproduce? Thanks John On Fri, Jun 24, 2016 at 8:57 AM, John Omernik wrote: > I created a JIRA and included all this here: > https://issues.apache.org/jira/browse/DRILL-4753. I am using the MapR 1.6 > release.

Enable or Disable multiple storage plugin at a time

2016-06-27 Thread Sanjiv Kumar
Is it possible to enable or disable multiple storage plugins at a time through web console. OR Is there any other specific way to do so. ?? -- .. Thanks & Regards *Sanjiv Kumar*

Problem with HDFS Encryption.

2016-06-27 Thread Kidong Lee
Hi, I got some problem using drill with HDFS Encryption. With Hive, DFS Storage, I got the errors like this: Error: SYSTEM ERROR: IOException: No KeyProvider is configured, cannot access an encrypted file Even if I have added some confs below to drill storage plugin, the result is the same: in

Re: Question about querying array fields in parquet files

2016-06-27 Thread Kunal Khatua
Hi Dave I think you might be hitting one of these recent issues: https://issues.apache.org/jira/browse/DRILL-4594 >From a quick glance, the 'array' word appears to be treated as a key in a map >within the lastName field. But, your schema otherwise looks fine. Could you >post a set of the