Re: Benchmark numbers using Drill

Thanks for this very useful info.. On 19 Oct 2017 11:28 pm, "Saurabh Mahapatra" wrote: > I do not think you will get such information about benchmarks from > customers on production workloads. But from the customers I have worked > with who have taken Drill to

Re: S3 with mixed files

Hi Daniel, Looks like it's data schema change related issue. You should be getting this error with data uncompressed as well. Check for any schema change with json data structure and see if setting below property helps (Experimental feature as per doc). ALTER SESSION SET

Re: S3 with mixed files

Hi Arjun, Yes! Thanks. I didn't have my "log" storage plugin defined correctly (It was missing the "extensions" key set to value "log".) However, when I try to query a file like abc.log.gz select * from ibios3.root.`/tracking/abc.log.gz`; I get a different error

Re: S3 Connection Issues

Hi Charles, I'm not aware of any such settings. As Padma mentioned in previous mail, It works fine for me by following instructions in https://drill.apache.org/docs/s3-storage-plugin/ . Thanks, Arjun From: Charles Givre Sent: Friday,

Re: S3 Connection Issues

Hi Arjun, Thanks for your help. Are there settings in S3 that would prevent Drill from connecting? I’ll try hdfs shell, but I am able to connect with the CLI tool. My hunch is that there is a permission not set correctly on S3 or I’m missing some config variable in Drill. — C > On Oct

Re: S3 Connection Issues

Hi Charles, Any chance you can test s3 connectivity with other tools like hdfs shell or hive in case you haven't tried already (and these tools available)? This may help to identify if it is Drill specific issue. For connecting via hdfs , you may try below command. hadoop fs

Re: S3 with mixed files

Hi Daniel, This error may occur if you don't have format defined in S3 storage plugin that handles ".log" extension. For eg: -- I have file input.csv and have csv format defined in s3 storage plugin. 2 rows selected (1.233 seconds) 0: jdbc:drill:schema=dfs> select * from

Re: S3 with mixed files

Hi Daniel, Can you try select * from ibios3.root.`./tracking/tracking.log`; instead of select * from ibios3.root.`tracking/tracking.log`; Thanks, Divya On 20 October 2017 at 13:13, Daniel McQuillen wrote: > Thanks for your help, Padma! > > Just tried the following,