Is the failure due to ORC file not being supported by DFS/S3 plugin? This error may come if you are querying on unsupported format or if you don't have the format defined in corresponding storage plugin definition.
Below is sample execution for junk format 'thenga' not defined in storage plugin definition. $ hadoop fs -ls /tmp/sample.thenga -rwxr-x--- 3 manga manga 37 2017-10-16 16:31 /tmp/sample.thenga $sqlline 0: jdbc:drill:schema=dfs> select * from dfs.`/tmp/sample.thenga`; Error: [MapR][DrillJDBCDriver](500165) Query execution error: VALIDATION ERROR: From line 1, column 15 to line 1, column 17: Table 'dfs./tmp/sample.thenga' not found SQL Query null [Error Id: 154d6187-eea2-4afe-ab64-ac0f287a3433 on drill-node:31010] (state=HY000,code=500165) 0: jdbc:drill:schema=dfs> One option would be to use Hive table built on top of these files and use hive storage plugin in Drill ( if hive table on top of S3 ORC files works fine). Or Parquet files would be a good choice with Drill. Thanks, Arjun ________________________________ From: Sorabh Hamirwasia <shamirwa...@mapr.com> Sent: Tuesday, February 6, 2018 1:11 PM To: user@drill.apache.org Subject: Re: Apache drill validation error, table not found Hi, Can you please try following instruction here [1] once.? Also after configuration you can try to list tables by "show databases" to make sure setup is fine. And the query should be: SELECT * FROM s3.`./data/part-r-001` LIMIT 100 [1]: https://drill.apache.org/docs/s3-storage-plugin/ S3 Storage Plugin - Apache Drill<https://drill.apache.org/docs/s3-storage-plugin/> drill.apache.org Drill works with data stored in the cloud. With a few simple steps, you can configure the S3 storage plugin for Drill and be off to the races running queries. Thanks, Sorabh ________________________________ From: Bo Qiang <bo.qi...@nielsen.com> Sent: Monday, February 5, 2018 9:17 PM To: user@drill.apache.org Subject: Apache drill validation error, table not found I have been trying to use Apache drill to query data in s3 buckets. Inside of Drill Explorer, I met the following errors: ERROR [HY000] [MapR][Drill] (1040) Drill failed to execute the query: SELECT * FROM `s3`.`default`.`./data/part-r-001` LIMIT 100 [30034]Query execution error. Details:[ VALIDATION ERROR: From line 1, column 15 to line 1, column 18: Table 's3.default../data/part-r-001' not found SQL Query null [Error Id: fa18496f-038f-46b1-9d3f-c40809511768 on 10.23.58.220:31010] ] at System.Data.Odbc.OdbcConnection.HandleError(OdbcHandle hrHandle, RetCode retcode) at System.Data.Odbc.OdbcCommand.ExecuteReaderObject(CommandBehavior behavior, String method, Boolean needReader, Object[] methodArguments, SQL_API odbcApiMethod) at System.Data.Odbc.OdbcCommand.ExecuteReaderObject(CommandBehavior behavior, String method, Boolean needReader) at System.Data.Odbc.OdbcCommand.ExecuteReader(CommandBehavior behavior) at DrillExplorer.DROdbcProvider.GetStatmentColumns(String in_query) The part-r-001 file are of ORC format. Is there anything fix? Thanks a lot!