Is the failure due to ORC file not being supported by DFS/S3 plugin?  This 
error may come if you are querying on unsupported format or if you don't have 
the format defined in corresponding storage plugin definition.

Below is sample execution for junk format 'thenga' not defined in storage 
plugin definition.

$ hadoop fs -ls /tmp/sample.thenga
-rwxr-x---   3 manga manga         37 2017-10-16 16:31 /tmp/sample.thenga

$sqlline
0: jdbc:drill:schema=dfs> select * from dfs.`/tmp/sample.thenga`;
Error: [MapR][DrillJDBCDriver](500165) Query execution error: VALIDATION ERROR: 
From line 1, column 15 to line 1, column 17: Table 'dfs./tmp/sample.thenga' not 
found

SQL Query null

[Error Id: 154d6187-eea2-4afe-ab64-ac0f287a3433 on drill-node:31010] 
(state=HY000,code=500165)
0: jdbc:drill:schema=dfs>

One option would be to use Hive table built on top of these files and use hive 
storage plugin in Drill ( if hive table on top of S3 ORC files works fine). Or 
Parquet files would be a good choice with Drill.

Thanks,

Arjun

________________________________
From: Sorabh Hamirwasia <shamirwa...@mapr.com>
Sent: Tuesday, February 6, 2018 1:11 PM
To: user@drill.apache.org
Subject: Re: Apache drill validation error, table not found

Hi,

Can you please try following instruction here [1] once.? Also after 
configuration you can try to list tables by "show databases" to make sure setup 
is fine.


And the query should be:

SELECT * FROM s3.`./data/part-r-001` LIMIT 100


[1]: https://drill.apache.org/docs/s3-storage-plugin/
S3 Storage Plugin - Apache 
Drill<https://drill.apache.org/docs/s3-storage-plugin/>
drill.apache.org
Drill works with data stored in the cloud. With a few simple steps, you can 
configure the S3 storage plugin for Drill and be off to the races running 
queries.





Thanks,
Sorabh


________________________________
From: Bo Qiang <bo.qi...@nielsen.com>
Sent: Monday, February 5, 2018 9:17 PM
To: user@drill.apache.org
Subject: Apache drill validation error, table not found

I have been trying to use Apache drill to query data in s3 buckets. Inside
of Drill Explorer, I met the following errors:

    ERROR [HY000] [MapR][Drill] (1040) Drill failed to execute the query:
SELECT * FROM `s3`.`default`.`./data/part-r-001` LIMIT 100
    [30034]Query execution error. Details:[
    VALIDATION ERROR: From line 1, column 15 to line 1, column 18: Table
's3.default../data/part-r-001' not found

    SQL Query null

    [Error Id: fa18496f-038f-46b1-9d3f-c40809511768 on 10.23.58.220:31010]
    ]
       at System.Data.Odbc.OdbcConnection.HandleError(OdbcHandle hrHandle,
RetCode retcode)
       at System.Data.Odbc.OdbcCommand.ExecuteReaderObject(CommandBehavior
behavior, String method, Boolean needReader, Object[] methodArguments,
SQL_API odbcApiMethod)
       at System.Data.Odbc.OdbcCommand.ExecuteReaderObject(CommandBehavior
behavior, String method, Boolean needReader)
       at System.Data.Odbc.OdbcCommand.ExecuteReader(CommandBehavior
behavior)
       at DrillExplorer.DROdbcProvider.GetStatmentColumns(String in_query)

The part-r-001 file are of ORC format.

Is there anything fix? Thanks a lot!

Reply via email to