[
https://issues.apache.org/jira/browse/DRILL-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Keranen resolved DRILL-7197.
---------------------------------
Resolution: Not A Problem
S3 configuration needs to be in core-site.xml, not the storage configuration.
> Drill attempts to create table on Amazon when configured for on premise S3A
> ---------------------------------------------------------------------------
>
> Key: DRILL-7197
> URL: https://issues.apache.org/jira/browse/DRILL-7197
> Project: Apache Drill
> Issue Type: Bug
> Components: Server
> Affects Versions: 1.15.0
> Environment: On premises 4 node Minio S3A storage cluster:
> {
> {{ "type": "file",}}
> {{ "connection": "s3a://logs",}}
> {{ "config": {}}
> {{ "fs.s3a.endpoint": "x.x.x.x:9001",}}
> {{ "fs.s3a.connection.ssl.enabled": "false",}}
> {{ "fs.s3a.access.key": "xxx",}}
> {{ "fs.s3a.secret.key": "xxx"}}
> {{ },}}
> {{ "workspaces": {}}
> {{ "tmp": {}}
> {{ "location": "/tmp",}}
> {{ "writable": true,}}
> {{ "defaultInputFormat": null,}}
> {{ "allowAccessOutsideWorkspace": false}}
> {{ },}}
> {{ "logs": {}}
> {{ "location": "/",}}
> {{ "writable": true,}}
> {{ "defaultInputFormat": null,}}
> {{ "allowAccessOutsideWorkspace": false }}
> {{ }}}
> },
> Reporter: Matt Keranen
> Priority: Major
>
> Attempting to create Parquet tables from JSON data both within an on premises
> Minio S3A cluster.
> Able to SELECT from local S3 storage (Minio), but CTAS seems to be trying to
> go to Amazon S3:
> SELECT * FROM s3.logs LIMIT 1;
> works, but
> CREATE TABLE s3.logs.`test` SELECT ... FROM s3.logs
> results in the following error. Drill appears to attempt a connection to
> Amazon on a CTAS but not a SELECT alone:
>
> {{Error: SYSTEM ERROR: AmazonS3Exception: Status Code: 403, AWS Service:
> Amazon S3, AWS Request ID: XXX, AWS Error Code: InvalidAccessKeyId, AWS Error
> Message: The AWS Access Key Id you provided does not exist in our records.}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
