Copying and pasting your JSON directly into a new configuration gets me “Error 
(invalid JSON Mapping)”.



What am I doing wrong?







[cid:[email protected]]



Nick Monetta | INRIX |[email protected] |Movement Intelligence | www.inrix.com  | 
mobile +1 646-248-4105 |





-----Original Message-----
From: Jason Altekruse [mailto:[email protected]]
Sent: Wednesday, April 20, 2016 4:27 PM
To: [email protected]
Cc: [email protected]
Subject: Re: Unable to connect to S3 parquet data using Drill



{

  "type": "file",

  "enabled": true,

  "connection": "s3a://PATH.TO.BUCKET/",

  "config": {

    "fs.s3a.access.key": "<YOUR ACCESS KEY HERE>",

    "fs.s3a.secret.key": "<YOUR SECRET KEY HERE>"

  },

  "workspaces": {

    "root": {

      "location": "/",

      "writable": false,

      "defaultInputFormat": null

    },

    "tmp": {

      "location": "/tmp",

      "writable": true,

      "defaultInputFormat": null

    }

  },

  "formats": {

    "psv": {

      "type": "text",

      "extensions": [

        "tbl"

      ],

      "delimiter": "|"

    },

    "csv": {

      "type": "text",

      "extensions": [

        "csv"

      ],

      "delimiter": ","

    },

    "tsv": {

      "type": "text",

      "extensions": [

        "tsv"

      ],

      "delimiter": "\t"

    },

    "parquet": {

      "type": "parquet"

    },

    "json": {

      "type": "json",

      "extensions": [

        "json"

      ]

    },

    "avro": {

      "type": "avro"

    },

    "sequencefile": {

      "type": "sequencefile",

      "extensions": [

        "seq"

      ]

    },

    "csvh": {

      "type": "text",

      "extensions": [

        "csvh"

      ],

      "extractHeader": true,

      "delimiter": ","

    }

  }

}



Jason Altekruse

Software Engineer at Dremio

Apache Drill Committer



On Wed, Apr 20, 2016 at 1:24 PM, Nick Monetta 
<[email protected]<mailto:[email protected]>> wrote:



> Can you send me the full JSON for the new config example you provided?

> I keep getting JSON errors.

>

>

> Nick Monetta | INRIX |[email protected]<mailto:|[email protected]> |Movement 
> Intelligence |

> www.inrix.com<http://www.inrix.com>  | mobile +1 646-248-4105 |

>

>

> -----Original Message-----

> From: Abhishek Girish [mailto:[email protected]]

> Sent: Wednesday, April 20, 2016 12:57 PM

> To: user <[email protected]<mailto:[email protected]>>

> Subject: Re: Unable to connect to S3 parquet data using Drill

>

> Hey Trang,

>

> A similar issue related to S3 config was discussed today on the

> mailing list [1]. Can you see if that helps resolve the issue?

>

> [1]

>

> http://mail-archives.apache.org/mod_mbox/drill-dev/201604.mbox/%3CCAN6

> ttnukzsAKgQE-RTF0RNCvBr1uWsB9SaxnS_7y-v0yBdUj%3Dw%40mail.gmail.com%3E

>

>

> -Abhishek

>

> On Tue, Apr 19, 2016 at 6:38 PM, Trang Nguyen 
> <[email protected]<mailto:[email protected]>>

> wrote:

>

> > Hi,

> >

> > I am having trouble to connect to an Amazon S3 bucket containing

> > parquet files.

> > I followed the instructions on

> > https://drill.apache.org/docs/s3-storage-plugin/ to download

> > jets3_0.9.3 on my Ubuntu VM.

> > My storage configs:

> > {

> >   "type": "file",

> >   "enabled": true,

> >   "connection": "s3://inrixprod-tapp",

> >   "config": null,

> >   "workspaces": {

> >     "root": {

> >       "location": "/",

> >       "writable": false,

> >       "defaultInputFormat": null

> >     },

> >     "tmp": {

> >       "location": "/tmp",

> >       "writable": true,

> >       "defaultInputFormat": null

> >     }

> >   },

> > ...

> > }

> >

> > I've started the embedded-drill instance but get the following error

> > trying to connect:

> > 0: jdbc:drill:zk=local> use s3-trips.`root`;

> > Error: SYSTEM ERROR: IOException: / doesn't exist

> >

> >

> > [Error Id: 081c66e6-177d-48fa-8eca-4ee1370ae785 on

> > ubuntu-VirtualBox:31010] (state=,code=0)

> >

> > Any advice would be appreciated!

> >

> > Thanks,

> > Trang

> >

>

Reply via email to