Re: failing to drill zips of jsons

[Jason Altekruse]

Drill needs to know what format is stored underneath the compression, the
default way this is accomplished is with a compound extension (I don't know
if there is an accepted term for this practice).

You should be able to read the file if you name it data.json.zip.

On Tue, Feb 23, 2016 at 2:53 PM, Sharma, Tapan  wrote:

> Hi Gang,
>
> I read the following email:
> http://mail-archives.apache.org/mod_mbox/drill-dev/201412.mbox/%3ccampyv7by21rj1nw5kuhbwn-19mzjpe4np3kzzu294texr96...@mail.gmail.com%3E
>
> And I was trying to query from a zip of JSONs and it just fails with
> Validation error.  Any clue what might be wrong?
>
>
> taps@ubuntu:~/data/temp$ file json.zip
> json.zip: Zip archive data, at least v1.0 to extract
>
> 0: jdbc:drill:zk=local> select count(*) from
> dfs.`/home/taps/data/temp/json.zip`;
> Feb 21, 2016 2:35:26 PM
> org.apache.calcite.sql.validate.SqlValidatorException 
> SEVERE: org.apache.calcite.sql.validate.SqlValidatorException: Table
> 'dfs./home/taps/data/temp/json.zip' not found
> Feb 21, 2016 2:35:26 PM org.apache.calcite.runtime.CalciteException 
> SEVERE: org.apache.calcite.runtime.CalciteContextException: From line 1,
> column 22 to line 1, column 24: Table 'dfs./home/taps/data/temp/json.zip'
> not found
> Error: VALIDATION ERROR: From line 1, column 22 to line 1, column 24:
> Table 'dfs./home/taps/data/temp/json.zip' not found
>
>
> [Error Id: f734308a-8c5b-4140-b813-08572f9a54c1 on ubuntu:31010]
> (state=,code=0)
>
> If I unzip the JSONs and try the query it works, I unzipped it in the very
> same temp directory and moved the json.zip file.
> 0: jdbc:drill:zk=local> select count(*) from dfs.`/home/taps/data/temp/`;
> +-+
> | EXPR$0  |
> +-+
> | 284 |
> +-+
> 1 row selected (0.632 seconds)
>
>
> Thanks,
> Tapan
>

failing to drill zips of jsons

[Sharma, Tapan]

Hi Gang,

I read the following email: 
http://mail-archives.apache.org/mod_mbox/drill-dev/201412.mbox/%3ccampyv7by21rj1nw5kuhbwn-19mzjpe4np3kzzu294texr96...@mail.gmail.com%3E

And I was trying to query from a zip of JSONs and it just fails with Validation 
error.  Any clue what might be wrong?


taps@ubuntu:~/data/temp$ file json.zip
json.zip: Zip archive data, at least v1.0 to extract

0: jdbc:drill:zk=local> select count(*) from 
dfs.`/home/taps/data/temp/json.zip`;
Feb 21, 2016 2:35:26 PM org.apache.calcite.sql.validate.SqlValidatorException 

SEVERE: org.apache.calcite.sql.validate.SqlValidatorException: Table 
'dfs./home/taps/data/temp/json.zip' not found
Feb 21, 2016 2:35:26 PM org.apache.calcite.runtime.CalciteException 
SEVERE: org.apache.calcite.runtime.CalciteContextException: From line 1, column 
22 to line 1, column 24: Table 'dfs./home/taps/data/temp/json.zip' not found
Error: VALIDATION ERROR: From line 1, column 22 to line 1, column 24: Table 
'dfs./home/taps/data/temp/json.zip' not found


[Error Id: f734308a-8c5b-4140-b813-08572f9a54c1 on ubuntu:31010] (state=,code=0)

If I unzip the JSONs and try the query it works, I unzipped it in the very same 
temp directory and moved the json.zip file.
0: jdbc:drill:zk=local> select count(*) from dfs.`/home/taps/data/temp/`;
+-+
| EXPR$0  |
+-+
| 284 |
+-+
1 row selected (0.632 seconds)


Thanks,
Tapan