Dear Kristine, Still fighting with 1.4
I carefully checked for hidden and system files - there are none Also keep in mind, that the very same query and same data directories do work fine in 1.3 (on the same machine, with the same setup) From a user point of view it seems that directory handling on my machine is totally broken in 1.4 (whatever is causing this) Does the error message Unexpected internal error near index 1 \ ^ [Error Id: 467e9ccd-3730-4add-aa63-a205a1e16107 on ... ] Hold any clues? Best regards, Alexander -----Original Message----- From: Kristine Hahn [mailto:kh...@maprtech.com] Sent: 07 January 2016 16:57 To: user@drill.apache.org Cc: ngriff...@dremio.com Subject: Re: Querying a directory of json.gz Files in Drill 1.4 Look for a hidden file and remove it. See DRILL-2424 and DRILL-1131 (still open). On Thursday, January 7, 2016, Holy Alexander <alexander.h...@derstandard.at> wrote: > Nathan, > > Actually, all my queries do read > > SELECT * FROM dfs.` D:\DataFiles\2015\12\16` ORDER BY ID LIMIT 10 > > And it does not work. > > I am switching back and forth between 1.3 (all my examples do work as > expected) > and 1.4 (all of my examples fail) > > Could this be a bug that is somehow OS related and specific to running > Drill 1.4 on Windows? > > Is there an even simpler test case (I suspect dirX handling to be > broken in 1.4 on Windows in my configuration? > My config is now: Windows 10 (1511), JDK 1.8.0_66, embedded mode) > > Thanks, > Alexander > > > -----Original Message----- > From: Nathan Griffith [mailto:ngriff...@dremio.com <javascript:;>] > Sent: 21 December 2015 19:13 > To: user@drill.apache.org <javascript:;> > Subject: Re: Querying a directory of json.gz Files in Drill 1.4 > > Alexander, > > I'm also successfully querying a directory of (compressed) JSON in > Drill 1.4. > > This is maybe a trivial suggestion, but for sanity what happens when > you specify the standard dfs plugin with: > dfs.`D:\DataFiles\2015\12\16` ? > > --Nathan > > On Fri, Dec 18, 2015 at 1:44 AM, Holy Alexander < > alexander.h...@derstandard.at <javascript:;>> wrote: > > I've tried every possible combination of > > > > SELECT * FROM ` D:\DataFiles\2015\12\16` ORDER BY ID LIMIT 10 > > SELECT * FROM ` D:\DataFiles\2015\12\16\` ORDER BY ID LIMIT 10 > > SELECT * FROM ` D:\DataFiles\2015\12\16\*` ORDER BY ID LIMIT 10 > > SELECT * FROM ` D:\DataFiles\2015\12\16\*.gz` ORDER BY ID LIMIT 10 > > > > All are working in Drill 1.3, > > none of the above is working in Drill 1.4 (Unexpected internal error > > near index 1 \ ^ [Error Id: 467e9ccd-3730-4add-aa63-a205a1e16107 on > > ... ]) > > > > I also deleted and rebuilt all configuration, tmp contents etc > > > > At least on my machine (Windows 10 (1511) x64 workstation) it looks > > like something is broken in 1.4 My Java is jdk1.8.0_51 > > > > The same effect/problem occurs with both .json and .json.gz In all > > cases things do work in 1.3 and not in 1.4 > > > > Thanks, > > Alexander > > > > > > -----Original Message----- > > From: Nirav Shah [mailto:nirav.s...@games24x7.com <javascript:;>] > > Sent: 18 December 2015 05:46 > > To: user@drill.apache.org <javascript:;> > > Subject: Re: Querying a directory of json.gz Files in Drill 1.4 > > > > May be you can try > > In Drill 1.4 the same Query > > SELECT * FROM ` D:\DataFiles\2015\12\16\*.gz` ORDER BY ID LIMIT 10 > > > > it's working for me. > > Thanks, > > Nirav > > > > On Fri, Dec 18, 2015 at 12:46 AM, Holy Alexander < > alexander.h...@derstandard.at <javascript:;>> wrote: > > > >> I keep my JSON Files in local File system, such as > >> > >> D:\DataFiles\2015\12\16\2015-12-16T0000.json.gz > >> D:\DataFiles\2015\12\16\2015-12-16T0100.json.gz > >> D:\DataFiles\2015\12\16\2015-12-16T0200.json.gz > >> (etc.) > >> > >> Up to Drill 1.3 > >> SELECT * FROM ` D:\DataFiles\2015\12\16` ORDER BY ID LIMIT 10 would > >> produce the desired result, querying all the files in the directory. > >> > >> > >> In Drill 1.4 the same Query > >> SELECT * FROM ` D:\DataFiles\2015\12\16` ORDER BY ID LIMIT 10 > >> > >> always results in this error: > >> org.apache.drill.common.exceptions.UserRemoteException: VALIDATION > ERROR: > >> Unexpected internal error near index 1 \ ^ [Error Id: > >> 467e9ccd-3730-4add-aa63-a205a1e16107 on ... ] > >> > >> However, > >> SELECT * FROM ` D:\DataFiles\2015\12\16\2015-12-16T0000.json.gz ` > >> ORDER BY ID LIMIT 10 Still successfully queries a single file in > >> Drill > >> 1.4 > >> > >> I was searching the doc for changes in Drill 1.4 but could not find > >> a hint what goes wrong? > >> > >> Any clues? > >> > >> Thanks, > >> Alexander > >> > >> > -- Kristine Hahn Sr. Technical Writer 415-497-8107 @krishahn skype:krishahn
