Re: drill tests not passing

2023-07-11 Thread Paul Rogers
Hi Mike, A quick glance at the log suggests a failure in the tests for the JSON reader, in the Mongo extended types. Drill's date/time support has historically been fragile. Some tests only work if your machine is set to use the UTC time zone (or Java is told to pretend that the time is UTC.) The

Re: Drill and Highly Hierarchical Data from Daffodil

2023-07-11 Thread Paul Rogers
Drill can internally handle scalars, arrays (AKA vectors) and maps (AKA tuples, structs). SQL, however, prefers to work with scalars: there is no good syntax to reach inside a complex object for, say, a WHERE condition without also projecting that item as a top-level scalar. The cool thing, for

Re: Drill and Highly Hierarchical Data from Daffodil

2023-07-11 Thread Charles Givre
HI Mike, When you say "you want all of them', can you clarify a bit about what you'd want the data to look like? Best, -- C > On Jul 11, 2023, at 12:33 PM, Mike Beckerle wrote: > > In designing the integration of Apache Daffodil into Drill, I'm trying to > figure out how queries would look

Drill and Highly Hierarchical Data from Daffodil

2023-07-11 Thread Mike Beckerle
In designing the integration of Apache Daffodil into Drill, I'm trying to figure out how queries would look operating on deeply nested data. Here's an example. This is the path to many geo-location latLong field pairs in some "messageSet" data:

Re: [I] NPE on DeltaRowGroupScan (drill)

2023-07-11 Thread via GitHub
cgivre closed issue #2810: NPE on DeltaRowGroupScan URL: https://github.com/apache/drill/issues/2810 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: Newby: First attempt to build drill - failure

2023-07-11 Thread Charles Givre
Methinks the Hive plugin could probably use some attention. With that said, I don't know how much use it actually gets. Yes... a ticket would probably be in order. Best, -- C > On Jul 11, 2023, at 10:38 AM, Mike Beckerle wrote: > > Should there be a ticket created about this: > >

Re: Newby: First attempt to build drill - failure

2023-07-11 Thread Mike Beckerle
Should there be a ticket created about this:

Re: [I] dir/*.parquet UNION ALL dir/*.json reading slow (drill)

2023-07-11 Thread via GitHub
pandalanax closed issue #2814: dir/*.parquet UNION ALL dir/*.json reading slow URL: https://github.com/apache/drill/issues/2814 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] dir/*.parquet UNION ALL dir/*.json reading slow (drill)

2023-07-11 Thread via GitHub
pandalanax commented on issue #2814: URL: https://github.com/apache/drill/issues/2814#issuecomment-1630227543 We created a workaround for the time being while we are upgrading the Drill version in our cluster. Workaround: create `n` empty json files via ```bash for n in