Hi,
This query targets Avro files in the latest 1.5 release:
0: jdbc:drill:zk=local> select count(*) from
dfs.asa.`/streaming/venuepoint/transactions/` as s where s.sold_to =
'Customer/4-2492847';
+---------+
| EXPR$0 |
+---------+
| 5788 |
+---------+
0: jdbc:drill:zk=local> select count(*) from
dfs.asa.`/streaming/venuepoint/transactions/` as s where s.sold_to IN
('Customer/4-2492847');
+---------+
| EXPR$0 |
+---------+
| 0 |
+---------+
It shows that the IN operator does not work with Avro (works with Parquet).
This finally tips us over. We have invested hundreds of hours moving all
streaming/fresh data from JSON to Avro but the Avro part of Drill is broken
in too many ways to recommend its use to anyone.
Attempts to report Avro errors and shortcomings, like the missing support
for dirX, has had no results.
I think it would be prudent to warn people on the Drill website that the
Avro support is experimental, at best
- Stefán Baxter
