Can you tell us what the volume of those files was? How many records, how many files, how many columns?
Sent from my iPhone > On Feb 25, 2016, at 7:27 PM, "Edmon Begoli" <ebeg...@gmail.com> wrote: > > Hello fellow Driilers, > > I have been inactive on the development side of the project, as we got busy > being heavy/power users of the Drill in the last few months. > > I just want to share some great experiences with the latest versions of > Drill. > > Just tonight, as we were scrambling to meet the deadline, we were able to > query two years of flat psv files of claims/billing and clinical data in > Drill in less than 60 seconds. > > No ETL, no warehousing - just plain SQL against tons of files. Run SQL, get > results. > > Amazing! > > We have also done some much more important things too, and we had a paper > accepted to Big Data Services about the experiences. The co-author of the > paper is Drill's own Dr. Ted Dunning :-) > I will share it once it is published. > > Anyway, cheers to all, and hope to re-join the dev activities soon. > > Best, > Edmon