Thank you :-) And, I've poked at PCAPs with Drill & sergeant to great effect (not on S3, but that — as you said — should work fine, too).
I just wish I had time to PR into the project to have it not totally bork on imperfect packets, support more PCAP formats and add in/port some helper UDF decoders. Drill + sergeant is used daily for at-scale analytics on internet scan and honeypot data where I work (Rapid7). -Bob > On Feb 7, 2018, at 1:13 PM, Ted Dunning <ted.dunn...@gmail.com> wrote: > > On Tue, Feb 6, 2018 at 1:08 AM, Arjun kr <arjun...@outlook.com> wrote: > >> ... >> I don't have any clue about using Drill with 'R Sergeant library' library. >> Hopefully, others can throw any lights on this question. >> > > I just looked this up and in their own words: > > Jul 17, 2017 - *sergeant*: Tools to Transform and Query Data with 'Apache' >> 'Drill'. 'Apache Drill' is a low-latency distributed query engine designed >> to enable data exploration and 'analytics' on both relational and >> non-relational 'datastores', scaling to petabytes of data. Methods are >> provided that enable working > > > This is so very cool!
signature.asc
Description: Message signed with OpenPGP