[ https://issues.apache.org/jira/browse/DRILL-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308923#comment-16308923 ]
ASF GitHub Bot commented on DRILL-5432: --------------------------------------- GitHub user tdunning opened a pull request: https://github.com/apache/drill/pull/1080 Add acknowledgement sequence number and flags fields. This pull request relates to DRILL-5432 but is not ready to merge You can merge this pull request into a Git repository by running: $ git pull https://github.com/tdunning/drill master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/drill/pull/1080.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1080 ---- commit af548bb918c6ac7773dab0fc9509db2142979401 Author: Ted Dunning <ted.dunning@...> Date: 2018-01-03T00:20:35Z Add acknowledgement sequence number and flags fields. ---- > Added pcap-format support > ------------------------- > > Key: DRILL-5432 > URL: https://issues.apache.org/jira/browse/DRILL-5432 > Project: Apache Drill > Issue Type: New Feature > Reporter: Ted Dunning > Labels: doc-impacting > Fix For: 1.11.0 > > > PCAP files [1] are the de facto standard for storing network capture data. In > security and protocol applications, it is very common to want to extract > particular packets from a capture for further analysis. > At a first level, it is desirable to query and filter by source and > destination IP and port or by protocol. Beyond that, however, it would be > very useful to be able to group packets by TCP session and eventually to look > at packet contents. For now, however, the most critical requirement is that > we should be able to scan captures at very high speed. > I previously wrote a (kind of working) proof of concept for a PCAP decoder > that did lazy deserialization and could traverse hundreds of MB of PCAP data > per second per core. This compares to roughly 2-3 MB/s for widely available > Apache-compatible open source PCAP decoders. > This JIRA covers the integration and extension of that proof of concept as a > Drill file format. > Initial work is available at https://github.com/mapr-demos/drill-pcap-format > [1] https://en.wikipedia.org/wiki/Pcap -- This message was sent by Atlassian JIRA (v6.4.14#64029)