[Bro-Dev] [Auto] Merge Status

2014-01-29 Thread Merge Tracker

Open Merge Requests
===

IDComponentReporterAssigneeUpdated   For 
Version  PrioritySummary
  ---  --  --  --  
-  --  
BIT-1122 [1]  Bro  Jon Siwek   Seth Hall   2014-01-28
2.3  Normal  topic/jsiwek/dns-improvements [2]
BIT-1121 [3]  BroControl   Daniel Thayer   -   2014-01-28
2.3  Normal  topic/dnthayer/test-improvements [4]
BIT-1120 [5]  Bro  Bernhard Amann  -   2014-01-27
2.3  Normal  Fix & extend x509_extension event
BIT-1119 [6]  Bro  Jon Siwek   -   2014-01-28
2.3  Normal  topic/jsiwek/tcp-improvements [7]


Open Fastpath Commits
==

Commit   ComponentAuthor  DateSummary
---  ---  --  --  
-
62b3cb0 [8]  bro  Bernhard Amann  2014-01-28  Also use exec-module test 
to check for leaks.


[1]  BIT-1122   https://bro-tracker.atlassian.net/browse/BIT-1122
[2]  dns-improvements   
https://github.com/bro/bro/tree/topic/jsiwek/dns-improvements
[3]  BIT-1121   https://bro-tracker.atlassian.net/browse/BIT-1121
[4]  test-improvements  
https://github.com/bro/brocontrol/tree/topic/dnthayer/test-improvements
[5]  BIT-1120   https://bro-tracker.atlassian.net/browse/BIT-1120
[6]  BIT-1119   https://bro-tracker.atlassian.net/browse/BIT-1119
[7]  tcp-improvements   
https://github.com/bro/bro/tree/topic/jsiwek/tcp-improvements
[8]  62b3cb0
https://github.com/bro/bro/commit/62b3cb0a5b7bdd8fed1d7d0dae3337115b2feae7

___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1119) topic/jsiwek/tcp-improvements

2014-01-29 Thread Jon Siwek (JIRA)

[ 
https://bro-tracker.atlassian.net/browse/BIT-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304#comment-15304
 ] 

Jon Siwek commented on BIT-1119:


{quote}
I'm going ahead merging this but I'm wondering about the new 
detect_filtered_trace flag. It's pretty common (in the research world, anyways  
to run Bro on a SYN/FIN/RST trace and I imagine having this by default off can 
add a lot for warnings in that case. Can we add some other heuristic to detect 
such a trace (i.e., guess whether detect_filtered_trace should be on) ? A 
(very) coarse approach would simply be a global variable recording if we've 
ever seen anything else than a TCP control packet. Thoughts?
{quote}

If a person found out that Bro automatically switched modes part way through 
the trace, they will probably just re-run after manually toggling the option, 
right?  Maybe treat it in a similar way to checksums -- have a FAQ and/or have 
some script warn if all TCP connections are missing 100% of content and suggest 
toggling {{detect_filtered_trace}} if the person would like to trade off 
correctness for minimized output.  But if it's actually not that important for 
a person using filtered traces to minimize output, I think it's fine enough as 
is?

> topic/jsiwek/tcp-improvements
> -
>
> Key: BIT-1119
> URL: https://bro-tracker.atlassian.net/browse/BIT-1119
> Project: Bro Issue Tracker
>  Issue Type: Improvement
>  Components: Bro
>Affects Versions: git/master
>Reporter: Jon Siwek
> Fix For: 2.3
>
>
> This branch is in the bro, bro-testing, and bro-testing-private repos and has 
> a few changes to improve reporting of TCP connection sizes and gaps (commit 
> messages explain in more detail).
> The baseline changes in the external repos all seemed reasonable/explainable 
> (or actually fix a problem).  There's too much changed to go through 
> case-by-case and actually check things, but I did do closer examinations of 
> unique differences as I came across them (e.g. try to corroborate Bro results 
> via wireshark).  Then for those that seem to follow the same trend as 
> something I already inspected, I wouldn't manually check.



--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)
___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1119) topic/jsiwek/tcp-improvements

2014-01-29 Thread Robin Sommer (JIRA)

[ 
https://bro-tracker.atlassian.net/browse/BIT-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305#comment-15305
 ] 

Robin Sommer commented on BIT-1119:
---

{quote}
have some script warn if all TCP connections are missing 100% of content and 
suggest toggling detect_filtered_trace
{quote}

I like that, is that something we can do efficiently?

{quote}
 But if it's actually not that important for a person using filtered traces to 
minimize output, I think it's fine enough as is?
{quote}

it's less the volume of output but the potential for confusion: one sees it and 
starts wondering what's wrong. It's easy to forget that TCP analysis gets 
confused because the trace is filtered. So if there was some way to point that 
out, that's all it would need. 

It's not a biggie but it's indeed in the same category like the checksums: 
something easy to get wrong without realizing what's going on, in particular 
because we're changing the default here.


> topic/jsiwek/tcp-improvements
> -
>
> Key: BIT-1119
> URL: https://bro-tracker.atlassian.net/browse/BIT-1119
> Project: Bro Issue Tracker
>  Issue Type: Improvement
>  Components: Bro
>Affects Versions: git/master
>Reporter: Jon Siwek
> Fix For: 2.3
>
>
> This branch is in the bro, bro-testing, and bro-testing-private repos and has 
> a few changes to improve reporting of TCP connection sizes and gaps (commit 
> messages explain in more detail).
> The baseline changes in the external repos all seemed reasonable/explainable 
> (or actually fix a problem).  There's too much changed to go through 
> case-by-case and actually check things, but I did do closer examinations of 
> unique differences as I came across them (e.g. try to corroborate Bro results 
> via wireshark).  Then for those that seem to follow the same trend as 
> something I already inspected, I wouldn't manually check.



--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)
___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1121) topic/dnthayer/test-improvements

2014-01-29 Thread Robin Sommer (JIRA)

 [ 
https://bro-tracker.atlassian.net/browse/BIT-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robin Sommer updated BIT-1121:
--

Resolution: Merged  (was: Fixed)
Status: Closed  (was: Merge Request)

> topic/dnthayer/test-improvements
> 
>
> Key: BIT-1121
> URL: https://bro-tracker.atlassian.net/browse/BIT-1121
> Project: Bro Issue Tracker
>  Issue Type: Problem
>  Components: BroControl
>Reporter: Daniel Thayer
> Fix For: 2.3
>
>
> Various improvements to the test build scripts to address some
> error scenarios and to provide convenience features (added a
> new makefile target "rerun" to more easily re-run failed tests,
> and scripts now recognize two new env. vars. to enable doing a
> non-standard build).  Improved the test diff canonifiers
> to do more thorough checking, and to workaround an issue in btest-diff
> which was causing some failed tests to not be reported as failed.
> Added lots of new tests (there are now 50% more test cases) to 
> fill in gaps in the test coverage.  Also improved many existing
> tests.



--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)
___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1120) Fix & extend x509_extension event

2014-01-29 Thread Robin Sommer (JIRA)

 [ 
https://bro-tracker.atlassian.net/browse/BIT-1120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robin Sommer updated BIT-1120:
--

Resolution: Merged  (was: Fixed)
Status: Closed  (was: Merge Request)

> Fix & extend x509_extension event
> -
>
> Key: BIT-1120
> URL: https://bro-tracker.atlassian.net/browse/BIT-1120
> Project: Bro Issue Tracker
>  Issue Type: Problem
>  Components: Bro
>Affects Versions: git/master, 2.2
>Reporter: Bernhard Amann
> Fix For: 2.3
>
>
> Please merge topic/bernhard/fix-x509-extension.
> This branch fixes and extends the x509_extension event, which was never 
> called in the previous implementation. The event now parses the extension 
> into a bro data structure. If supports printing it, it is converted into the 
> openssl ascii output, otherwise a raw hex-dump is output.
> New event syntax:
> event x509_extension(c: connection, is_orig: bool, cert:X509, extension: 
> X509_extension_info)
> Example output for extension:
>   [name=X509v3 Extended Key Usage,
> short_name=extendedKeyUsage,
> oid=2.5.29.37,
> critical=F,
> value=TLS Web Server Authentication, TLS Web Client Authentication]
>   [name=X509v3 Certificate Policies,
>short_name=certificatePolicies,
>oid=2.5.29.32,
>critical=F,
>value=Policy: 1.3.6.1.4.1.6449.1.2.1.3.4^J  CPS: 
> https://secure.comodo.com/CPS^J]



--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)
___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1119) topic/jsiwek/tcp-improvements

2014-01-29 Thread Seth Hall (JIRA)

 [ 
https://bro-tracker.atlassian.net/browse/BIT-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Seth Hall updated BIT-1119:
---

Attachment: signature.asc



We could probably do it similarly to how we're doing the detection of invalid 
checksums by sampling weirds for a little bit.  I also like this approach a 
lot.  I think that keeping the default settings of Bro working "correctly" in 
the normal case is good, but it's awesome to be able to notify people when 
things are failing and how they could fix it.



> topic/jsiwek/tcp-improvements
> -
>
> Key: BIT-1119
> URL: https://bro-tracker.atlassian.net/browse/BIT-1119
> Project: Bro Issue Tracker
>  Issue Type: Improvement
>  Components: Bro
>Affects Versions: git/master
>Reporter: Jon Siwek
> Fix For: 2.3
>
> Attachments: signature.asc
>
>
> This branch is in the bro, bro-testing, and bro-testing-private repos and has 
> a few changes to improve reporting of TCP connection sizes and gaps (commit 
> messages explain in more detail).
> The baseline changes in the external repos all seemed reasonable/explainable 
> (or actually fix a problem).  There's too much changed to go through 
> case-by-case and actually check things, but I did do closer examinations of 
> unique differences as I came across them (e.g. try to corroborate Bro results 
> via wireshark).  Then for those that seem to follow the same trend as 
> something I already inspected, I wouldn't manually check.



--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)
___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1119) topic/jsiwek/tcp-improvements

2014-01-29 Thread Jon Siwek (JIRA)

[ 
https://bro-tracker.atlassian.net/browse/BIT-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15307#comment-15307
 ] 

Jon Siwek commented on BIT-1119:


{quote}
it's less the volume of output but the potential for confusion: one sees it and 
starts wondering what's wrong. It's easy to forget that TCP analysis gets 
confused because the trace is filtered.
{quote}

I might be misremembering (or repressed the details of the TCP code), but isn't 
the TCP analysis *less* confused in the face of filtered traces with the 
change?  i.e. things are now most correct and it actually reports content gaps 
so e.g. missing_bytes fields for connections can be populated.

{quote}
but it's awesome to be able to notify people when things are failing and how 
they could fix it.
{quote}

I wouldn't say filtered traces fail due to the change, you just get more, 
possibly unexpected but not incorrect, output.

(I'm just trying to clarify perspective, not really against idea of sampling 
weirds to issue suggestion/warning)

> topic/jsiwek/tcp-improvements
> -
>
> Key: BIT-1119
> URL: https://bro-tracker.atlassian.net/browse/BIT-1119
> Project: Bro Issue Tracker
>  Issue Type: Improvement
>  Components: Bro
>Affects Versions: git/master
>Reporter: Jon Siwek
> Fix For: 2.3
>
> Attachments: signature.asc
>
>
> This branch is in the bro, bro-testing, and bro-testing-private repos and has 
> a few changes to improve reporting of TCP connection sizes and gaps (commit 
> messages explain in more detail).
> The baseline changes in the external repos all seemed reasonable/explainable 
> (or actually fix a problem).  There's too much changed to go through 
> case-by-case and actually check things, but I did do closer examinations of 
> unique differences as I came across them (e.g. try to corroborate Bro results 
> via wireshark).  Then for those that seem to follow the same trend as 
> something I already inspected, I wouldn't manually check.



--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)
___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1123) topic/jdopheid/bro/edits_to_installation_and_getting_started

2014-01-29 Thread Jeannette Dopheide (JIRA)
Jeannette Dopheide created BIT-1123:
---

 Summary: 
topic/jdopheid/bro/edits_to_installation_and_getting_started
 Key: BIT-1123
 URL: https://bro-tracker.atlassian.net/browse/BIT-1123
 Project: Bro Issue Tracker
  Issue Type: Improvement
  Components: Bro
Affects Versions: git/master
Reporter: Jeannette Dopheide


Minor grammar edits to Installation and Quick Start pages

Also, please let me know if I need to modify future JIRA tickets.

Thanks,
Jeannette



Repository : ssh://g...@bro-ids.icir.org/bro

On branch  : topic/jdopheid/bro/edits_to_installation_and_getting_started
Link   : 
https://github.com/bro/bro/commit/4c52c378d5873abb052d688251f0ec7f5aa1c514

And: 

Repository : ssh://g...@bro-ids.icir.org/bro

On branch  : topic/jdopheid/bro/edits_to_installation_and_getting_started
Link   : 
https://github.com/bro/bro/commit/af95026348688e0df8c867f67d2a53a3d440cf41




--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)
___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1123) topic/jdopheid/bro/edits_to_installation_and_getting_started

2014-01-29 Thread Jeannette Dopheide (JIRA)

 [ 
https://bro-tracker.atlassian.net/browse/BIT-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jeannette Dopheide updated BIT-1123:


Status: Merge Request  (was: Open)

> topic/jdopheid/bro/edits_to_installation_and_getting_started
> 
>
> Key: BIT-1123
> URL: https://bro-tracker.atlassian.net/browse/BIT-1123
> Project: Bro Issue Tracker
>  Issue Type: Improvement
>  Components: Bro
>Affects Versions: git/master
>Reporter: Jeannette Dopheide
>
> Minor grammar edits to Installation and Quick Start pages
> Also, please let me know if I need to modify future JIRA tickets.
> Thanks,
> Jeannette
> 
> Repository : ssh://g...@bro-ids.icir.org/bro
> On branch  : topic/jdopheid/bro/edits_to_installation_and_getting_started
> Link   : 
> https://github.com/bro/bro/commit/4c52c378d5873abb052d688251f0ec7f5aa1c514
> And: 
> Repository : ssh://g...@bro-ids.icir.org/bro
> On branch  : topic/jdopheid/bro/edits_to_installation_and_getting_started
> Link   : 
> https://github.com/bro/bro/commit/af95026348688e0df8c867f67d2a53a3d440cf41



--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)
___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1123) topic/jdopheid/bro/edits_to_installation_and_getting_started

2014-01-29 Thread Jeannette Dopheide (JIRA)

 [ 
https://bro-tracker.atlassian.net/browse/BIT-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jeannette Dopheide updated BIT-1123:


Fix Version/s: 2.3

> topic/jdopheid/bro/edits_to_installation_and_getting_started
> 
>
> Key: BIT-1123
> URL: https://bro-tracker.atlassian.net/browse/BIT-1123
> Project: Bro Issue Tracker
>  Issue Type: Improvement
>  Components: Bro
>Affects Versions: git/master
>Reporter: Jeannette Dopheide
> Fix For: 2.3
>
>
> Minor grammar edits to Installation and Quick Start pages
> Also, please let me know if I need to modify future JIRA tickets.
> Thanks,
> Jeannette
> 
> Repository : ssh://g...@bro-ids.icir.org/bro
> On branch  : topic/jdopheid/bro/edits_to_installation_and_getting_started
> Link   : 
> https://github.com/bro/bro/commit/4c52c378d5873abb052d688251f0ec7f5aa1c514
> And: 
> Repository : ssh://g...@bro-ids.icir.org/bro
> On branch  : topic/jdopheid/bro/edits_to_installation_and_getting_started
> Link   : 
> https://github.com/bro/bro/commit/af95026348688e0df8c867f67d2a53a3d440cf41



--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)
___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1125) topic/jsiwek/http-file-id-caching

2014-01-29 Thread Jon Siwek (JIRA)
Jon Siwek created BIT-1125:
--

 Summary: topic/jsiwek/http-file-id-caching
 Key: BIT-1125
 URL: https://bro-tracker.atlassian.net/browse/BIT-1125
 Project: Bro Issue Tracker
  Issue Type: Improvement
  Components: Bro
Affects Versions: git/master
Reporter: Jon Siwek
 Fix For: 2.3


This branch is in bro and bro-testing repos.  It adds a file ID caching / "fast 
path" mechanism to the file analysis API and adapts HTTP to use it for 
performance improvement.



--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)
___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1125) topic/jsiwek/http-file-id-caching

2014-01-29 Thread Jon Siwek (JIRA)

 [ 
https://bro-tracker.atlassian.net/browse/BIT-1125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jon Siwek updated BIT-1125:
---

Status: Merge Request  (was: Open)

> topic/jsiwek/http-file-id-caching
> -
>
> Key: BIT-1125
> URL: https://bro-tracker.atlassian.net/browse/BIT-1125
> Project: Bro Issue Tracker
>  Issue Type: Improvement
>  Components: Bro
>Affects Versions: git/master
>Reporter: Jon Siwek
> Fix For: 2.3
>
>
> This branch is in bro and bro-testing repos.  It adds a file ID caching / 
> "fast path" mechanism to the file analysis API and adapts HTTP to use it for 
> performance improvement.



--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)
___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [JIRA] (BIT-1124) process command misplaces custom scripts

2014-01-29 Thread Robin Sommer (JIRA)
Robin Sommer created BIT-1124:
-

 Summary: process command misplaces custom scripts
 Key: BIT-1124
 URL: https://bro-tracker.atlassian.net/browse/BIT-1124
 Project: Bro Issue Tracker
  Issue Type: Problem
  Components: BroControl
Affects Versions: 2.2
Reporter: Robin Sommer


{noformat}
# cat test.bro
@load base/utils/site
print Site::local_nets;
{noformat}

{{broctl  process trace.pcap test.bro}} gives:

{noformat}
error in /usr/local/bro-2.2/share/bro/policy/misc/loaded-scripts.bro, line 4: 
syntax error, at or near “module"
{noformat}

I believe it's due to test.bro being placed in the middle of the command line 
that {{process}} builds. If I move it to the end, it works fine.




--
This message was sent by Atlassian JIRA
(v6.2-OD-07-028#6211)

___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev


[Bro-Dev] [Auto] Merge Status

2014-01-29 Thread Merge Tracker

Open Merge Requests
===

IDComponentReporterAssigneeUpdated   For 
Version  PrioritySummary
  ---  --  --  --  
-  --  

BIT-1125 [1]  Bro  Jon Siwek   -   2014-01-29   
 2.3  Normal  topic/jsiwek/http-file-id-caching [2]
BIT-1123 [3]  Bro  Jeannette Dopheide  -   2014-01-29   
 2.3  Normal  topic/jdopheid/bro/edits_to_installation_and_getting_started 
[4]
BIT-1122 [5]  Bro  Jon Siwek   Seth Hall   2014-01-28   
 2.3  Normal  topic/jsiwek/dns-improvements [6]
BIT-1119 [7]  Bro  Jon Siwek   -   2014-01-29   
 2.3  Normal  topic/jsiwek/tcp-improvements [8]


Open Fastpath Commits
==

Commit   ComponentAuthor  DateSummary
---  ---  --  --  
-
62b3cb0 [9]  bro  Bernhard Amann  2014-01-28  Also use exec-module test 
to check for leaks.


[1]  BIT-1125   
https://bro-tracker.atlassian.net/browse/BIT-1125
[2]  http-file-id-caching   
https://github.com/bro/bro/tree/topic/jsiwek/http-file-id-caching
[3]  BIT-1123   
https://bro-tracker.atlassian.net/browse/BIT-1123
[4]  edits_to_installation_and_getting_started  
https://github.com/bro/bro/tree/topic/jdopheid/bro/edits_to_installation_and_getting_started
[5]  BIT-1122   
https://bro-tracker.atlassian.net/browse/BIT-1122
[6]  dns-improvements   
https://github.com/bro/bro/tree/topic/jsiwek/dns-improvements
[7]  BIT-1119   
https://bro-tracker.atlassian.net/browse/BIT-1119
[8]  tcp-improvements   
https://github.com/bro/bro/tree/topic/jsiwek/tcp-improvements
[9]  62b3cb0
https://github.com/bro/bro/commit/62b3cb0a5b7bdd8fed1d7d0dae3337115b2feae7

___
bro-dev mailing list
bro-dev@bro.org
http://mailman.icsi.berkeley.edu/mailman/listinfo/bro-dev