In light of this comment [1], I propose that we move forward with another Metron release and forgo the Metron Bro Plugin 0.3.0 release until we can resolve METRON-1910 [2]. There is no need to rush the fix as the current 0.2.0 release of the Bro Plugin is not impacted by the bug. We do have a good amount of other Metron functionality to release though. I do not see a need to hold-up the release.
--- [1] https://github.com/apache/metron-bro-plugin-kafka/pull/20#issuecomment-443481440 [2] https://github.com/apache/metron-bro-plugin-kafka/pull/20 On Thu, Nov 29, 2018 at 10:29 AM Justin Leet <justinjl...@gmail.com> wrote: > There's a few issues I would like to see at least triaged and preferably > addressed prior to the release of the main repo. In Jira, we have a > "test-failures" label, that has a few things attached to it. If we know of > any other Jiras that should have this label attached, please do so and I'd > appreciate it if you replied to the thread. See test-failures > < > https://issues.apache.org/jira/browse/METRON-1851?jql=project%20%3D%20METRON%20AND%20labels%20%3D%20test-failure > > > . > > The Jiras are: > METRON-1810 <https://issues.apache.org/jira/browse/METRON-1810> > METRON-1814 <https://issues.apache.org/jira/browse/METRON-1814> > METRON-1851 <https://issues.apache.org/jira/browse/METRON-1851> > > On Wed, Nov 21, 2018 at 2:20 PM zeo...@gmail.com <zeo...@gmail.com> wrote: > > > A metron-bro-plugin-kafka 0.3 release is good to go from my side. Thanks > > for all of the reviews Nick > > > > On Wed, Nov 21, 2018 at 11:16 AM Nick Allen <n...@nickallen.org> wrote: > > > > > Ha. Yes, that definitely counts and makes a ton of sense. Thanks! > > > > > > On Wed, Nov 21, 2018 at 11:00 AM Justin Leet <justinjl...@gmail.com> > > > wrote: > > > > > > > Does "I forgot to pull master fresh before running the command" count > > as > > > a > > > > reason? > > > > > > > > The missing Jiras are: > > > > > > > > METRON-1890 Metron Vagrant should disable audio (ottobackwards) > > > closes > > > > apache/metron#1277 > > > > METRON-1874 Create a Parser Debugger (nickwallen) closes > > > > apache/metron#1265 > > > > METRON-1880 Use Caffeine for Profiler Caching (nickwallen) closes > > > > apache/metron#1270 > > > > METRON-1877 Nested IF ELSE statements can cause parse errors in > > > Stellar > > > > (justinleet) closes apache/metron#1268 > > > > METRON-1872 Move rat plugin away from snapshot version > (justinleet) > > > > closes apache/metron#1264 > > > > > > > > On Wed, Nov 21, 2018 at 10:59 AM Nick Allen <n...@nickallen.org> > > wrote: > > > > > > > > > Also, I'd like to get this one included in the release. This is > > really > > > > > annoying for people just wanting to try out the Profiler. And this > > was > > > > > 'broken' after the last release, so there currently is no release > > with > > > > this > > > > > problem and I'd like to keep it that way. :) > > > > > > > > > > https://github.com/apache/metron/pull/1276 > > > > > > > > > > On Wed, Nov 21, 2018 at 10:11 AM Justin Leet < > justinjl...@gmail.com> > > > > > wrote: > > > > > > > > > > > Realized I'd never sent the updated list of Jiras. I changed the > > > > command > > > > > > slightly (to remove a clause I thought we'd already removed re: > > http, > > > > and > > > > > > added the awk to remove dupes resulting from multiple commits > for a > > > > > single > > > > > > Jira. I'll do a PR for these changes). > > > > > > > > > > > > *apache/metron* > > > > > > git log "master" "^tags/apache-metron-0.6.0-release" --no-merges > | > > > grep > > > > > -E > > > > > > "^[[:blank:]]+METRON" | sed 's/\[//g' | sed 's/\]//g' | awk > > > '!x[$1]++' > > > > > > METRON-1875 Expose configurable global settings in the Alerts > > UI > > > > > > (merrimanr) closes apache/metron#1266 > > > > > > METRON-1834: Migrate Elasticsearch from TransportClient to > new > > > Java > > > > > > REST API (mmiklavc via mmiklavc) closes apache/metron#1242 > > > > > > METRON-1749 Update Angular to latest release in Management UI > > > > > (sardell > > > > > > via nickwallen) closes apache/metron#1217 > > > > > > METRON-1870 Intermittent Stellar REST test failures > (merrimanr > > > via > > > > > > nickwallen) closes apache/metron#1263 > > > > > > METRON-1868 metron-committer-common incorrectly checking > > > REPO_NAME > > > > > > (JonZeolla via jonzeolla) closes apache/metron#1260 > > > > > > METRON-1740 Improve Palo Alto parser to handle CONFIG and > > SYSTEM > > > > > syslog > > > > > > messages (liuy-tnz via nickwallen) closes apache/metron#1171 > > > > > > METRON-1847 Create reusable script with functions from > > > > prepare-commit > > > > > > (ottobackwards) closes apache/metron#1248 > > > > > > METRON-1850 Stellar REST function (merrimanr) closes > > > > > apache/metron#1250 > > > > > > METRON-1858 BasicFireEyeParser check style cleanup and > > > optimization > > > > > > (ottobackwards) closes apache/metron#1255 > > > > > > METRON-1864 Stellar date format test fails after daylight > > saving > > > > > > (ottobackwards) closes apache/metron#1258 > > > > > > METRON-1861 METRON-1861: REST fails to start when LDAP > enabled > > > and > > > > > > 'Active Spring profiles' config is empty (anandsubbu via > > justinleet) > > > > > closes > > > > > > apache/metron#1256 > > > > > > METRON-1853: Add shutdown hook to Stellar > BaseFunctionResolver > > > > > > (mmiklavc via mmiklavc) closes apache/metron#1251 > > > > > > METRON-1857 Fix Metaalert Nested Alert Field Name in Index > > > Template > > > > > > (nickwallen) closes apache/metron#1253 > > > > > > METRON-1855: Make unified enrichment topology the default and > > > > > deprecate > > > > > > split-join (mmiklavc via mmiklavc) closes apache/metron#1252 > > > > > > METRON-1790 Unsubscribe from every observable in the pcap > panel > > > UI > > > > > > component (ruffle via nickwallen) closes apache/metron#1208 > > > > > > METRON-1803: Integrate Cypress with Travis (tiborm via > > mmiklavc) > > > > > closes > > > > > > apache/metron#1226 > > > > > > METRON-1844 Allow for LDAP to be used for authentication and > > > roles > > > > > > (justinleet) closes apache/metron#1246 > > > > > > METRON-1830 Re-implement Alerts dialog box without jQuery > > > (sardell > > > > > via > > > > > > merrimanr) closes apache/metron#1240 > > > > > > METRON-1826 Update librdkafka and devtoolset (JonZeolla via > > > > > jonzeolla) > > > > > > closes apache/metron#1238 > > > > > > METRON-1839 Install Elasticsearch MPack Step in Ansible Not > > > > > Idempotent > > > > > > (nickwallen) closes apache/metron#1244 > > > > > > METRON-1833: Management UI incorrectly displaying sensor > > topology > > > > > > latency units as seconds instead of millis (mmiklavc via > mmiklavc) > > > > closes > > > > > > apache/metron#1241 > > > > > > METRON-1829 Large Error Message Causes Slow Search > Performance > > > > > > (merrimanr) closes apache/metron#1239 > > > > > > METRON-1831 Project Version Substitution Not Working > > (nickwallen) > > > > > > closes apache/metron#1243 > > > > > > METRON-1816 Date format Stellar function (merrimanr) closes > > > > > > apache/metron#1233 > > > > > > METRON-1681 Decouple the ParserBolt from the Parse execution > > > logic > > > > > > (merrimanr) closes apache/metron#1213 > > > > > > METRON-1820 Update to new Simple-Syslog-5424 version to > support > > > > error > > > > > > handling (ottobackwards) closes apache/metron#1234 > > > > > > METRON-1805 Provide a default value for the Storm > > > > > > topology.max.spout.pending setting (merrimanr) closes > > > > apache/metron#1221 > > > > > > METRON-1821 Align prepare-release-candidate with > documentation > > > > > > (JonZeolla via jonzeolla) closes apache/metron#1236 > > > > > > METRON-1801 Allow Customization of Elasticsearch Document ID > > > > > > (nickwallen) closes apache/metron#1218 > > > > > > METRON-1799 Remove outdated bylaws from site. (justinleet) > > closes > > > > > > apache/metron#1216 > > > > > > METRON-1769 Script creation of a release candidate > (justinleet) > > > > > closes > > > > > > apache/metron#1188 > > > > > > METRON-1761 Allow a grok statement to be applied to each line > > in > > > a > > > > > > file. (ottobackwards) closes apache/metron#1184 > > > > > > METRON-1813 Stellar REPL Not Initialized with Client JAAS > > > > > (nickwallen) > > > > > > closes apache/metron#1232 > > > > > > METRON-1812: Fix dependencies_with_url.csv (mmiklavc via > > > mmiklavc) > > > > > > closes apache/metron#1230 > > > > > > METRON-1811 Alert Search Fails When Sorting by Alert Status > > > > > (merrimanr) > > > > > > closes apache/metron#1231 > > > > > > METRON-1809 Support Column Oriented Input with Batch Profiler > > > > > > (nickwallen) closes apache/metron#1229 > > > > > > METRON-1806: Upgrade Maven Shade Plugin version (mmiklavc via > > > > > mmiklavc) > > > > > > closes apache/metron#1224 > > > > > > METRON-1792 Simplify Profile Definitions in Integration Tests > > > > > > (nickwallen) closes apache/metron#1211 > > > > > > METRON-1807 Auto populate the recommended values to some of > the > > > > > metron > > > > > > config parameters (MohanDV via merrimanr) closes > > apache/metron#1227 > > > > > > METRON-1808 Add Ansible created pyc to gitignore (justinleet) > > > > closes > > > > > > apache/metron#1228 > > > > > > METRON-1695 Expose pcap properties through Ambari > (anandsubbu) > > > > closes > > > > > > apache/metron#1207 > > > > > > METRON-1771 Update REST endpoints to support eventually > > > consistent > > > > UI > > > > > > updates (merrimanr) closes apache/metron#1190 > > > > > > METRON-1791 Add GUID to Messages Produced by Profiler > > > (nickwallen) > > > > > > closes apache/metron#1210 > > > > > > METRON-1804 Update version to 0.6.1 (justinleet) closes > > > > > > apache/metron#1220 > > > > > > METRON-1798 Add mpack support for parser aggregation > > (anandsubbu) > > > > > > closes apache/metron#1215 > > > > > > METRON-1750 Create Parser for Syslog RFC 5424 Messages > > > > > (ottobackwards) > > > > > > closes apache/metron#1175 > > > > > > METRON-1794 Include User Details When Escalating Alerts > > > > (nickwallen) > > > > > > closes apache/metron#1212 > > > > > > METRON-1782 Add Kafka Partition and Offset to Profiler Debug > > Logs > > > > > > (nickwallen) closes apache/metron#1202 > > > > > > METRON-1758 Add support for Ansible 2.6 in dev (JonZeolla via > > > > > > jonzeolla) closes apache/metron#1179 > > > > > > METRON-1784: Re-allow remote ssh and scp in Centos full dev > > > > (mmiklavc > > > > > > via mmiklavc) closes apache/metron#1204 > > > > > > METRON-1787 Input Time Constraints for Batch Profiler > > > (nickwallen) > > > > > > closes apache/metron#1209 > > > > > > METRON-1508 In Ubuntu14 Dev Indexing Fails to Write to > > > > Elasticsearch > > > > > > (nickwallen) closes apache/metron#1185 > > > > > > METRON-1786 Pcap Topology Status Incorrect (MohanDV via > > > nickwallen) > > > > > > closes apache/metron#1206 > > > > > > METRON-1709 Add controls to start / stop the PCAP topology > from > > > > > Ambari. > > > > > > (MohanDV via nickwallen) closes apache/metron#1201 > > > > > > METRON-1759 PCAP UI: Removing wrong Input annotations from > pcap > > > > panel > > > > > > component (tiborm via nickwallen) closes apache/metron#1180 > > > > > > METRON-1772 Support alternative input formats in the Batch > > > Profiler > > > > > > (nickwallen) closes apache/metron#1191 > > > > > > METRON-1770 Add Docs for Running the Profiler with Spark on > > YARN > > > > > > (nickwallen) closes apache/metron#1189 > > > > > > METRON-1774 Allow user to configure JAAS client in Ambari > > > > > (nickwallen) > > > > > > closes apache/metron#1192 > > > > > > METRON-1760 Kill PCAP job should prompt for confirmation > > (ruffle > > > > via > > > > > > nickwallen) closes apache/metron#1199 > > > > > > METRON-1777: Fix Elasticsearch X-Pack sample pom in > > documentation > > > > > > (mmiklavc via mmiklavc) closes apache/metron#1196 > > > > > > METRON-1781 Fix RPM Spec File (nickwallen) closes > > > > apache/metron#1200 > > > > > > METRON-1780 Fix broken website images (justinleet) closes > > > > > > apache/metron#1198 > > > > > > METRON-1476 Update to Angular 6.1.3 (sardell via nickwallen) > > > closes > > > > > > apache/metron#1096 > > > > > > METRON-1776 Update public web site to point at 0.6.0 new > > release > > > > > > (justinleet) closes apache/metron#1195 > > > > > > METRON-1775 Transient exception could prevent expired > profiles > > > from > > > > > > being flushed (nickwallen) closes apache/metron#1194 > > > > > > METRON-1717 Relocate Storm Profiler Code (nickwallen) closes > > > > > > apache/metron#1187 > > > > > > METRON-1748 Improve Storm Profiler Integration Test > > (nickwallen) > > > > > closes > > > > > > apache/metron#1174 > > > > > > METRON-1741 Move REPL Port of Profiler to Separate Project > > > > > (nickwallen) > > > > > > closes apache/metron#1170 > > > > > > METRON-1715 Create DEB Packaging for Batch Profiler > > (nickwallen) > > > > > closes > > > > > > apache/metron#1167 > > > > > > METRON-1736 Enhance Batch Profiler Integration Test > > (nickwallen) > > > > > closes > > > > > > apache/metron#1162 > > > > > > METRON-1714 Create RPM Packaging for the Batch Profiler > > > > (nickwallen) > > > > > > closes apache/metron#1163 > > > > > > METRON-1708 Run the Batch Profiler in Spark (nickwallen) > closes > > > > > > apache/metron#1161 > > > > > > METRON-1707 Port Profiler to Spark (nickwallen) closes > > > > > > apache/metron#1150 > > > > > > METRON-1705 Create ProfilePeriod Using Period ID (nickwallen) > > > > closes > > > > > > apache/metron#1148 > > > > > > METRON-1706 HbaseClient.mutate should return the number of > > > > mutations > > > > > > (nickwallen) closes apache/metron#1147 > > > > > > METRON-1704 Message Timestamp Logic Should be Shared > > (nickwallen) > > > > > > closes apache/metron#1146 > > > > > > METRON-1703 Make Core Profiler Components Serializable > > > (nickwallen) > > > > > > closes apache/metron#1145 > > > > > > > > > > > > > > > > > > *apache/metron-bro-plugin-kafka* > > > > > > git log "master" > > "^tags/apache-metron-bro-plugin-kafka_0.2.0-release" > > > > > > --no-merges | grep -E "^[[:blank:]]+METRON" | sed 's/\[//g' | sed > > > > > 's/\]//g' > > > > > > | awk '!x[$1]++' > > > > > > METRON-1827 Update librdkafka in metron-bro-plugin-kafka > > > (JonZeolla > > > > > via > > > > > > jonzeolla) closes apache/metron-bro-plugin-kafka#13 > > > > > > METRON-1866 Improve metron-bro-plugin-kafka documentation > > > > (JonZeolla > > > > > > via jonzeolla) closes apache/metron-bro-plugin-kafka#17 > > > > > > METRON-1304 Allow metron-bro-plugin-kafka to include or > exclude > > > > logs > > > > > > (JonZeolla via nickwallen) closes > apache/metron-bro-plugin-kafka#2 > > > > > > METRON-1865 Fix metron-bro-plugin-kafka tests (JonZeolla via > > > > > jonzeolla) > > > > > > closes apache/metron-bro-plugin-kafka#16 > > > > > > METRON-1828 Improve bro plugin contributing documentation > > > > (JonZeolla) > > > > > > closes apache/metron-bro-plugin-kafka#14 > > > > > > METRON-1818 Remove config_files from bro-pkg.meta (JonZeolla) > > > > closes > > > > > > apache/metron-bro-plugin-kafka#11 > > > > > > METRON-1800 Increment metron-bro-plugin-kafka version > > (JonZeolla > > > > via > > > > > > jonzeolla) closes apache/metron-bro-plugin-kafka#10 > > > > > > METRON-1773 Bro plugin docs should refer to Apache Metron > > project > > > > > > (nickwallen) closes apache/metron-bro-plugin-kafka#9 > > > > > > > > > > > > On Sun, Nov 18, 2018 at 7:52 AM zeo...@gmail.com < > zeo...@gmail.com > > > > > > > > wrote: > > > > > > > > > > > > > I'm good with that release schedule, and using version 0.7.0 > for > > > the > > > > > > > apache/metron release. > > > > > > > > > > > > > > I opened up METRON-1881 and have a branch ready to PR for the > 0.3 > > > > > > > plugin upgrade. > > > > > > > > > > > > > > Jon > > > > > > > > > > > > > > On Fri, Nov 16, 2018 at 10:08 AM Otto Fowler < > > > > ottobackwa...@gmail.com> > > > > > > > wrote: > > > > > > > > > > > > > >> Can you generate the jiras that would be included in the > > release? > > > > > > >> > > > > > > >> > > > > > > >> On November 16, 2018 at 10:05:50, Justin Leet ( > > > > justinjl...@gmail.com) > > > > > > >> wrote: > > > > > > >> > > > > > > >> Given that we've had a couple major PRs (the ES client > migration > > > > along > > > > > > >> with > > > > > > >> the Angular upgrade stuff, and I'm sure others), I'd be in > favor > > > of > > > > > > >> releasing both the plugin and the main repo. > > > > > > >> > > > > > > >> I'd be in favor of doing something like: > > > > > > >> metron-bro-plugin-kafka release 0.3.0 > > > > > > >> PR to update full dev > > > > > > >> metron release 0.7.0 (given that things changed a good amount) > > > > > > >> > > > > > > >> I would also expect this process to most likely be kicked off > > post > > > > > > >> Thanksgiving break (Thursday 22nd and Friday 23rd for anybody > > not > > > in > > > > > the > > > > > > >> US). > > > > > > >> > > > > > > >> I can kick out another summarization thread if we want, but > > > > basically: > > > > > > >> * Nov 26 - Start the Bro plugin release process > > > > > > >> * Once that finishes, PR to update full dev with new plugin > > > version > > > > > > >> * Once PR is in, start metron release process (hopefully) > > sometime > > > > the > > > > > > >> week > > > > > > >> of the 3rd? > > > > > > >> > > > > > > >> Are there any objections to staggering the releases like that? > > > They > > > > > > could > > > > > > >> also be done together, but it means that we have to update > full > > > dev > > > > to > > > > > > >> match the plugin version post release. > > > > > > >> > > > > > > >> On Wed, Nov 14, 2018 at 10:29 AM zeo...@gmail.com < > > > zeo...@gmail.com > > > > > > > > > > > >> wrote: > > > > > > >> > > > > > > >> > In my opinion metron-bro-plugin-kafka is ready for a > release. > > > > > Anything > > > > > > >> > else people would want to see? Once it gets released, I > would > > > like > > > > > to > > > > > > >> > update full dev to use the newest version prior to any > future > > > > metron > > > > > > >> > release (0.6.1 or whatever we choose). > > > > > > >> > > > > > > > >> > Jon > > > > > > >> > > > > > > > >> > On Wed, Nov 7, 2018 at 8:07 PM zeo...@gmail.com < > > > zeo...@gmail.com > > > > > > > > > > > >> wrote: > > > > > > >> > > > > > > > >> > > So, about this release, anybody have time to review > > > > > > >> > > apache/metron-bro-plugin-kafka#2 and > > > > > > >> apache/metron-bro-plugin-kafka#13? > > > > > > >> > > > > > > > > >> > > Jon > > > > > > >> > > > > > > > > >> > > On Wed, Oct 17, 2018 at 10:37 AM Michael Miklavcic < > > > > > > >> > > michael.miklav...@gmail.com> wrote: > > > > > > >> > > > > > > > > >> > >> And I do think we will be ready to roll another Metron > > > release > > > > in > > > > > > the > > > > > > >> > near > > > > > > >> > >> future as well. > > > > > > >> > >> > > > > > > >> > >> On Wed, Oct 17, 2018 at 8:26 AM Justin Leet < > > > > > justinjl...@gmail.com > > > > > > > > > > > > > >> > >> wrote: > > > > > > >> > >> > > > > > > >> > >> > I tend to agree with Mike. I think we could do a > release > > of > > > > the > > > > > > >> main > > > > > > >> > >> > project and get benefit, but I think skipping this > cycle > > > > > > >> (especially > > > > > > >> > >> since > > > > > > >> > >> > we had a release last month) let's us get things like > the > > > ES > > > > > > client > > > > > > >> > >> > migration in and settled and just generally make > > > > recommending a > > > > > > >> newer > > > > > > >> > >> > version easier. > > > > > > >> > >> > > > > > > > >> > >> > The main reason for doing a release for the Bro plugin > is > > > to > > > > > > >> address > > > > > > >> > >> > shortcomings that we discovered and are addressing. > > > > > > >> > >> > > > > > > > >> > >> > On Tue, Oct 16, 2018 at 4:42 PM Michael Miklavcic < > > > > > > >> > >> > michael.miklav...@gmail.com> wrote: > > > > > > >> > >> > > > > > > > >> > >> > > Migrating the ES client, refactoring parser bolt. > There > > > are > > > > > > some > > > > > > >> > >> > interface > > > > > > >> > >> > > changes in flight right now that I think would be > > > > beneficial > > > > > to > > > > > > >> see > > > > > > >> > in > > > > > > >> > >> > the > > > > > > >> > >> > > next release. > > > > > > >> > >> > > > > > > > > >> > >> > > On Tue, Oct 16, 2018 at 2:01 PM Nick Allen < > > > > > n...@nickallen.org > > > > > > > > > > > > > >> > >> wrote: > > > > > > >> > >> > > > > > > > > >> > >> > > > I am in favor of a release for both. > > > > > > >> > >> > > > > > > > > > >> > >> > > > There are a lot of really useful bug fixes, > > management > > > of > > > > > > pcap > > > > > > >> > >> through > > > > > > >> > >> > > > Ambari, more flexibility for configuring JAAS in > > > Ambari, > > > > > > >> increased > > > > > > >> > >> > > > Elasticsearch performance, the Syslog parser, and > the > > > > Batch > > > > > > >> > >> Profiler, > > > > > > >> > >> > > among > > > > > > >> > >> > > > others. I would be happy with calling it a 0.6.1 > > point > > > > > > release. > > > > > > >> > >> > > > > > > > > > >> > >> > > > Mike - What is outstanding that you would like to > see > > > in > > > > > the > > > > > > >> > >> release? > > > > > > >> > >> > > > > > > > > > >> > >> > > > On Tue, Oct 16, 2018, 12:21 PM Michael Miklavcic < > > > > > > >> > >> > > > michael.miklav...@gmail.com> wrote: > > > > > > >> > >> > > > > > > > > > >> > >> > > > > I'd be +1 on going with just the > > > > metron-bro-kafka-plugin > > > > > > >> > release. > > > > > > >> > >> It > > > > > > >> > >> > > > seems > > > > > > >> > >> > > > > like it's ready to go, and I think there are a > few > > > more > > > > > > >> things > > > > > > >> > I'd > > > > > > >> > >> > like > > > > > > >> > >> > > > to > > > > > > >> > >> > > > > see get into our next Metron release so I'm good > > with > > > > > > holding > > > > > > >> > off > > > > > > >> > >> > > there. > > > > > > >> > >> > > > > > > > > > > >> > >> > > > > Mike > > > > > > >> > >> > > > > > > > > > > >> > >> > > > > On Tue, Oct 16, 2018 at 10:26 AM Justin Leet < > > > > > > >> > >> justinjl...@gmail.com> > > > > > > >> > >> > > > > wrote: > > > > > > >> > >> > > > > > > > > > > >> > >> > > > > > Hi all, > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > As you might recall from a prior discussion > about > > > > > release > > > > > > >> > >> cadence, > > > > > > >> > >> > we > > > > > > >> > >> > > > > were > > > > > > >> > >> > > > > > interested in initiating release threads near > our > > > > board > > > > > > >> > reports > > > > > > >> > >> to > > > > > > >> > >> > > see > > > > > > >> > >> > > > if > > > > > > >> > >> > > > > > we wanted to do releases or not. Additionally, > > the > > > > work > > > > > > is > > > > > > >> > done > > > > > > >> > >> to > > > > > > >> > >> > do > > > > > > >> > >> > > > two > > > > > > >> > >> > > > > > separate releases, so our options are releasing > > > > both, a > > > > > > >> single > > > > > > >> > >> one, > > > > > > >> > >> > > or > > > > > > >> > >> > > > > > neither. > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > Having said that, a metron-bro-kafka-plugin > 0.3.0 > > > > > release > > > > > > >> came > > > > > > >> > >> up > > > > > > >> > >> > on > > > > > > >> > >> > > > this > > > > > > >> > >> > > > > > thread > > > > > > >> > >> > > > > > < > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > > > > > > >> > >> > > > > > > > > > >> > >> > > > > > > > > >> > >> > > > > > > > >> > >> > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > https://lists.apache.org/thread.html/3c18c3aba6b436b11032831e7db541d50eb7cb1e3ae54b7423057c88@%3Cdev.metron.apache.org%3E > > > > > > >> > >> > > > > > >. > > > > > > >> > >> > > > > > In particular, the prospect of a release came > up > > in > > > > the > > > > > > >> > context > > > > > > >> > >> of > > > > > > >> > >> > > > > having a > > > > > > >> > >> > > > > > version with better (and working) testing. > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > Version Number > > > > > > >> > >> > > > > > If we choose to do a core Metron release, I > > propose > > > > > > 0.6.1. > > > > > > >> For > > > > > > >> > >> > > > > > metron-bro-kafka-plugin, I propose 0.3.0. Keep > in > > > > mind, > > > > > > the > > > > > > >> > >> > > versioning > > > > > > >> > >> > > > > for > > > > > > >> > >> > > > > > the plugin is a bit different in that we need > x.y > > > for > > > > > > >> bro-pkg, > > > > > > >> > >> > > instead > > > > > > >> > >> > > > of > > > > > > >> > >> > > > > > x.y.z, so we wouldn't release 0.2.1. > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > I would personally be in favor of doing a > plugin > > > > > release, > > > > > > >> but > > > > > > >> > >> I'm > > > > > > >> > >> > > less > > > > > > >> > >> > > > > > inclined to do a core Metron release. > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > For Metron, I believe the main feature is the > > batch > > > > > > >> profiler > > > > > > >> > >> work, > > > > > > >> > >> > > but > > > > > > >> > >> > > > > > there's a fair amount of fixes and > improvements. > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > For the plugin, I believe the main improvements > > > would > > > > > be > > > > > > >> > around > > > > > > >> > >> the > > > > > > >> > >> > > > > fixing > > > > > > >> > >> > > > > > our testing and more maintenance type work. > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > JIRA status > > > > > > >> > >> > > > > > *metron* > > > > > > >> > >> > > > > > There are 24 opens PRs at > > > > > > >> > >> https://github.com/apache/metron/pulls. > > > > > > >> > >> > > If > > > > > > >> > >> > > > we > > > > > > >> > >> > > > > > do > > > > > > >> > >> > > > > > decide to release, we should work on getting > > > anything > > > > > > >> meriting > > > > > > >> > >> > > > inclusion > > > > > > >> > >> > > > > > closed out. > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > There have been 49 commits since the 0.6.0 > > release > > > > > > (listed > > > > > > >> at > > > > > > >> > >> the > > > > > > >> > >> > end > > > > > > >> > >> > > > of > > > > > > >> > >> > > > > > the message). This assumes a release from > master. > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > *metron-bro-kafka-plugin* > > > > > > >> > >> > > > > > There are 6 open PRs at > > > > > > >> > >> > > > > > > > > > > https://github.com/apache/metron-bro-plugin-kafka/pulls. > > > > > > >> If > > > > > > >> > >> we do > > > > > > >> > >> > > > > decide > > > > > > >> > >> > > > > > to release, we should get anything we need > closed > > > > out. > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > There have been 2 commits since the 0.2.0 > release > > > > > (listed > > > > > > >> at > > > > > > >> > the > > > > > > >> > >> > end > > > > > > >> > >> > > of > > > > > > >> > >> > > > > the > > > > > > >> > >> > > > > > message). This assumes a release from master. > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > *Metron changelog* > > > > > > >> > >> > > > > > METRON-1801 Allow Customization of > Elasticsearch > > > > > Document > > > > > > >> > ID > > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1218 > > > > > > >> > >> > > > > > METRON-1799 Remove outdated bylaws from site. > > > > > > (justinleet) > > > > > > >> > >> > closes > > > > > > >> > >> > > > > > apache/metron#1216 > > > > > > >> > >> > > > > > METRON-1769 Script creation of a release > > candidate > > > > > > >> > >> (justinleet) > > > > > > >> > >> > > > > closes > > > > > > >> > >> > > > > > apache/metron#1188 > > > > > > >> > >> > > > > > METRON-1761 Allow a grok statement to be > applied > > to > > > > > each > > > > > > >> > >> line > > > > > > >> > >> > in > > > > > > >> > >> > > a > > > > > > >> > >> > > > > > file. (ottobackwards) closes apache/metron#1184 > > > > > > >> > >> > > > > > METRON-1813 Stellar REPL Not Initialized with > > > Client > > > > > JAAS > > > > > > >> > >> > > > > (nickwallen) > > > > > > >> > >> > > > > > closes apache/metron#1232 > > > > > > >> > >> > > > > > METRON-1812: Fix dependencies_with_url.csv > > > (mmiklavc > > > > > via > > > > > > >> > >> > > mmiklavc) > > > > > > >> > >> > > > > > closes apache/metron#1230 > > > > > > >> > >> > > > > > METRON-1811 Alert Search Fails When Sorting by > > > Alert > > > > > > >> > Status > > > > > > >> > >> > > > > (merrimanr) > > > > > > >> > >> > > > > > closes apache/metron#1231 > > > > > > >> > >> > > > > > METRON-1809 Support Column Oriented Input with > > > Batch > > > > > > >> > >> Profiler > > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1229 > > > > > > >> > >> > > > > > METRON-1806: Upgrade Maven Shade Plugin version > > > > > (mmiklavc > > > > > > >> > >> via > > > > > > >> > >> > > > > mmiklavc) > > > > > > >> > >> > > > > > closes apache/metron#1224 > > > > > > >> > >> > > > > > METRON-1792 Simplify Profile Definitions in > > > > Integration > > > > > > >> > >> Tests > > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1211 > > > > > > >> > >> > > > > > METRON-1807 Auto populate the recommended > values > > to > > > > > some > > > > > > >> > of > > > > > > >> > >> the > > > > > > >> > >> > > > > metron > > > > > > >> > >> > > > > > config parameters (MohanDV via merrimanr) > closes > > > > > > >> > >> > apache/metron#1227 > > > > > > >> > >> > > > > > METRON-1808 Add Ansible created pyc to > gitignore > > > > > > >> > >> (justinleet) > > > > > > >> > >> > > > closes > > > > > > >> > >> > > > > > apache/metron#1228 > > > > > > >> > >> > > > > > METRON-1695 Expose pcap properties through > Ambari > > > > > > >> > >> (anandsubbu) > > > > > > >> > >> > > > closes > > > > > > >> > >> > > > > > apache/metron#1207 > > > > > > >> > >> > > > > > METRON-1771 Update REST endpoints to support > > > > eventually > > > > > > >> > >> > > consistent > > > > > > >> > >> > > > UI > > > > > > >> > >> > > > > > updates (merrimanr) closes apache/metron#1190 > > > > > > >> > >> > > > > > METRON-1791 Add GUID to Messages Produced by > > > Profiler > > > > > > >> > >> > > (nickwallen) > > > > > > >> > >> > > > > > closes apache/metron#1210 > > > > > > >> > >> > > > > > METRON-1804 Update version to 0.6.1 > (justinleet) > > > > closes > > > > > > >> > >> > > > > > apache/metron#1220 > > > > > > >> > >> > > > > > METRON-1798 Add mpack support for parser > > > aggregation > > > > > > >> > >> > (anandsubbu) > > > > > > >> > >> > > > > > closes apache/metron#1215 > > > > > > >> > >> > > > > > METRON-1750 Create Parser for Syslog RFC 5424 > > > > Messages > > > > > > >> > >> > > > > (ottobackwards) > > > > > > >> > >> > > > > > closes apache/metron#1175 > > > > > > >> > >> > > > > > METRON-1794 Include User Details When > Escalating > > > > Alerts > > > > > > >> > >> > > > (nickwallen) > > > > > > >> > >> > > > > > closes apache/metron#1212 > > > > > > >> > >> > > > > > METRON-1782 Add Kafka Partition and Offset to > > > > Profiler > > > > > > >> > Debug > > > > > > >> > >> > Logs > > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1202 > > > > > > >> > >> > > > > > METRON-1758 Add support for Ansible 2.6 in dev > > > > > (JonZeolla > > > > > > >> > >> via > > > > > > >> > >> > > > > > jonzeolla) closes apache/metron#1179 > > > > > > >> > >> > > > > > METRON-1784: Re-allow remote ssh and scp in > > Centos > > > > full > > > > > > >> > dev > > > > > > >> > >> > > > (mmiklavc > > > > > > >> > >> > > > > > via mmiklavc) closes apache/metron#1204 > > > > > > >> > >> > > > > > METRON-1787 Input Time Constraints for Batch > > > Profiler > > > > > > >> > >> > > (nickwallen) > > > > > > >> > >> > > > > > closes apache/metron#1209 > > > > > > >> > >> > > > > > METRON-1508 In Ubuntu14 Dev Indexing Fails to > > Write > > > > to > > > > > > >> > >> > > > Elasticsearch > > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1185 > > > > > > >> > >> > > > > > METRON-1786 Pcap Topology Status Incorrect > > (MohanDV > > > > via > > > > > > >> > >> > > nickwallen) > > > > > > >> > >> > > > > > closes apache/metron#1206 > > > > > > >> > >> > > > > > METRON-1709 Add controls to start / stop the > PCAP > > > > > > topology > > > > > > >> > >> from > > > > > > >> > >> > > > > Ambari. > > > > > > >> > >> > > > > > (MohanDV via nickwallen) closes > > apache/metron#1201 > > > > > > >> > >> > > > > > METRON-1759 PCAP UI: Removing wrong Input > > > annotations > > > > > > from > > > > > > >> > >> pcap > > > > > > >> > >> > > > panel > > > > > > >> > >> > > > > > component (tiborm via nickwallen) closes > > > > > > apache/metron#1180 > > > > > > >> > >> > > > > > METRON-1772 Support alternative input formats > in > > > the > > > > > > Batch > > > > > > >> > >> > > Profiler > > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1191 > > > > > > >> > >> > > > > > METRON-1770 Add Docs for Running the Profiler > > with > > > > > Spark > > > > > > >> > on > > > > > > >> > >> > YARN > > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1189 > > > > > > >> > >> > > > > > METRON-1774 Allow user to configure JAAS client > > in > > > > > Ambari > > > > > > >> > >> > > > > (nickwallen) > > > > > > >> > >> > > > > > closes apache/metron#1192 > > > > > > >> > >> > > > > > METRON-1760 Kill PCAP job should prompt for > > > > > confirmation > > > > > > >> > >> > (ruffle > > > > > > >> > >> > > > via > > > > > > >> > >> > > > > > nickwallen) closes apache/metron#1199 > > > > > > >> > >> > > > > > METRON-1777: Fix Elasticsearch X-Pack sample > pom > > in > > > > > > >> > >> > documentation > > > > > > >> > >> > > > > > (mmiklavc via mmiklavc) closes > apache/metron#1196 > > > > > > >> > >> > > > > > METRON-1781 Fix RPM Spec File (nickwallen) > closes > > > > > > >> > >> > > > apache/metron#1200 > > > > > > >> > >> > > > > > METRON-1780 Fix broken website images > > (justinleet) > > > > > closes > > > > > > >> > >> > > > > > apache/metron#1198 > > > > > > >> > >> > > > > > METRON-1476 Update to Angular 6.1.3 (sardell > via > > > > > > >> > nickwallen) > > > > > > >> > >> > > closes > > > > > > >> > >> > > > > > apache/metron#1096 > > > > > > >> > >> > > > > > METRON-1776 Update public web site to point at > > > 0.6.0 > > > > > new > > > > > > >> > >> > release > > > > > > >> > >> > > > > > (justinleet) closes apache/metron#1195 > > > > > > >> > >> > > > > > METRON-1775 Transient exception could prevent > > > expired > > > > > > >> > >> profiles > > > > > > >> > >> > > from > > > > > > >> > >> > > > > > being flushed (nickwallen) closes > > > apache/metron#1194 > > > > > > >> > >> > > > > > METRON-1717 Relocate Storm Profiler Code > > > (nickwallen) > > > > > > >> > closes > > > > > > >> > >> > > > > > apache/metron#1187 > > > > > > >> > >> > > > > > METRON-1748 Improve Storm Profiler Integration > > Test > > > > > > >> > >> > (nickwallen) > > > > > > >> > >> > > > > closes > > > > > > >> > >> > > > > > apache/metron#1174 > > > > > > >> > >> > > > > > METRON-1741 Move REPL Port of Profiler to > > Separate > > > > > > Project > > > > > > >> > >> > > > > (nickwallen) > > > > > > >> > >> > > > > > closes apache/metron#1170 > > > > > > >> > >> > > > > > METRON-1715 Create DEB Packaging for Batch > > Profiler > > > > > > >> > >> > (nickwallen) > > > > > > >> > >> > > > > closes > > > > > > >> > >> > > > > > apache/metron#1167 > > > > > > >> > >> > > > > > METRON-1736 Enhance Batch Profiler Integration > > Test > > > > > > >> > >> > (nickwallen) > > > > > > >> > >> > > > > closes > > > > > > >> > >> > > > > > apache/metron#1162 > > > > > > >> > >> > > > > > METRON-1714 Create RPM Packaging for the Batch > > > > Profiler > > > > > > >> > >> > > > (nickwallen) > > > > > > >> > >> > > > > > closes apache/metron#1163 > > > > > > >> > >> > > > > > METRON-1708 Run the Batch Profiler in Spark > > > > > (nickwallen) > > > > > > >> > >> closes > > > > > > >> > >> > > > > > apache/metron#1161 > > > > > > >> > >> > > > > > METRON-1707 Port Profiler to Spark (nickwallen) > > > > closes > > > > > > >> > >> > > > > > apache/metron#1150 > > > > > > >> > >> > > > > > METRON-1705 Create ProfilePeriod Using Period > ID > > > > > > >> > >> (nickwallen) > > > > > > >> > >> > > > closes > > > > > > >> > >> > > > > > apache/metron#1148 > > > > > > >> > >> > > > > > METRON-1706 HbaseClient.mutate should return > the > > > > number > > > > > > of > > > > > > >> > >> > > > mutations > > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1147 > > > > > > >> > >> > > > > > METRON-1704 Message Timestamp Logic Should be > > > Shared > > > > > > >> > >> > (nickwallen) > > > > > > >> > >> > > > > > closes apache/metron#1146 > > > > > > >> > >> > > > > > METRON-1703 Make Core Profiler Components > > > > Serializable > > > > > > >> > >> > > (nickwallen) > > > > > > >> > >> > > > > > closes apache/metron#1145 > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > *Metron-bro-kafka-plugin changelog* > > > > > > >> > >> > > > > > METRON-1800 Increment metron-bro-plugin-kafka > > > version > > > > > > >> > >> > (JonZeolla > > > > > > >> > >> > > > via > > > > > > >> > >> > > > > > jonzeolla) closes > > apache/metron-bro-plugin-kafka#10 > > > > > > >> > >> > > > > > METRON-1773 Bro plugin docs should refer to > > Apache > > > > > Metron > > > > > > >> > >> > project > > > > > > >> > >> > > > > > (nickwallen) closes > > > apache/metron-bro-plugin-kafka#9 > > > > > > >> > >> > > > > > > > > > > > >> > >> > > > > > > > > > > >> > >> > > > > > > > > > >> > >> > > > > > > > > >> > >> > > > > > > > >> > >> > > > > > > >> > > -- > > > > > > >> > > > > > > > > >> > > Jon Zeolla > > > > > > >> > > > > > > > > >> > -- > > > > > > >> > > > > > > > >> > Jon Zeolla > > > > > > >> > > > > > > > >> > > > > > > > -- > > > > > > > > > > > > > > Jon Zeolla > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > Jon Zeolla > > >