Can I advocate to get METRON-1129 in the RC, and throw in a second vote for METRON-1134? Both in an attempt to better support of prod/offline use. Happy to provide testing cycles for the former.
Jon On Wed, Aug 30, 2017 at 11:41 AM Anand Subramanian < asubraman...@hortonworks.com> wrote: > Hi Matt, > > This defect needs to be included as a follow-on to METRON-1122: > * METRON-1141 (https://github.com/apache/metron/pull/723) > > > Thanks, > Anand > > > > On 8/30/17, 8:57 PM, "Michael Miklavcic" <michael.miklav...@gmail.com> > wrote: > > >I have some work around fixing how we handle config with Ambari that I'd > >like to see go in. No PR yet, but coming soon. I expect to have this by > the > >RC deadline. > > > >Mike > > > >On Wed, Aug 30, 2017 at 8:57 AM, Nick Allen <n...@nickallen.org> wrote: > > > >> The following PRs are usability enhancements for the Profiler. They are > >> fairly simple and I think are very helpful for troubleshooting. I don't > >> want to hold up the release, but it would be a "nice to have" to get > these > >> in. > >> > >> If anyone has cycles, I would appreciate some reviews of these PRs. > >> https://github.com/apache/metron/pull/721 > >> https://github.com/apache/metron/pull/716 > >> > >> > >> > >> On Tue, Aug 29, 2017 at 8:59 PM Matt Foley <ma...@apache.org> wrote: > >> > >> > Okay, just to be clear, you’re requesting we wait until Friday, if > >> > necessary, to cut an RC with 717 in it? > >> > Thanks, > >> > --Matt > >> > > >> > On 8/29/17, 11:45 AM, "Casey Stella" <ceste...@gmail.com> wrote: > >> > > >> > 709 is in and 717 is under concerted review by Otto. I'd like to > see > >> > it in > >> > by Friday. > >> > > >> > On Tue, Aug 29, 2017 at 1:35 PM, Matt Foley <ma...@apache.org> > >> wrote: > >> > > >> > > Hi all, > >> > > Thanks for your inputs. The three PRs Nick mentioned have been > >> > > successfully closed. > >> > > Casey, do you have an ETA for these two PRs? (PR#709 and 717) > >> > > Thanks, > >> > > --Matt > >> > > > >> > > On 8/29/17, 9:34 AM, "Casey Stella" <ceste...@gmail.com> wrote: > >> > > > >> > > For my PRs, I'd vote for METRON-1122 being in (commit very > >> > imminent). > >> > > I'd very much like METRON-1134 to be in as well. > >> > > > >> > > Beyond that, I'm ok > >> > > > >> > > On Tue, Aug 22, 2017 at 4:37 PM, Nick Allen < > >> n...@nickallen.org> > >> > > wrote: > >> > > > >> > > > Thanks for starting the process, Matt. > >> > > > > >> > > > These are my own open PRs that I would most like to see > get > >> in. > >> > > They all > >> > > > relate to the Profiler. My other outstanding PRs are less > >> > important. > >> > > > > >> > > > - https://github.com/apache/metron/pull/705 > >> > > > - https://github.com/apache/metron/pull/707 > >> > > > - https://github.com/apache/metron/pull/708 > >> > > > > >> > > > > >> > > > > >> > > > > >> > > > > >> > > > On Tue, Aug 22, 2017 at 4:17 PM Matt Foley < > ma...@apache.org > >> > > >> > wrote: > >> > > > > >> > > > > Hello all, > >> > > > > At the meeting this morning, the community expressed the > >> > wish to > >> > > create a > >> > > > > new release, to be a point release and not including > >> > METRON-777. > >> > > > > > >> > > > > Therefore, I propose to create release 0.4.1 from Metron > >> > master > >> > > branch, > >> > > > > with whatever additional commits the community considers > >> > vital and > >> > > can > >> > > > get > >> > > > > in in the next few days. > >> > > > > > >> > > > > There have been 74 commits since the 0.4.0 release (list > >> > appended > >> > > to end > >> > > > > of this message). > >> > > > > I have not yet done a compare to make sure all 74 > completed > >> > > commits have > >> > > > > closed their Jiras, but I will follow up with that info. > >> > > > > > >> > > > > There are 35 open PRs, see > >> > https://github.com/apache/metron/pulls > >> > > , > >> > > > which > >> > > > > is getting a little clunky. Surely not all of them can > get > >> > in in > >> > > the > >> > > > next > >> > > > > few days, but do we want to try to close and include > some > >> of > >> > them? > >> > > > > > >> > > > > Please respond to the list with your requests to include > >> > specific > >> > > > > additional PRs before we cut the 0.4.1 release > candidate. > >> > Let’s > >> > > keep it > >> > > > > practical so we don’t delay more than a week or so. > >> > > > > > >> > > > > TIMEFRAME: Tentatively I would like to start the > process > >> of > >> > > cutting an > >> > > > RC > >> > > > > this coming Monday 28 August. If we have too many PRs > >> > required to > >> > > be in, > >> > > > > we may have to slip that. Likewise, if there is need > for > >> > urgency, > >> > > I can > >> > > > > start as soon as tomorrow. We will be guided by your > >> > responses. > >> > > > > > >> > > > > Thanks, > >> > > > > --Matt > >> > > > > (Release Manager) > >> > > > > > >> > > > > COMPLETED PRs as of 22 Aug 2017: > >> > > > > METRON-1115 Jackson is not properly serializing > >> > readMetadata > >> > > and > >> > > > > mergeMetadata SensorParserConfig properties (merrimanr) > >> > closes > >> > > > > apache/metron#703 > >> > > > > METRON-1047 REST should use core-site.xml for Hadoop > >> > > configuration > >> > > > > (merrimanr) closes apache/metron#672 > >> > > > > METRON-1111 Mislabeled Configuration Property in > Ambari > >> > > (nickwallen) > >> > > > > closes apache/metron#698 > >> > > > > METRON-1113 UpdateControllerIntegrationTest fails > with > >> > 500 > >> > > error > >> > > > > (merrimanr) closes apache/metron#701 > >> > > > > METRON-711 StellarShell assigns variables even if an > >> > exception > >> > > was > >> > > > > thrown in the statement. (ottobackwards) closes > >> > apache/metron#686 > >> > > > > METRON-1110 REST jvm flags property is being > >> overwritten > >> > when > >> > > > Kerberos > >> > > > > is enabled (merrimanr) closes apache/metron#697 > >> > > > > METRON-739 Create Local Profile Runner (nickwallen) > >> > closes > >> > > > > apache/metron#693 > >> > > > > METRON-1109 Indexing topology fails to start after > >> > Kerberos is > >> > > > enabled > >> > > > > (merrimanr) closes apache/metron#696 > >> > > > > METRON-1108 Metron configuration tabs are not > showing > >> up > >> > in > >> > > Ambari > >> > > > > this closes apache/incubator-metron#695 > >> > > > > METRON-1078 Metron Indexing fails to stop during > >> > "Stop All > >> > > > > Services" (dlyle65535) closes apache/metron#680 > >> > > > > METRON-1104 Build Failure - Due to Bootstrap version > >> > change > >> > > > > (iraghumitra via justinleet) closes apache/metron#691 > >> > > > > METRON-1094 MaaS will not start due to classpath > error > >> > > relating to > >> > > > > Yarn closes apache/incubator-metron#688 > >> > > > > METRON-1102 Add support for ingesting cybox URI > >> > observables > >> > > from > >> > > > taxii > >> > > > > feeds closes apache/incubator-metron#689 > >> > > > > METRON-838 Incorrect set of ts in FireEye parser > >> (bjigmp > >> > via > >> > > > > justinleet) closes apache/metron#528 > >> > > > > METRON-322 Global Batching and Flushing > (mattf-horton) > >> > closes > >> > > > > apache/metron#481 > >> > > > > METRON-988 UI for viewing alerts generated by Metron > >> > > (iraghumitra > >> > > > via > >> > > > > nickwallen) closes apache/metron#620 > >> > > > > METRON-1084 Management UI web server license should > be > >> > Apache > >> > > > > (merrimanr) closes apache/metron#683 > >> > > > > METRON-1026 threatintel_taxii_load.sh throws > exception > >> > closes > >> > > > > apache/incubator-metron#643 > >> > > > > METRON-1051 Enable the ability to update indexed > >> messages > >> > > closes > >> > > > > apache/incubator-metron#666 > >> > > > > METRON-1069 Ambari MPack documentation around > >> development > >> > > strategies > >> > > > > (justinleet) closes apache/metron#1069 > >> > > > > METRON-1069 Ambari MPack documentation around > >> development > >> > > strategies > >> > > > > (merrimanr via justinleet) closes apache/metron#1069 > >> > > > > METRON-1069 Ambari MPack documentation around > >> development > >> > > strategies > >> > > > > (justinleet) closes apache/metron#1069 > >> > > > > METRON-1076 Management UI status check always > reports > >> the > >> > > service as > >> > > > > running (merrimanr) closes apache/metron#678 > >> > > > > METRON-1075 Add faceted search capabilities > (merrimanr) > >> > closes > >> > > > > apache/metron#679 > >> > > > > METRON-379 Stellar - No Error When Adding Variables > >> That > >> > Do > >> > > Not Exist > >> > > > > (ottobackwards) closes apache/metron#675 > >> > > > > METRON-1038 Stellar should have a better collection > of > >> > basic > >> > > math > >> > > > > operations closes apache/incubator-metron#650 > >> > > > > METRON-1072 Cleanup Maven build warnings (mmiklavc) > >> > closes > >> > > > > apache/metron#676 > >> > > > > METRON-1056 Get field types from Elasticsearch > >> > (merrimanr) > >> > > closes > >> > > > > apache/metron#662 > >> > > > > METRON-1011 Stellar ENRICHMENT functions should > enforce > >> > > submission of > >> > > > > 4 parameters (jasper-k via ottobackwards) closes > >> > apache/metron#628 > >> > > > > METRON-975 Normalize logging and switch to common > idiom > >> > with > >> > > SLF4J > >> > > > > (mmiklavc) closes apache/metron#599 > >> > > > > METRON-681 CSVConverter should trim values (basvdl > via > >> > > ottobackwards) > >> > > > > closes apache/metron#674 > >> > > > > METRON-746 Build Custom Checkstyle and IDE > formatting > >> > settings > >> > > > > (justinleet via mmiklavc) closes apache/metron#577 > >> > > > > METRON-1060 Add performance timing logging to > >> enrichment > >> > > topology > >> > > > > (mmiklavc) closes apache/metron#665 > >> > > > > METRON-982 REST STORM Support for supervisor summary > >> > > (ottobackwards) > >> > > > > closes apache/metron#607 > >> > > > > METRON-1064 Make init script OS-agnostic (merrimanr) > >> > closes > >> > > > > apache/metron#669 > >> > > > > METRON-984 Create STELLAR Decoding Functions > >> > (ottobackwards) > >> > > closes > >> > > > > apache/metron#642 > >> > > > > METRON-1067 Minor typo in documentation > (spencer-hanson > >> > via > >> > > > > justinleet) closes apache/metron#671 > >> > > > > METRON-1018 Integration tests should reference flux > >> yaml > >> > and > >> > > property > >> > > > > files deployed by Ambari (merrimanr) closes > >> apache/metron#635 > >> > > > > METRON-1050 Improve Docs of > `profiler.period.duration` > >> > > (nickwallen) > >> > > > > closes apache/metron#656 > >> > > > > METRON-1043 Profiler Should be Less Dramatic When > >> Missing > >> > > > > Configuration (nickwallen) closes apache/metron#655 > >> > > > > METRON-1053 Relocate Metron Docker (nickwallen) > closes > >> > > > > apache/metron#659 > >> > > > > METRON-1058 address checkstyle warnings for > >> > UnusedImports in > >> > > > > metron-stellar (dbist via ottobackwards) closes > >> > apache/metron#663 > >> > > > > METRON-1035 Added SUM to the rules triage > aggregation > >> > docs > >> > > closes > >> > > > > apache/incubator-metron#649 > >> > > > > METRON-1039 Add ZIP function to Stellar closes > >> > > > > apache/incubator-metron#652 > >> > > > > METRON-1054 Ambari Mpack Attempts to Kill Topologies > >> > That Are > >> > > Not > >> > > > > Running (nickwallen) closes apache/metron#660 > >> > > > > METRON-992: Create performance tuning guide > (mmiklavc) > >> > closes > >> > > > > apache/metron#614 > >> > > > > METRON-1044 Disabled writers are not acking messages > >> > > (merrimanr) > >> > > > > closes apache/metron#654 > >> > > > > METRON-1022 Elasticsearch REST endpoint this closes > >> > > > > apache/incubator-metron#636 > >> > > > > METRON-1048 Intermittent Test Failure for > >> > > > > SimpleHBaseEnrichmentWriterLoggingTest (nickwallen) > closes > >> > > > apache/metron#658 > >> > > > > METRON-1029 Topology worker opts are not being set > when > >> > > Kerberos is > >> > > > > enabled (merrimanr) closes apache/metron#645 > >> > > > > METRON-1031 Management UI Cannot Start Topologies in > >> > Kerberized > >> > > > > Environment (nickwallen) closes apache/metron#647 > >> > > > > METRON-1008 Migrate Travis build to use Trusty > (jjmeyer > >> > via > >> > > > > justinleet) closes apache/metron#633 > >> > > > > METRON-633 Create better logging for > >> > HbaseEnrichmentWriter > >> > > (zezutom > >> > > > > via justinleet) closes apache/metron#572 > >> > > > > METRON-1003 ParserUtil parses dates incorrect > (bjigmp > >> via > >> > > justinleet) > >> > > > > closes apache/metron#623 > >> > > > > METRON-1040 Create Installation Instructions for the > >> > Profiler > >> > > > > (nickwallen) closes apache/metron#653 > >> > > > > METRON-833 Update MaaS documentation to explain how > it > >> > > interacts with > >> > > > > kerberos (cestella via justinleet) closes > apache/metron#520 > >> > > > > METRON-1033 Profiler example uses incorrect units > for > >> > expires > >> > > > > (simonellistonball via nickwallen) closes > apache/metron#648 > >> > > > > METRON-1019 Metron 0.4.0 manual installation guide > for > >> > CentOS 6 > >> > > > > (lvets via ottobackwards) closes apache/metron#631 > >> > > > > METRON-1013 StellarShell does not validate > parameters > >> > > (ottobackwards) > >> > > > > closes apache/metron#639 > >> > > > > METRON-1017 Ambari components should be separate > >> > (merrimanr) > >> > > closes > >> > > > > apache/metron#634 > >> > > > > METRON-933 STELLAR support for setting fields to > regex > >> > match > >> > > captures > >> > > > > (ottobackwards) closes apache/metron#638 > >> > > > > METRON-1001 Allow metron to ingest parser metadata > >> along > >> > with > >> > > data > >> > > > > closes apache/incubator-metron#621 > >> > > > > METRON-1027 Errant Log Message When No GeoIP Hit on > >> > Valid, > >> > > External > >> > > > > IPv4 Address (nickwallen) closes apache/metron#644 > >> > > > > METRON-1025 Metron github pr template should not > >> > reference > >> > > incubator > >> > > > > (ottobackwards) closes apache/metron#640 > >> > > > > METRON-1021 increment metron version number to > 0.4.1 in > >> > poms > >> > > etc > >> > > > > (mattf-horton) closes apache/metron#637 > >> > > > > METRON-986 Enhance Fastcapa to Support Intel X520 > >> > (nickwallen) > >> > > closes > >> > > > > apache/metron#608 > >> > > > > METRON-1012 Update Metron public web site for 0.4.0 > >> > release > >> > > > > (mattf-horton) closes apache/metron#629 > >> > > > > METRON-1014 StellarShell class name typo > (mattf-horton) > >> > closes > >> > > > > apache/metron#630 > >> > > > > METRON-990 Clean up and organize flux properties > >> > (merrimanr) > >> > > closes > >> > > > > apache/metron#613 > >> > > > > METRON-508 Expand Elasticsearch templates to support > >> the > >> > > standard bro > >> > > > > logs (JonZeolla) closes apache/metron#586 > >> > > > > METRON-1007 Ship the metron-management jar as part > of > >> > the mpack > >> > > > > install (ottobackwards) closes apache/metron#627 > >> > > > > METRON-877 Extract core implementation and UDF > support, > >> > create > >> > > > > metron-stellar module (mattf-horton) closes > >> apache/metron#616 > >> > > > > METRON-1004 Travis CI - Job Exceeded Maximum Time > Limit > >> > > (justinleet) > >> > > > > closes apache/metron#624 > >> > > > > METRON-999 Add virtualization support checks to > >> > > platform-info.sh > >> > > > > (JonZeolla via jonzeolla) closes apache/metron#618 > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > >> > > > >> > > > >> > > > >> > > > >> > > >> > > >> > > >> > > >> > -- Jon
