Hi Matt, This defect needs to be included as a follow-on to METRON-1122: * METRON-1141 (https://github.com/apache/metron/pull/723)
Thanks, Anand On 8/30/17, 8:57 PM, "Michael Miklavcic" <[email protected]> wrote: >I have some work around fixing how we handle config with Ambari that I'd >like to see go in. No PR yet, but coming soon. I expect to have this by the >RC deadline. > >Mike > >On Wed, Aug 30, 2017 at 8:57 AM, Nick Allen <[email protected]> wrote: > >> The following PRs are usability enhancements for the Profiler. They are >> fairly simple and I think are very helpful for troubleshooting. I don't >> want to hold up the release, but it would be a "nice to have" to get these >> in. >> >> If anyone has cycles, I would appreciate some reviews of these PRs. >> https://github.com/apache/metron/pull/721 >> https://github.com/apache/metron/pull/716 >> >> >> >> On Tue, Aug 29, 2017 at 8:59 PM Matt Foley <[email protected]> wrote: >> >> > Okay, just to be clear, you’re requesting we wait until Friday, if >> > necessary, to cut an RC with 717 in it? >> > Thanks, >> > --Matt >> > >> > On 8/29/17, 11:45 AM, "Casey Stella" <[email protected]> wrote: >> > >> > 709 is in and 717 is under concerted review by Otto. I'd like to see >> > it in >> > by Friday. >> > >> > On Tue, Aug 29, 2017 at 1:35 PM, Matt Foley <[email protected]> >> wrote: >> > >> > > Hi all, >> > > Thanks for your inputs. The three PRs Nick mentioned have been >> > > successfully closed. >> > > Casey, do you have an ETA for these two PRs? (PR#709 and 717) >> > > Thanks, >> > > --Matt >> > > >> > > On 8/29/17, 9:34 AM, "Casey Stella" <[email protected]> wrote: >> > > >> > > For my PRs, I'd vote for METRON-1122 being in (commit very >> > imminent). >> > > I'd very much like METRON-1134 to be in as well. >> > > >> > > Beyond that, I'm ok >> > > >> > > On Tue, Aug 22, 2017 at 4:37 PM, Nick Allen < >> [email protected]> >> > > wrote: >> > > >> > > > Thanks for starting the process, Matt. >> > > > >> > > > These are my own open PRs that I would most like to see get >> in. >> > > They all >> > > > relate to the Profiler. My other outstanding PRs are less >> > important. >> > > > >> > > > - https://github.com/apache/metron/pull/705 >> > > > - https://github.com/apache/metron/pull/707 >> > > > - https://github.com/apache/metron/pull/708 >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > On Tue, Aug 22, 2017 at 4:17 PM Matt Foley <[email protected] >> > >> > wrote: >> > > > >> > > > > Hello all, >> > > > > At the meeting this morning, the community expressed the >> > wish to >> > > create a >> > > > > new release, to be a point release and not including >> > METRON-777. >> > > > > >> > > > > Therefore, I propose to create release 0.4.1 from Metron >> > master >> > > branch, >> > > > > with whatever additional commits the community considers >> > vital and >> > > can >> > > > get >> > > > > in in the next few days. >> > > > > >> > > > > There have been 74 commits since the 0.4.0 release (list >> > appended >> > > to end >> > > > > of this message). >> > > > > I have not yet done a compare to make sure all 74 completed >> > > commits have >> > > > > closed their Jiras, but I will follow up with that info. >> > > > > >> > > > > There are 35 open PRs, see >> > https://github.com/apache/metron/pulls >> > > , >> > > > which >> > > > > is getting a little clunky. Surely not all of them can get >> > in in >> > > the >> > > > next >> > > > > few days, but do we want to try to close and include some >> of >> > them? >> > > > > >> > > > > Please respond to the list with your requests to include >> > specific >> > > > > additional PRs before we cut the 0.4.1 release candidate. >> > Let’s >> > > keep it >> > > > > practical so we don’t delay more than a week or so. >> > > > > >> > > > > TIMEFRAME: Tentatively I would like to start the process >> of >> > > cutting an >> > > > RC >> > > > > this coming Monday 28 August. If we have too many PRs >> > required to >> > > be in, >> > > > > we may have to slip that. Likewise, if there is need for >> > urgency, >> > > I can >> > > > > start as soon as tomorrow. We will be guided by your >> > responses. >> > > > > >> > > > > Thanks, >> > > > > --Matt >> > > > > (Release Manager) >> > > > > >> > > > > COMPLETED PRs as of 22 Aug 2017: >> > > > > METRON-1115 Jackson is not properly serializing >> > readMetadata >> > > and >> > > > > mergeMetadata SensorParserConfig properties (merrimanr) >> > closes >> > > > > apache/metron#703 >> > > > > METRON-1047 REST should use core-site.xml for Hadoop >> > > configuration >> > > > > (merrimanr) closes apache/metron#672 >> > > > > METRON-1111 Mislabeled Configuration Property in Ambari >> > > (nickwallen) >> > > > > closes apache/metron#698 >> > > > > METRON-1113 UpdateControllerIntegrationTest fails with >> > 500 >> > > error >> > > > > (merrimanr) closes apache/metron#701 >> > > > > METRON-711 StellarShell assigns variables even if an >> > exception >> > > was >> > > > > thrown in the statement. (ottobackwards) closes >> > apache/metron#686 >> > > > > METRON-1110 REST jvm flags property is being >> overwritten >> > when >> > > > Kerberos >> > > > > is enabled (merrimanr) closes apache/metron#697 >> > > > > METRON-739 Create Local Profile Runner (nickwallen) >> > closes >> > > > > apache/metron#693 >> > > > > METRON-1109 Indexing topology fails to start after >> > Kerberos is >> > > > enabled >> > > > > (merrimanr) closes apache/metron#696 >> > > > > METRON-1108 Metron configuration tabs are not showing >> up >> > in >> > > Ambari >> > > > > this closes apache/incubator-metron#695 >> > > > > METRON-1078 Metron Indexing fails to stop during >> > "Stop All >> > > > > Services" (dlyle65535) closes apache/metron#680 >> > > > > METRON-1104 Build Failure - Due to Bootstrap version >> > change >> > > > > (iraghumitra via justinleet) closes apache/metron#691 >> > > > > METRON-1094 MaaS will not start due to classpath error >> > > relating to >> > > > > Yarn closes apache/incubator-metron#688 >> > > > > METRON-1102 Add support for ingesting cybox URI >> > observables >> > > from >> > > > taxii >> > > > > feeds closes apache/incubator-metron#689 >> > > > > METRON-838 Incorrect set of ts in FireEye parser >> (bjigmp >> > via >> > > > > justinleet) closes apache/metron#528 >> > > > > METRON-322 Global Batching and Flushing (mattf-horton) >> > closes >> > > > > apache/metron#481 >> > > > > METRON-988 UI for viewing alerts generated by Metron >> > > (iraghumitra >> > > > via >> > > > > nickwallen) closes apache/metron#620 >> > > > > METRON-1084 Management UI web server license should be >> > Apache >> > > > > (merrimanr) closes apache/metron#683 >> > > > > METRON-1026 threatintel_taxii_load.sh throws exception >> > closes >> > > > > apache/incubator-metron#643 >> > > > > METRON-1051 Enable the ability to update indexed >> messages >> > > closes >> > > > > apache/incubator-metron#666 >> > > > > METRON-1069 Ambari MPack documentation around >> development >> > > strategies >> > > > > (justinleet) closes apache/metron#1069 >> > > > > METRON-1069 Ambari MPack documentation around >> development >> > > strategies >> > > > > (merrimanr via justinleet) closes apache/metron#1069 >> > > > > METRON-1069 Ambari MPack documentation around >> development >> > > strategies >> > > > > (justinleet) closes apache/metron#1069 >> > > > > METRON-1076 Management UI status check always reports >> the >> > > service as >> > > > > running (merrimanr) closes apache/metron#678 >> > > > > METRON-1075 Add faceted search capabilities (merrimanr) >> > closes >> > > > > apache/metron#679 >> > > > > METRON-379 Stellar - No Error When Adding Variables >> That >> > Do >> > > Not Exist >> > > > > (ottobackwards) closes apache/metron#675 >> > > > > METRON-1038 Stellar should have a better collection of >> > basic >> > > math >> > > > > operations closes apache/incubator-metron#650 >> > > > > METRON-1072 Cleanup Maven build warnings (mmiklavc) >> > closes >> > > > > apache/metron#676 >> > > > > METRON-1056 Get field types from Elasticsearch >> > (merrimanr) >> > > closes >> > > > > apache/metron#662 >> > > > > METRON-1011 Stellar ENRICHMENT functions should enforce >> > > submission of >> > > > > 4 parameters (jasper-k via ottobackwards) closes >> > apache/metron#628 >> > > > > METRON-975 Normalize logging and switch to common idiom >> > with >> > > SLF4J >> > > > > (mmiklavc) closes apache/metron#599 >> > > > > METRON-681 CSVConverter should trim values (basvdl via >> > > ottobackwards) >> > > > > closes apache/metron#674 >> > > > > METRON-746 Build Custom Checkstyle and IDE formatting >> > settings >> > > > > (justinleet via mmiklavc) closes apache/metron#577 >> > > > > METRON-1060 Add performance timing logging to >> enrichment >> > > topology >> > > > > (mmiklavc) closes apache/metron#665 >> > > > > METRON-982 REST STORM Support for supervisor summary >> > > (ottobackwards) >> > > > > closes apache/metron#607 >> > > > > METRON-1064 Make init script OS-agnostic (merrimanr) >> > closes >> > > > > apache/metron#669 >> > > > > METRON-984 Create STELLAR Decoding Functions >> > (ottobackwards) >> > > closes >> > > > > apache/metron#642 >> > > > > METRON-1067 Minor typo in documentation (spencer-hanson >> > via >> > > > > justinleet) closes apache/metron#671 >> > > > > METRON-1018 Integration tests should reference flux >> yaml >> > and >> > > property >> > > > > files deployed by Ambari (merrimanr) closes >> apache/metron#635 >> > > > > METRON-1050 Improve Docs of `profiler.period.duration` >> > > (nickwallen) >> > > > > closes apache/metron#656 >> > > > > METRON-1043 Profiler Should be Less Dramatic When >> Missing >> > > > > Configuration (nickwallen) closes apache/metron#655 >> > > > > METRON-1053 Relocate Metron Docker (nickwallen) closes >> > > > > apache/metron#659 >> > > > > METRON-1058 address checkstyle warnings for >> > UnusedImports in >> > > > > metron-stellar (dbist via ottobackwards) closes >> > apache/metron#663 >> > > > > METRON-1035 Added SUM to the rules triage aggregation >> > docs >> > > closes >> > > > > apache/incubator-metron#649 >> > > > > METRON-1039 Add ZIP function to Stellar closes >> > > > > apache/incubator-metron#652 >> > > > > METRON-1054 Ambari Mpack Attempts to Kill Topologies >> > That Are >> > > Not >> > > > > Running (nickwallen) closes apache/metron#660 >> > > > > METRON-992: Create performance tuning guide (mmiklavc) >> > closes >> > > > > apache/metron#614 >> > > > > METRON-1044 Disabled writers are not acking messages >> > > (merrimanr) >> > > > > closes apache/metron#654 >> > > > > METRON-1022 Elasticsearch REST endpoint this closes >> > > > > apache/incubator-metron#636 >> > > > > METRON-1048 Intermittent Test Failure for >> > > > > SimpleHBaseEnrichmentWriterLoggingTest (nickwallen) closes >> > > > apache/metron#658 >> > > > > METRON-1029 Topology worker opts are not being set when >> > > Kerberos is >> > > > > enabled (merrimanr) closes apache/metron#645 >> > > > > METRON-1031 Management UI Cannot Start Topologies in >> > Kerberized >> > > > > Environment (nickwallen) closes apache/metron#647 >> > > > > METRON-1008 Migrate Travis build to use Trusty (jjmeyer >> > via >> > > > > justinleet) closes apache/metron#633 >> > > > > METRON-633 Create better logging for >> > HbaseEnrichmentWriter >> > > (zezutom >> > > > > via justinleet) closes apache/metron#572 >> > > > > METRON-1003 ParserUtil parses dates incorrect (bjigmp >> via >> > > justinleet) >> > > > > closes apache/metron#623 >> > > > > METRON-1040 Create Installation Instructions for the >> > Profiler >> > > > > (nickwallen) closes apache/metron#653 >> > > > > METRON-833 Update MaaS documentation to explain how it >> > > interacts with >> > > > > kerberos (cestella via justinleet) closes apache/metron#520 >> > > > > METRON-1033 Profiler example uses incorrect units for >> > expires >> > > > > (simonellistonball via nickwallen) closes apache/metron#648 >> > > > > METRON-1019 Metron 0.4.0 manual installation guide for >> > CentOS 6 >> > > > > (lvets via ottobackwards) closes apache/metron#631 >> > > > > METRON-1013 StellarShell does not validate parameters >> > > (ottobackwards) >> > > > > closes apache/metron#639 >> > > > > METRON-1017 Ambari components should be separate >> > (merrimanr) >> > > closes >> > > > > apache/metron#634 >> > > > > METRON-933 STELLAR support for setting fields to regex >> > match >> > > captures >> > > > > (ottobackwards) closes apache/metron#638 >> > > > > METRON-1001 Allow metron to ingest parser metadata >> along >> > with >> > > data >> > > > > closes apache/incubator-metron#621 >> > > > > METRON-1027 Errant Log Message When No GeoIP Hit on >> > Valid, >> > > External >> > > > > IPv4 Address (nickwallen) closes apache/metron#644 >> > > > > METRON-1025 Metron github pr template should not >> > reference >> > > incubator >> > > > > (ottobackwards) closes apache/metron#640 >> > > > > METRON-1021 increment metron version number to 0.4.1 in >> > poms >> > > etc >> > > > > (mattf-horton) closes apache/metron#637 >> > > > > METRON-986 Enhance Fastcapa to Support Intel X520 >> > (nickwallen) >> > > closes >> > > > > apache/metron#608 >> > > > > METRON-1012 Update Metron public web site for 0.4.0 >> > release >> > > > > (mattf-horton) closes apache/metron#629 >> > > > > METRON-1014 StellarShell class name typo (mattf-horton) >> > closes >> > > > > apache/metron#630 >> > > > > METRON-990 Clean up and organize flux properties >> > (merrimanr) >> > > closes >> > > > > apache/metron#613 >> > > > > METRON-508 Expand Elasticsearch templates to support >> the >> > > standard bro >> > > > > logs (JonZeolla) closes apache/metron#586 >> > > > > METRON-1007 Ship the metron-management jar as part of >> > the mpack >> > > > > install (ottobackwards) closes apache/metron#627 >> > > > > METRON-877 Extract core implementation and UDF support, >> > create >> > > > > metron-stellar module (mattf-horton) closes >> apache/metron#616 >> > > > > METRON-1004 Travis CI - Job Exceeded Maximum Time Limit >> > > (justinleet) >> > > > > closes apache/metron#624 >> > > > > METRON-999 Add virtualization support checks to >> > > platform-info.sh >> > > > > (JonZeolla via jonzeolla) closes apache/metron#618 >> > > > > >> > > > > >> > > > > >> > > > > >> > > > > >> > > > >> > > >> > > >> > > >> > > >> > >> > >> > >> > >>
