I have some work around fixing how we handle config with Ambari that I'd like to see go in. No PR yet, but coming soon. I expect to have this by the RC deadline.
Mike On Wed, Aug 30, 2017 at 8:57 AM, Nick Allen <n...@nickallen.org> wrote: > The following PRs are usability enhancements for the Profiler. They are > fairly simple and I think are very helpful for troubleshooting. I don't > want to hold up the release, but it would be a "nice to have" to get these > in. > > If anyone has cycles, I would appreciate some reviews of these PRs. > https://github.com/apache/metron/pull/721 > https://github.com/apache/metron/pull/716 > > > > On Tue, Aug 29, 2017 at 8:59 PM Matt Foley <ma...@apache.org> wrote: > > > Okay, just to be clear, you’re requesting we wait until Friday, if > > necessary, to cut an RC with 717 in it? > > Thanks, > > --Matt > > > > On 8/29/17, 11:45 AM, "Casey Stella" <ceste...@gmail.com> wrote: > > > > 709 is in and 717 is under concerted review by Otto. I'd like to see > > it in > > by Friday. > > > > On Tue, Aug 29, 2017 at 1:35 PM, Matt Foley <ma...@apache.org> > wrote: > > > > > Hi all, > > > Thanks for your inputs. The three PRs Nick mentioned have been > > > successfully closed. > > > Casey, do you have an ETA for these two PRs? (PR#709 and 717) > > > Thanks, > > > --Matt > > > > > > On 8/29/17, 9:34 AM, "Casey Stella" <ceste...@gmail.com> wrote: > > > > > > For my PRs, I'd vote for METRON-1122 being in (commit very > > imminent). > > > I'd very much like METRON-1134 to be in as well. > > > > > > Beyond that, I'm ok > > > > > > On Tue, Aug 22, 2017 at 4:37 PM, Nick Allen < > n...@nickallen.org> > > > wrote: > > > > > > > Thanks for starting the process, Matt. > > > > > > > > These are my own open PRs that I would most like to see get > in. > > > They all > > > > relate to the Profiler. My other outstanding PRs are less > > important. > > > > > > > > - https://github.com/apache/metron/pull/705 > > > > - https://github.com/apache/metron/pull/707 > > > > - https://github.com/apache/metron/pull/708 > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Aug 22, 2017 at 4:17 PM Matt Foley <ma...@apache.org > > > > wrote: > > > > > > > > > Hello all, > > > > > At the meeting this morning, the community expressed the > > wish to > > > create a > > > > > new release, to be a point release and not including > > METRON-777. > > > > > > > > > > Therefore, I propose to create release 0.4.1 from Metron > > master > > > branch, > > > > > with whatever additional commits the community considers > > vital and > > > can > > > > get > > > > > in in the next few days. > > > > > > > > > > There have been 74 commits since the 0.4.0 release (list > > appended > > > to end > > > > > of this message). > > > > > I have not yet done a compare to make sure all 74 completed > > > commits have > > > > > closed their Jiras, but I will follow up with that info. > > > > > > > > > > There are 35 open PRs, see > > https://github.com/apache/metron/pulls > > > , > > > > which > > > > > is getting a little clunky. Surely not all of them can get > > in in > > > the > > > > next > > > > > few days, but do we want to try to close and include some > of > > them? > > > > > > > > > > Please respond to the list with your requests to include > > specific > > > > > additional PRs before we cut the 0.4.1 release candidate. > > Let’s > > > keep it > > > > > practical so we don’t delay more than a week or so. > > > > > > > > > > TIMEFRAME: Tentatively I would like to start the process > of > > > cutting an > > > > RC > > > > > this coming Monday 28 August. If we have too many PRs > > required to > > > be in, > > > > > we may have to slip that. Likewise, if there is need for > > urgency, > > > I can > > > > > start as soon as tomorrow. We will be guided by your > > responses. > > > > > > > > > > Thanks, > > > > > --Matt > > > > > (Release Manager) > > > > > > > > > > COMPLETED PRs as of 22 Aug 2017: > > > > > METRON-1115 Jackson is not properly serializing > > readMetadata > > > and > > > > > mergeMetadata SensorParserConfig properties (merrimanr) > > closes > > > > > apache/metron#703 > > > > > METRON-1047 REST should use core-site.xml for Hadoop > > > configuration > > > > > (merrimanr) closes apache/metron#672 > > > > > METRON-1111 Mislabeled Configuration Property in Ambari > > > (nickwallen) > > > > > closes apache/metron#698 > > > > > METRON-1113 UpdateControllerIntegrationTest fails with > > 500 > > > error > > > > > (merrimanr) closes apache/metron#701 > > > > > METRON-711 StellarShell assigns variables even if an > > exception > > > was > > > > > thrown in the statement. (ottobackwards) closes > > apache/metron#686 > > > > > METRON-1110 REST jvm flags property is being > overwritten > > when > > > > Kerberos > > > > > is enabled (merrimanr) closes apache/metron#697 > > > > > METRON-739 Create Local Profile Runner (nickwallen) > > closes > > > > > apache/metron#693 > > > > > METRON-1109 Indexing topology fails to start after > > Kerberos is > > > > enabled > > > > > (merrimanr) closes apache/metron#696 > > > > > METRON-1108 Metron configuration tabs are not showing > up > > in > > > Ambari > > > > > this closes apache/incubator-metron#695 > > > > > METRON-1078 Metron Indexing fails to stop during > > "Stop All > > > > > Services" (dlyle65535) closes apache/metron#680 > > > > > METRON-1104 Build Failure - Due to Bootstrap version > > change > > > > > (iraghumitra via justinleet) closes apache/metron#691 > > > > > METRON-1094 MaaS will not start due to classpath error > > > relating to > > > > > Yarn closes apache/incubator-metron#688 > > > > > METRON-1102 Add support for ingesting cybox URI > > observables > > > from > > > > taxii > > > > > feeds closes apache/incubator-metron#689 > > > > > METRON-838 Incorrect set of ts in FireEye parser > (bjigmp > > via > > > > > justinleet) closes apache/metron#528 > > > > > METRON-322 Global Batching and Flushing (mattf-horton) > > closes > > > > > apache/metron#481 > > > > > METRON-988 UI for viewing alerts generated by Metron > > > (iraghumitra > > > > via > > > > > nickwallen) closes apache/metron#620 > > > > > METRON-1084 Management UI web server license should be > > Apache > > > > > (merrimanr) closes apache/metron#683 > > > > > METRON-1026 threatintel_taxii_load.sh throws exception > > closes > > > > > apache/incubator-metron#643 > > > > > METRON-1051 Enable the ability to update indexed > messages > > > closes > > > > > apache/incubator-metron#666 > > > > > METRON-1069 Ambari MPack documentation around > development > > > strategies > > > > > (justinleet) closes apache/metron#1069 > > > > > METRON-1069 Ambari MPack documentation around > development > > > strategies > > > > > (merrimanr via justinleet) closes apache/metron#1069 > > > > > METRON-1069 Ambari MPack documentation around > development > > > strategies > > > > > (justinleet) closes apache/metron#1069 > > > > > METRON-1076 Management UI status check always reports > the > > > service as > > > > > running (merrimanr) closes apache/metron#678 > > > > > METRON-1075 Add faceted search capabilities (merrimanr) > > closes > > > > > apache/metron#679 > > > > > METRON-379 Stellar - No Error When Adding Variables > That > > Do > > > Not Exist > > > > > (ottobackwards) closes apache/metron#675 > > > > > METRON-1038 Stellar should have a better collection of > > basic > > > math > > > > > operations closes apache/incubator-metron#650 > > > > > METRON-1072 Cleanup Maven build warnings (mmiklavc) > > closes > > > > > apache/metron#676 > > > > > METRON-1056 Get field types from Elasticsearch > > (merrimanr) > > > closes > > > > > apache/metron#662 > > > > > METRON-1011 Stellar ENRICHMENT functions should enforce > > > submission of > > > > > 4 parameters (jasper-k via ottobackwards) closes > > apache/metron#628 > > > > > METRON-975 Normalize logging and switch to common idiom > > with > > > SLF4J > > > > > (mmiklavc) closes apache/metron#599 > > > > > METRON-681 CSVConverter should trim values (basvdl via > > > ottobackwards) > > > > > closes apache/metron#674 > > > > > METRON-746 Build Custom Checkstyle and IDE formatting > > settings > > > > > (justinleet via mmiklavc) closes apache/metron#577 > > > > > METRON-1060 Add performance timing logging to > enrichment > > > topology > > > > > (mmiklavc) closes apache/metron#665 > > > > > METRON-982 REST STORM Support for supervisor summary > > > (ottobackwards) > > > > > closes apache/metron#607 > > > > > METRON-1064 Make init script OS-agnostic (merrimanr) > > closes > > > > > apache/metron#669 > > > > > METRON-984 Create STELLAR Decoding Functions > > (ottobackwards) > > > closes > > > > > apache/metron#642 > > > > > METRON-1067 Minor typo in documentation (spencer-hanson > > via > > > > > justinleet) closes apache/metron#671 > > > > > METRON-1018 Integration tests should reference flux > yaml > > and > > > property > > > > > files deployed by Ambari (merrimanr) closes > apache/metron#635 > > > > > METRON-1050 Improve Docs of `profiler.period.duration` > > > (nickwallen) > > > > > closes apache/metron#656 > > > > > METRON-1043 Profiler Should be Less Dramatic When > Missing > > > > > Configuration (nickwallen) closes apache/metron#655 > > > > > METRON-1053 Relocate Metron Docker (nickwallen) closes > > > > > apache/metron#659 > > > > > METRON-1058 address checkstyle warnings for > > UnusedImports in > > > > > metron-stellar (dbist via ottobackwards) closes > > apache/metron#663 > > > > > METRON-1035 Added SUM to the rules triage aggregation > > docs > > > closes > > > > > apache/incubator-metron#649 > > > > > METRON-1039 Add ZIP function to Stellar closes > > > > > apache/incubator-metron#652 > > > > > METRON-1054 Ambari Mpack Attempts to Kill Topologies > > That Are > > > Not > > > > > Running (nickwallen) closes apache/metron#660 > > > > > METRON-992: Create performance tuning guide (mmiklavc) > > closes > > > > > apache/metron#614 > > > > > METRON-1044 Disabled writers are not acking messages > > > (merrimanr) > > > > > closes apache/metron#654 > > > > > METRON-1022 Elasticsearch REST endpoint this closes > > > > > apache/incubator-metron#636 > > > > > METRON-1048 Intermittent Test Failure for > > > > > SimpleHBaseEnrichmentWriterLoggingTest (nickwallen) closes > > > > apache/metron#658 > > > > > METRON-1029 Topology worker opts are not being set when > > > Kerberos is > > > > > enabled (merrimanr) closes apache/metron#645 > > > > > METRON-1031 Management UI Cannot Start Topologies in > > Kerberized > > > > > Environment (nickwallen) closes apache/metron#647 > > > > > METRON-1008 Migrate Travis build to use Trusty (jjmeyer > > via > > > > > justinleet) closes apache/metron#633 > > > > > METRON-633 Create better logging for > > HbaseEnrichmentWriter > > > (zezutom > > > > > via justinleet) closes apache/metron#572 > > > > > METRON-1003 ParserUtil parses dates incorrect (bjigmp > via > > > justinleet) > > > > > closes apache/metron#623 > > > > > METRON-1040 Create Installation Instructions for the > > Profiler > > > > > (nickwallen) closes apache/metron#653 > > > > > METRON-833 Update MaaS documentation to explain how it > > > interacts with > > > > > kerberos (cestella via justinleet) closes apache/metron#520 > > > > > METRON-1033 Profiler example uses incorrect units for > > expires > > > > > (simonellistonball via nickwallen) closes apache/metron#648 > > > > > METRON-1019 Metron 0.4.0 manual installation guide for > > CentOS 6 > > > > > (lvets via ottobackwards) closes apache/metron#631 > > > > > METRON-1013 StellarShell does not validate parameters > > > (ottobackwards) > > > > > closes apache/metron#639 > > > > > METRON-1017 Ambari components should be separate > > (merrimanr) > > > closes > > > > > apache/metron#634 > > > > > METRON-933 STELLAR support for setting fields to regex > > match > > > captures > > > > > (ottobackwards) closes apache/metron#638 > > > > > METRON-1001 Allow metron to ingest parser metadata > along > > with > > > data > > > > > closes apache/incubator-metron#621 > > > > > METRON-1027 Errant Log Message When No GeoIP Hit on > > Valid, > > > External > > > > > IPv4 Address (nickwallen) closes apache/metron#644 > > > > > METRON-1025 Metron github pr template should not > > reference > > > incubator > > > > > (ottobackwards) closes apache/metron#640 > > > > > METRON-1021 increment metron version number to 0.4.1 in > > poms > > > etc > > > > > (mattf-horton) closes apache/metron#637 > > > > > METRON-986 Enhance Fastcapa to Support Intel X520 > > (nickwallen) > > > closes > > > > > apache/metron#608 > > > > > METRON-1012 Update Metron public web site for 0.4.0 > > release > > > > > (mattf-horton) closes apache/metron#629 > > > > > METRON-1014 StellarShell class name typo (mattf-horton) > > closes > > > > > apache/metron#630 > > > > > METRON-990 Clean up and organize flux properties > > (merrimanr) > > > closes > > > > > apache/metron#613 > > > > > METRON-508 Expand Elasticsearch templates to support > the > > > standard bro > > > > > logs (JonZeolla) closes apache/metron#586 > > > > > METRON-1007 Ship the metron-management jar as part of > > the mpack > > > > > install (ottobackwards) closes apache/metron#627 > > > > > METRON-877 Extract core implementation and UDF support, > > create > > > > > metron-stellar module (mattf-horton) closes > apache/metron#616 > > > > > METRON-1004 Travis CI - Job Exceeded Maximum Time Limit > > > (justinleet) > > > > > closes apache/metron#624 > > > > > METRON-999 Add virtualization support checks to > > > platform-info.sh > > > > > (JonZeolla via jonzeolla) closes apache/metron#618 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >