16GB. It's a MBP from a few years back. I'm getting the same result as most it seems, currently oversubscribed but doable with care, works way better with the Ansible/Ambari integration that I'm doing for METRON-671.
-D... On Sat, Feb 25, 2017 at 2:13 PM, Matt Foley <[email protected]> wrote: > David, how much RAM do you have in the test system where you run full dev? > > On 2/25/17, 8:46 AM, "David Lyle" <[email protected]> wrote: > > +1 (binding) > Checked signatures > Tests passed > Full dev ran sucessfully-ish (bit more below, tl;dr- it's ugly, but > much > better after METRON-671) > Data flowed into the index/dashboard/hdfs > > On full-dev: Monit got into a state where it started killing topologies > because the Storm cli was non-responsive due to memory pressure. That > caused cascading failures. I let it be for about 20 minutes, and it > seemed > to calm down. I then killed pcap-service and Monit to make some > headroom. I > haven't seen this in my work with METRON-671 as only sensor probes and > pcap-service are managed by Monit. Once the topologies are monitored by > Ambari, we no longer use the Storm CLI for status so that frees up some > additional memory. > > -D... > > > > On Sat, Feb 25, 2017 at 10:42 AM, David Lyle <[email protected]> > wrote: > > > I'm running it up now. I don't think it should affect the release, > but > > it's extremely important that full-dev work. It's how quick-dev is > created. > > Any notion that it's been deprecated is incorrect. > > > > Fwiw, I've been working with it for the last few weeks as part of > > METRON-671 and it's been (knocking loudly on wood) reliable. > > I think we should leave full-dev in as the release verification step, > > particularly in the case that a release changes the Hadoop versions. > > There's a bit of a chicken-egg problem when we bump versions and > quick dev > > will lag. > > > > I'll update with run results shortly. > > > > -D... > > > > > > On Sat, Feb 25, 2017 at 9:24 AM, Otto Fowler < > [email protected]> > > wrote: > > > >> I see this with full dev on my laptop pretty much every time. > >> I think it is a resource issue. I see not enough memory errors > trying to > >> start things. > >> > >> > >> > >> On February 25, 2017 at 09:15:15, Ryan Merriman ( > [email protected]) > >> wrote: > >> > >> When I go to Ambari to ensure the services are all up, HDFS is > down. I > >> tried it 4 or 5 times and got the same result each time. I've seen > others > >> validate with quick dev so I assumed full dev was not used anymore. > I'll > >> spin it up this morning and get a more detailed error. > >> > >> Is anyone else able to validate it in full dev? > >> > >> > On Feb 25, 2017, at 7:21 AM, Casey Stella <[email protected]> > wrote: > >> > > >> > What exactly are the errors that you saw, Ryan? > >> >> On Sat, Feb 25, 2017 at 07:31 David Lyle <[email protected]> > wrote: > >> >> > >> >> Is there any reason full dev shouldn't be working? > >> >> > >> >>> On Fri, Feb 24, 2017 at 9:19 PM, Casey Stella < > [email protected]> > >> wrote: > >> >>> > >> >>> Sounds like a good idea to me; thanks Ryan! > >> >>>> On Fri, Feb 24, 2017 at 21:11 Ryan Merriman < > [email protected]> > >> wrote: > >> >>>> > >> >>>> +1 binding > >> >>>> > >> >>>> Verified the signature > >> >>>> Passed maven tests > >> >>>> Started quick-dev, verified data in ES, kibana, and checked the > >> >>> topologies > >> >>>> for errors (bro topology has parsing errors but I think a > couple bad > >> >>>> messages in bro data set is normal) > >> >>>> Tested REPL > >> >>>> RPMs built fine > >> >>>> > >> >>>> The recommended build validation wiki page ( > >> https://cwiki.apache.org/ > >> >>>> confluence/display/METRON/Verifying+Builds > >> >>>> <https://cwiki.apache.org/confluence/display/METRON/ > Verifying+Builds > >> >) > >> >>>> has some mistakes. This did > >> >>>> not run successfully in full-dev-platform and the HDFS paths > look > >> like > >> >>> they > >> >>>> are old. I am happy to update the wiki page if everyone agrees > these > >> >> are > >> >>>> legitimate mistakes. > >> >>>> > >> >>>> On Fri, Feb 24, 2017 at 9:22 AM, Justin Leet < > [email protected]> > >> >>>> wrote: > >> >>>> > >> >>>>> +1 (non-binding) > >> >>>>> > >> >>>>> Verified signature > >> >>>>> Ran build and tests in maven > >> >>>>> Ran up in quick-dev and saw data flow through topologies into > the UI > >> >>>>> Ensured the REPL spun up and performed some basic tasks > >> >>>>> Built rpms > >> >>>>> > >> >>>>> Justin > >> >>>>> > >> >>>>>> On Thu, Feb 23, 2017 at 11:18 AM, Casey Stella < > [email protected] > >> > > >> >>>>> wrote: > >> >>>>> > >> >>>>>> This is a call to vote on releasing Apache Metron 0.3.1-RC5 > >> >>> incubating > >> >>>>>> > >> >>>>>> Full list of changes in this release: > >> >>>>>> https://dist.apache.org/repos/dist/dev/incubator/metron/0.3. > >> >>>>>> 1-RC5-incubating/CHANGES > >> >>>>>> > >> >>>>>> The tag/commit to be voted upon is apache-metron-0.3.1-rc5- > >> >>> incubating: > >> >>>>>> https://git-wip-us.apache.org/repos/asf?p=incubator-metron. > >> >>>>>> git;a=shortlog;h=refs/tags/apache-metron-0.3.1-rc5- > incubating > >> >>>>>> > >> >>>>>> The source archive being voted upon can be found here: > >> >>>>>> https://dist.apache.org/repos/dist/dev/incubator/metron/0.3. > >> >>>>>> 1-RC5-incubating/apache-metron-0.3.1-rc5-incubating.tar.gz > >> >>>>>> > >> >>>>>> Other release files, signatures and digests can be found > here: > >> >>>>>> https://dist.apache.org/repos/dist/dev/incubator/metron/0.3. > >> >>>>>> 1-RC5-incubating/ > >> >>>>>> > >> >>>>>> The release artifacts are signed with the following key: > >> >>>>>> https://git-wip-us.apache.org/repos/asf?p=incubator-metron. > >> >>>>>> git;a=blob;f=KEYS;h=8381e96d64c249a0c1b489bc0c234d > >> >>>>> 9c260ba55e;hb=refs/tags/ > >> >>>>>> apache-metron-0.3.1-rc5-incubating > >> >>>>>> > >> >>>>>> The book associated with this RC is located at > >> >>>>>> https://dist.apache.org/repos/dist/dev/incubator/metron/0.3. > >> >>>>>> 1-RC5-incubating/book-site/index.html > >> >>>>>> > >> >>>>>> Please vote on releasing this package as Apache Metron > 0.3.1-RC5 > >> >>>>> incubating > >> >>>>>> > >> >>>>>> When voting, please list the actions taken to verify the > release. > >> >>>>>> > >> >>>>>> Recommended build validation and verification instructions > are > >> >> posted > >> >>>>> here: > >> >> https://cwiki.apache.org/confluence/display/METRON/ > Verifying+Builds > >> >>>>>> > >> >>>>>> > >> >>>>>> This vote will be open for at least 72 hours. > >> >>>>>> > >> >>>>>> [ ] +1 Release this package as Apache Metron 0.3.1-RC5 > incubating > >> >>>>>> > >> >>>>>> [ ] 0 No opinion > >> >>>>>> > >> >>>>>> [ ] -1 Do not release this package because... > >> >> > >> > > > > > > > >
