Does the pre-req script at:
metron-deployment/scripts/platform-info.sh need to be updated? I notice it is complaining that node and npm are NOT installed on my machine, yet I am able to build and deploy without any problems. Is docker being used to host a build image for node/npm? Regards, Dale. ________________________________ From: Michael Miklavcic <michael.miklav...@gmail.com> Sent: Wednesday, 10 April 2019 4:07 PM To: dev@metron.apache.org Cc: Dale Richardson Subject: Re: Problems with Dev deployment. Dale - to spin back around to what would best help you, for now you could reference docs from latest Metron master. You can either open the READMEs directly on github or just build them locally, ie. metron$ cd site-book metron/site-book$ mvn clean site && open target/site/index.html I'm not sure what's going on with the main product docs - I think we may have some old pages that didn't get cleaned up and are still being cached by Google, et al. For example, this shows our latest documentation correctly - https://metron.apache.org/current-book/metron-deployment/index.html<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmetron.apache.org%2Fcurrent-book%2Fmetron-deployment%2Findex.html&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767050625&sdata=v4t%2FCXrE8%2BobFXJHAZIEkBGHYP8bKnU%2BJ4dEIc1AnF8%3D&reserved=0>. Actually, as long as you're seeing version 0.7.0 in the menu bar, you're good to go. No need to traverse the READMEs or build locally. Just follow the TOC there. Best, Mike On Wed, Apr 10, 2019 at 10:00 AM Michael Miklavcic <michael.miklav...@gmail.com<mailto:michael.miklav...@gmail.com>> wrote: So does anyone know, have we not been updating the site-book when we do a release? That documentation is waaaay outdated - v0.4.2??? - and should either be removed or setup as that version number in the URL as other projects do. e.g. Spark - https://spark.apache.org/documentation.html<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fspark.apache.org%2Fdocumentation.html&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767070634&sdata=CC%2B96RDg4f9fyEdwV1I9u6h4W55FMLpdqsof5hWO2wM%3D&reserved=0> On Wed, Apr 10, 2019 at 9:34 AM zeo...@gmail.com <zeo...@gmail.com<mailto:zeo...@gmail.com>> wrote: Wow, I didn't realize that never got finalized/merged. Looks like there is a failure in travis on that PR, if you get that wrapped up I would think we should take another look at that and maybe get it merged. It has been a while but I recall I was pretty happy with it after my review cycle with you. - Jon Zeolla zeo...@gmail.com On Wed, Apr 10, 2019 at 9:17 AM Otto Fowler <ottobackwa...@gmail.com<mailto:ottobackwa...@gmail.com>> wrote: > These issues are the reason > https://github.com/apache/metron/pull/1261<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmetron%2Fpull%2F1261&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767080639&sdata=VWJdRh4dj3kCMGBvzicxajIjifYVkCueAhqj4YgEwrQ%3D&reserved=0> > was > done. It would be nice if we could get by them. > > > On April 10, 2019 at 08:13:04, Dale Richardson > (tigerqu...@outlook.com<mailto:tigerqu...@outlook.com>) > wrote: > > Older pre-req versions are mentioned at: > > > https://metron.apache.org/current-book/metron-deployment/vagrant/codelab-platform/index.html<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmetron.apache.org%2Fcurrent-book%2Fmetron-deployment%2Fvagrant%2Fcodelab-platform%2Findex.html&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767090692&sdata=AZHivJHaD5kK%2Bxy5SFzUO5oP4KdzrbXQnpcdCssaI5U%3D&reserved=0> > Metron – Developer Image for Apache Metron on Virtualbox< > > https://metron.apache.org/current-book/metron-deployment/vagrant/codelab-platform/index.html<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmetron.apache.org%2Fcurrent-book%2Fmetron-deployment%2Fvagrant%2Fcodelab-platform%2Findex.html&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767110665&sdata=lHTB%2BsTqLSXfAOtrj4w%2Bj4tKdZHBZh4G56lAEgEOxlQ%3D&reserved=0> > > > > Developer Image for Apache Metron on Virtualbox. This image is a fully > functional Metron installation that has been pre-loaded with Ambari, HDP > and Metron. > metron.apache.org<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmetron.apache.org&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767120730&sdata=fQPlJappVC%2FKBJs%2BXp7CpYtobFJCsjqUyhRbXxC1hJ0%3D&reserved=0> > > > https://metron.apache.org/current-book/metron-deployment/vagrant/full-dev-platform/index.html<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmetron.apache.org%2Fcurrent-book%2Fmetron-deployment%2Fvagrant%2Ffull-dev-platform%2Findex.html&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767140698&sdata=TWeukGr1PREP%2FC12Vu9hv9C95XF0aZLm7DtAQWtwwl4%3D&reserved=0> > Metron – Full Development Platform< > > https://metron.apache.org/current-book/metron-deployment/vagrant/full-dev-platform/index.html<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmetron.apache.org%2Fcurrent-book%2Fmetron-deployment%2Fvagrant%2Ffull-dev-platform%2Findex.html&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767150690&sdata=7k4el52gQW2vWstA8lfKmQooaQds2WpDvHjHevhn%2BR8%3D&reserved=0> > > > > Full Development Platform. This project fully automates the provisioning > and deployment of Apache Metron and all necessary prerequisites on a > single, virtualized host running on Virtualbox. > metron.apache.org<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmetron.apache.org&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767170730&sdata=6vf0U%2BMwqJuvohYcdwgooM9A4zgmW2Zdu%2ByszWaS3qg%3D&reserved=0> > > > > https://metron.apache.org/current-book/metron-deployment/vagrant/quick-dev-platform/index.html<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmetron.apache.org%2Fcurrent-book%2Fmetron-deployment%2Fvagrant%2Fquick-dev-platform%2Findex.html&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767180723&sdata=01FAKBxgJfVIqfM49agy6wtXzP4qmNr98546piPqBuo%3D&reserved=0> > Metron – Quick Development Platform< > > https://metron.apache.org/current-book/metron-deployment/vagrant/quick-dev-platform/index.html<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmetron.apache.org%2Fcurrent-book%2Fmetron-deployment%2Fvagrant%2Fquick-dev-platform%2Findex.html&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767190746&sdata=YliIEB9bWkkz%2Fe3BASH%2FVS2FsAPK0UPOGlJAER1jwVU%3D&reserved=0> > > > > Quick Development Platform. This project fully automates the provisioning > and deployment of Apache Metron and all necessary prerequisites on a > single, virtualized host running on Virtualbox. > metron.apache.org<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmetron.apache.org&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767210749&sdata=6S7QumZ69R1FiNlt6IRkZXbhxXSChwpyQAXbYeLfgOQ%3D&reserved=0> > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=68718548<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fpages%2Fviewpage.action%3FpageId%3D68718548&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767220754&sdata=XflWLPM6cpNHpsOY8z%2FuEU84%2BG6tWNjBDOoqoqIqF1A%3D&reserved=0> > > Metron Install on Ubuntu/Debian single-node VM with Vagrant and Ambari - > Metron - Apache Software Foundation - > cwiki.apache.org<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcwiki.apache.org&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767240764&sdata=LJDHPZ7YII9kuJIgt0XLR%2BbnCSZAW6NFAO%2FvXL0a3UE%3D&reserved=0>< > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=68718548<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fpages%2Fviewpage.action%3FpageId%3D68718548&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767250798&sdata=Sx4lkYwwismZIRT%2FLMttLHilqeHJEnTgpeBCawOXlfY%3D&reserved=0>> > Contributed by Umesh Kaushik < > umesh.kaus...@bhujang.net<mailto:umesh.kaus...@bhujang.net> > Introduction. > These instructions are for an Ubuntu host, with occasional comments about > how to do similar tasks in CentOS. > cwiki.apache.org<https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcwiki.apache.org&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767260821&sdata=X2dve5mleQLKPTRSmLMvm7E8WcjCHOBcQ9rcKw2E4dE%3D&reserved=0> > > Which links to > https://gist.github.com/dpalomar/96b826dac5c2e8b62cbf4c86dbd1c9df<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgist.github.com%2Fdpalomar%2F96b826dac5c2e8b62cbf4c86dbd1c9df&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767280861&sdata=siqtVsNnUYoRn4SGbSsGy6jZYVX7W8jRPp2LSa0o%2F4s%3D&reserved=0> > > > > ________________________________ > From: Michael Miklavcic > <michael.miklav...@gmail.com<mailto:michael.miklav...@gmail.com>> > Sent: Wednesday, 10 April 2019 4:15 AM > To: dev@metron.apache.org<mailto:dev@metron.apache.org> > Subject: Re: Problems with Dev deployment. > > Where are you seeing 2.0.0.2 for Ansible? Should be 2.4.0+ now. > > https://github.com/apache/metron/blob/master/metron-deployment/development/centos6/README.md<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmetron%2Fblob%2Fmaster%2Fmetron-deployment%2Fdevelopment%2Fcentos6%2FREADME.md&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767300846&sdata=4765S2MxnGURNh%2BCxzNXui6EFhF8%2FVphBWdiBgXbKv0%3D&reserved=0> > > > > On Tue, Apr 9, 2019, 6:59 PM Michael Miklavcic < > michael.miklav...@gmail.com<mailto:michael.miklav...@gmail.com>> > > wrote: > > > That would be awesome man! Yes, Jira tickets for every change. I don't > > recall off the top of my head the version - I'll have to look when I get > > back in front of a computer. > > > > On Tue, Apr 9, 2019, 6:56 PM Dale Richardson > > <tigerqu...@outlook.com<mailto:tigerqu...@outlook.com>> > > wrote: > > > >> Hi Michael, > >> Yep that was the issue, looks like "brew install ansible" configures > >> ansible for python 3. Happy to patch the documentation with updated > >> install instructions (I will add the MacOS Mojave Drive permission issue > >> as well). Do you know if the minimum ansible version requirement has > >> changed at all? (some documentation lists it as 2.0.0.2 or 2.2.2.0). Do > >> you guys usually put in a Jira to cover small documentation changes at > all? > >> > >> Regards, > >> Dale. > >> ________________________________ > >> From: Otto Fowler <ottobackwa...@gmail.com<mailto:ottobackwa...@gmail.com>> > >> Sent: Sunday, 7 April 2019 1:40 PM > >> To: dev@metron.apache.org<mailto:dev@metron.apache.org> > >> Subject: Re: Problems with Dev deployment. > >> > >> Can you pull down > >> > > https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmetron%2Fpull%2F1261&data=02%7C01%7C%7Cc00c98c5300d45adf8c508d6bbab3180%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636902741276312736&sdata=oylL4njlCkTYaLsyLYl44Zy8%2BoZoB4HVBCb5F2vgxng%3D&reserved=0<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmetron%2Fpull%2F1261&data=02%7C01%7C%7C47f2f0dff5c4435a5eca08d6bdceb0fe%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636905092767310815&sdata=doKsQ70Ms11vCBE7Gdr5o1jnxn0nqQrljeJkRMohbHg%3D&reserved=0> > >> and try? > >> That should eliminate any env. issues. > >> > >> I’ll update it to latest master now. > >> > >> > >> > >> On April 7, 2019 at 08:33:52, Dale Richardson > >> (tigerqu...@outlook.com<mailto:tigerqu...@outlook.com>) > >> wrote: > >> > >> Hi Folks, > >> I've been walking through some of the documentations on building and > >> deploying the Metron development image. > >> I am building Metron version 0.7. The deployment appears to go OK up > until > >> the Ambari deployment stage, and then I get the following error: > >> > >> > >> SyntaxError: invalid syntax > >> > >> INFO interface: detail: The full traceback is: > >> > >> Traceback (most recent call last): > >> > >> File > >> > >> > > "/usr/local/Cellar/ansible/2.7.9/libexec/lib/python3.7/site-packages/ansible/executor/task_executor.py", > > >> line 140, in run > >> > >> res = self._execute() > >> > >> File > >> > >> > > "/usr/local/Cellar/ansible/2.7.9/libexec/lib/python3.7/site-packages/ansible/executor/task_executor.py", > > >> line 612, in _execute > >> > >> result = self._handler.run(task_vars=variables) > >> > >> File > >> > >> > > "/usr/local/Cellar/ansible/2.7.9/libexec/lib/python3.7/site-packages/ansible/plugins/action/normal.py", > > >> line 46, in run > >> > >> result = merge_hash(result, self._execute_module(task_vars=task_vars, > >> wrap_async=wrap_async)) > >> > >> File > >> > >> > > "/usr/local/Cellar/ansible/2.7.9/libexec/lib/python3.7/site-packages/ansible/plugins/action/__init__.py", > > >> line 742, in _execute_module > >> > >> (module_style, shebang, module_data, module_path) = > >> self._configure_module(module_name=module_name, module_args=module_args, > >> task_vars=task_vars) > >> > >> File > >> > >> > > "/usr/local/Cellar/ansible/2.7.9/libexec/lib/python3.7/site-packages/ansible/plugins/action/__init__.py", > > >> line 178, in _configure_module > >> > >> environment=final_environment) > >> > >> File > >> > >> > > "/usr/local/Cellar/ansible/2.7.9/libexec/lib/python3.7/site-packages/ansible/executor/module_common.py", > > >> line 973, in modify_module > >> > >> environment=environment) > >> > >> File > >> > >> > > "/usr/local/Cellar/ansible/2.7.9/libexec/lib/python3.7/site-packages/ansible/executor/module_common.py", > > >> line 791, in _find_module_utils > >> > >> recursive_finder(module_name, b_module_data, py_module_names, > >> py_module_cache, zf) > >> > >> File > >> > >> > > "/usr/local/Cellar/ansible/2.7.9/libexec/lib/python3.7/site-packages/ansible/executor/module_common.py", > > >> line 538, in recursive_finder > >> > >> tree = ast.parse(data) > >> > >> File > >> > >> > > "/usr/local/opt/python/Frameworks/Python.framework/Versions/3.7/lib/python3.7/ast.py", > > >> line 35, in parse > >> > >> return compile(source, filename, mode, PyCF_ONLY_AST) > >> > >> File "<unknown>", line 230 > >> > >> except requests.ConnectionError, e: > >> > >> ^ > >> > >> MacOS Mojava (Version 10.14.3) > >> VirtualBox version 5.2.26 > >> Vagrant version 2.2.4 > >> > >> ansible 2.7.9 > >> config file = > >> > /Users/user/work/metron/metron-deployment/development/centos6/ansible.cfg > >> ansible python module location = > >> > >> > /usr/local/Cellar/ansible/2.7.9/libexec/lib/python3.7/site-packages/ansible > >> executable location = /usr/local/bin/ansible > >> python version = 3.7.2 (default, Feb 12 2019, 08:15:36) [Clang 10.0.0 > >> (clang-1000.11.45.5)] > >> > >> > >> > >> Python2 version is 2.7.16 > >> > >> commit 2263983761e77b7eec52f70f5e8f8001bac83125 (HEAD, tag: > >> apache-metron_0.7.0-release, tag: apache-metron-0.7.0-rc1, > >> origin/Metron_0.7.0) > >> > >> Does anybody have any suggestions on how to proceed? > >> > >> Thanks, > >> Dale. > >> > > >
