Hi Patrizio, Network resolvability of Hadoop cluster nodes is a painful requirement at times. We test to catch issues like this on clouds/containers, but it sounds like we've missed an openstack case. If you don't mind, please describe the failing environment and your /etc/hosts fix in an issue here:
https://github.com/juju-solutions/layer-apache-bigtop-base/issues I'm concerned to hear that the smoke tests are failing for you as well. Our tests for hadoop-processing run the smoke-test actions for all components and a teragen/terasort across all the clouds. The latest results from just a few hours ago lgtm: http://162.213.34.190:5000/cwr_bundle_hadoop_processing/44/report.html Please open an issue for any failing test and we'll find out what's going on. Thanks for the reports! -- Kevin Monroe On Tue, Jun 20, 2017 at 7:01 AM, Patrizio Bassi <patrizio.ba...@gmail.com> wrote: > Dear Samuel > > i deployed the hadoop-processing bundle successfully. > I had some troubles because openstack instances didn't get the dns entry > so hadoop-hdfs-namenode/datanode could not resolve their own addresses > first, then the peers'. > > I did a fast hack just manually adding the entries in /etc/hosts while > waiting for Designate service to be deployed and active. > > It would be great if you could add in the documentation the dns need. > > This said, i run the smoke tests and they all failed. HDFS storage is > reported working instead. > I'm totally newbie in hadoop clusters so i didn't start investigation, but > i wanted to report in case you may check on your local working copy and > verify it's fine upstream. > > Thank you > > Patrizio > > > > > 2017-06-16 12:08 GMT+02:00 Patrizio Bassi <patrizio.ba...@gmail.com>: > >> Hi Samuel, >> >> thank you for fast and honest reply. I will start to take a look at >> hadoop-processing bundle. >> Regards, >> >> Patrizio >> >> 2017-06-16 9:54 GMT+02:00 Samuel Cozannet <samuel.cozan...@canonical.com> >> : >> >>> Hi Patrizio, >>> >>> Thanks for reaching out. There is a list of more recent charms based on >>> Big Top here: https://jujucharms.com/q/bigtop?type=charm >>> The current strategy is to focus on big top, so products from >>> Hortonworks are no longer supported as you could notice. >>> >>> The team to track is here : https://jujucharms.com/u/bigdata-charmers/ >>> >>> In addition, there are 2 community teams actively involved in Big Data >>> solutions via Juju, who can help for big data solutions: >>> * http://spicule.co.uk/ (on IRC reach out to MagicalTrout) >>> * http://tengu.intec.ugent.be/v1/ (reach out to >>> merlijn.sebrec...@gmail.com) >>> >>> Best, >>> Sam >>> >>> >>> >>> >>> -- >>> Samuel Cozannet >>> Cloud, Big Data and IoT Strategy Team >>> Business Development - Cloud and ISV Ecosystem >>> Changing the Future of Cloud >>> Ubuntu <http://ubuntu.com> / Canonical UK LTD <http://canonical.com> / >>> Juju <https://jujucharms.com> >>> samuel.cozan...@canonical.com >>> mob: +33 616 702 389 >>> skype: samnco >>> Twitter: @SaMnCo_23 >>> [image: View Samuel Cozannet's profile on LinkedIn] >>> <https://es.linkedin.com/in/scozannet> >>> >>> On Fri, Jun 16, 2017 at 9:36 AM, Patrizio Bassi < >>> patrizio.ba...@gmail.com> wrote: >>> >>>> Hi all, >>>> >>>> looking at a hadoop distro in the jujucharms is found >>>> https://jujucharms.com/hdp-hadoop/trusty/1 charm, >>>> following the announcement in https://insights.ubuntu.com >>>> /2015/02/19/ubuntu-hortonworks-and-microsoft-big-data-hosted-solution/ >>>> . >>>> >>>> >>>> I would like to know if it's still maintained, i don't see commits >>>> since 2015, version is stuck to trusty for ubuntu and hdp at 2.1.3 while >>>> upstream is on 2.2 series. >>>> the Contact Information show a no more valid email address too. >>>> >>>> Is Canonical looking at Apache bundle only? >>>> >>>> Thank you >>>> >>>> Patrizio >>>> >>>> -- >>>> Juju mailing list >>>> Juju@lists.ubuntu.com >>>> Modify settings or unsubscribe at: https://lists.ubuntu.com/mailm >>>> an/listinfo/juju >>>> >>>> >>> >> >> >> -- >> >> Patrizio Bassi >> www.patriziobassi.it >> http://piazzadelpopolo.patriziobassi.it >> > > > > -- > > Patrizio Bassi > www.patriziobassi.it > http://piazzadelpopolo.patriziobassi.it > > -- > Juju mailing list > Juju@lists.ubuntu.com > Modify settings or unsubscribe at: https://lists.ubuntu.com/ > mailman/listinfo/juju > >
-- Juju mailing list Juju@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/juju
