Ambari Wizard: Repo Tab

2017-04-25 Thread Otto Fowler
Hi, Should I see the repo tab in the ambari wizard for metron at this point? Asking for a friend who can’t get the wizard to work :)

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread Michael Miklavcic
I've been doing an internal hwx deployment (HCP) recently for testing purposes. I have some ES tweaks to work out, but other than that it has been running smoothly. Can you share any log info or screenshots? Mike On Apr 25, 2017 11:30 AM, "Otto Fowler" wrote: > Hi, > Should I see the repo tab i

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread Otto Fowler
Yes, I’m going to run through again and get the logs. The basic issue is, no repo tab -> if I should have one, and the ES yum command failing with nothing to do, which stops deployment on all the nodes. On April 25, 2017 at 13:36:25, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: I've

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread Otto Fowler
stderr: Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/ELASTICSEARCH/2.3.3/package/scripts/elastic_slave.py", line 71, in Elasticsearch().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread Michael Miklavcic
Hey Otto, I don't have wizard screenshots in front of me right now to say for sure, but I do see a repoinfo.xml in the mpack. I haven't run into anything like that, but next time I run through the install I can take another look. https://github.com/apache/incubator-metron/blob/master/metron-deploy

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread David Lyle
Any chance they're running Ambari < 2.4.2? -D... On Tue, Apr 25, 2017 at 3:23 PM, Michael Miklavcic < michael.miklav...@gmail.com> wrote: > Hey Otto, I don't have wizard screenshots in front of me right now to say > for sure, but I do see a repoinfo.xml in the mpack. I haven't run into > anythi

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread Otto Fowler
2.4.1 as a matter of fact On April 25, 2017 at 15:29:43, David Lyle (dlyle65...@gmail.com) wrote: Any chance they're running Ambari < 2.4.2? -D... On Tue, Apr 25, 2017 at 3:23 PM, Michael Miklavcic < michael.miklav...@gmail.com> wrote: > Hey Otto, I don't have wizard screenshots in front of

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread David Lyle
That would do it. It requires 2.4.2+. I would have sworn I put that in the README, but I must have only annotated the PR. :( I'll get that in asap. -D... On Tue, Apr 25, 2017 at 3:44 PM, Otto Fowler wrote: > 2.4.1 as a matter of fact > > > On April 25, 2017 at 15:29:43, David Lyle (dlyle65...

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread Otto Fowler
I was going by the HW community page. Ok, Let me try it On April 25, 2017 at 16:04:07, David Lyle (dlyle65...@gmail.com) wrote: That would do it. It requires 2.4.2+. I would have sworn I put that in the README, but I must have only annotated the PR. :( I'll get that in asap. -D... On Tue,

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread Otto Fowler
Ok, now I see the repos in the ‘pick version’ screen, but it is erring on the f://localrepo even though the folder exists, there is no repodata/repomd.xml. What is the command to create a local repo? On April 25, 2017 at 16:05:17, Otto Fowler (ottobackwa...@gmail.com) wrote: I was going by the

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread Nick Allen
createrepo On Tue, Apr 25, 2017 at 4:42 PM, Otto Fowler wrote: > Ok, now I see the repos in the ‘pick version’ screen, but it is erring on > the f://localrepo > even though the folder exists, there is no repodata/repomd.xml. > > What is the command to create a local repo? > > > > On April 25, 20

Re: Ambari Wizard: Repo Tab

2017-04-25 Thread Otto Fowler
Nm. sorry. I fixed it. On April 25, 2017 at 16:42:05, Otto Fowler (ottobackwa...@gmail.com) wrote: Ok, now I see the repos in the ‘pick version’ screen, but it is erring on the f://localrepo even though the folder exists, there is no repodata/repomd.xml. What is the command to create a local

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Can you describe what ES issues you are working on? Fixing the repos got everything installed, but my ES components don’t stay running. I need to harvest the errors. On April 25, 2017 at 16:46:00, Otto Fowler (ottobackwa...@gmail.com) wrote: Nm. sorry. I fixed it. On April 25, 2017 at 16:4

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Anand Subramanian
FWIW, I don’t see the Repository tab as well in recent builds. Here's a screenshot of how it was earlier: https://community.hortonworks.com/storage/attachments/9844-metron-screen2.png And here's one from a recent build: http://imgur.com/yjkltES Regards, Anand On 4/26/17, 5:57 PM, "Otto Fow

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Updating to use ambari 2.4.2 fixed it for me. You will see the repos in the beginning of the wizard, mixed in with the HDP repos now. The steps in the community page where you ‘just’ copy the rpm’s to the /localrepo don’t work anymore though, because you have to run create repo there. On April

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 293, in _call raise ExecutionFailed(err_msg, code, out, err) ExecutionFailed: Execution of 'service elasticsearch status' returned 3. ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Michael Miklavcic
Hey Otto, How do you have the ES nodes configured? For a base install I would setup 1 master (NOT as data node) and 2 data nodes (NOT on the same node as the master). This is the install configuration I got working. You can also modify some configuration properties around master node as data node,

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
I am following https://community.hortonworks.com/articles/60805/deploying-a-fresh-metron-cluster-using-ambari-serv.html I DO have master and data node together. Why is that a problem? I will try again with master and data node separate. On April 26, 2017 at 10:41:59, Michael Miklavcic ( michael.

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread zeo...@gmail.com
I'm also interested to know why that's important at such a small scale. Jon On Wed, Apr 26, 2017, 10:51 AM Otto Fowler wrote: > I am following > > https://community.hortonworks.com/articles/60805/deploying-a-fresh-metron-cluster-using-ambari-serv.html > I DO have master and data node together.

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
I still can’t keep ES running, it dies. Also, I’m getting exceptions from enrichment trying to restart when the topology wasn’t running. Is there some coordination in this work? Should I just log jiras? If someone is already sussing out ES, we can sync up On April 26, 2017 at 11:35:03, zeo...@

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Getting the same error in ES as before from what I can see On April 26, 2017 at 13:47:09, Otto Fowler (ottobackwa...@gmail.com) wrote: I still can’t keep ES running, it dies. Also, I’m getting exceptions from enrichment trying to restart when the topology wasn’t running. Is there some coordinat

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
So the elasticsearch service is disabled. That is the issue. When ES calls get status ( service elasticsearch status ) it fails. I don’t know systemd too well, but does that mean we didn’t do the equiv of chkconfig on? On April 26, 2017 at 13:54:10, Otto Fowler (ottobackwa...@gmail.com) wrote:

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Actually never mind. I am not sure how to read the exception. Is it failing to read the configuration? On April 26, 2017 at 14:01:26, Otto Fowler (ottobackwa...@gmail.com) wrote: So the elasticsearch service is disabled. That is the issue. When ES calls get status ( service elasticsearch stat

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Michael Miklavcic
A couple more things you should check, given this setup: - 1 master node (not as data node) - 2 data nodes I'd use something like this: - gateway_recover_after_data_nodes=1 or 2 - index_number_of_replicas=0 or 1 (2 data nodes, with 2 total copies of the index - if you set this val

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
I think it is literally crashing trying to load the config file On April 26, 2017 at 15:00:25, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: A couple more things you should check, given this setup: - 1 master node (not as data node) - 2 data nodes I'd use something like this:

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Nick Allen
Check on the `network_hosts` setting. I just ran into the same issue. I had to add brackets around it otherwise the file was not valid YAML and it would crash trying to load the config file. network.host: ["_lo:ipv4_","_eth0:ipv4_"] On Wed, Apr 26, 2017 at 3:09 PM, Otto Fowler wrote: > I thin

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Would i have to change that on Centos 7? On April 26, 2017 at 15:12:38, Nick Allen (n...@nickallen.org) wrote: Check on the `network_hosts` setting. I just ran into the same issue. I had to add brackets around it otherwise the file was not valid YAML and it would crash trying to load the config

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Nick Allen
Yes, I am also running on CentOS 7. On Wed, Apr 26, 2017 at 3:19 PM, Otto Fowler wrote: > Would i have to change that on Centos 7? > > > On April 26, 2017 at 15:12:38, Nick Allen (n...@nickallen.org) wrote: > > Check on the `network_hosts` setting. I just ran into the same issue. I > had to add

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
So now I’m getting errors for ETH0 I think that is one of the things that has to change on centos7? Can you check what you have? On April 26, 2017 at 15:20:18, Nick Allen (n...@nickallen.org) wrote: Yes, I am also running on CentOS 7. On Wed, Apr 26, 2017 at 3:19 PM, Otto Fowler wrote: > Wou

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Ok, I did ifconfig, i mean ip a and got the right values that and the brackets and it looks like es is up. Now my next problem is prob. a bug. Ambari thinks it needs to restart ‘metron’. the enrichment restart crashes because we don’t catch the storm exception that you are stopping a topology tha

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Michael Miklavcic
I thought we had addressed that at some point, so if it's blowing up still on restart when parsers are down, then I would file a Jira. On Wed, Apr 26, 2017 at 1:41 PM, Otto Fowler wrote: > Ok, I did ifconfig, i mean ip a and got the right values > that and the brackets and it looks like es is up

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
I can’t reproduce now, and the log rolled, so I’m not going to log it until I see it again. On April 26, 2017 at 15:47:48, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: I thought we had addressed that at some point, so if it's blowing up still on restart when parsers are down, then I

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Matt Foley
zen_discovery_ping_unicast_hosts, if used, also needs square brackets in the parameter string. Both these should be fixed to provide the square brackets in the template text (as is done by most other params that need them), but I didn’t include that in METRON-634 because it would muck up curren

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Nick Allen
Yes, Otto. I just experienced that myself. It is a bug that we should create a JIRA for. I was able to work around it by just using "start" instead of "restart". On Wed, Apr 26, 2017 at 3:41 PM, Otto Fowler wrote: > Ok, I did ifconfig, i mean ip a and got the right values > that and the brack

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Nick Allen
I can create the JIRA. I capture the logs. On Wed, Apr 26, 2017 at 4:48 PM, Nick Allen wrote: > Yes, Otto. I just experienced that myself. It is a bug that we should > create a JIRA for. > > I was able to work around it by just using "start" instead of "restart". > > On Wed, Apr 26, 2017 at 3

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Otto Fowler
Thanks Nick. I don’t think we catch exceptions at all from the execute calls. I wonder what the best practice is? I can’t seem to find the ambari mpack programming documentation ;) On April 26, 2017 at 16:50:18, Nick Allen (n...@nickallen.org) wrote: I can create the JIRA. I capture the logs.

Re: Ambari Wizard: Repo Tab

2017-04-26 Thread Nick Allen
It is actually pretty handy. You can get those type of logs right in the Ambari web interface. If you click on "Ops" near the top of the Ambari screen, it will open a window where you can dig-into all the previous operations that were run. From there you can find the operation that failed and cl