[jira] [Assigned] (METRON-2250) Missing services in HDP 3.1 metron mpack and installer stuck
[
https://issues.apache.org/jira/browse/METRON-2250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Miklavcic reassigned METRON-2250:
-
Assignee: Mohan (was: Michael Miklavcic)
> Missing services in HDP 3.1 metron mpack and installer stuck
>
>
> Key: METRON-2250
> URL: https://issues.apache.org/jira/browse/METRON-2250
> Project: Metron
> Issue Type: Sub-task
>Reporter: Michael Miklavcic
>Assignee: Mohan
>Priority: Major
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> We missed this during our full dev deployment because we use blueprints,
> which seems to bypass the service_advisor mechanism in Ambari.
>
> If you uninstall Metron and attempt to reinstall the service (or do any fresh
> install for that matter), the service recommendations will fail due to
> missing hostnames in the services list. The following stack traces appear in
> the Ambari server logs.
>
> {code:java}
> Error occured in stack advisor.
> Error details: list index out of range
> 2019-09-03 20:42:10,911 INFO [ambari-client-thread-34] StackAdvisorRunner:167
> - Advisor script stderr: Traceback (most recent call last):
> File "/var/lib/ambari-server/resources/scripts/stack_advisor.py", line 190,
> in
> main(sys.argv)
> File "/var/lib/ambari-server/resources/scripts/stack_advisor.py", line 122,
> in main
> result = stackAdvisor.validateComponentLayout(services, hosts)
> File "/var/lib/ambari-server/resources/scripts/../stacks/stack_advisor.py",
> line 1072, in validateComponentLayout
> validationItems = self.getComponentLayoutValidations(services, hosts)
> File "/var/lib/ambari-server/resources/scripts/../stacks/stack_advisor.py",
> line 1095, in getComponentLayoutValidations
> items.extend(serviceAdvisor.getServiceComponentLayoutValidations(services,
> hosts))
> File
> "/var/lib/ambari-server/resources/common-services/METRON/0.7.2/service_advisor.py",
> line 46, in getServiceComponentLayoutValidations
> metronParsersHost = self.getHosts(componentsList, "METRON_PARSERS")[0]
> IndexError: list index out of range
> 2019-09-03 20:42:10,912 WARN [ambari-client-thread-34]
> ValidationResourceProvider:132 - Error occurred during validation
> org.apache.ambari.server.api.services.stackadvisor.StackAdvisorException:
> Stack Advisor reported an error. Exit Code: 2. Error: IndexError: list index
> out of range
> StdOut file: /var/run/ambari-server/stack-recommendations/7/stackadvisor.out
> StdErr file: /var/run/ambari-server/stack-recommendations/7/stackadvisor.err
> at
> org.apache.ambari.server.api.services.stackadvisor.StackAdvisorRunner.processLogs(StackAdvisorRunner.java:149)
> at
> org.apache.ambari.server.api.services.stackadvisor.StackAdvisorRunner.runScript(StackAdvisorRunner.java:89)
> at
> org.apache.ambari.server.api.services.stackadvisor.commands.StackAdvisorCommand.invoke(StackAdvisorCommand.java:314)
> at
> org.apache.ambari.server.api.services.stackadvisor.StackAdvisorHelper.validate(StackAdvisorHelper.java:94)
> at
> org.apache.ambari.server.controller.internal.ValidationResourceProvider.createResources(ValidationResourceProvider.java:127)
> at
> org.apache.ambari.server.controller.internal.ClusterControllerImpl.createResources(ClusterControllerImpl.java:296)
> at
> org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.create(PersistenceManagerImpl.java:97)
> at
> org.apache.ambari.server.api.handlers.CreateHandler.persist(CreateHandler.java:50)
> at
> org.apache.ambari.server.api.handlers.BaseManagementHandler.handleRequest(BaseManagementHandler.java:68)
> at
> org.apache.ambari.server.api.services.BaseRequest.process(BaseRequest.java:144)
> at
> org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:163)
> at
> org.apache.ambari.server.api.services.BaseService.handleRequest(BaseService.java:127)
> at
> org.apache.ambari.server.api.services.ValidationService.getValidation(ValidationService.java:59)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
> at
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
> at
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
> at
>
[jira] [Commented] (METRON-2232) Upgrade to Hadoop 3.1.1
[ https://issues.apache.org/jira/browse/METRON-2232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931753#comment-16931753 ] Michael Miklavcic commented on METRON-2232: --- The exception shown in the integration test looks like a bit of a red herring. I'm seeing the ADD operation work just fine [https://github.com/apache/metron/blob/master/metron-analytics/metron-maas-service/src/test/java/org/apache/metron/maas/service/MaasIntegrationTest.java#L214] and the REMOVE operation never seem to remove the endpoint [https://github.com/apache/metron/blob/master/metron-analytics/metron-maas-service/src/test/java/org/apache/metron/maas/service/MaasIntegrationTest.java#L252], so the whole thing loops indefinitely here until the test times out [https://github.com/apache/metron/blob/master/metron-analytics/metron-maas-service/src/test/java/org/apache/metron/maas/service/MaasIntegrationTest.java#L261] > Upgrade to Hadoop 3.1.1 > --- > > Key: METRON-2232 > URL: https://issues.apache.org/jira/browse/METRON-2232 > Project: Metron > Issue Type: Sub-task >Reporter: Michael Miklavcic >Assignee: Michael Miklavcic >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[GitHub] [metron] mmiklavc commented on issue #1513: METRON-2257: Metron-Alerts GUI testing failing on MacOS builds
mmiklavc commented on issue #1513: METRON-2257: Metron-Alerts GUI testing failing on MacOS builds URL: https://github.com/apache/metron/pull/1513#issuecomment-532345303 +1. I also ran this up locally. Thanks @sardell for the contribution and thanks @tigerquoll for the feedback and review contribution on this. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] nickwallen closed pull request #1512: METRON-2250 : Missing services in HDP 3.1 metron mpack and installer stuck
nickwallen closed pull request #1512: METRON-2250 : Missing services in HDP 3.1 metron mpack and installer stuck URL: https://github.com/apache/metron/pull/1512 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] nickwallen commented on issue #1512: METRON-2250 : Missing services in HDP 3.1 metron mpack and installer stuck
nickwallen commented on issue #1512: METRON-2250 : Missing services in HDP 3.1 metron mpack and installer stuck URL: https://github.com/apache/metron/pull/1512#issuecomment-532269794 This has been merged into the feature branch. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] mmiklavc commented on issue #1512: METRON-2250 : Missing services in HDP 3.1 metron mpack and installer stuck
mmiklavc commented on issue #1512: METRON-2250 : Missing services in HDP 3.1 metron mpack and installer stuck URL: https://github.com/apache/metron/pull/1512#issuecomment-532260687 Excellent work @MohanDV and @nickwallen, this looks great. Documentation is solid, the code is simple, yet robust. All around great work here. +1 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] asfgit closed pull request #1503: METRON-2247 - rpm-docker: Provide an option to bypass running rpmlint
asfgit closed pull request #1503: METRON-2247 - rpm-docker: Provide an option to bypass running rpmlint URL: https://github.com/apache/metron/pull/1503 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [metron] nickwallen commented on issue #1512: METRON-2250 : Missing services in HDP 3.1 metron mpack and installer stuck
nickwallen commented on issue #1512: METRON-2250 : Missing services in HDP 3.1 metron mpack and installer stuck URL: https://github.com/apache/metron/pull/1512#issuecomment-532189410 +1 Thanks @MohanDV. Great job finding a work around to this issue. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Assigned] (METRON-2257) Metron-Alerts GUI testing failing on MacOS builds
[ https://issues.apache.org/jira/browse/METRON-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Ardell reassigned METRON-2257: Assignee: Shane Ardell > Metron-Alerts GUI testing failing on MacOS builds > - > > Key: METRON-2257 > URL: https://issues.apache.org/jira/browse/METRON-2257 > Project: Metron > Issue Type: Bug >Reporter: Dale Richardson >Assignee: Shane Ardell >Priority: Minor > Time Spent: 40m > Remaining Estimate: 0h > > Since [METRON-2243 [UI] Update npm dependencies to resolve audit warnings > (s…|https://github.com/apache/metron/commit/edc449ffa6be51749f6a3b100bf6a0a33755e50c] > > (edc449ffa6be51749f6a3b100bf6a0a33755e50c) was merged with Master on 3rd > September 2019, Metron-Alerts has a number of GUI tests that fail when run on > MacOS (at least). Interestingly these tests did not appear to fail on the > Travis builds (which I'm led to believe run on Ubuntu). -- This message was sent by Atlassian Jira (v8.3.2#803003)
[GitHub] [metron] MohanDV commented on issue #1512: METRON-2250 : Missing services in HDP 3.1 metron mpack and installer stuck
MohanDV commented on issue #1512: METRON-2250 : Missing services in HDP 3.1 metron mpack and installer stuck URL: https://github.com/apache/metron/pull/1512#issuecomment-532160316 Thanks @nickwallen !! I merged your PR changes and verified it on full dev also on 5 node cluster. This is working for me with no issues . This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
