Re: when agent sync service scripts
In my case, i define a stack and install a service. For start/stop, i need to do some test, so i edit service script under stack. Then restart server, not sync. Then restart agent, still not. Does it need time to sync or it is real-time? From: "David Quiroga" To: "user" Sent: Monday, May 21, 2018 1:20:31 AM Subject: Re: when agent sync service scripts The agent code cache should update when the agents check-in to the server. Believe check-in occurs after the server is restarted and/or after an agent is restarted. Is the python? code in the standard location ambari-server/resources/common-services/YOUR_SERVICE/VERSION/package/scripts/ Or what type of code update are you attempting. On Sat, May 19, 2018 at 1:37 AM, < xiang@sky-data.cn > wrote: I install a custom stack in VM, then i want to update some codes for a installed service. But when i restart server, the codes in agent does not update. Then i restart agent, still failed. So when agent sync service scripts? Thanks
Re: Operating System matching redhat7 could not be found
.hortonworks.com/HDP-UTILS-1.1.0.21/repos/ubuntu12, repoName=SKY-UTILS, distribution=null, components=null, mirrorsList=null, unique=false, ambariManagedRepositories=true, applicableServices= ]]} From: "xiang dai" To: "user" Sent: Saturday, May 19, 2018 9:30:32 AM Subject: Re: Operating System matching redhat7 could not be found I use centos7.4: $ cat /etc/redhat-release CentOS Linux release 7.4.1708 (Core) From: "David Quiroga" To: "user" Sent: Saturday, May 19, 2018 4:08:37 AM Subject: Re: Operating System matching redhat7 could not be found What is the output of cat /etc/*release on the hosts. I know the code has to map values to the 'redhat7' On Fri, May 18, 2018 at 7:08 AM, < xiang@sky-data.cn > wrote: I define a stack called SKY, and my repo.xml is as below: http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.0.3 SKY-3.0 SKY true http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7 SKY-UTILS-1.1.0.21 SKY-UTILS false I use centos7 to test, i really do not know how to fix it. Could someone help me? Thanks From: "David Quiroga" < quirogadf4w...@gmail.com > To: "user" < user@ambari.apache.org > Sent: Friday, May 18, 2018 1:29:13 AM Subject: Re: Operating System matching redhat7 could not be found "At least one set of repositories for OS should be provided" I would take a look in Ambari under Admin > Stacks and Versions > Versions Tab For the current version "Show Details", click Edit button this should list the OS and repositories. Are those valid from the host you are now running on? On Thu, May 17, 2018 at 7:38 AM, < xiang@sky-data.cn > wrote: BQ_BEGIN True error maybe as below: 17 May 2018 20:33:46,103 ERROR [ambari-client-thread-78] AbstractResourceProvider:343 - Caught AmbariException when modifying a resource org.apache.ambari.server.AmbariException: At least one set of repositories for OS should be provided at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:490) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:439) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:356) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java:455) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.modifyResources(AbstractResourceProvider.java:336) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.updateResourcesAuthorized(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.CGLIB$updateResourcesAuthorized$2() at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843$$FastClassByGuice$$bbfdd590.invoke() at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.updateResourcesAuthorized() at org.apache.ambari.server.controller.internal.AbstractAuthorizedResourceProvider.updateResources(AbstractAuthorizedResourceProvider.java:301) at org.apache.ambari.server.controller.internal.ClusterControllerImpl.updateResources(ClusterControllerImpl.java:319) at org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.update(PersistenceManagerImpl.java:125) at org.apache.ambari.server.api.handlers.UpdateHandler.persist(UpdateHandler.java:45) From: "xiang dai" < xiang@sky-data.cn > To: "user" < user@ambari.apache.org > Sent: Thursday, May 17, 2018 4:29:14 PM Subject: Re: Operating System matching redhat7 could not be found Add some clue: 17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - Unable to compile query predicate: Unexpected token encountered in query string. Last Token Type=PROPERTY_OP
when agent sync service scripts
I install a custom stack in VM, then i want to update some codes for a installed service. But when i restart server, the codes in agent does not update. Then i restart agent, still failed. So when agent sync service scripts? Thanks
Re: Operating System matching redhat7 could not be found
I use centos7.4: $ cat /etc/redhat-release CentOS Linux release 7.4.1708 (Core) From: "David Quiroga" To: "user" Sent: Saturday, May 19, 2018 4:08:37 AM Subject: Re: Operating System matching redhat7 could not be found What is the output of cat /etc/*release on the hosts. I know the code has to map values to the 'redhat7' On Fri, May 18, 2018 at 7:08 AM, < xiang@sky-data.cn > wrote: I define a stack called SKY, and my repo.xml is as below: http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.0.3 SKY-3.0 SKY true http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7 SKY-UTILS-1.1.0.21 SKY-UTILS false I use centos7 to test, i really do not know how to fix it. Could someone help me? Thanks From: "David Quiroga" < quirogadf4w...@gmail.com > To: "user" < user@ambari.apache.org > Sent: Friday, May 18, 2018 1:29:13 AM Subject: Re: Operating System matching redhat7 could not be found "At least one set of repositories for OS should be provided" I would take a look in Ambari under Admin > Stacks and Versions > Versions Tab For the current version "Show Details", click Edit button this should list the OS and repositories. Are those valid from the host you are now running on? On Thu, May 17, 2018 at 7:38 AM, < xiang@sky-data.cn > wrote: BQ_BEGIN True error maybe as below: 17 May 2018 20:33:46,103 ERROR [ambari-client-thread-78] AbstractResourceProvider:343 - Caught AmbariException when modifying a resource org.apache.ambari.server.AmbariException: At least one set of repositories for OS should be provided at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:490) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:439) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:356) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java:455) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.modifyResources(AbstractResourceProvider.java:336) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.updateResourcesAuthorized(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.CGLIB$updateResourcesAuthorized$2() at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843$$FastClassByGuice$$bbfdd590.invoke() at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.updateResourcesAuthorized() at org.apache.ambari.server.controller.internal.AbstractAuthorizedResourceProvider.updateResources(AbstractAuthorizedResourceProvider.java:301) at org.apache.ambari.server.controller.internal.ClusterControllerImpl.updateResources(ClusterControllerImpl.java:319) at org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.update(PersistenceManagerImpl.java:125) at org.apache.ambari.server.api.handlers.UpdateHandler.persist(UpdateHandler.java:45) From: "xiang dai" < xiang@sky-data.cn > To: "user" < user@ambari.apache.org > Sent: Thursday, May 17, 2018 4:29:14 PM Subject: Re: Operating System matching redhat7 could not be found Add some clue: 17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - Unable to compile query predicate: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Cur rent Token[type=LOGICAL_OPERATOR, value='&'] org.apache.ambari.server.api.predicate.InvalidQueryException: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Current Token[type=LOGICAL_OPERATOR, value='&'] at org.apache.ambari.server.api.predicate.QueryParser$TokenHandler.handleToken
Re: Operating System matching redhat7 could not be found
I define a stack called SKY, and my repo.xml is as below: http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.0.3 SKY-3.0 SKY true http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7 SKY-UTILS-1.1.0.21 SKY-UTILS false I use centos7 to test, i really do not know how to fix it. Could someone help me? Thanks From: "David Quiroga" To: "user" Sent: Friday, May 18, 2018 1:29:13 AM Subject: Re: Operating System matching redhat7 could not be found "At least one set of repositories for OS should be provided" I would take a look in Ambari under Admin > Stacks and Versions > Versions Tab For the current version "Show Details", click Edit button this should list the OS and repositories. Are those valid from the host you are now running on? On Thu, May 17, 2018 at 7:38 AM, < xiang@sky-data.cn > wrote: True error maybe as below: 17 May 2018 20:33:46,103 ERROR [ambari-client-thread-78] AbstractResourceProvider:343 - Caught AmbariException when modifying a resource org.apache.ambari.server.AmbariException: At least one set of repositories for OS should be provided at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:490) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:439) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:356) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java:455) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.modifyResources(AbstractResourceProvider.java:336) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.updateResourcesAuthorized(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.CGLIB$updateResourcesAuthorized$2() at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843$$FastClassByGuice$$bbfdd590.invoke() at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.updateResourcesAuthorized() at org.apache.ambari.server.controller.internal.AbstractAuthorizedResourceProvider.updateResources(AbstractAuthorizedResourceProvider.java:301) at org.apache.ambari.server.controller.internal.ClusterControllerImpl.updateResources(ClusterControllerImpl.java:319) at org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.update(PersistenceManagerImpl.java:125) at org.apache.ambari.server.api.handlers.UpdateHandler.persist(UpdateHandler.java:45) From: "xiang dai" < xiang@sky-data.cn > To: "user" < user@ambari.apache.org > Sent: Thursday, May 17, 2018 4:29:14 PM Subject: Re: Operating System matching redhat7 could not be found Add some clue: 17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - Unable to compile query predicate: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Cur rent Token[type=LOGICAL_OPERATOR, value='&'] org.apache.ambari.server.api.predicate.InvalidQueryException: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Current Token[type=LOGICAL_OPERATOR, value='&'] at org.apache.ambari.server.api.predicate.QueryParser$TokenHandler.handleToken(QueryParser.java:351) From: "xiang dai" < xiang@sky-data.cn > To: "user" < user@ambari.apache.org > Sent: Thursday, May 17, 2018 10:27:23 AM Subject: Operating System matching redhat7 could not be found Hi! I met a confused issue: when i use vagrant to test, all work. when i change to my hosts, below waring show: org.apache.ambari.server.controller.spi.SystemException: Operating System matching redhat7 could not be found And UI hang. The question is that both VM and hosts
Re: Operating System matching redhat7 could not be found
True error maybe as below: 17 May 2018 20:33:46,103 ERROR [ambari-client-thread-78] AbstractResourceProvider:343 - Caught AmbariException when modifying a resource org.apache.ambari.server.AmbariException: At least one set of repositories for OS should be provided at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:490) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:439) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:356) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java:455) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.modifyResources(AbstractResourceProvider.java:336) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.updateResourcesAuthorized(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.CGLIB$updateResourcesAuthorized$2() at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843$$FastClassByGuice$$bbfdd590.invoke() at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.updateResourcesAuthorized() at org.apache.ambari.server.controller.internal.AbstractAuthorizedResourceProvider.updateResources(AbstractAuthorizedResourceProvider.java:301) at org.apache.ambari.server.controller.internal.ClusterControllerImpl.updateResources(ClusterControllerImpl.java:319) at org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.update(PersistenceManagerImpl.java:125) at org.apache.ambari.server.api.handlers.UpdateHandler.persist(UpdateHandler.java:45) From: "xiang dai" To: "user" Sent: Thursday, May 17, 2018 4:29:14 PM Subject: Re: Operating System matching redhat7 could not be found Add some clue: 17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - Unable to compile query predicate: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Cur rent Token[type=LOGICAL_OPERATOR, value='&'] org.apache.ambari.server.api.predicate.InvalidQueryException: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Current Token[type=LOGICAL_OPERATOR, value='&'] at org.apache.ambari.server.api.predicate.QueryParser$TokenHandler.handleToken(QueryParser.java:351) From: "xiang dai" To: "user" Sent: Thursday, May 17, 2018 10:27:23 AM Subject: Operating System matching redhat7 could not be found Hi! I met a confused issue: when i use vagrant to test, all work. when i change to my hosts, below waring show: org.apache.ambari.server.controller.spi.SystemException: Operating System matching redhat7 could not be found And UI hang. The question is that both VM and hosts are Centos7, why behave differently? Thanks -- 戴翔 南京天数信息科技有限公司 电话: +86 1 3382776490 公司官网: www.sky-data.cn 免费使用天数润科智能计算平台 SkyDiscovery
Re: Operating System matching redhat7 could not be found
Add some clue: 17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - Unable to compile query predicate: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Cur rent Token[type=LOGICAL_OPERATOR, value='&'] org.apache.ambari.server.api.predicate.InvalidQueryException: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Current Token[type=LOGICAL_OPERATOR, value='&'] at org.apache.ambari.server.api.predicate.QueryParser$TokenHandler.handleToken(QueryParser.java:351) From: "xiang dai" To: "user" Sent: Thursday, May 17, 2018 10:27:23 AM Subject: Operating System matching redhat7 could not be found Hi! I met a confused issue: when i use vagrant to test, all work. when i change to my hosts, below waring show: org.apache.ambari.server.controller.spi.SystemException: Operating System matching redhat7 could not be found And UI hang. The question is that both VM and hosts are Centos7, why behave differently? Thanks
Operating System matching redhat7 could not be found
Hi! I met a confused issue: when i use vagrant to test, all work. when i change to my hosts, below waring show: org.apache.ambari.server.controller.spi.SystemException: Operating System matching redhat7 could not be found And UI hang. The question is that both VM and hosts are Centos7, why behave differently? Thanks
Re: metrics can not work as expected
I reinstalled and tested, found that zookeeper failed indeed: 2018-05-09 14:55:09,187 - File['/var/lib/ambari-agent/tmp/zkSmoke.out'] {'action': ['delete']} 2018-05-09 14:55:09,188 - File['/var/lib/ambari-agent/tmp/zkSmoke.sh'] {'content': StaticFile('zkSmoke.sh'), 'mode': 0755} 2018-05-09 14:55:09,189 - Writing File['/var/lib/ambari-agent/tmp/zkSmoke.sh'] because it doesn't exist 2018-05-09 14:55:09,189 - Changing permission for /var/lib/ambari-agent/tmp/zkSmoke.sh from 644 to 755 2018-05-09 14:55:09,189 - Execute['/var/lib/ambari-agent/tmp/zkSmoke.sh /usr/hdp/current/zookeeper-client/bin/zkCli.sh ambari-qa /etc/zookeeper/conf 2181 False kinit no_keytab no_principal /var/lib/ambari-agent/tmp/zkSmoke.out'] {'logoutput': True, 'path': ['/usr/sbin:/sbin:/usr/local/bin:/bin:/usr/bin'], 'tries': 3, 'try_sleep': 5} zk_node1=dx-app.novalocal log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Exception in thread "main" java.lang.IllegalArgumentException: A HostProvider may not be empty! at org.apache.zookeeper.client.StaticHostProvider.(StaticHostProvider.java:63) at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:446) at org.apache.zookeeper.ZooKeeperMain.connectToZK(ZooKeeperMain.java:279) at org.apache.zookeeper.ZooKeeperMain.(ZooKeeperMain.java:293) at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:286) log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Exception in thread "main" java.lang.IllegalArgumentException: A HostProvider may not be empty! at org.apache.zookeeper.client.StaticHostProvider.(StaticHostProvider.java:63) at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:446) at org.apache.zookeeper.ZooKeeperMain.connectToZK(ZooKeeperMain.java:279) at org.apache.zookeeper.ZooKeeperMain.(ZooKeeperMain.java:293) at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:286) Running test on host dx-app.novalocal Connecting to dx-app.novalocal:2181 log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Exception in thread "main" java.lang.IllegalArgumentException: A HostProvider may not be empty! at org.apache.zookeeper.client.StaticHostProvider.(StaticHostProvider.java:63) at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:446) at org.apache.zookeeper.ZooKeeperMain.connectToZK(ZooKeeperMain.java:279) at org.apache.zookeeper.ZooKeeperMain.(ZooKeeperMain.java:293) at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:286) I know little about zookeeper, what is wrong with zookeeper? Maybe start right but can not work as expected. From: "Siddharth Wagle" To: "user" Sent: Wednesday, May 9, 2018 1:26:39 PM Subject: Re: metrics can not work as expected Yes the default that Ambari sets in most cases should just work, not sure about the move part, usually configs are cluster specific so cannot know for sure unless diving deeper. The wiki has some useful info that you could take a look at: https://cwiki.apache.org/confluence/display/AMBARI/Troubleshooting+Guide https://cwiki.apache.org/confluence/display/AMBARI/Known+Issues https://cwiki.apache.org/confluence/display/AMBARI/Configuration - Sid From: David Quiroga Sent: Tuesday, May 8, 2018 9:46 PM To: user@ambari.apache.org Subject: Re: metrics can not work as expected In most cases Ambari Metrics runs separate HBase and Zookeeper instances. The default ports of Ambari Metrics Zookeeper are typically in the 60,000 range. Would expect the Ambari defaults to do the trick, which I suspect relates to Sid's question. On Sun, May 6, 2018 at 5:07 AM, < xiang@sky-data.cn > wrote: I just download them and make my own repo including them. Then, i install them with ambari UI. From: "Siddharth Wagle" < swa...@hortonworks.com > To: "user" < user@ambari.apache.org > Sent: Saturday, May 5, 2018 11:07:12 PM Subject: Re: metrics can not work as expected Collector is not able to reach Zookeeper. Are you not installing AMS using Ambari? - Sid From: xiang@sky-data.cn < xiang@sky-data.cn > Sent: Saturday, May 5, 2018 1:27 AM To: user Subject: metrics can not work as expected Hi! I tested installation on my vbox, it works well, then i move it to a server which run many services. When install, it failed at check service status. I checked ambari-metrics-collector.log and found below error: 2018-05-05 08:16:03,536 INFO org.apache.phoenix.metrics.Metrics: Initializing metrics system: phoenix
Re: metrics can not work as expected
I just download them and make my own repo including them. Then, i install them with ambari UI. From: "Siddharth Wagle" To: "user" Sent: Saturday, May 5, 2018 11:07:12 PM Subject: Re: metrics can not work as expected Collector is not able to reach Zookeeper. Are you not installing AMS using Ambari? - Sid From: xiang@sky-data.cn Sent: Saturday, May 5, 2018 1:27 AM To: user Subject: metrics can not work as expected Hi! I tested installation on my vbox, it works well, then i move it to a server which run many services. When install, it failed at check service status. I checked ambari-metrics-collector.log and found below error: 2018-05-05 08:16:03,536 INFO org.apache.phoenix.metrics.Metrics: Initializing metrics system: phoenix 2018-05-05 08:16:03,559 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties 2018-05-05 08:18:50,342 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to dx-1.novalocal/192.168.80.34:2188, initiating session 2018-05-05 08:18:50,343 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect 2018-05-05 08:18:50,811 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server dx-2.novalocal/192.168.80.27:2188. Will not attempt to authenticate using SASL (unknown error) 2018-05-05 08:18:50,812 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to dx-2.novalocal/192.168.80.27:2188, initiating session 2018-05-05 08:18:50,813 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect 2018-05-05 08:18:50,947 INFO org.apache.helix.manager.zk.ZkClient: Closing zkclient: State:CONNECTING sessionid:0x0 local:null remoteserver:null lastZxid:0 xid:1 sent:35 recv:0 queuedpkts:0 pendingresp:0 queuedevents:0 2018-05-05 08:18:50,947 INFO org.I0Itec.zkclient.ZkEventThread: Terminate ZkClient event thread. 2018-05-05 08:18:51,352 INFO org.apache.zookeeper.ZooKeeper: Session: 0x0 closed 2018-05-05 08:18:51,352 INFO org.apache.helix.manager.zk.ZkClient: Closed zkclient 2018-05-05 08:18:51,352 ERROR org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore: org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server within timeout: 3 2018-05-05 08:18:51,354 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore failed in state INITED; cause: org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException: Unable to initialize HA controller org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException: Unable to initialize HA controller at org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.initializeSubsystem(HBaseTimelineMetricStore.java:118) at org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.serviceInit(HBaseTimelineMetricStore.java:96) . The 2188 port is my setting about zookeeper, and from web UI, its status is OK. Also i check zookeeper process, it runs as usual. By the way, metrics needs listen 6188 port, but i use `netstat` to check, related processes do not start. I do not know how to fix it, could someone help me? Thanks
Re: metrics do not show
There is no conf: [root@dx-a ~]# less /etc/ambari-metrics/conf/metrics_grafana.ini /etc/ambari-metrics/conf/metrics_grafana.ini: No such file or directory [root@dx-a ~]# yum list | grep grafana ambari-metrics-grafana.x86_64 2.6.1.0-143 @dx-ambari I download pkgs and make my own repo including it. From: "Siddharth Wagle" To: "user" Sent: Saturday, May 5, 2018 11:05:18 PM Subject: Re: metrics do not show That is the Phoenix metrics system initialization of AMS itself and is non-consequential for the dashboard or Grafana metrics. Check your /etc/ambari-metrics/conf/metrics_grafana.ini is pointing to the collector. - Sid From: xiang@sky-data.cn Sent: Friday, May 4, 2018 11:25 PM To: user Subject: Re: metrics do not show I found below wwaring: 2018-05-05 06:19:30,393 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties From: "Aravindan Vijayan" To: "user" Sent: Friday, May 4, 2018 9:02:46 PM Subject: Re: metrics do not show Hi Xiang, If you have Grafana installed, can you check if the System-Servers and System-Home dashboard show data? -- Thanks and Regards, Aravindan Vijayan From: "xiang@sky-data.cn" Reply-To: "user@ambari.apache.org" Date: Friday, May 4, 2018 at 12:51 AM To: user Subject: metrics do not show But i find that metrics in AMBARI-METRICS and metrics in hosts can not show. -- 戴翔 南京天数信息科技有限公司 电话: +86 1 3382776490 公司官网: www.sky-data.cn 免费使用天数润科智能计算平台 SkyDiscovery
Re: metrics do not show
There is no conf: [root@dx-a ~]# less /etc/ambari-metrics/conf/metrics_grafana.ini /etc/ambari-metrics/conf/metrics_grafana.ini: No such file or directory [root@dx-a ~]# yum list | grep grafana ambari-metrics-grafana.x86_64 2.6.1.0-143 @dx-ambari I download pkgs and make my own repo including it. From: "Siddharth Wagle" To: "user" Sent: Saturday, May 5, 2018 11:05:18 PM Subject: Re: metrics do not show That is the Phoenix metrics system initialization of AMS itself and is non-consequential for the dashboard or Grafana metrics. Check your /etc/ambari-metrics/conf/metrics_grafana.ini is pointing to the collector. - Sid From: xiang@sky-data.cn Sent: Friday, May 4, 2018 11:25 PM To: user Subject: Re: metrics do not show I found below wwaring: 2018-05-05 06:19:30,393 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties From: "Aravindan Vijayan" To: "user" Sent: Friday, May 4, 2018 9:02:46 PM Subject: Re: metrics do not show Hi Xiang, If you have Grafana installed, can you check if the System-Servers and System-Home dashboard show data? -- Thanks and Regards, Aravindan Vijayan From: "xiang@sky-data.cn" Reply-To: "user@ambari.apache.org" Date: Friday, May 4, 2018 at 12:51 AM To: user Subject: metrics do not show But i find that metrics in AMBARI-METRICS and metrics in hosts can not show. -- 戴翔 南京天数信息科技有限公司 电话: +86 1 3382776490 公司官网: www.sky-data.cn 免费使用天数润科智能计算平台 SkyDiscovery
metrics can not work as expected
Hi! I tested installation on my vbox, it works well, then i move it to a server which run many services. When install, it failed at check service status. I checked ambari-metrics-collector.log and found below error: 2018-05-05 08:16:03,536 INFO org.apache.phoenix.metrics.Metrics: Initializing metrics system: phoenix 2018-05-05 08:16:03,559 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties 2018-05-05 08:18:50,342 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to dx-1.novalocal/192.168.80.34:2188, initiating session 2018-05-05 08:18:50,343 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect 2018-05-05 08:18:50,811 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server dx-2.novalocal/192.168.80.27:2188. Will not attempt to authenticate using SASL (unknown error) 2018-05-05 08:18:50,812 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to dx-2.novalocal/192.168.80.27:2188, initiating session 2018-05-05 08:18:50,813 INFO org.apache.zookeeper.ClientCnxn: Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect 2018-05-05 08:18:50,947 INFO org.apache.helix.manager.zk.ZkClient: Closing zkclient: State:CONNECTING sessionid:0x0 local:null remoteserver:null lastZxid:0 xid:1 sent:35 recv:0 queuedpkts:0 pendingresp:0 queuedevents:0 2018-05-05 08:18:50,947 INFO org.I0Itec.zkclient.ZkEventThread: Terminate ZkClient event thread. 2018-05-05 08:18:51,352 INFO org.apache.zookeeper.ZooKeeper: Session: 0x0 closed 2018-05-05 08:18:51,352 INFO org.apache.helix.manager.zk.ZkClient: Closed zkclient 2018-05-05 08:18:51,352 ERROR org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore: org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server within timeout: 3 2018-05-05 08:18:51,354 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore failed in state INITED; cause: org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException: Unable to initialize HA controller org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException: Unable to initialize HA controller at org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.initializeSubsystem(HBaseTimelineMetricStore.java:118) at org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.serviceInit(HBaseTimelineMetricStore.java:96) . The 2188 port is my setting about zookeeper, and from web UI, its status is OK. Also i check zookeeper process, it runs as usual. By the way, metrics needs listen 6188 port, but i use `netstat` to check, related processes do not start. I do not know how to fix it, could someone help me? Thanks
Re: metrics do not show
I found below wwaring: 2018-05-05 06:19:30,393 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties From: "Aravindan Vijayan" To: "user" Sent: Friday, May 4, 2018 9:02:46 PM Subject: Re: metrics do not show Hi Xiang, If you have Grafana installed, can you check if the System-Servers and System-Home dashboard show data? -- Thanks and Regards, Aravindan Vijayan From: "xiang@sky-data.cn" Reply-To: "user@ambari.apache.org" Date: Friday, May 4, 2018 at 12:51 AM To: user Subject: metrics do not show But i find that metrics in AMBARI-METRICS and metrics in hosts can not show.
metrics do not show
Hi! I build 2.6.1 ambari server and agent following docs. Then I succeed in installing zookeeper and ambari-metrics, and metrics in dashborad looks very good. But i find that metrics in AMBARI-METRICS and metrics in hosts can not show. I check the log but do not find error. Did i miss something import? Could someone help me? Thanks
How to set make config warning span enable?
Hi! I want to add a service with customized config. But i notice that if i do not click this service tab, the required warning span can not show. I am confused about this since all other service defined by ambari can show without click like the attached pic shows. How can i do this? Could someone help me? Thanks.
How to use installed zookeeper to install Ambari Metrics
Hi! I have a cluster which has installed zookeeper, and i want to use Ambari to manage it. Also, Ambari Metrics is so cool that i want to add it to my cluster. Is it possible? If so, how to make it?
how to support multi languages
Hi! I am kind of new to Ambari, and it is a wonderful tool to deploy hadoop env. I have a question that how can i use other language to show in web. Is there a easy way to do it? Thanks
services disappeared after add services in web
Hi! I am using ambati 2.6.1, and find a confused question: I add a new stack and then install services in this stack. Install is ok, but after adding a service, the web refresh and then all services disappeared. I found no error in log and if i restart ambari-server, it becomes normally. Could someone help me? -- Best Regards Dai Xiang
How to write service scripts in shell
Hi! I am new about ambari and want to add customized services. I am used to writing scripts in shell. I read docs at ambari and seems that ambari support use shell to write service scripts. But i do not find any examples. All service scripts in ambari repo are in python. Could someone know how to use shell to write service scripts for ambari? Or somewhere can get examples? Thanks Dai