Re: How to add new service in deployed hosts

Hi Xinsheng, Adding a service using the Ambari Web UI is currently under development and should be a part of the next release. You can use the API to add a service, the only challenge is to figure out the right configurations. You can look for default configurations in the stack definition (/var/l

Re: bootstrap hdfs

Hi Aaron, Could you check if the following stub file exists: /var/run/hadoop/hdfs/namenode-formatted ? A restart of NN through Ambari should create all the required directories for you. Go ahead and delete the stub if it exists and restart the NN through Ambari web UI. Best Regards, Sid On Thu

Re: bootstrap hdfs

the file system had a bunch of > stuff in it. > > Thanks, > > Aaron Zimmerman > > > On Thu, Jan 2, 2014 at 6:51 PM, Siddharth Wagle wrote: > >> Hi Aaron, >> >> Could you check if the following stub file exists: >> /var/run/hadoop/hdfs/namenode-format

Re: SSL Connect

Hi Roshan, Seems like a problem with SSL handshake. What is the version of OS you are on? Also, can you check openssl and tls versions installed on the failing hosts. Example: [root@c6401 resources]# rpm -qa | grep openssl openssl-devel-1.0.1e-16.el6_5.4.x86_64 openssl-1.0.1e-16.el6_5.4.x86_64

Re: SSL Connect

-qa | grep openssl >> openssl098e-0.9.8e-17.el6.centos.2.x86_64 >> openssl-1.0.1e-16.el6_5.x86_64 >> >> - rpm -qa | grep tls (Returns nothing) >> >> >> On Thu, Jan 23, 2014 at 12:53 PM, Siddharth Wagle > > wrote: >> >>> Hi Roshan, >

Re: Error while adding new service to existing cluster

Hi Anisha, It seems the service might not be a part of the stack. Can you provide the exact API call? Also, what version of stack did you select while installing your cluster? Note, make sure to append *-H "X-Requested-By:ambari" *with every curl call. Although, this would result in 400 Bad reque

Re: Overriding values in component configuration using the Ambari UI

Hi Chris, Are you using Config groups to overrides configs as per the latest API docs ? https://github.com/apache/ambari/blob/trunk/ambari-server/docs/api/v1/config-groups.md It is possible to do this using the Web UI too, using the Manage Config Groups link on the Config page. Could you please

Re: Ambari python shell

Hi Lajos, This is a part of the ambari cli, the git repo url: https://github.com/apache/ambari/tree/trunk/ambari-client Best Regards, Sid On Wed, Feb 19, 2014 at 12:31 AM, lajos papp wrote: > Hi, > > On the wiki page there is an "Ambari python Shell" section: > https://cwiki.apache.org/conflue

Re: Error installing Hadoop using ambari

Hi Akshatha, The command that is failing by looking at the log: mkdir -p /tmp/HDP-artifacts/ ; curl -kf --retry 10 http://host-ambari.uisp-hadoop.com:8080/resources//jdk-6u31-linux-x64.bin -o /tmp/HDP-artifacts//jdk-6u31-linux-x64.bin Can you verify that the /tmp directory has correct permission

Re: Error deploying hadoop cluster using Ambari

Correction, /tmp permissions should be "1777". On Thu, Feb 20, 2014 at 10:20 PM, AKSHATHA SATHYANARAYAN < akshath...@samsung.com> wrote: > > > Hello, > > > > I am getting the following error while trying to deploy a hadoop cluster > with 2 data nodes. > > err: > /Stage[1]/Hdp::Snmp/Hdp::Package

Re: REST api question

Hi Aaron, You should be able to do this by changing state of a Service component. Sample API call: curl -H "X-Requested-By:ambari" -u admin:admin -i -X PUT -d '{"RequestInfo":{"context":"Stop all datanodes"},"ServiceComponentInfo": {"state": "INSTALLED"}}' http://localhost:8080/api/v1/clusters/c

Re: Initializaton errors on Ambari 1.4.1

Hi Ximo, Could you please provide the thread dump when you notice this? (jstack command output) I would be glad to open a Jira for tracking this issue unless you want to open it that's fine too. The tables to look at for cleaning up the postgres db are, execution_command and host_role_command wh

Re: Initializaton errors on Ambari 1.4.1

hout a maintenance period. I will try to reproduce in > another environment to get the thread dump and I will attach it to the JIRA. > > Thanks! > Ximo > > De: Siddharth Wagle mailto:swa...@hortonworks.com > >> > Responder a: "user@ambari.apache.org<mailto:user@am

Re: role dependency question

We use Role Command order to figure out what can be run in parallel within a stage and what cannot. However, we do Install and Start as separate stages, the Start / Stop API calls are designed to do State transitions which effectively mean create Start stage after and Install stage is successful.

Re: What to override when extending a stack in 1.5?

Hello Chris, Based on conversation with Dmitry L, responses posted inline. I'd like to know how the "extends" mechanism works. I want to extend an existing stack to use as a base for my stack. How would the following scenarios be accomplished: - I'd like to extend a stack under HDP, but from a d

Re: Finding valid properties for config via Ambari 1.5

Hi Chris, If you look at global.xml in the stack definition you should be able to find most if not all of the above properties. These are properties that are required to configure the cluster but do not belong to a stack component, the web UI sets the appropriate values at runtime. The configurati

Re: Finding valid properties for config via Ambari 1.5

tack, would it make sense to go in that direction? > > Does that make sense? > > Thanks, > -Chris > > > On Mon, Apr 7, 2014 at 2:55 PM, Siddharth Wagle wrote: > >> Hi Chris, >> >> If you look at global.xml in the stack definition you should be able to >>

Re: Using Ambari with vanilla Apache releases

I can join you guys as well with Ambari backend support. -Sid On Fri, Apr 11, 2014 at 6:24 PM, Yusaku Sako wrote: > Hi Roman, > > This is a great idea! > I'm interested in providing some Ambari expertise. > > Yusaku > > > On Fri, Apr 11, 2014 at 4:57 PM, Roman Shaposhnik wrote: > >> On Fri, Ap

Re: Upgrading to ambari 1.5.1

Hi, This is harmless exception related to blueprints which happens when you run upgrade script and does not affected cluster deployment functionality. Best Regards, Sid On Thu, Apr 24, 2014 at 1:52 PM, ILOGLU, EMINE wrote: > I get this in /var/log/ambari-server/ambari-server.log. Any remedy

Re: Question about how to change name node ip address after cluster is created by Ambari

Ambari uses hostnames as keys for all managed hosts. As long as the hostnames remain the same you should not have any problems. Best Regards, Sid On Tue, May 27, 2014 at 11:22 PM, Xiaoding Bian Cloud Services RANDD - 72410 wrote: > > > -- > *From: *"Emma Lin" > *T

Re: Question about how to change name node ip address after cluster is created by Ambari

io. If yes, we can integrate with this function, if no, I > will get a reasonable justification for DDNS setup in user's environment. > > thanks, > Emma > ------ > *From: *"Siddharth Wagle" > *To: *user@ambari.apache.org > *Sent: *Wednesday, Ma

Re: Getting started with custom stacks

Hi Pradeep, This should be a good starting point, https://cwiki.apache.org/confluence/display/AMBARI/Stacks+and+Services -Sid On Mon, Jun 2, 2014 at 3:51 PM, Pradeep Gollakota wrote: > Hi All, > > I would like to write some custom stacks. The recent release of Ambari-1.5 > has made this possi

Re: How to add configurations to specific host to create cluster using blueprint ?

Hi Qing Chi, You can have 2 host_groups with exactly same components say "salve_type_1", "slave_type_2" with different configs for each host group. -Sid On Thu, Jun 5, 2014 at 6:52 PM, Qing Chi 79624 wrote: > Hi Jeff, > Thanks a lot for your help. > I think the host_group is the group which

Re: How to add configurations to specific host to create cluster using blueprint ?

t if there are hundreds of host with the same > components. In this solution I must create hundreds of host_group as well. > > -qing > > From: Siddharth Wagle > Reply-To: > Date: Thu, 5 Jun 2014 19:00:18 -0700 > To: "user@ambari.apache.org" > > Cc: Em

Re: Graphs and HeatMaps are Not Visible on Ambari Web-UI

Hi Meghavi, Are you able to obtain metrics data by turning off SELinux temporarily on Ganglia host ? Also, are rrd files being written to /var/lib/ganglia/rrds/ ? -Sid On Mon, Jun 9, 2014 at 4:19 AM, Meghavi Sugandhi wrote: > > Hello, > > I am using Ambari 1.4.4. > I have installed it succe

Re: Graphs and HeatMaps are Not Visible on Ambari Web-UI

e: http://www.tcs.com >>> >>> -Yusaku Sako >>> wrote: - >>> To: user@ambari.apache.org >>> From: Yusaku Sako >>> Date: 06/10/2014 11:21AM >>> Subject: Re: Graphs and HeatMaps are Not Visible on Ambari Web-UI >>> >>> You can ru

Re: ambari upgrade

Hi Emine, This would happen if, you had custom service components defined in the stack definition before the upgrade. Ambari upgrade would override the stack definition with newer versions of the stack, example HDP-1.3.3 and the service component that was added previously to the XML definition wo

Re: Ambari UI not recovering after Machine power failure

Hi Suraj, Found a similar thread on postgres forum, http://postgresql.1045698.n5.nabble.com/select-table-indicate-missing-chunk-number-0-for-toast-value-96635-in-pg-toast-2619-td5682176.html The cleanup commands at the end of the topic seem worth a try. Note: If key_value_store has corrupt data

Re: Ambari UI not recovering after Machine power failure

ll ambari face problem ? Which is the configuration file Ambari uses to >store postgres username and password? > > -- > Suraj Nayak > > > On Thursday 10 July 2014 09:31 AM, Yusaku Sako wrote: > > Suraj, > > Here's the API call that Sid mentioned for res

Re: All processes are waiting during Cluster install

Try a yum clean all and a "yum install *mysql-connector-java*" from command line on the hosts with any HIVE, OOZIE components. Then retry from UI. -Sid On Sun, Jul 13, 2014 at 12:36 PM, Suraj Nayak M wrote: > Hi Sumit, > > "I restarted the process" meant - I restarted the deployment from the

Re: ambari upgrade

ow do you add a service component to the stack? > > > > Thanks > > > > *Emine Iloglu* > > AT&T - System Architecture & Applied Technology (SAAT) > > T: 848-218-2108 | Q: ei947t > > (Remote, Eastern Timezone) > > > > > > *From:* Siddh

Re: How to run Ambari Server Locally

Hi Suraj, You can edit the /usr/sbin/ambari-server.py file on the VM running Ambari server and search for START_CMD. The debug instruction is just below it in the python script. Rename the DEBUG_CMD to the start and the start to something else and restart the ambari server. You can then connect

Re: Issue while installing Ambari Clusters

Hi Max, Can you edit bootstrap.py and set DEBUG = False to DEBUG = True and retry. This will give you the scp command that is failing and you can actually run it manually to see what is the actual error. Best Regards, Sid On Fri, Jul 25, 2014 at 4:26 PM, Maximilian Arruda < max.arr...@vectorx.

Re: RestAPI for pushing a configuration to a component in 1.2.4

Hi Sudarshan, 1. What version of Ambari are you on? (This will decide what feature support you have, regardless of the stack version). 2. push configuration in the form of Json or a file. - This can be done with /var/lib/ambari-server/resources/scripts/configs.sh (Not sure which version of this

Re: RestAPI for pushing a configuration to a component in 1.2.4

specific component installed on a particular >host: I am guessing we have no choice but to upgrade ? Or some custom >stuff with configs.sh I am guessing . > > Regards > Sud > > From: Siddharth Wagle > Reply-To: "user@ambari.apache.org" > Date: Monday,

Re: RestAPI for pushing a configuration to a component in 1.2.4

You can create a config and attach it to any service and thereby a host component. The config will be sent to the host on any execution command, example: START/STOP. However, you would need to add a small snippet of code (4 lines) for the configuration to be applied on the host. Take a look at the

Re: RestAPI for pushing a configuration to a component in 1.2.4

Correct URL: https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HDFS/package/scripts/hdfs.py -Sid On Tue, Jul 29, 2014 at 1:07 PM, Siddharth Wagle wrote: > You can create a config and attach it to any service and thereby a host > com

Re: Ambari dependency on Python version 2.6

Hi Sidharth and Martin, I have run unit tests with python version 2.7 a while ago and all of them ran ok. There was also a recent Jira which fixed a related issue, https://issues.apache.org/jira/browse/AMBARI-6845 It would be great if one you could proceed with installing Ambari with Python 2.7.

Re: question on [STACK]/[SERVICE]/metainfo.xml inheritance rules

Hi Alex, Replies inline. 1. If a component exists in the parent stack and is defined again in the child stack with just a few attributes, are these values just to override the parent's values or the whole component definition is replaced. We go property by property and merge them from parent to

Re: Not all metrics are populating‏

The JMX URL posted in the log looks wrong. What is the value of "dfs.namenode.http-address" in your hdf-site.xml ? And, can you access : http://namenode.localdomain:8745/ jmx, from your browser? Make sure the Ganglia host resolves from your amb

Re: Puppet and Ambari

Hi Aaron, Unfortunately we do not have a way to run puppet code anymore from the ambari agent. We got rid of the puppet code for several reasons, most important ones were: - Speed - Ability to write unit tests That being said at the task execution level executing a puppet apply from the PuppetExe

Re: No Cluster Load, Memory, CPU and network information for HDPNamenode in Ganglia

Hi Ming, 1. Check of gmond daemon is running on the Ganglia server host with HDPNamenode in the path. Namenode pushes metrics to that gmond process. 2. Edit /etc/ganglia/hdp/HDPNamenode/gmond.core.conf, set debug = 10. Restart gmond on ganglia server host, #] service hdp-gmond restart. This wil

Re: No Cluster Load, Memory, CPU and network information for HDPNamenode in Ganglia

> HDPNamenode folder). > > I think the HDPNameNode related config files should be pushed to > /etc/ganglia/hdp folder of the namenode machine. This should also apply to > other services. > > Let me know what you think. Thanks! > > On Tue, Oct 21, 2014 at 11:51 AM, Siddharth

Re: Ambari Tracking configuration changes

Hi Iva, Correctly specifying type and tag will get you the key values that you are looking for. You might find it useful to download a JsonViewer app (if using Chrome/Firefox) and effectively just click on the config hrefs to navigate to the key/value properties. -Sid On Fri, Nov 7, 2014 at 12:

Re: Adding install priority to custom services

Hi Satya, Take a look at the ambari-server/src/main/resources/role_command_order.json This json structure is used to build the dependency graph between components. Every stack overrides this file to add order between new components that the stack introduces, so that the base copy of this fil

Re: Adding install priority to custom services

er was happening in Alphabetical order. 3. I want the order to be C, B and A. Am I missing something here. Thanks, Satya. From: Siddharth Wagle [mailto:swa...@hortonworks.com<mailto:swa...@hortonworks.com>] Sent: 05 March 2015 01:58 To: user@ambari.apache.org<mailto:u

Re: Ambari Nagios plugin config

Hi Anil, You should be able to do this using the Nagios Web UI. You can reach it by using the Quick links drop down on Nagios service page in the Ambari web. BR, Sid From: aaa kkk Sent: Wednesday, April 01, 2015 4:47 AM To: user@ambari.apache.org Subject: A

Re: Re:How to get datanode numbers in stack_advisor.py#recommendHDFSConfigurations?

Hi Qi Yun Liu, This method is what you are looking for : stacks/HDP/2.0.6/services HDP206StackAdvisor#getHostsWithComponent Example: datanodeHosts = self.getHostsWithComponent("HDFS", "DATANODE", services, hosts) In: stacks/HDP/2.2/services/ HDP22StackAdvisor#recommendHDFSConfigurations

Re: Re:Re: Re:How to get datanode numbers in stack_advisor.py#recommendHDFSConfigurations?

os_type': u'redhat6', u'last_agent_env': {u'transparentHugePage': u'never', u'hostHealth': {u'agentTimeStampAtReporting': 1429155391291, u'activeJavaProcs': [], u'serverTimeStampAtReporting': 1429155391348,

Re: Re:Re: Re:How to get datanode numbers in stack_advisor.py#recommendHDFSConfigurations?

By we, I meant the stack advisor feature only. -Sid From: Siddharth Wagle Sent: Thursday, April 16, 2015 9:34 AM To: user@ambari.apache.org Subject: Re: Re:Re: Re:How to get datanode numbers in stack_advisor.py#recommendHDFSConfigurations? Hi Qi Yun Li, I

Re: Re:Re: Re:Re: Re:How to get datanode numbers in stack_advisor.py#recommendHDFSConfigurations?

milar requirements. Therefore, I created a patch for jira AMBARI-10515 and did some tests to ensure no regression bug is brought. Could you please help take a review on it? Thanks a lot! At 2015-04-17 00:34:51, "Siddharth Wagle" wrote: By we, I meant the stack advisor featu

Re: ambari metrics dose not show some information after recreating ambari-server instance from image on Google Cloud Platform

Hi Jongchul, Can you check for/post errors if any in either : /var/log/ambari-metrics-collector/hbase-ams-master-.log /var/log/ambari-metrics-collector/ambari-metrics-collector.log Also, make sure "ps aux | grep ams" on the Metrics Collector shows 3 process (I am assuming that this is defau

Re: Kafka broker metrics not appearing in REST API

Hi Jayesh, Are you using Ambari 2.0 with Ambari Metrics service? BR, Sid From: Jayesh Thakrar Sent: Wednesday, May 06, 2015 7:53 PM To: user@ambari.apache.org Subject: Kafka broker metrics not appearing in REST API Hi, I have installed 2 clusters with Ambar

Re: Kafka broker metrics not appearing in REST API

: Wednesday, May 06, 2015 8:07 PM To: Siddharth Wagle; user@ambari.apache.org Subject: Re: Kafka broker metrics not appearing in REST API Hi Siddharth, Yes, I am using Ambari 2.0 with Ambari Metrics service. The interesting thing is that I got them for some time and not anymore. And I also know that the

Re: Kafka broker metrics not appearing in REST API

= hdfs://:8020/amshbase hbase.cluster.distributed = true -Sid From: Jayesh Thakrar Sent: Wednesday, May 06, 2015 8:30 PM To: user@ambari.apache.org; Siddharth Wagle; Jayesh Thakrar Subject: Re: Kafka broker metrics not appearing in REST API More info I was

Re: Kafka broker metrics not appearing in REST API

ition: 0Leader: 12 Replicas: 12,2,3Isr: 12,3,2 Topic: slimlogs_v1 Partition: 1Leader: 14 Replicas: 14,3,4Isr: 14,3,4 Topic: slimlogs_v1 Partition: 2Leader: 15 Replicas: 15,4,5Isr: 15,4,5 ____

Re: Kafka broker metrics not appearing in REST API

o that, will let you know once I have tried it out. Thanks, jayesh ________ From: Siddharth Wagle To: "user@ambari.apache.org" ; Jayesh Thakrar Sent: Wednesday, May 6, 2015 10:42 PM Subject: Re: Kafka broker metrics not appearing in REST API How big is your cl

Re: Kafka broker metrics not appearing in REST API

e data dir size. [jthakrar@dtord01flm03p data]$ pwd /localpart0/ambari-metrics-collector/hbase/data [jthakrar@dtord01flm03p data]$ du -xhs * 14G default 72K hbase ____ From: Siddharth Wagle To: "j_thak...@yahoo.com" ; "user@ambari.apache.or

Re: Kafka broker metrics not appearing in REST API

5 Swap: 8191 0 8191 ________ From: Siddharth Wagle To: "user@ambari.apache.org" ; "user@ambari.apache.org" Sent: Wednesday, May 6, 2015 11:31 PM Subject: Re: Kafka broker metrics not appearing in REST API Is this or can this be w

Re: Kafka broker metrics not appearing in REST API

Sorry, took a while - was away. I don't have the "enhanced-dashboard" file, but am attaching the following - ambari-metrics-collector/ambari-metrics-collector.log ambari-metrics-collector/ambari-metrics-collector.out Thanks, Jayesh From: Siddharth W

Re: Kafka broker metrics not appearing in REST API

Based on your collector log in the file which goes back for a few hours there was no issues talking to HBase, the aggregation threads all completing in time. The HBase log might reveal something. From: Siddharth Wagle Sent: Thursday, May 07, 2015 11:35 AM To

Re: Kafka broker metrics not appearing in REST API

don't get it. Thanks, jayesh ____ From: Siddharth Wagle To: "user@ambari.apache.org" ; Jayesh Thakrar Sent: Thursday, May 7, 2015 1:35 PM Subject: Re: Kafka broker metrics not appearing in REST API My mistake that is just my hostname. Could you att

Re: Adding configuration parameters and monitoring metrics for custom service

Ambari Metrics wiki page has useful info for you: https://cwiki.apache.org/confluence/display/AMBARI/Metrics BR, Sid From: Jayesh Thakrar Sent: Tuesday, May 19, 2015 3:01 PM To: User Subject: Adding configuration parameters and monitoring metrics for custom

Re: Adding configuration parameters and monitoring metrics for custom service

TSDB metrics are in Ambari, how do I show them in simple graphs in Ambari? From: Siddharth Wagle To: User ; Jayesh Thakrar Sent: Tuesday, May 19, 2015 6:31 PM Subject: Re: Adding configuration parameters and monitoring metrics for custom service Ambari Metrics wiki

Re: Adding configuration parameters and monitoring metrics for custom service

right? From: Siddharth Wagle To: "user@ambari.apache.org" ; Jayesh Thakrar Sent: Wednesday, May 20, 2015 11:45 AM Subject: Re: Adding configuration parameters and monitoring metrics for custom service Hi Jayesh, Did you look through the A

Re: Can't get Ambari Metrics to write to HDP 2.2.4 HBase

Inline. From: Ken Barclay Sent: Thursday, July 09, 2015 4:46 PM To: Siddharth Wagle; Sumit Mohanty Subject: Re: Can't get Ambari Metrics to write to HDP 2.2.4 HBase Hi Sid, Thanks, I can install Phoenix and see how far I get. Could I understand more abou

Re: Questions for AMBARI-5707

From: Lixiantao Sent: Friday, July 24, 2015 12:37 AM To: Siddharth Wagle Subject: Questions for AMBARI-5707 Hi, I have seen Revised archtecture diagram.pnd , want to know how to deploy the OpenTSDB ?it is deployed specilally for Metrcs System or the same one as bussiness

Re: Posting Metrics to Ambari

Hi Bryan, Few things you can do: 1. Turn on DEBUG mode by changing log4j.properties at, /etc/ambari-metrics-collector/conf/ This might reveal more info, I don't think we print every metrics received to the log in 2.0 or 2.1, I did add this option if TRACE is enabled to trunk recently. 2.

Re: Posting Metrics to Ambari

pRow":"AMBARI_METRICS.SmokeTest.FakeMetric\\x01","loadColumnFamiliesOnDemand":null,"totalColumns":1,"cacheBlocks":true,"families":{"0":["ALL"]},"maxResultSize":-1,"maxVersions":1,"filter&

Re: Posting Metrics to Ambari

.json completed would be much easier. The AMS API does need some refinement. Jiras / Bugs are welcome. -Sid From: Siddharth Wagle Sent: Saturday, July 25, 2015 9:01 PM To: user@ambari.apache.org Subject: Re: Posting Metrics to Ambari No dev work need only ne

Re: Posting Metrics to Ambari

g with all these questions, I just don't have any previous experience with Ambari. Thanks, Bryan On Sun, Jul 26, 2015 at 12:10 AM, Siddharth Wagle mailto:swa...@hortonworks.com>> wrote: The AMS API does not allow open ended queries so startTime and endTime are required fields

Re: Posting Metrics to Ambari

mp;appId=NIFI&hostname=localhost&startTime=143804730&endTime=143804742&precision=hours Those all get no results. The only time I got a difference response, was this example: http://localhost:6188/ws/v1/timeline/metrics?metricNames=FlowFiles_Received_Last_5_mins&a

Re: Dynamic Metric Names

Hi Bryan, Yes, we do have regex support in the declarative definition of the service. Unfortunately, it isn't documented at the moment. Best Example: YARN Queue metrics. The queue name is substiuted by the UI, replaced by the MetricsPropertyProvider inside the actual metrics name before call

Re: Modifying metrics.json file of a service.

Note: After restarting the server that is, as Bryan pointed out. From: Siddharth Wagle Sent: Friday, August 14, 2015 3:06 PM To: user@ambari.apache.org Subject: Re: Modifying metrics.json file of a service. Hi Chris, You should be able to see your changes

Re: host_metrics.jpg

/confluence/display/AMBARI/Ambari+Metrics+API+specification Regards, Sid From: 宋锋 Sent: Wednesday, August 19, 2015 8:05 PM To: Siddharth Wagle Subject: host_metrics.jpg Dear Siddharth Wagle, Sorry to take your time to answer my question. Would you

Re: Ambari metrics collector CPU usage

Hi Andrew, 1. Have you looked at the gc log for the collector HBase? There could be a correlation between the heap pressure and the CPU spike. What we have seen is tuning the heap settings (Xmx and Xmn sizes) does help in alleviating the CPU usage. 2. What is the load average on your Collector

Re: Warning from Ehcache in ambari-server log, and a socket error

Hi Eirik, Thank you for reporting this issue. Unless there is a problem with Out of Memory error on ambari server caused due to Ehcache giving up on calculating true size of the in-memory cache, the following error is harmless. I have created a Jira, AMBARI-13411, to address this problem in the

Re: Ambari Metrics

://cwiki.apache.org/confluence/display/AMBARI/Troubleshooting+Guide Best Regards, Sid From: smlynarc...@prognosive.com Sent: Monday, October 19, 2015 12:33 PM To: Siddharth Wagle Cc: Daryl Heinz Subject: Ambari Metrics Hello Siddharth, I am hoping to get your input on

Re: Ambari Metrics

this mean that one would never be able to deploy/run AMS on a Mac because hadoop never has had any native libs built for Darwin? thanks — Hitesh On Oct 20, 2015, at 6:50 PM, Siddharth Wagle wrote: > Hi Stan, > > Based on the col.txt attached, the real problem is: >

Re: Ambari Metrics

info. Also, the configs from: /etc/ams-hbase/conf and /etc/ambari-metrics-collector/conf - Sid From: smlynarc...@prognosive.com Sent: Wednesday, October 21, 2015 10:38 AM To: Siddharth Wagle; user@ambari.apache.org Cc: Daryl Heinz Subject: Re: Ambari Metrics

Re: Ambari Metrics

es. - Sid From: smlynarc...@prognosive.com Sent: Wednesday, October 21, 2015 5:33 PM To: Siddharth Wagle; user@ambari.apache.org Cc: Daryl Heinz Subject: Re: Ambari Metrics Hello Sid, here are the configs. The logs are very large so instead of emailing, I ha

Re: Issue with Ambari Metrics Collector - Distributed mode

Hi Vijaya, Please make all of the configs are accurate. (https://cwiki.apache.org/confluence/display/AMBARI/AMS+-+distributed+mode) Can you attach, your ams-site.xml and /etc/ams-hbase/conf/hbase-site.xml ? - Sid From: Vijaya Narayana Reddy Bhoomi Reddy

Re: metrics visible from host_component but not component

Hi, There is a field called timelineAppId, example: common-services/ACCUMULO/1.6.1.2.2.0/metainfo.xml This will override what Ambari uses in the call to AMS, you can set this to gpfs. - Sid From: Dmitry Sen Sent: Tuesday, November 10, 2015 9:21 AM To: use

Re: metrics visible from host_component but not component

-X GET "http://dn01:6188/ws/v1/timeline/metrics?metricNames=gpfs.disk_used&appId=gpfs"; {"metrics":[]} [root@dn01-dat ~]# curl -X GET "http://dn01:6188/ws/v1/timeline/metrics?metricNames=gpfs.disk_used&appId=gpfs_master"; {"metrics":[]} I have al

Re: metrics visible from host_component but not component

Hi Nate, I'm glad you figured out the fine grained details. I will try to add a wiki page on this to help others out. The timeline.metrics.service.cluster.aggregator.appIds controls the system level app metrics, meaning in addition to what metrics you are writing to AMS, it will give you the

Re: Unable to Start Ambari Metrics Collector

Hi Shaik, Please look at Issue # 6 on this list: https://cwiki.apache.org/confluence/display/AMBARI/Known+Issues Let me know if that helped. Thanks, Sid From: Shaik M Sent: Wednesday, November 11, 2015 4:29 PM To: user@ambari.apache.org Subject: Re: Un

Re: Yarn nodemanager java.lang.OutOfMemory

Thanks Adam for reporting this. Could you please tell us which version of Ambari are you running? This bit is very important to be known. We do not have previous report of this issue. I have filed an Apache Jira for this: https://issues.apache.org/jira/browse/AMBARI-15100 BR, Sid __

[ANNOUNCE] Sandor Magyari as Ambari committer

Hi all, It's my pleasure to announce Sandor Magyari as a new Apache Ambari committer. He has made valuable contributions to the project and we hope he will continue to do so. Congratulations Sandor. Best Regards, Sid

Re: Cluster CPU widget is wrong

Hi Cyril, Could you kindly open an Apache Jira with details like: - Ambari version - Number of cores - OS for the host Note: AMS supports (._avg, ._sum, ._max, ._min) as the aggregate functions for any metrics requested. We have made numerous fixes recently to AMS including new Grafana U

Re: Graphana integration in ambari metrics

Helpful instructions: https://github.com/apache/ambari/tree/trunk/ambari-metrics/ambari-metrics-grafana#installam - Sid From: Sean Roberts Sent: Tuesday, May 17, 2016 9:10 AM To: user@ambari.apache.org Cc: Jayush Luniya Subject: Re: Graphana integration in am

Re: About Ganglia configuration in hadoop-metrics2.properties.j2

Hi Rui Gao, Ambari no longer support Ganglia in version 2.1.0. Instead Ambari Metrics Service provides better capability to scale with regards to growing cluster size as well as customized dashboard based visualizations using Grafana. Regarding you question regarding the ports: Is the NN conf

Re: About Ganglia configuration in hadoop-metrics2.properties.j2

the rrd file names in /var/lib/ganglia/rrds Then use UI or API to change the widget definition to pull that metric. BR, Sid From: Siddharth Wagle Sent: Wednesday, September 07, 2016 9:10 AM To: user@ambari.apache.org Subject: Re: About Ganglia configuration in

Re: About Ganglia configuration in hadoop-metrics2.properties.j2

: Siddharth Wagle Reply-To: "user@ambari.apache.org" Date: Thursday, September 8, 2016 at 02:59 To: "user@ambari.apache.org" Subject: Re: About Ganglia configuration in hadoop-metrics2.properties.j2 Note: AMS sink adds the client/service to the metric name, as far as I rememb

Re: [metrics collector] stopping by itself

Hi Eric, Please take a look at the troubleshooting section on the wiki: https://cwiki.apache.org/confluence/display/AMBARI/Troubleshooting How many node cluster do you have? What is the version of Ambari? BR, Sid From: Eric Troies Sent: Wednesday, Septem

Re: [metrics collector] stopping by itself

x27;ve set timeline.metrics.cluster.aggregator.second.ttl from 15 days to 3, will see if that helps. Regards, Olivier On Wed, Sep 21, 2016 at 6:04 PM, Siddharth Wagle mailto:swa...@hortonworks.com>> wrote: Hi Eric, Please take a look at the troubleshooting section on the wiki: https://cwiki.apache.org/confluenc

Re: Ambari Metrics Collector Process alert - CRITICAL threshold rule

Hi Ganesh, AMS in AMbari version 2.2.1 had some perf impact due to HBase noramlizer, I would recommend upgrading to 2.4.1 if possible. Regarding 2] The HBase and HDFS alerts are not all based off of AMS only the Namenode alerts ending with "_hourly" or "_daily" depend on AMS. Other alerts ei

Re: Ambari Metrics Collector Process alert - CRITICAL threshold rule

It means that the alert runner/thread on the agent waits for 1.5 seconds before raising a WARNING and 5 seconds before raising a CRITICAL message. The configured interval for often this runs is independent of these threasholds consumed by the alert instance. I am not sure what you mean by "po

Re: custom metrics - tomcat

API to POST metrics to AMS: https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification You can query metadata API to check if metrics are written to the Collector with this API: http://:6188/ws/v1/timeline/metrics/metadata Grafana UI's are driven by metadata API a

Re: adding functionality to transfer metrics data to another external file

@Naveen, what is it that you are trying to achieve? It is hard to suggest anything based on obscure details below. If you are writing a new Sink please look at the page below for some guidance: https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification BR, Sid _

Re: Apply custom service configs using Rest API

Ambari upgrade should not affect your custom service in any way. Depending on what version of Ambari you are on, you might have to back up your service definition that you placed in the Ambari server resources/common-services and resource/stacks dirs. We have a script to aid config backup / re

  1   2   >