Re: Ambari 2.0 Kerberos Activation - Failed to create keytab

2015-04-17 Thread Frank Eisenhauer
Hi Rob, thank you very much. I wasn't aware Ambari is running as non-root as I always started Ambaris as root user. I changed the user setting in ambari.properties and was able to activate kerberos. Is there already a date for the Ambari Update to be availabe? Best regards Frank Am 18.04.

Re: Ambari 2.0 Kerberos Activation - Failed to create keytab

2015-04-17 Thread Robert Levas
Hi FrankŠ It seems like Ambari is running as ambari-server, not root. This isn¹t typically an issue, but in this case the problem from https://issues.apache.org/jira/browse/AMBARI-10266 is coming into play. The solution will be in the next releases of Ambari (2.0.1 and 2.1), but for now it appear

Re: Ambari 2.0 Kerberos Activation - Failed to create keytab

2015-04-17 Thread Frank Eisenhauer
Hi Rob, the direcory "/var/lib/ambari-server/data/tmp/" exists and has the following permissions: drwx-- 2 ambari-server root 4096 Apr 13 20:28 cache drwxrwxrwx 10 ambari-server root 4096 Apr 17 21:41 tmp I changed the permissions to 777 just to exclude permissions as a root cause. But

Re: Ambari 2.0 Kerberos Activation - Failed to create keytab

2015-04-17 Thread Robert Levas
Hi Frank, Can you check to see if /var/lib/ambari-server/data/tmp/ exists on the Ambari server host? If so, what permissions does it have? Ideally, /var/lib/ambari-server/data/tmp/ exists and all directories in the path are executable by the user that Ambari runs as. Both of these are essential

Re: Ambari 2.0 Kerberos Activation - Failed to create keytab

2015-04-17 Thread Frank Eisenhauer
Hi Jeff, Ambari is running as root. Am 17.04.2015 um 21:50 schrieb Jeff Sposetti: Hi, Are you running your Ambari Server as non-root? https://issues.apache.org/jira/browse/AMBARI-10266 You might be hitting that BUG. On 4/17/15, 3:41 PM, "Frank Eisenhauer" wrote: Hi All, I'm trying to enab

Re: Ambari 2.0 Kerberos Activation - Failed to create keytab

2015-04-17 Thread Jeff Sposetti
Hi, Are you running your Ambari Server as non-root? https://issues.apache.org/jira/browse/AMBARI-10266 You might be hitting that BUG. On 4/17/15, 3:41 PM, "Frank Eisenhauer" wrote: >Hi All, >I'm trying to enable Kerberos in Ambari 2.0.0 after upgrade from Ambari >1.7. > >During "Test Kerberos

Ambari 2.0 Kerberos Activation - Failed to create keytab

2015-04-17 Thread Frank Eisenhauer
Hi All, I'm trying to enable Kerberos in Ambari 2.0.0 after upgrade from Ambari 1.7. During "Test Kerberos Client" I'm getting the error "Failed to create keytab file for ambari-qa_idhey...@bigdata.xxx - Failed to export keytab file" The ambari-server.log states: 17 Apr 2015 21:41:29,601 INF

Re: delete using API problem

2015-04-17 Thread Artem Ervits
I'll gather the logs but curl outputs I lost in the console. On Fri, Apr 17, 2015 at 3:03 PM, Sumit Mohanty wrote: > Can you share the logs and curl outputs - perhaps attach to an Apache > JIRA? The errors need some more investigation. > > > -Sumit > -- > *From:* d

Re: delete using API problem

2015-04-17 Thread Sumit Mohanty
Can you share the logs and curl outputs - perhaps attach to an Apache JIRA? The errors need some more investigation. -Sumit From: dbis...@gmail.com on behalf of Artem Ervits Sent: Friday, April 17, 2015 12:00 PM To: user@ambari.apache.org Subject: Re: delete

Re: delete using API problem

2015-04-17 Thread Artem Ervits
still had to delete STORM_UI_SERVER by API curl -u admin:admin -H "X-Requested-By:ambari" -X DELETE http://localhost:8080/api/v1/clusters/NYPTest/services/STORM then tried deleting the service again and transaction rolled back again. retried the command and it went through: 17 Apr 2015 14:58:39

Re: delete using API problem

2015-04-17 Thread Artem Ervits
ok, I went to the Ambari database and found table servicedesiredstate, in that table, STORM is listed as STARTED in desired_state column. I issued a command to stop the service curl -u admin:password -i -H 'X-Requested-By: ambari' -X PUT -d '{"RequestInfo": {"context" :"Stop STORM"}, "Body": {"Ser

Re: No Heartbeat after upgrade to Ambari 2.0

2015-04-17 Thread Frank Eisenhauer
Hi Sumit, THANK YOU VERY MUCH!! Everything works like a charm! I'm looking forward to testing the new ambari features! Am 17.04.2015 um 19:51 schrieb Sumit Mohanty: Looks like two hosts originally registered with all CAPS. HADOOP01.BIGDATA.LOCAL HADOOP02.BIGDATA.LOCAL Does hostname

Re: Re:Re: Re:Re: Re:How to get datanode numbers in stack_advisor.py#recommendHDFSConfigurations?

2015-04-17 Thread Srimanth Gunturi
​Hi Qi Yun Liu, On the trunk source #getHostsWithComponent() returns all hosts containing the component. https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py#L211 There is also #getHostWithComponent() which returns the first o

RE: Ambari Blueprint

2015-04-17 Thread Pratik Gadiya
Thanks Alejandro !! I had generated that blueprint by actually deploying a cluster with the desired configuration. However, I was not sure if following services needs to be there on both the nodes or they need to be there on compute or on master host. 1. Flume 2. Supervisor 3.

Re: delete using API problem

2015-04-17 Thread Artem Ervits
I am seeing a lot of these: 17 Apr 2015 13:52:18,828 WARN [pool-2-thread-684] RestMetricsPropertyProvider:204 - Unable to get component REST metrics. No host name for STORM_UI_SERVER. 17 Apr 2015 13:52:25,183 WARN [pool-2-thread-685] RestMetricsPropertyProvider:204 - Unable to get component REST

Re: No Heartbeat after upgrade to Ambari 2.0

2015-04-17 Thread Sumit Mohanty
Looks like two hosts originally registered with all CAPS. HADOOP01.BIGDATA.LOCAL HADOOP02.BIGDATA.LOCAL Does hostname -f or socket.getfqdn() [python] return names in all CAPS? Ambari 2.0 code is converting host names to lower and that could be the reason for mismatch. The work-around is to

Re: Re:Re: Re:Re: Re:How to get datanode numbers in stack_advisor.py#recommendHDFSConfigurations?

2015-04-17 Thread Siddharth Wagle
Hi Qi Yun Li, I do not see any downstream changes in this patch. How does this help you? Let me elaborate more on what I mean by heterogeneous envs are not supported: When you have different host configurations the way to configure them differently is by using the Config Group feature of Amba

Re: Ambari Blueprint

2015-04-17 Thread Alejandro Fernandez
Hi Pratik, the safest way to generate a blueprint is to actually deploy a cluster with the desired configuration (even a 3-node cluster will work). Ambari can ensure that any dependent services are also installed in the topology. Further, the blueprint also captures the configs. https://cwiki.ap

Re: ambari upgrade from 1.7 to 2.0?

2015-04-17 Thread Alejandro Fernandez
* Backup your database * Follow http://docs.hortonworks.com/HDPDocuments/Ambari-2.0.0.0/Ambari_Doc_Suite/index.html#Item4.2.1 * Verify the version by running select * from metainfo; From: jongchul seon mailto:jongchul.s...@gmail.com>> Reply-To: "user@ambari.apache.org

Re: adjust the agent heartbeat?

2015-04-17 Thread Greg Hill
https://issues.apache.org/jira/browse/AMBARI-10571 I also opened: https://issues.apache.org/jira/browse/AMBARI-10570 For the bug I ran into last week. Greg From: Sumit Mohanty mailto:smoha...@hortonworks.com>> Reply-To: "user@ambari.apache.org

Re: No Heartbeat after upgrade to Ambari 2.0

2015-04-17 Thread Frank Eisenhauer
Sure. Please find the output attached. The configuration worked without any problems in Ambari 1.7 [root@* ~]# curl -u admin:* -H "X-Requested-By: ambari" -X GET http://localhost:8080/api/v1/hosts { "href" : "http://localhost:8080/api/v1/hosts";, "items" : [ { "href" : "h

Re: delete using API problem

2015-04-17 Thread Yusaku Sako
Wow, this is bizarre. Artem, do you see anything in ambari-server.log corresponding to the GET http://localhost:8080/api/v1/clusters/c1/services/STORM call? Yusaku From: Sumit Mohanty mailto:smoha...@hortonworks.com>> Reply-To: "user@ambari.apache.org" mailto:user

Re: delete using API problem

2015-04-17 Thread Sumit Mohanty
?That error is something I am not familiar with. Perhaps someone else can chime in. From: dbis...@gmail.com on behalf of Artem Ervits Sent: Friday, April 17, 2015 8:24 AM To: user@ambari.apache.org Subject: Re: delete using API problem I think the anwer lies i

Re: adjust the agent heartbeat?

2015-04-17 Thread Sumit Mohanty
?Not without code change. This is probably a good feature to add. Can you create a task? From: Greg Hill Sent: Friday, April 17, 2015 8:32 AM To: user@ambari.apache.org Subject: adjust the agent heartbeat? https://github.com/apache/ambari/blob/trunk/ambari-agent

Re: No Heartbeat after upgrade to Ambari 2.0

2015-04-17 Thread Sumit Mohanty
Can you share the output of curl -u admin:admin -H "X-Requested-By: ambari" -X GET http://localhost:8080/api/v1/hosts curl -u admin:admin -H "X-Requested-By: ambari" -X GET http://localhost:8080/api/v1/clusters/c1/hosts Generic pattern of the calls being curl -u : -H "X-Requested-By: ambari" -X

adjust the agent heartbeat?

2015-04-17 Thread Greg Hill
https://github.com/apache/ambari/blob/trunk/ambari-agent/src/main/python/ambari_agent/NetUtil.py#L34 Is there any way to tweak that heartbeat interval setting? If I'm reading the code right, it checks in with the server every 10s. I'd like to be able to tweak that and see if I can speed up bui

Re: delete using API problem

2015-04-17 Thread Artem Ervits
I think the anwer lies in last line "couldn't resolve host ''. How do I go about this? { "href" : "http://localhost:8080/api/v1/clusters/c1/services/STORM";, "ServiceInfo" : { "cluster_name" : "c1", "maintenance_state" : "ON", "service_name" : "STORM", "state" : "UNKNOWN" },

Re: delete using API problem

2015-04-17 Thread Sumit Mohanty
These steps seem fine to me. In fact I just tried and deleted some service in my test cluster (using latest trunk code base though). What does GET return curl -u admin:password -H "X-Requested-By: ambari" -X GET http://localhost:8080/api/v1/clusters/c1/services/STORM ?

delete using API problem

2015-04-17 Thread Artem Ervits
Hello, I have an issue where I need to delete Storm service but I may have botched the order of steps. Here are my commands: *curl -u admin:password -H "X-Requested-By: ambari" -X PUT -d '{"RequestInfo":{"context":"Stop Service"},"Body":{"ServiceInfo":{"state":"INSTALLED"}}}' http://localh

Re: ambari upgrade from 1.7 to 2.0?

2015-04-17 Thread jongchul seon
You can try on your console There is a command to help you upgrade your db schema. You can check on official ambari site. As I remember, the command is ambari-server upgrade. Please double confirm the command before you really execute it, since I am not 100% sure the command. Frankly I forgot

Re:Re: Re:Re: Re:How to get datanode numbers in stack_advisor.py#recommendHDFSConfigurations?

2015-04-17 Thread Qi Yun Liu
Hi Siddharth, Yes, I agree that it makes sense to get only 1 host when we were not supporting heterogeneous environments. At present, we might support heterogeneous environments, so it also make sense to update this method accordingly. In addition, I really need this method to return all hosts

ambari upgrade from 1.7 to 2.0?

2015-04-17 Thread Xiaoyong Zhu
Hi Experts I am using Ambari 1.7 with HDP2.2. however, when I want to try Ambari 2.0, Ambari cannot start with following errors: 17 Apr 2015 08:44:37,331 WARN [main] AmbariServer:592 - Current database store version is not compatible with current server version, serverVersion=2.0.0, schemaVer

Ambari Blueprint

2015-04-17 Thread Pratik Gadiya
Hi All, I want to create a generalize blueprint in Ambari that can be used to deploy a hadoop cluster for 1 Master Node and N Compute Nodes. Host Groups Content of Blueprint : "host_groups" : [ { "name" : "compute", "configurations" : [ ], "components" : [ {

Re: No Heartbeat after upgrade to Ambari 2.0

2015-04-17 Thread Frank Eisenhauer
Hi Sumit, I stopped ambari agent, cleared the logs and started the agent again. The log seems to be ok, there is only one warning which might be related to the issue: WARNING 2015-04-17 07:50:47,784 AlertSchedulerHandler.py:92 - There are no alert definition commands in the heartbeat; unable t