[
https://issues.apache.org/jira/browse/AMBARI-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14192838#comment-14192838
]
Alejandro Fernandez commented on AMBARI-8089:
---------------------------------------------
+1 LGTM for the patch
> 'Refresh Yarn capacity scheduler' action failed on secured HDP-2.2
> ------------------------------------------------------------------
>
> Key: AMBARI-8089
> URL: https://issues.apache.org/jira/browse/AMBARI-8089
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
> Affects Versions: 1.7.0
> Reporter: Siddharth Wagle
> Assignee: Siddharth Wagle
> Fix For: 1.7.0
>
> Attachments: AMBARI-8089.patch
>
>
> On a secure cluster, run Refresh Yarn capacity scheduler service action.
> {code}
> 014-10-31 16:15:39,161 - Directory['/var/run/hadoop-yarn/yarn'] {'owner':
> 'yarn', 'group': 'hadoop', 'recursive': True}
> 2014-10-31 16:15:39,171 - Directory['/grid/0/log/hadoop/yarn'] {'owner':
> 'yarn', 'group': 'hadoop', 'recursive': True}
> 2014-10-31 16:15:39,171 - Directory['/var/run/hadoop-mapreduce/mapred']
> {'owner': 'mapred', 'group': 'hadoop', 'recursive': True}
> 2014-10-31 16:15:39,172 - Directory['/var/log/hadoop-mapreduce/mapred']
> {'owner': 'mapred', 'group': 'hadoop', 'recursive': True}
> 2014-10-31 16:15:39,173 - Directory['/grid/0/log/hadoop'] {'owner': 'yarn',
> 'ignore_failures': True, 'recursive': True}
> 2014-10-31 16:15:39,173 - Changing owner for /grid/0/log/hadoop from 0 to yarn
> 2014-10-31 16:15:39,173 - XmlConfig['core-site.xml'] {'group': 'hadoop',
> 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes':
> ..., 'owner': 'hdfs', 'configurations': ...}
> 2014-10-31 16:15:39,218 - Generating config: /etc/hadoop/conf/core-site.xml
> 2014-10-31 16:15:39,219 - File['/etc/hadoop/conf/core-site.xml'] {'owner':
> 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644,
> 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,228 - Writing File['/etc/hadoop/conf/core-site.xml']
> because contents don't match
> 2014-10-31 16:15:39,229 - XmlConfig['mapred-site.xml'] {'group': 'hadoop',
> 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes':
> ..., 'owner': 'yarn', 'configurations': ...}
> 2014-10-31 16:15:39,274 - Generating config: /etc/hadoop/conf/mapred-site.xml
> 2014-10-31 16:15:39,275 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner':
> 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644,
> 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,282 - Writing File['/etc/hadoop/conf/mapred-site.xml']
> because contents don't match
> 2014-10-31 16:15:39,283 - Changing owner for /etc/hadoop/conf/mapred-site.xml
> from 2526 to yarn
> 2014-10-31 16:15:39,283 - XmlConfig['yarn-site.xml'] {'group': 'hadoop',
> 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes':
> ..., 'owner': 'yarn', 'configurations': ...}
> 2014-10-31 16:15:39,320 - Generating config: /etc/hadoop/conf/yarn-site.xml
> 2014-10-31 16:15:39,326 - File['/etc/hadoop/conf/yarn-site.xml'] {'owner':
> 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644,
> 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,329 - Writing File['/etc/hadoop/conf/yarn-site.xml']
> because contents don't match
> 2014-10-31 16:15:39,330 - XmlConfig['capacity-scheduler.xml'] {'group':
> 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644,
> 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...}
> 2014-10-31 16:15:39,369 - Generating config:
> /etc/hadoop/conf/capacity-scheduler.xml
> 2014-10-31 16:15:39,370 - File['/etc/hadoop/conf/capacity-scheduler.xml']
> {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
> 0644, 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,380 - Writing
> File['/etc/hadoop/conf/capacity-scheduler.xml'] because contents don't match
> 2014-10-31 16:15:39,381 - Changing owner for
> /etc/hadoop/conf/capacity-scheduler.xml from 2525 to yarn
> 2014-10-31 16:15:39,381 -
> File['/grid/0/log/hadoop/yarn/hadoop-mapreduce.jobsummary.log'] {'owner':
> 'yarn', 'group': 'hadoop'}
> 2014-10-31 16:15:39,382 - File['/etc/hadoop/conf/yarn.exclude'] {'owner':
> 'yarn', 'group': 'hadoop'}
> 2014-10-31 16:15:39,396 - File['/etc/security/limits.d/yarn.conf']
> {'content': Template('yarn.conf.j2'), 'mode': 0644}
> 2014-10-31 16:15:39,411 - File['/etc/security/limits.d/mapreduce.conf']
> {'content': Template('mapreduce.conf.j2'), 'mode': 0644}
> 2014-10-31 16:15:39,425 - File['/etc/hadoop/conf/yarn-env.sh'] {'content':
> InlineTemplate(...), 'owner': 'yarn', 'group': 'hadoop', 'mode': 0755}
> 2014-10-31 16:15:39,427 -
> File['/usr/hdp/current/hadoop-yarn-client/bin/container-executor'] {'group':
> 'hadoop', 'mode': 06050}
> 2014-10-31 16:15:39,448 - File['/etc/hadoop/conf/container-executor.cfg']
> {'content': Template('container-executor.cfg.j2'), 'group': 'hadoop', 'mode':
> 0644}
> 2014-10-31 16:15:39,461 - File['/etc/hadoop/conf/mapred-env.sh'] {'content':
> InlineTemplate(...), 'owner': 'root'}
> 2014-10-31 16:15:39,486 -
> File['/usr/hdp/current/hadoop-client/sbin/task-controller'] {'owner': 'root',
> 'group': 'hadoop', 'mode': 06050}
> 2014-10-31 16:15:39,504 - File['/etc/hadoop/conf/taskcontroller.cfg']
> {'content': Template('taskcontroller.cfg.j2'), 'owner': 'root', 'group':
> 'hadoop', 'mode': 0644}
> 2014-10-31 16:15:39,520 - XmlConfig['mapred-site.xml'] {'owner': 'mapred',
> 'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf',
> 'configuration_attributes': ..., 'configurations': ...}
> 2014-10-31 16:15:39,554 - Generating config: /etc/hadoop/conf/mapred-site.xml
> 2014-10-31 16:15:39,555 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner':
> 'mapred', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None,
> 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,557 - Changing owner for /etc/hadoop/conf/mapred-site.xml
> from 2528 to mapred
> 2014-10-31 16:15:39,557 - XmlConfig['capacity-scheduler.xml'] {'owner':
> 'hdfs', 'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf',
> 'configuration_attributes': ..., 'configurations': ...}
> 2014-10-31 16:15:39,594 - Generating config:
> /etc/hadoop/conf/capacity-scheduler.xml
> 2014-10-31 16:15:39,595 - File['/etc/hadoop/conf/capacity-scheduler.xml']
> {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
> None, 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,596 - Changing owner for
> /etc/hadoop/conf/capacity-scheduler.xml from 2528 to hdfs
> 2014-10-31 16:15:39,600 - Execute['export
> HADOOP_LIBEXEC_DIR=/usr/hdp/current/hadoop-client/libexec &&
> /usr/hdp/current/hadoop-yarn-client/bin/yarn rmadmin -refreshQueues']
> {'user': 'yarn'}
> 2014-10-31 16:15:46,621 - Error while executing command 'refreshqueues':
> Traceback (most recent call last):
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 122, in execute
> method(env)
> File
> "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/resourcemanager.py",
> line 72, in refreshqueues
> action='refreshQueues'
> File
> "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py",
> line 74, in service
> user=usr,
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
> line 148, in __init__
> self.env.run()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 149, in run
> self.run_action(resource, action)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 115, in run_action
> provider_action()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 241, in action_run
> raise ex
> Fail: Execution of 'export
> HADOOP_LIBEXEC_DIR=/usr/hdp/current/hadoop-client/libexec &&
> /usr/hdp/current/hadoop-yarn-client/bin/yarn rmadmin -refreshQueues' returned
> 255. 14/10/31 16:15:44 INFO client.RMProxy: Connecting to ResourceManager at
> ip-172-31-37-201.ec2.internal/172.31.37.201:8141
> 14/10/31 16:15:46 WARN ipc.Client: Exception encountered while connecting to
> the server : javax.security.sasl.SaslException: GSS initiate failed [Caused
> by GSSException: No valid credentials provided (Mechanism level: Failed to
> find any Kerberos tgt)]
> refreshQueues: Failed on local exception: java.io.IOException:
> javax.security.sasl.SaslException: GSS initiate failed [Caused by
> GSSException: No valid credentials provided (Mechanism level: Failed to find
> any Kerberos tgt)]; Host Details : local host is:
> "ip-172-31-37-201/172.31.37.201"; destination host is:
> "ip-172-31-37-201.ec2.internal":8141;
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
