----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35006/#review86414 -----------------------------------------------------------
Ship it! Ship It! - Vitalyi Brodetskyi On Червень 3, 2015, 3:06 після полудня, Andrew Onischuk wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/35006/ > ----------------------------------------------------------- > > (Updated Червень 3, 2015, 3:06 після полудня) > > > Review request for Ambari and Vitalyi Brodetskyi. > > > Bugs: AMBARI-11657 > https://issues.apache.org/jira/browse/AMBARI-11657 > > > Repository: ambari > > > Description > ------- > > 1) non-root ambari server and non-root ambari-agent, umask 027, > 2) Build #1904 > 3) I attempt to install HDP 2.3 with hdfs, yarn, hive, zk, tez, atlas...fails > with error below on first component install > 4) switch to agent as root (keeping everything else the same) and things work > fine > > > > > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py", > line 38, in <module> > BeforeInstallHook().execute() > File > "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", > line 216, in execute > method(env) > File > "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py", > line 34, in hook > install_packages() > File > "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py", > line 87, in install_packages > Package(packages) > File > "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line > 116, in __new__ > cls(name.pop(0), env, provider, **kwargs) > File > "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line > 157, in __init__ > self.env.run() > File > "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", > line 152, in run > self.run_action(resource, action) > File > "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", > line 118, in run_action > provider_action() > File > "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", > line 43, in action_install > self.install_package(package_name, self.resource.use_repos) > File > "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", > line 43, in install_package > if use_repos or not self._check_existence(name): > File > "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", > line 90, in _check_existence > package_list = yb.rpmdb.simplePkgList() > File "/usr/lib64/python2.6/contextlib.py", line 34, in __exit__ > self.gen.throw(type, value, traceback) > File > "/usr/lib/python2.6/site-packages/resource_management/core/utils.py", line > 117, in suppress_stdout > yield > File > "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", > line 90, in _check_existence > package_list = yb.rpmdb.simplePkgList() > File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 502, in > simplePkgList > return self.pkglist > File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 232, in > _get_pkglist > csumpkgtups = self.preloadPackageChecksums(load_packages=False) > File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 979, in > preloadPackageChecksums > rpmdbv = self.simpleVersion(main_only=True)[0] > File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 1125, in > simpleVersion > rpmdbv = self._get_cached_simpleVersion_main() > File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 1075, in > _get_cached_simpleVersion_main > rpmdbv = open(rpmdbvfname).readline()[:-1] > IOError: [Errno 13] Permission denied: > '//var/lib/yum/rpmdb-indexes/version' > > stdout: /var/lib/ambari-agent/data/output-25.txt > > 2015-06-02 13:49:13,850 - > Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/'] {'recursive': > True} > 2015-06-02 13:49:13,874 - > File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jce_policy-8.zip'] > {'content': > DownloadSource('http://c6401.ambari.apache.org:8080/resources//jce_policy-8.zip')} > 2015-06-02 13:49:13,894 - Not downloading the file from > http://c6401.ambari.apache.org:8080/resources//jce_policy-8.zip, because > /var/lib/ambari-agent/data/tmp/jce_policy-8.zip already exists > 2015-06-02 13:49:13,914 - Group['hadoopX'] {'ignore_failures': False} > 2015-06-02 13:49:13,915 - Group['usersX'] {'ignore_failures': False} > 2015-06-02 13:49:13,915 - User['ambari-qaX'] {'gid': 'hadoopX', > 'ignore_failures': False, 'groups': ['usersX']} > 2015-06-02 13:49:13,916 - User['hcatX'] {'gid': 'hadoopX', > 'ignore_failures': False, 'groups': ['hadoopX']} > 2015-06-02 13:49:13,916 - User['yarnX'] {'gid': 'hadoopX', > 'ignore_failures': False, 'groups': ['hadoopX']} > 2015-06-02 13:49:13,917 - User['hiveX'] {'gid': 'hadoopX', > 'ignore_failures': False, 'groups': ['hadoopX']} > 2015-06-02 13:49:13,917 - User['atlasX'] {'gid': 'hadoopX', > 'ignore_failures': False, 'groups': ['hadoopX']} > 2015-06-02 13:49:13,918 - User['hdfsX'] {'gid': 'hadoopX', > 'ignore_failures': False, 'groups': ['hadoopX']} > 2015-06-02 13:49:13,919 - User['tezX'] {'gid': 'hadoopX', > 'ignore_failures': False, 'groups': ['usersX']} > 2015-06-02 13:49:13,919 - User['zookeeperX'] {'gid': 'hadoopX', > 'ignore_failures': False, 'groups': ['hadoopX']} > 2015-06-02 13:49:13,919 - User['mapredX'] {'gid': 'hadoopX', > 'ignore_failures': False, 'groups': ['hadoopX']} > 2015-06-02 13:49:13,920 - > File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content': > StaticFile('changeToSecureUid.sh'), 'mode': 0555} > 2015-06-02 13:49:13,983 - > Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qaX > /tmp/hadoop-ambari-qaX,/tmp/hsperfdata_ambari-qaX,/home/ambari-qaX,/tmp/ambari-qaX,/tmp/sqoop-ambari-qaX'] > {'not_if': '(test $(id -u ambari-qaX) -gt 1000) || (false)'} > 2015-06-02 13:49:13,988 - Skipping > Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qaX > /tmp/hadoop-ambari-qaX,/tmp/hsperfdata_ambari-qaX,/home/ambari-qaX,/tmp/ambari-qaX,/tmp/sqoop-ambari-qaX'] > due to not_if > 2015-06-02 13:49:13,988 - Group['hdfsX'] {'ignore_failures': False} > 2015-06-02 13:49:13,988 - User['hdfsX'] {'ignore_failures': False, > 'groups': ['hadoopX', 'hdfsX']} > 2015-06-02 13:49:13,989 - Directory['/etc/hadoop'] {'mode': 0755} > 2015-06-02 13:49:14,029 - Repository['HDP-2.3'] {'base_url': > 'http://s3.amazonaws.com/dev.hortonworks.com/HDP/centos6/2.x/BUILDS/2.3.0.0-2208', > 'action': ['create'], 'components': ['HDP', 'main'], 'repo_template': > 'repo_suse_rhel.j2', 'repo_file_name': 'HDP', 'mirror_list': None} > 2015-06-02 13:49:14,037 - File['/etc/yum.repos.d/HDP.repo'] {'content': > Template('/usr/lib/ambari-server/lib/resource_management/libraries/providers/../data/repo_suse_rhel.j2')} > 2015-06-02 13:49:14,085 - Repository['HDP-UTILS-1.1.0.20'] {'base_url': > 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos6', > 'action': ['create'], 'components': ['HDP-UTILS', 'main'], 'repo_template': > 'repo_suse_rhel.j2', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None} > 2015-06-02 13:49:14,089 - File['/etc/yum.repos.d/HDP-UTILS.repo'] > {'content': > Template('/usr/lib/ambari-server/lib/resource_management/libraries/providers/../data/repo_suse_rhel.j2')} > 2015-06-02 13:49:14,133 - Package['unzip'] {} > 2015-06-02 13:49:14,221 - Installing package unzip ('/usr/bin/yum -d 0 -e > 0 -y install unzip') > 2015-06-02 13:49:21,096 - Package['curl'] {} > > > Diffs > ----- > > ambari-agent/src/test/python/resource_management/TestPackageResource.py > d69f278 > > ambari-common/src/main/python/resource_management/core/providers/package/__init__.py > 2358e86 > > ambari-common/src/main/python/resource_management/core/providers/package/yumrpm.py > 2d39c4d > > ambari-common/src/main/python/resource_management/core/providers/package/zypper.py > b7f33f4 > ambari-common/src/main/python/resource_management/core/providers/system.py > 43044db > ambari-common/src/main/python/resource_management/core/resources/system.py > bf10c43 > ambari-common/src/main/python/resource_management/core/shell.py 2ddc9eb > > Diff: https://reviews.apache.org/r/35006/diff/ > > > Testing > ------- > > mvn clean test > > > Thanks, > > Andrew Onischuk > >
