[jira] [Commented] (AMBARI-20361) Stack Upgrade tests fail during Hive Metastore restart due to missing hive-site.jceks file
[
https://issues.apache.org/jira/browse/AMBARI-20361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901818#comment-15901818
]
Hudson commented on AMBARI-20361:
-
FAILURE: Integrated in Jenkins build Ambari-branch-2.5 #1215 (See
[https://builds.apache.org/job/Ambari-branch-2.5/1215/])
AMBARI-20361 - Stack Upgrade tests fail during Hive Metastore restart (jhurley:
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=c5d2d5b03073215667a3a70989600c5a99bf1e9a])
* (edit) ambari-server/src/test/python/stacks/utils/RMFTestCase.py
* (edit) ambari-common/src/main/python/resource_management/core/source.py
> Stack Upgrade tests fail during Hive Metastore restart due to missing
> hive-site.jceks file
> --
>
> Key: AMBARI-20361
> URL: https://issues.apache.org/jira/browse/AMBARI-20361
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
>Affects Versions: 2.5.0
>Reporter: Vivek Sharma
>Assignee: Jonathan Hurley
>Priority: Blocker
> Labels: express_upgrade
> Fix For: 2.5.0
>
> Attachments: AMBARI-20361.patch
>
>
> *STR*
> # Deploy HDP-2.5.0.0 with Ambari-2.5.x
> # Register HDP-2.6 version and install the bits
> # Start Express Upgrade
> *Result:*
> Failed with below error during restart of Hive Metastore:
> {code}
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 260, in
> HiveMetastore().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 313, in execute
> method(env)
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 761, in restart
> self.start(env, upgrade_type=upgrade_type)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 58, in start
> self.configure(env)
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 116, in locking_configure
> original_configure(obj, *args, **kw)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 74, in configure
> hive(name = 'metastore')
> File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py",
> line 89, in thunk
> return fn(*args, **kwargs)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py",
> line 228, in hive
> params.user_group
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/security_commons.py",
> line 55, in update_credential_provider_path
> content = StaticFile(src_provider_path)
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
> line 155, in __init__
> self.env.run()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 160, in run
> self.run_action(resource, action)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 124, in run_action
> provider_action()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 123, in action_create
> content = self._get_content()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 160, in _get_content
> return content()
> File "/usr/lib/python2.6/site-packages/resource_management/core/source.py",
> line 52, in __call__
> return self.get_content()
> File "/usr/lib/python2.6/site-packages/resource_management/core/source.py",
> line 76, in get_content
> raise Fail("{0} Source file {1} is not found".format(repr(self), path))
> resource_management.core.exceptions.Fail:
> StaticFile('/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks')
> Source file /usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks
> is not found
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (AMBARI-20361) Stack Upgrade tests fail during Hive Metastore restart due to missing hive-site.jceks file
[
https://issues.apache.org/jira/browse/AMBARI-20361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901810#comment-15901810
]
Hudson commented on AMBARI-20361:
-
FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #6978 (See
[https://builds.apache.org/job/Ambari-trunk-Commit/6978/])
AMBARI-20361 - Stack Upgrade tests fail during Hive Metastore restart (jhurley:
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=8b7c661e714fa221447e3461325811ca3f0821c0])
* (edit) ambari-server/src/test/python/stacks/utils/RMFTestCase.py
* (edit) ambari-common/src/main/python/resource_management/core/source.py
> Stack Upgrade tests fail during Hive Metastore restart due to missing
> hive-site.jceks file
> --
>
> Key: AMBARI-20361
> URL: https://issues.apache.org/jira/browse/AMBARI-20361
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
>Affects Versions: 2.5.0
>Reporter: Vivek Sharma
>Assignee: Jonathan Hurley
>Priority: Blocker
> Labels: express_upgrade
> Fix For: 2.5.0
>
> Attachments: AMBARI-20361.patch
>
>
> *STR*
> # Deploy HDP-2.5.0.0 with Ambari-2.5.x
> # Register HDP-2.6 version and install the bits
> # Start Express Upgrade
> *Result:*
> Failed with below error during restart of Hive Metastore:
> {code}
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 260, in
> HiveMetastore().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 313, in execute
> method(env)
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 761, in restart
> self.start(env, upgrade_type=upgrade_type)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 58, in start
> self.configure(env)
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 116, in locking_configure
> original_configure(obj, *args, **kw)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 74, in configure
> hive(name = 'metastore')
> File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py",
> line 89, in thunk
> return fn(*args, **kwargs)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py",
> line 228, in hive
> params.user_group
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/security_commons.py",
> line 55, in update_credential_provider_path
> content = StaticFile(src_provider_path)
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
> line 155, in __init__
> self.env.run()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 160, in run
> self.run_action(resource, action)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 124, in run_action
> provider_action()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 123, in action_create
> content = self._get_content()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 160, in _get_content
> return content()
> File "/usr/lib/python2.6/site-packages/resource_management/core/source.py",
> line 52, in __call__
> return self.get_content()
> File "/usr/lib/python2.6/site-packages/resource_management/core/source.py",
> line 76, in get_content
> raise Fail("{0} Source file {1} is not found".format(repr(self), path))
> resource_management.core.exceptions.Fail:
> StaticFile('/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks')
> Source file /usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks
> is not found
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (AMBARI-20361) Stack Upgrade tests fail during Hive Metastore restart due to missing hive-site.jceks file
[
https://issues.apache.org/jira/browse/AMBARI-20361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901470#comment-15901470
]
Jonathan Hurley commented on AMBARI-20361:
--
Not sure why upgrades runs into this, but it does seem like a permissions
problem since the file exists:
{code}
[agentslava@ctr-e129-1487033772569-37801-01-02 root]$ ll
/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks
ls: cannot access
/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks: Permission
denied
{code}
Seems like {{StaticFile}} can't read this since the permissions are 640.
> Stack Upgrade tests fail during Hive Metastore restart due to missing
> hive-site.jceks file
> --
>
> Key: AMBARI-20361
> URL: https://issues.apache.org/jira/browse/AMBARI-20361
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
>Affects Versions: 2.5.0
>Reporter: Vivek Sharma
>Assignee: Jonathan Hurley
>Priority: Blocker
> Labels: express_upgrade
> Fix For: 2.5.0
>
>
> *STR*
> # Deploy HDP-2.5.0.0 with Ambari-2.5.x
> # Register HDP-2.6 version and install the bits
> # Start Express Upgrade
> *Result:*
> Failed with below error during restart of Hive Metastore:
> {code}
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 260, in
> HiveMetastore().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 313, in execute
> method(env)
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 761, in restart
> self.start(env, upgrade_type=upgrade_type)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 58, in start
> self.configure(env)
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 116, in locking_configure
> original_configure(obj, *args, **kw)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 74, in configure
> hive(name = 'metastore')
> File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py",
> line 89, in thunk
> return fn(*args, **kwargs)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py",
> line 228, in hive
> params.user_group
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/security_commons.py",
> line 55, in update_credential_provider_path
> content = StaticFile(src_provider_path)
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
> line 155, in __init__
> self.env.run()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 160, in run
> self.run_action(resource, action)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 124, in run_action
> provider_action()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 123, in action_create
> content = self._get_content()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 160, in _get_content
> return content()
> File "/usr/lib/python2.6/site-packages/resource_management/core/source.py",
> line 52, in __call__
> return self.get_content()
> File "/usr/lib/python2.6/site-packages/resource_management/core/source.py",
> line 76, in get_content
> raise Fail("{0} Source file {1} is not found".format(repr(self), path))
> resource_management.core.exceptions.Fail:
> StaticFile('/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks')
> Source file /usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks
> is not found
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (AMBARI-20361) Stack Upgrade tests fail during Hive Metastore restart due to missing hive-site.jceks file
[
https://issues.apache.org/jira/browse/AMBARI-20361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901469#comment-15901469
]
Jonathan Hurley commented on AMBARI-20361:
--
So far, nothing out of the ordinary here:
- During installation of HDP 2.5.3, we're seeding the new conf directory,
including files we don't manage:
{code}
2017-03-07 08:43:49,050 - Seeding versioned configuration directories for hive
2017-03-07 08:43:49,050 - Execute['ambari-sudo.sh -H -E cp -R -p -v
/usr/hdp/current/hive-client/conf/* /etc/hive/2.5.3.0-37/0'] {'logoutput': True}
...
`/usr/hdp/current/hive-client/conf/conf.server/hive-site.jceks' ->
`/etc/hive/2.5.3.0-37/0/conf.server/hive-site.jceks'
{code}
- The file referenced in the above error does exist:
{code}
[root@nat-yc-r6-ehss-ambari-api-hou-1-7 ~]# ll
/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks
-rw-r-. 1 cstm-hive hadoop 520 Mar 7 07:18
/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks
{code}
Initially, I suspect is has something to do with symlinks ...
> Stack Upgrade tests fail during Hive Metastore restart due to missing
> hive-site.jceks file
> --
>
> Key: AMBARI-20361
> URL: https://issues.apache.org/jira/browse/AMBARI-20361
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
>Affects Versions: 2.5.0
>Reporter: Vivek Sharma
>Assignee: Jonathan Hurley
>Priority: Blocker
> Labels: express_upgrade
> Fix For: 2.5.0
>
>
> *STR*
> # Deploy HDP-2.5.0.0 with Ambari-2.5.x
> # Register HDP-2.6 version and install the bits
> # Start Express Upgrade
> *Result:*
> Failed with below error during restart of Hive Metastore:
> {code}
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 260, in
> HiveMetastore().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 313, in execute
> method(env)
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 761, in restart
> self.start(env, upgrade_type=upgrade_type)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 58, in start
> self.configure(env)
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 116, in locking_configure
> original_configure(obj, *args, **kw)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py",
> line 74, in configure
> hive(name = 'metastore')
> File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py",
> line 89, in thunk
> return fn(*args, **kwargs)
> File
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py",
> line 228, in hive
> params.user_group
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/security_commons.py",
> line 55, in update_credential_provider_path
> content = StaticFile(src_provider_path)
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
> line 155, in __init__
> self.env.run()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 160, in run
> self.run_action(resource, action)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 124, in run_action
> provider_action()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 123, in action_create
> content = self._get_content()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 160, in _get_content
> return content()
> File "/usr/lib/python2.6/site-packages/resource_management/core/source.py",
> line 52, in __call__
> return self.get_content()
> File "/usr/lib/python2.6/site-packages/resource_management/core/source.py",
> line 76, in get_content
> raise Fail("{0} Source file {1} is not found".format(repr(self), path))
> resource_management.core.exceptions.Fail:
> StaticFile('/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks')
> Source file /usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks
> is not found
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
