Hi There, I'm not sure which community fits the issue I'm having best, so apologies if it seems like I am duplicating an email across Bigtop and Ambari.
As you can see in the below email, I am deploying Ambari 2.7.5 with the Bigtop Mpack from the master branch. It all looks fine until I go to install the services from the mpack and get the below error. I've have retried the deployment again on a fresh cluster, but still getting the same error. When I look at the file '/var/lib/ambari-agent/data/command-13.json' it doesn't have a stack packages object in the cluster-env object. I have also attached a copy of the file. Stack Packages is also not present in the cluster-env.xml on the server. I'm a bit confused as to where I should look next, so if anyone has any suggestions, I would really appreciate it. Kind Regards, Nathan ________________________________ From: English,N,Nathan,VIR R Sent: 06 October 2021 10:13 To: [email protected] <[email protected]> Subject: Bigtop Ambari Mpack Issue Hi There, I am deploying Ambari 2.7.5 with the Bigtop Mpack from the master branch. It all looks fine until I go to install the services from the mpack and get the below error. Looking at stack_select.py[1], It looks like it's searching for the 'stack_packages' in the cluster-env.xml (Path: "/configurations/cluster-env/stack_packages") however when I look at the cluster-env.xml[2] in the bigtop mpack I don't see anything called stack_packages? I could be completely wrong at what it's looking for though! Does anyone have any ideas or suggestions? Kind Regards, Nathan stderr: Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/hook.py", line 39, in <module> AfterInstallHook().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute method(env) File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/hook.py", line 32, in hook setup_stack_symlinks(self.stroutfile) File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/shared_initialization.py", line 53, in setup_stack_symlinks stack_packages = stack_select.get_packages(stack_select.PACKAGE_SCOPE_INSTALL) File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 185, in get_packages raise Fail("The stack packages are not defined on the command. Unable to load packages for the stack-select tool") resource_management.core.exceptions.Fail: The stack packages are not defined on the command. Unable to load packages for the stack-select tool stdout: 2021-10-06 08:18:24,404 - Stack Feature Version Info: Cluster Stack=1.0, Command Stack=None, Command Version=None -> 1.0 2021-10-06 08:18:24,411 - Skipping creation of User and Group as host is sys prepped or ignore_groupsusers_create flag is on 2021-10-06 08:18:24,412 - Skipping setting dfs cluster admin and tez view acls as host is sys prepped 2021-10-06 08:18:24,412 - FS Type: HDFS 2021-10-06 08:18:24,412 - Directory['/etc/hadoop'] {'mode': 0755} 2021-10-06 08:18:24,464 - File['/etc/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'} 2021-10-06 08:18:24,466 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777} 2021-10-06 08:18:24,487 - Repository['BGTP-1.0-repo-4'] {'base_url': 'http://c7905.ambari.apache.org/', 'action': ['prepare'], 'components': [u'BGTP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-bgtp-4', 'mirror_list': None} 2021-10-06 08:18:24,501 - Repository[None] {'action': ['create']} 2021-10-06 08:18:24,503 - File['/tmp/tmpSnZLdC'] {'content': '[BGTP-1.0-repo-4]\nname=BGTP-1.0-repo-4\nbaseurl=http://c7905.ambari.apache.org/\n\npath=/\nenabled=1\ngpgcheck=0'} 2021-10-06 08:18:24,504 - Writing File['/tmp/tmpSnZLdC'] because contents don't match 2021-10-06 08:18:24,505 - Rewriting /etc/yum.repos.d/ambari-bgtp-4.repo since it has changed. 2021-10-06 08:18:24,505 - File['/etc/yum.repos.d/ambari-bgtp-4.repo'] {'content': StaticFile('/tmp/tmpSnZLdC')} 2021-10-06 08:18:24,507 - Writing File['/etc/yum.repos.d/ambari-bgtp-4.repo'] because it doesn't exist 2021-10-06 08:18:24,508 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2021-10-06 08:18:24,689 - Skipping installation of existing package unzip 2021-10-06 08:18:24,689 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2021-10-06 08:18:24,712 - Skipping installation of existing package curl 2021-10-06 08:18:25,093 - Package['hadoop-yarn'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2021-10-06 08:18:25,271 - Skipping installation of existing package hadoop-yarn 2021-10-06 08:18:25,273 - Package['hadoop-hdfs'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2021-10-06 08:18:25,297 - Skipping installation of existing package hadoop-hdfs 2021-10-06 08:18:25,298 - Package['hadoop-mapreduce'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2021-10-06 08:18:25,321 - Skipping installation of existing package hadoop-mapreduce 1. https://github.com/apache/ambari/blob/release-2.7.5/ambari-common/src/main/python/resource_management/libraries/functions/stack_select.py 2. https://github.com/apache/bigtop/blob/release-1.5.0/bigtop-packages/src/common/bigtop-ambari-mpack/bgtp-ambari-mpack/src/main/resources/stacks/BGTP/1.0/configuration/cluster-env.xml [https://opengraph.githubassets.com/8810b73a2c2c4b7cab46ecfe0397fc64e5b171d1a2679752c656e7c8f03060e5/apache/bigtop]<https://github.com/apache/bigtop/blob/release-1.5.0/bigtop-packages/src/common/bigtop-ambari-mpack/bgtp-ambari-mpack/src/main/resources/stacks/BGTP/1.0/configuration/cluster-env.xml> bigtop/cluster-env.xml at release-1.5.0 · apache/bigtop<https://github.com/apache/bigtop/blob/release-1.5.0/bigtop-packages/src/common/bigtop-ambari-mpack/bgtp-ambari-mpack/src/main/resources/stacks/BGTP/1.0/configuration/cluster-env.xml> Mirror of Apache Bigtop. Contribute to apache/bigtop development by creating an account on GitHub. github.com [https://opengraph.githubassets.com/9302541dd14e06f69f6b955eb7f20a4e495240e95027b33d65cf7da9995ea5e3/apache/ambari]<https://github.com/apache/ambari/blob/release-2.7.5/ambari-common/src/main/python/resource_management/libraries/functions/stack_select.py> ambari/stack_select.py at release-2.7.5 · apache/ambari<https://github.com/apache/ambari/blob/release-2.7.5/ambari-common/src/main/python/resource_management/libraries/functions/stack_select.py> Mirror of Apache Ambari. Contribute to apache/ambari development by creating an account on GitHub. github.com 3. Command failed after 1 tries
command-13.json
Description: command-13.json
