Hi All,
I've installed a cluster using Bigtop's binary distribution and deployed
using its Ambari.
As Ranger 2.4 is not in the repo, I had compiled and am deploying it
independently. However, I've encountered a serious issue when I was
deploying the Hive plugin for Ranger. It basically called BGTP files in
Amabri agent and looked even in looked for RANGER entries with the
configuration.
The error file is attached. I don't understand a) why does my Ranger
plugin gets entangled in Ambari installation when Ranger is not even
distributed with Bigtop. b) why call for admin-properties in the
configuration in RANGER/0.5.0 or 0.7.1 when Ranger is now v2.4, not
included with Bigtop, not deployed by Ambari.
Does any one have a solution to resolve this issue?
Keng
stderr:
2023-08-28 16:28:16,643 - WARNING. Cannot copy hive tarball because file does
not exist: /usr/bgtp/1.0/hive/hive.tar.gz . It is possible that this component
is not installed on this host.
2023-08-28 16:28:16,644 - WARNING. Cannot copy hadoop_streaming tarball because
file does not exist: /usr/bgtp/1.0/hadoop-mapreduce/hadoop-streaming.jar . It
is possible that this component is not installed on this host.
Traceback (most recent call last):
File
"/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 999, in restart
self.status(env)
File
"/var/lib/ambari-agent/cache/stacks/BGTP/1.0/services/HIVE/package/scripts/hive_server.py",
line 79, in status
check_process_status(status_params.hive_pid)
File
"/usr/lib/ambari-agent/lib/resource_management/libraries/functions/check_process_status.py",
line 43, in check_process_status
raise ComponentIsNotRunning()
ComponentIsNotRunning
The above exception was the cause of the following exception:
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/stacks/BGTP/1.0/services/HIVE/package/scripts/hive_server.py",
line 143, in <module>
HiveServer().execute()
File
"/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 352, in execute
method(env)
File
"/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
line 1010, in restart
self.start(env, upgrade_type=upgrade_type)
File
"/var/lib/ambari-agent/cache/stacks/BGTP/1.0/services/HIVE/package/scripts/hive_server.py",
line 52, in start
setup_ranger_hive(upgrade_type=upgrade_type)
File
"/var/lib/ambari-agent/cache/stacks/BGTP/1.0/services/HIVE/package/scripts/setup_ranger_hive.py",
line 85, in setup_ranger_hive
component_user_keytab=params.hive_server2_keytab if params.security_enabled
else None)
File
"/usr/lib/ambari-agent/lib/resource_management/libraries/functions/setup_ranger_plugin_xml.py",
line 70, in setup_ranger_plugin
if policymgr_mgr_url.endswith('/'):
File
"/usr/lib/ambari-agent/lib/resource_management/libraries/script/config_dictionary.py",
line 73, in __getattr__
raise Fail("Configuration parameter '" + self.name + "' was not found in
configurations dictionary!")
resource_management.core.exceptions.Fail: Configuration parameter
'admin-properties' was not found in configurations dictionary!
stdout:
2023-08-28 16:28:11,872 - Stack Feature Version Info: Cluster Stack=1.0,
Command Stack=None, Command Version=None -> 1.0
2023-08-28 16:28:11,969 - Stack Feature Version Info: Cluster Stack=1.0,
Command Stack=None, Command Version=None -> 1.0
2023-08-28 16:28:11,971 - Group['spark'] {}
2023-08-28 16:28:11,972 - Group['hadoop'] {}
2023-08-28 16:28:11,972 - User['hive'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2023-08-28 16:28:11,976 - User['zookeeper'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2023-08-28 16:28:11,980 - User['spark'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['spark', 'hadoop'], 'uid': None}
2023-08-28 16:28:11,982 - User['ambari-qa'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2023-08-28 16:28:11,984 - User['tez'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2023-08-28 16:28:11,986 - User['hdfs'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2023-08-28 16:28:11,988 - User['yarn'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2023-08-28 16:28:11,990 - User['hcat'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2023-08-28 16:28:11,992 - User['mapred'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2023-08-28 16:28:11,994 - User['hbase'] {'gid': 'hadoop',
'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2023-08-28 16:28:11,996 - File['/var/lib/ambari-agent/tmp/changeUid.sh']
{'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2023-08-28 16:28:11,997 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh
ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa
0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2023-08-28 16:28:12,006 - Skipping
Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa
0'] due to not_if
2023-08-28 16:28:12,006 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase',
'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2023-08-28 16:28:12,007 - File['/var/lib/ambari-agent/tmp/changeUid.sh']
{'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2023-08-28 16:28:12,007 - File['/var/lib/ambari-agent/tmp/changeUid.sh']
{'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2023-08-28 16:28:12,008 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase']
{}
2023-08-28 16:28:12,021 - call returned (0, '1010')
2023-08-28 16:28:12,021 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1010']
{'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2023-08-28 16:28:12,029 - Skipping
Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1010']
due to not_if
2023-08-28 16:28:12,030 - Group['hdfs'] {}
2023-08-28 16:28:12,030 - User['hdfs'] {'fetch_nonlocal_groups': True,
'groups': ['hadoop', u'hdfs']}
2023-08-28 16:28:12,033 - FS Type: HDFS
2023-08-28 16:28:12,033 - Directory['/etc/hadoop'] {'mode': 0755}
2023-08-28 16:28:12,045 - File['/etc/hadoop/conf/hadoop-env.sh'] {'content':
InlineTemplate(...), 'owner': 'root', 'group': 'hadoop'}
2023-08-28 16:28:12,045 -
Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs',
'group': 'hadoop', 'mode': 01777}
2023-08-28 16:28:12,062 - Execute[('setenforce', '0')] {'not_if': '(! which
getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo':
True, 'only_if': 'test -f /selinux/enforce'}
2023-08-28 16:28:12,071 - Skipping Execute[('setenforce', '0')] due to not_if
2023-08-28 16:28:12,071 - Directory['/var/log/hadoop'] {'owner': 'root',
'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2023-08-28 16:28:12,074 - Directory['/var/run/hadoop'] {'owner': 'root',
'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2023-08-28 16:28:12,075 - Directory['/var/run/hadoop/hdfs'] {'owner': 'hdfs',
'cd_access': 'a'}
2023-08-28 16:28:12,075 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs',
'create_parents': True, 'cd_access': 'a'}
2023-08-28 16:28:12,078 - File['/etc/hadoop/conf/commons-logging.properties']
{'content': Template('commons-logging.properties.j2'), 'owner': 'root'}
2023-08-28 16:28:12,080 - File['/etc/hadoop/conf/health_check'] {'content':
Template('health_check.j2'), 'owner': 'root'}
2023-08-28 16:28:12,084 - File['/etc/hadoop/conf/log4j.properties'] {'content':
InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:12,092 - File['/etc/hadoop/conf/hadoop-metrics2.properties']
{'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs',
'group': 'hadoop'}
2023-08-28 16:28:12,092 - File['/etc/hadoop/conf/task-log4j.properties']
{'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2023-08-28 16:28:12,092 - File['/etc/hadoop/conf/configuration.xsl'] {'owner':
'hdfs', 'group': 'hadoop'}
2023-08-28 16:28:12,095 - File['/etc/hadoop/conf/topology_mappings.data']
{'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if':
'test -d /etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:12,101 - File['/etc/hadoop/conf/topology_script.py']
{'content': StaticFile('topology_script.py'), 'only_if': 'test -d
/etc/hadoop/conf', 'mode': 0755}
2023-08-28 16:28:12,104 - Skipping unlimited key JCE policy check and setup
since the Java VM is not managed by Ambari
2023-08-28 16:28:12,269 - Skipping get_stack_version since
/usr/bin/distro-select is not yet available
2023-08-28 16:28:12,269 - Stack Feature Version Info: Cluster Stack=1.0,
Command Stack=None, Command Version=None -> 1.0
2023-08-28 16:28:12,271 -
File['/var/lib/ambari-agent/cred/lib/CredentialUtil.jar'] {'content':
DownloadSource('http://lgp-dat-comas01.lgp.com:8080/resources/CredentialUtil.jar'),
'mode': 0755}
2023-08-28 16:28:12,271 - Not downloading the file from
http://lgp-dat-comas01.lgp.com:8080/resources/CredentialUtil.jar, because
/var/lib/ambari-agent/tmp/CredentialUtil.jar already exists
2023-08-28 16:28:13,001 - Execute['/usr/bin/kinit -kt
/etc/security/keytabs/hive.service.keytab hive/[email protected];
'] {'user': 'hive'}
2023-08-28 16:28:13,090 - call['ambari-sudo.sh su hive -l -s /bin/bash -c 'cat
/var/run/hive/hive-server.pid 1>/tmp/tmpvTlQjR 2>/tmp/tmpZWpkab''] {'quiet':
False}
2023-08-28 16:28:13,157 - call returned (0, '')
2023-08-28 16:28:13,157 - get_user_call_output returned (0, u'518781', u'')
2023-08-28 16:28:13,159 - Execute['ambari-sudo.sh kill 518781'] {'not_if': '!
(ls /var/run/hive/hive-server.pid >/dev/null 2>&1 && ps -p 518781 >/dev/null
2>&1)'}
2023-08-28 16:28:13,212 - Execute['! (ls /var/run/hive/hive-server.pid
>/dev/null 2>&1 && ps -p 518781 >/dev/null 2>&1)'] {'tries': 10,
'ignore_failures': True, 'try_sleep': 3}
2023-08-28 16:28:13,257 - Retrying after 3 seconds. Reason: Execution of '! (ls
/var/run/hive/hive-server.pid >/dev/null 2>&1 && ps -p 518781 >/dev/null 2>&1)'
returned 1.
2023-08-28 16:28:16,309 - Execute['ambari-sudo.sh kill -9 518781'] {'not_if':
'! (ls /var/run/hive/hive-server.pid >/dev/null 2>&1 && ps -p 518781 >/dev/null
2>&1) || ( sleep 5 && ! (ls /var/run/hive/hive-server.pid >/dev/null 2>&1 && ps
-p 518781 >/dev/null 2>&1) )', 'ignore_failures': True}
2023-08-28 16:28:16,352 - Skipping Execute['ambari-sudo.sh kill -9 518781'] due
to not_if
2023-08-28 16:28:16,354 - Execute['! (ls /var/run/hive/hive-server.pid
>/dev/null 2>&1 && ps -p 518781 >/dev/null 2>&1)'] {'tries': 20, 'try_sleep': 3}
2023-08-28 16:28:16,401 - File['/var/run/hive/hive-server.pid'] {'action':
['delete']}
2023-08-28 16:28:16,402 - Deleting File['/var/run/hive/hive-server.pid']
2023-08-28 16:28:16,403 - Pid file /var/run/hive/hive-server.pid is empty or
does not exist
2023-08-28 16:28:16,408 - Directories to fill with configs: ['/etc/hive/conf',
'/etc/hive/conf']
2023-08-28 16:28:16,408 - Directory['/etc/hive/conf.dist'] {'owner': 'hive',
'group': 'hadoop', 'create_parents': True, 'mode': 0755}
2023-08-28 16:28:16,409 - XmlConfig['mapred-site.xml'] {'group': 'hadoop',
'conf_dir': '/etc/hive/conf.dist', 'mode': 0644, 'configuration_attributes':
{}, 'owner': 'hive', 'configurations': ...}
2023-08-28 16:28:16,417 - Generating config: /etc/hive/conf.dist/mapred-site.xml
2023-08-28 16:28:16,418 - File['/etc/hive/conf.dist/mapred-site.xml'] {'owner':
'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644,
'encoding': 'UTF-8'}
2023-08-28 16:28:16,442 - File['/etc/hive/conf.dist/hive-default.xml.template']
{'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:16,442 - File['/etc/hive/conf.dist/hive-env.sh.template']
{'owner': 'hive', 'group': 'hadoop', 'mode': 0755}
2023-08-28 16:28:16,445 -
File['/etc/hive/conf.dist/llap-daemon-log4j2.properties'] {'content':
InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:16,447 -
File['/etc/hive/conf.dist/llap-cli-log4j2.properties'] {'content':
InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:16,449 - File['/etc/hive/conf.dist/hive-log4j2.properties']
{'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode':
0644}
2023-08-28 16:28:16,451 -
File['/etc/hive/conf.dist/hive-exec-log4j2.properties'] {'content':
InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:16,453 - File['/etc/hive/conf.dist/beeline-log4j2.properties']
{'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode':
0644}
2023-08-28 16:28:16,453 - XmlConfig['beeline-site.xml'] {'owner': 'hive',
'group': 'hadoop', 'mode': 0644, 'conf_dir': '/etc/hive/conf.dist',
'configurations': {'beeline.hs2.jdbc.url.container':
u'jdbc:hive2://lgp-dat-comas01.lgp.com:2181,lgp-dat-cowk01.lgp.com:2181,lgp-dat-cowk02.lgp.com:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2',
'beeline.hs2.jdbc.url.default': u'container'}}
2023-08-28 16:28:16,459 - Generating config:
/etc/hive/conf.dist/beeline-site.xml
2023-08-28 16:28:16,459 - File['/etc/hive/conf.dist/beeline-site.xml']
{'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
0644, 'encoding': 'UTF-8'}
2023-08-28 16:28:16,461 -
File['/etc/hive/conf.dist/parquet-logging.properties'] {'content': ...,
'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:16,462 - Directory['/etc/hive/conf.dist'] {'owner': 'hive',
'group': 'hadoop', 'create_parents': True, 'mode': 0755}
2023-08-28 16:28:16,462 - XmlConfig['mapred-site.xml'] {'group': 'hadoop',
'conf_dir': '/etc/hive/conf.dist', 'mode': 0644, 'configuration_attributes':
{}, 'owner': 'hive', 'configurations': ...}
2023-08-28 16:28:16,467 - Generating config: /etc/hive/conf.dist/mapred-site.xml
2023-08-28 16:28:16,468 - File['/etc/hive/conf.dist/mapred-site.xml'] {'owner':
'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644,
'encoding': 'UTF-8'}
2023-08-28 16:28:16,491 - File['/etc/hive/conf.dist/hive-default.xml.template']
{'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:16,491 - File['/etc/hive/conf.dist/hive-env.sh.template']
{'owner': 'hive', 'group': 'hadoop', 'mode': 0755}
2023-08-28 16:28:16,494 -
File['/etc/hive/conf.dist/llap-daemon-log4j2.properties'] {'content':
InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:16,496 -
File['/etc/hive/conf.dist/llap-cli-log4j2.properties'] {'content':
InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:16,498 - File['/etc/hive/conf.dist/hive-log4j2.properties']
{'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode':
0644}
2023-08-28 16:28:16,500 -
File['/etc/hive/conf.dist/hive-exec-log4j2.properties'] {'content':
InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:16,501 - File['/etc/hive/conf.dist/beeline-log4j2.properties']
{'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode':
0644}
2023-08-28 16:28:16,502 - XmlConfig['beeline-site.xml'] {'owner': 'hive',
'group': 'hadoop', 'mode': 0644, 'conf_dir': '/etc/hive/conf.dist',
'configurations': {'beeline.hs2.jdbc.url.container':
u'jdbc:hive2://lgp-dat-comas01.lgp.com:2181,lgp-dat-cowk01.lgp.com:2181,lgp-dat-cowk02.lgp.com:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2',
'beeline.hs2.jdbc.url.default': u'container'}}
2023-08-28 16:28:16,508 - Generating config:
/etc/hive/conf.dist/beeline-site.xml
2023-08-28 16:28:16,508 - File['/etc/hive/conf.dist/beeline-site.xml']
{'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode':
0644, 'encoding': 'UTF-8'}
2023-08-28 16:28:16,510 -
File['/etc/hive/conf.dist/parquet-logging.properties'] {'content': ...,
'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2023-08-28 16:28:16,510 - File['/etc/hive/conf/hive-site.jceks'] {'content':
StaticFile('/var/lib/ambari-agent/cred/conf/hive_server/hive-site.jceks'),
'owner': 'hive', 'group': 'hadoop', 'mode': 0640}
2023-08-28 16:28:16,510 - Writing File['/etc/hive/conf/hive-site.jceks']
because contents don't match
2023-08-28 16:28:16,511 - XmlConfig['hive-site.xml'] {'group': 'hadoop',
'conf_dir': '/etc/hive/conf', 'mode': 0644, 'configuration_attributes':
{u'hidden': {u'javax.jdo.option.ConnectionPassword':
u'HIVE_CLIENT,WEBHCAT_SERVER,HCAT,CONFIG_DOWNLOAD'}, u'final':
{u'ambari.hive.db.schema.name': u'true'}}, 'owner': 'hive', 'configurations':
...}
2023-08-28 16:28:16,517 - Generating config: /etc/hive/conf/hive-site.xml
2023-08-28 16:28:16,517 - File['/etc/hive/conf/hive-site.xml'] {'owner':
'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644,
'encoding': 'UTF-8'}
2023-08-28 16:28:16,619 - File['/etc/hive/conf/hive-env.sh'] {'content':
InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0755}
2023-08-28 16:28:16,619 - Directory['/etc/security/limits.d'] {'owner': 'root',
'create_parents': True, 'group': 'root'}
2023-08-28 16:28:16,623 - File['/etc/security/limits.d/hive.conf'] {'content':
Template('hive.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644}
2023-08-28 16:28:16,624 - File['/etc/hive/conf/zkmigrator_jaas.conf']
{'content': Template('zkmigrator_jaas.conf.j2'), 'owner': 'hive', 'group':
'hadoop'}
2023-08-28 16:28:16,625 -
File['/usr/lib/ambari-agent/DBConnectionVerification.jar'] {'content':
DownloadSource('http://lgp-dat-comas01.lgp.com:8080/resources/DBConnectionVerification.jar'),
'mode': 0644}
2023-08-28 16:28:16,625 - Not downloading the file from
http://lgp-dat-comas01.lgp.com:8080/resources/DBConnectionVerification.jar,
because /var/lib/ambari-agent/tmp/DBConnectionVerification.jar already exists
2023-08-28 16:28:16,625 - Directory['/var/run/hive'] {'owner': 'hive',
'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2023-08-28 16:28:16,626 - Directory['/var/log/hive'] {'owner': 'hive',
'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2023-08-28 16:28:16,626 - Directory['/var/lib/hive'] {'owner': 'hive',
'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2023-08-28 16:28:16,627 -
File['/var/lib/ambari-agent/tmp/start_hiveserver2_script'] {'content':
Template('startHiveserver2.sh.j2'), 'mode': 0755}
2023-08-28 16:28:16,631 -
File['/etc/hive/conf/hadoop-metrics2-hiveserver2.properties'] {'content':
Template('hadoop-metrics2-hiveserver2.properties.j2'), 'owner': 'hive',
'group': 'hadoop', 'mode': 0600}
2023-08-28 16:28:16,631 - XmlConfig['hiveserver2-site.xml'] {'group': 'hadoop',
'conf_dir': '/etc/hive/conf', 'mode': 0600, 'configuration_attributes': {},
'owner': 'hive', 'configurations': ...}
2023-08-28 16:28:16,637 - Generating config: /etc/hive/conf/hiveserver2-site.xml
2023-08-28 16:28:16,637 - File['/etc/hive/conf/hiveserver2-site.xml'] {'owner':
'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0600,
'encoding': 'UTF-8'}
2023-08-28 16:28:16,642 - Writing File['/etc/hive/conf/hiveserver2-site.xml']
because contents don't match
2023-08-28 16:28:16,643 - Called copy_to_hdfs tarball: pig
2023-08-28 16:28:16,643 - Stack Feature Version Info: Cluster Stack=1.0,
Command Stack=None, Command Version=None -> 1.0
2023-08-28 16:28:16,643 - Tarball version was calcuated as 1.0. Use Command
Version: True
2023-08-28 16:28:16,643 - pig-env is not present on the cluster. Skip copying
/usr/bgtp/1.0/pig/pig.tar.gz
2023-08-28 16:28:16,643 - Called copy_to_hdfs tarball: hive
2023-08-28 16:28:16,643 - Stack Feature Version Info: Cluster Stack=1.0,
Command Stack=None, Command Version=None -> 1.0
2023-08-28 16:28:16,643 - Tarball version was calcuated as 1.0. Use Command
Version: True
2023-08-28 16:28:16,643 - Source file: /usr/bgtp/1.0/hive/hive.tar.gz , Dest
file in HDFS: /bgtp/apps/1.0/hive/hive.tar.gz
2023-08-28 16:28:16,643 - WARNING. Cannot copy hive tarball because file does
not exist: /usr/bgtp/1.0/hive/hive.tar.gz . It is possible that this component
is not installed on this host.
2023-08-28 16:28:16,644 - Called copy_to_hdfs tarball: sqoop
2023-08-28 16:28:16,644 - Stack Feature Version Info: Cluster Stack=1.0,
Command Stack=None, Command Version=None -> 1.0
2023-08-28 16:28:16,644 - Tarball version was calcuated as 1.0. Use Command
Version: True
2023-08-28 16:28:16,644 - sqoop-env is not present on the cluster. Skip copying
/usr/bgtp/1.0/sqoop/sqoop.tar.gz
2023-08-28 16:28:16,644 - Called copy_to_hdfs tarball: hadoop_streaming
2023-08-28 16:28:16,644 - Stack Feature Version Info: Cluster Stack=1.0,
Command Stack=None, Command Version=None -> 1.0
2023-08-28 16:28:16,644 - Tarball version was calcuated as 1.0. Use Command
Version: True
2023-08-28 16:28:16,644 - Source file:
/usr/bgtp/1.0/hadoop-mapreduce/hadoop-streaming.jar , Dest file in HDFS:
/bgtp/apps/1.0/mapreduce/hadoop-streaming.jar
2023-08-28 16:28:16,644 - WARNING. Cannot copy hadoop_streaming tarball because
file does not exist: /usr/bgtp/1.0/hadoop-mapreduce/hadoop-streaming.jar . It
is possible that this component is not installed on this host.
2023-08-28 16:28:16,644 -
HdfsResource['/warehouse/tablespace/external/hive/sys.db/']
{'security_enabled': True, 'hadoop_bin_dir': '/usr/bin', 'keytab':
'/etc/security/keytabs/hdfs.headless.keytab', 'dfs_type': 'HDFS', 'default_fs':
'hdfs://sandbox', 'hdfs_resource_ignore_file':
'/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ...,
'kinit_path_local': '/usr/bin/kinit', 'principal_name': '[email protected]',
'user': 'hdfs', 'owner': 'hive', 'hadoop_conf_dir': '/etc/hadoop/conf', 'type':
'directory', 'action': ['create_on_execute'], 'immutable_paths':
[u'/mr-history/done', u'/warehouse/tablespace/managed/hive',
u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 01775}
2023-08-28 16:28:16,646 - Execute['/usr/bin/kinit -kt
/etc/security/keytabs/hdfs.headless.keytab [email protected]'] {'user':
'hdfs'}
2023-08-28 16:28:16,731 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
--negotiate -u : -s
'"'"'http://lgp-dat-comas01.lgp.com:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"'
1>/tmp/tmpRC80YB 2>/tmp/tmpXSdoq4''] {'quiet': False}
2023-08-28 16:28:16,814 - call returned (0, '')
2023-08-28 16:28:16,815 - get_user_call_output returned (0, u'{\n "beans" : [
{\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType"
: "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.TotalSyncTimes" : "183
29 ",\n "tag.EnabledEcPolicies" : "RS-10-4-1024k, RS-6-3-1024k",\n
"tag.HAState" : "active",\n "tag.Hostname" : "lgp-dat-comas01.lgp.com",\n
"TotalSyncCount" : 111,\n "NumInMaintenanceLiveDataNodes" : 0,\n
"NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" :
0,\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n
"ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 4678,\n
"TransactionsSinceLastLogRoll" : 125,\n "LastWrittenTransactionId" :
109942,\n "LastCheckpointTime" : 1693199021628,\n "CapacityTotal" :
51134807408640,\n "CapacityTotalGB" : 47623.0,\n "CapacityUsed" :
237572857166,\n "CapacityUsedGB" : 221.0,\n "CapacityRemaining" :
50498944342333,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" :
47031.0,\n "CapacityUsedNonDFS" : 397185802930,\n "TotalLoad" : 18,\n
"SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones"
: 0,\n "CurrentTokensCount" : 4,\n "LockQueueLength" : 0,\n
"ReadLockLongHoldCount" : 0,\n "WriteLockLongHoldCount" : 1,\n
"BlocksTotal" : 6339,\n "NumFilesUnderConstruction" : 3,\n
"NumActiveClients" : 3,\n "FilesTotal" : 6590,\n
"PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n
"UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n
"CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n
"PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n
"CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n
"MissingReplicationOneBlocks" : 0,\n
"HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n
"HighestPriorityLowRedundancyECBlocks" : 0,\n
"BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" :
0,\n "TotalReplicatedBlocks" : 6339,\n "LowRedundancyECBlockGroups" :
0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n
"BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n
"TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n
"NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" :
0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" :
0,\n "BlockCapacity" : 536870912,\n "NumLiveDataNodes" : 5,\n
"NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n
"NumDecomDeadDataNodes" : 0,\n "NumInServiceLiveDataNodes" : 5,\n
"VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n
"NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n
"NumStaleStorages" : 0\n } ]\n}', u'')
2023-08-28 16:28:16,818 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
--negotiate -u : -s
'"'"'http://lgp-dat-cowk01.lgp.com:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"'
1>/tmp/tmpk3Xop1 2>/tmp/tmpyHOAiJ''] {'quiet': False}
2023-08-28 16:28:16,900 - call returned (0, '')
2023-08-28 16:28:16,900 - get_user_call_output returned (0, u'{\n "beans" : [
{\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType"
: "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.EnabledEcPolicies" :
"RS-10-4-1024k, RS-6-3-1024k",\n "tag.HAState" : "standby",\n
"tag.TotalSyncTimes" : "",\n "tag.Hostname" : "lgp-dat-cowk01.lgp.com",\n
"MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats"
: 0,\n "TransactionsSinceLastCheckpoint" : 4553,\n
"TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 105325,\n
"LastCheckpointTime" : 1693199023018,\n "CapacityTotal" :
51134807408640,\n "CapacityTotalGB" : 47623.0,\n "CapacityUsed" :
237572857166,\n "CapacityUsedGB" : 221.0,\n "CapacityRemaining" :
50499015248333,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" :
47031.0,\n "CapacityUsedNonDFS" : 397117190834,\n "TotalLoad" : 18,\n
"SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones"
: 0,\n "CurrentTokensCount" : 4,\n "LockQueueLength" : 0,\n
"ReadLockLongHoldCount" : 0,\n "WriteLockLongHoldCount" : 0,\n
"BlocksTotal" : 6325,\n "NumFilesUnderConstruction" : 3,\n
"NumActiveClients" : 3,\n "FilesTotal" : 6582,\n
"PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n
"UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n
"CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n
"PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n
"CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n
"MissingReplicationOneBlocks" : 0,\n
"HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n
"HighestPriorityLowRedundancyECBlocks" : 0,\n
"BytesInFutureReplicatedBlocks" : 0,\n "ExcessBlocks" : 0,\n
"PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 6325,\n
"LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n
"MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n
"PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n
"NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" :
0,\n "PendingDataNodeMessageCount" : 57,\n "MillisSinceLastLoadedEdits" :
113409,\n "BlockCapacity" : 536870912,\n "NumLiveDataNodes" : 5,\n
"NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n
"NumDecomDeadDataNodes" : 0,\n "NumInServiceLiveDataNodes" : 5,\n
"VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n
"NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n
"NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n
"NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" :
0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'')
2023-08-28 16:28:16,902 - NameNode HA states: active_namenodes = [(u'nn1',
'lgp-dat-comas01.lgp.com:50070')], standby_namenodes = [(u'nn2',
'lgp-dat-cowk01.lgp.com:50070')], unknown_namenodes = []
2023-08-28 16:28:16,905 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
-sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length:
0'"'"' --negotiate -u :
'"'"'http://lgp-dat-comas01.lgp.com:50070/webhdfs/v1/warehouse/tablespace/external/hive/sys.db/?op=GETFILESTATUS'"'"'
1>/tmp/tmpj9L8vI 2>/tmp/tmp2d1mKH''] {'logoutput': None, 'quiet': False}
2023-08-28 16:28:16,995 - call returned (0, '')
2023-08-28 16:28:16,995 - get_user_call_output returned (0,
u'{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":4,"fileId":16436,"group":"hdfs","length":0,"modificationTime":1690530687972,"owner":"hive","pathSuffix":"","permission":"1775","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200',
u'')
2023-08-28 16:28:16,996 -
HdfsResource['/warehouse/tablespace/external/hive/sys.db/query_data/']
{'security_enabled': True, 'hadoop_bin_dir': '/usr/bin', 'keytab':
'/etc/security/keytabs/hdfs.headless.keytab', 'dfs_type': 'HDFS', 'default_fs':
'hdfs://sandbox', 'hdfs_resource_ignore_file':
'/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ...,
'kinit_path_local': '/usr/bin/kinit', 'principal_name': '[email protected]',
'user': 'hdfs', 'owner': 'hive', 'hadoop_conf_dir': '/etc/hadoop/conf', 'type':
'directory', 'action': ['create_on_execute'], 'immutable_paths':
[u'/mr-history/done', u'/warehouse/tablespace/managed/hive',
u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 01777}
2023-08-28 16:28:16,997 - Execute['/usr/bin/kinit -kt
/etc/security/keytabs/hdfs.headless.keytab [email protected]'] {'user':
'hdfs'}
2023-08-28 16:28:17,081 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
--negotiate -u : -s
'"'"'http://lgp-dat-comas01.lgp.com:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"'
1>/tmp/tmp948ptP 2>/tmp/tmpOiGk8H''] {'quiet': False}
2023-08-28 16:28:17,160 - call returned (0, '')
2023-08-28 16:28:17,161 - get_user_call_output returned (0, u'{\n "beans" : [
{\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType"
: "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.TotalSyncTimes" : "183
29 ",\n "tag.EnabledEcPolicies" : "RS-10-4-1024k, RS-6-3-1024k",\n
"tag.HAState" : "active",\n "tag.Hostname" : "lgp-dat-comas01.lgp.com",\n
"TotalSyncCount" : 111,\n "NumInMaintenanceLiveDataNodes" : 0,\n
"NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" :
0,\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n
"ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 4678,\n
"TransactionsSinceLastLogRoll" : 125,\n "LastWrittenTransactionId" :
109942,\n "LastCheckpointTime" : 1693199021628,\n "CapacityTotal" :
51134807408640,\n "CapacityTotalGB" : 47623.0,\n "CapacityUsed" :
237572857166,\n "CapacityUsedGB" : 221.0,\n "CapacityRemaining" :
50498944342333,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" :
47031.0,\n "CapacityUsedNonDFS" : 397185802930,\n "TotalLoad" : 18,\n
"SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones"
: 0,\n "CurrentTokensCount" : 4,\n "LockQueueLength" : 0,\n
"ReadLockLongHoldCount" : 0,\n "WriteLockLongHoldCount" : 1,\n
"BlocksTotal" : 6339,\n "NumFilesUnderConstruction" : 3,\n
"NumActiveClients" : 3,\n "FilesTotal" : 6590,\n
"PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n
"UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n
"CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n
"PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n
"CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n
"MissingReplicationOneBlocks" : 0,\n
"HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n
"HighestPriorityLowRedundancyECBlocks" : 0,\n
"BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" :
0,\n "TotalReplicatedBlocks" : 6339,\n "LowRedundancyECBlockGroups" :
0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n
"BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n
"TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n
"NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" :
0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" :
0,\n "BlockCapacity" : 536870912,\n "NumLiveDataNodes" : 5,\n
"NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n
"NumDecomDeadDataNodes" : 0,\n "NumInServiceLiveDataNodes" : 5,\n
"VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n
"NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n
"NumStaleStorages" : 0\n } ]\n}', u'')
2023-08-28 16:28:17,164 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
--negotiate -u : -s
'"'"'http://lgp-dat-cowk01.lgp.com:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"'
1>/tmp/tmp_NdtDZ 2>/tmp/tmp05uR2Y''] {'quiet': False}
2023-08-28 16:28:17,369 - call returned (0, '')
2023-08-28 16:28:17,370 - get_user_call_output returned (0, u'{\n "beans" : [
{\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType"
: "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.EnabledEcPolicies" :
"RS-10-4-1024k, RS-6-3-1024k",\n "tag.HAState" : "standby",\n
"tag.TotalSyncTimes" : "",\n "tag.Hostname" : "lgp-dat-cowk01.lgp.com",\n
"MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats"
: 0,\n "TransactionsSinceLastCheckpoint" : 4553,\n
"TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 105325,\n
"LastCheckpointTime" : 1693199023018,\n "CapacityTotal" :
51134807408640,\n "CapacityTotalGB" : 47623.0,\n "CapacityUsed" :
237572857166,\n "CapacityUsedGB" : 221.0,\n "CapacityRemaining" :
50499015248333,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" :
47031.0,\n "CapacityUsedNonDFS" : 397117190834,\n "TotalLoad" : 18,\n
"SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones"
: 0,\n "CurrentTokensCount" : 4,\n "LockQueueLength" : 0,\n
"ReadLockLongHoldCount" : 0,\n "WriteLockLongHoldCount" : 0,\n
"BlocksTotal" : 6325,\n "NumFilesUnderConstruction" : 3,\n
"NumActiveClients" : 3,\n "FilesTotal" : 6582,\n
"PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n
"UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n
"CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n
"PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n
"CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n
"MissingReplicationOneBlocks" : 0,\n
"HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n
"HighestPriorityLowRedundancyECBlocks" : 0,\n
"BytesInFutureReplicatedBlocks" : 0,\n "ExcessBlocks" : 0,\n
"PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 6325,\n
"LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n
"MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n
"PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n
"NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" :
0,\n "PendingDataNodeMessageCount" : 57,\n "MillisSinceLastLoadedEdits" :
113409,\n "BlockCapacity" : 536870912,\n "NumLiveDataNodes" : 5,\n
"NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n
"NumDecomDeadDataNodes" : 0,\n "NumInServiceLiveDataNodes" : 5,\n
"VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n
"NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n
"NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n
"NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" :
0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'')
2023-08-28 16:28:17,372 - NameNode HA states: active_namenodes = [(u'nn1',
'lgp-dat-comas01.lgp.com:50070')], standby_namenodes = [(u'nn2',
'lgp-dat-cowk01.lgp.com:50070')], unknown_namenodes = []
2023-08-28 16:28:17,374 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
-sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length:
0'"'"' --negotiate -u :
'"'"'http://lgp-dat-comas01.lgp.com:50070/webhdfs/v1/warehouse/tablespace/external/hive/sys.db/query_data/?op=GETFILESTATUS'"'"'
1>/tmp/tmpnixLbe 2>/tmp/tmprN73Rd''] {'logoutput': None, 'quiet': False}
2023-08-28 16:28:17,465 - call returned (0, '')
2023-08-28 16:28:17,466 - get_user_call_output returned (0,
u'{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":0,"fileId":16437,"group":"hdfs","length":0,"modificationTime":1690530686865,"owner":"hive","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200',
u'')
2023-08-28 16:28:17,467 -
HdfsResource['/warehouse/tablespace/external/hive/sys.db/dag_meta']
{'security_enabled': True, 'hadoop_bin_dir': '/usr/bin', 'keytab':
'/etc/security/keytabs/hdfs.headless.keytab', 'dfs_type': 'HDFS', 'default_fs':
'hdfs://sandbox', 'hdfs_resource_ignore_file':
'/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ...,
'kinit_path_local': '/usr/bin/kinit', 'principal_name': '[email protected]',
'user': 'hdfs', 'owner': 'hive', 'hadoop_conf_dir': '/etc/hadoop/conf', 'type':
'directory', 'action': ['create_on_execute'], 'immutable_paths':
[u'/mr-history/done', u'/warehouse/tablespace/managed/hive',
u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 01777}
2023-08-28 16:28:17,468 - Execute['/usr/bin/kinit -kt
/etc/security/keytabs/hdfs.headless.keytab [email protected]'] {'user':
'hdfs'}
2023-08-28 16:28:17,550 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
--negotiate -u : -s
'"'"'http://lgp-dat-comas01.lgp.com:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"'
1>/tmp/tmpFRDWQP 2>/tmp/tmpghuMDb''] {'quiet': False}
2023-08-28 16:28:17,634 - call returned (0, '')
2023-08-28 16:28:17,634 - get_user_call_output returned (0, u'{\n "beans" : [
{\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType"
: "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.TotalSyncTimes" : "183
29 ",\n "tag.EnabledEcPolicies" : "RS-10-4-1024k, RS-6-3-1024k",\n
"tag.HAState" : "active",\n "tag.Hostname" : "lgp-dat-comas01.lgp.com",\n
"TotalSyncCount" : 111,\n "NumInMaintenanceLiveDataNodes" : 0,\n
"NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" :
0,\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n
"ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 4678,\n
"TransactionsSinceLastLogRoll" : 125,\n "LastWrittenTransactionId" :
109942,\n "LastCheckpointTime" : 1693199021628,\n "CapacityTotal" :
51134807408640,\n "CapacityTotalGB" : 47623.0,\n "CapacityUsed" :
237572857166,\n "CapacityUsedGB" : 221.0,\n "CapacityRemaining" :
50498944342333,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" :
47031.0,\n "CapacityUsedNonDFS" : 397185802930,\n "TotalLoad" : 18,\n
"SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones"
: 0,\n "CurrentTokensCount" : 4,\n "LockQueueLength" : 0,\n
"ReadLockLongHoldCount" : 0,\n "WriteLockLongHoldCount" : 1,\n
"BlocksTotal" : 6339,\n "NumFilesUnderConstruction" : 3,\n
"NumActiveClients" : 3,\n "FilesTotal" : 6590,\n
"PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n
"UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n
"CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n
"PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n
"CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n
"MissingReplicationOneBlocks" : 0,\n
"HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n
"HighestPriorityLowRedundancyECBlocks" : 0,\n
"BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" :
0,\n "TotalReplicatedBlocks" : 6339,\n "LowRedundancyECBlockGroups" :
0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n
"BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n
"TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n
"NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" :
0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" :
0,\n "BlockCapacity" : 536870912,\n "NumLiveDataNodes" : 5,\n
"NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n
"NumDecomDeadDataNodes" : 0,\n "NumInServiceLiveDataNodes" : 5,\n
"VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n
"NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n
"NumStaleStorages" : 0\n } ]\n}', u'')
2023-08-28 16:28:17,635 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
--negotiate -u : -s
'"'"'http://lgp-dat-cowk01.lgp.com:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"'
1>/tmp/tmpA1pne_ 2>/tmp/tmpeScq1g''] {'quiet': False}
2023-08-28 16:28:17,717 - call returned (0, '')
2023-08-28 16:28:17,718 - get_user_call_output returned (0, u'{\n "beans" : [
{\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType"
: "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.EnabledEcPolicies" :
"RS-10-4-1024k, RS-6-3-1024k",\n "tag.HAState" : "standby",\n
"tag.TotalSyncTimes" : "",\n "tag.Hostname" : "lgp-dat-cowk01.lgp.com",\n
"MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats"
: 0,\n "TransactionsSinceLastCheckpoint" : 4553,\n
"TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 105325,\n
"LastCheckpointTime" : 1693199023018,\n "CapacityTotal" :
51134807408640,\n "CapacityTotalGB" : 47623.0,\n "CapacityUsed" :
237572857166,\n "CapacityUsedGB" : 221.0,\n "CapacityRemaining" :
50499015248333,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" :
47031.0,\n "CapacityUsedNonDFS" : 397117190834,\n "TotalLoad" : 18,\n
"SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones"
: 0,\n "CurrentTokensCount" : 4,\n "LockQueueLength" : 0,\n
"ReadLockLongHoldCount" : 0,\n "WriteLockLongHoldCount" : 0,\n
"BlocksTotal" : 6325,\n "NumFilesUnderConstruction" : 3,\n
"NumActiveClients" : 3,\n "FilesTotal" : 6582,\n
"PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n
"UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n
"CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n
"PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n
"CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n
"MissingReplicationOneBlocks" : 0,\n
"HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n
"HighestPriorityLowRedundancyECBlocks" : 0,\n
"BytesInFutureReplicatedBlocks" : 0,\n "ExcessBlocks" : 0,\n
"PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 6325,\n
"LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n
"MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n
"PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n
"NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" :
0,\n "PendingDataNodeMessageCount" : 57,\n "MillisSinceLastLoadedEdits" :
113409,\n "BlockCapacity" : 536870912,\n "NumLiveDataNodes" : 5,\n
"NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n
"NumDecomDeadDataNodes" : 0,\n "NumInServiceLiveDataNodes" : 5,\n
"VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n
"NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n
"NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n
"NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" :
0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'')
2023-08-28 16:28:17,720 - NameNode HA states: active_namenodes = [(u'nn1',
'lgp-dat-comas01.lgp.com:50070')], standby_namenodes = [(u'nn2',
'lgp-dat-cowk01.lgp.com:50070')], unknown_namenodes = []
2023-08-28 16:28:17,722 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
-sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length:
0'"'"' --negotiate -u :
'"'"'http://lgp-dat-comas01.lgp.com:50070/webhdfs/v1/warehouse/tablespace/external/hive/sys.db/dag_meta?op=GETFILESTATUS'"'"'
1>/tmp/tmpjdO_EA 2>/tmp/tmpZwAco8''] {'logoutput': None, 'quiet': False}
2023-08-28 16:28:17,805 - call returned (0, '')
2023-08-28 16:28:17,806 - get_user_call_output returned (0,
u'{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":0,"fileId":16438,"group":"hdfs","length":0,"modificationTime":1690530687218,"owner":"hive","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200',
u'')
2023-08-28 16:28:17,808 -
HdfsResource['/warehouse/tablespace/external/hive/sys.db/dag_data']
{'security_enabled': True, 'hadoop_bin_dir': '/usr/bin', 'keytab':
'/etc/security/keytabs/hdfs.headless.keytab', 'dfs_type': 'HDFS', 'default_fs':
'hdfs://sandbox', 'hdfs_resource_ignore_file':
'/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ...,
'kinit_path_local': '/usr/bin/kinit', 'principal_name': '[email protected]',
'user': 'hdfs', 'owner': 'hive', 'hadoop_conf_dir': '/etc/hadoop/conf', 'type':
'directory', 'action': ['create_on_execute'], 'immutable_paths':
[u'/mr-history/done', u'/warehouse/tablespace/managed/hive',
u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 01777}
2023-08-28 16:28:17,809 - Execute['/usr/bin/kinit -kt
/etc/security/keytabs/hdfs.headless.keytab [email protected]'] {'user':
'hdfs'}
2023-08-28 16:28:17,899 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
--negotiate -u : -s
'"'"'http://lgp-dat-comas01.lgp.com:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"'
1>/tmp/tmpm8aScQ 2>/tmp/tmpTcUH9Y''] {'quiet': False}
2023-08-28 16:28:17,976 - call returned (0, '')
2023-08-28 16:28:17,976 - get_user_call_output returned (0, u'{\n "beans" : [
{\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType"
: "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.TotalSyncTimes" : "183
29 ",\n "tag.EnabledEcPolicies" : "RS-10-4-1024k, RS-6-3-1024k",\n
"tag.HAState" : "active",\n "tag.Hostname" : "lgp-dat-comas01.lgp.com",\n
"TotalSyncCount" : 111,\n "NumInMaintenanceLiveDataNodes" : 0,\n
"NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" :
0,\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n
"ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 4678,\n
"TransactionsSinceLastLogRoll" : 125,\n "LastWrittenTransactionId" :
109942,\n "LastCheckpointTime" : 1693199021628,\n "CapacityTotal" :
51134807408640,\n "CapacityTotalGB" : 47623.0,\n "CapacityUsed" :
237572857166,\n "CapacityUsedGB" : 221.0,\n "CapacityRemaining" :
50498944342333,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" :
47031.0,\n "CapacityUsedNonDFS" : 397185802930,\n "TotalLoad" : 18,\n
"SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones"
: 0,\n "CurrentTokensCount" : 4,\n "LockQueueLength" : 0,\n
"ReadLockLongHoldCount" : 0,\n "WriteLockLongHoldCount" : 1,\n
"BlocksTotal" : 6339,\n "NumFilesUnderConstruction" : 3,\n
"NumActiveClients" : 3,\n "FilesTotal" : 6590,\n
"PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n
"UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n
"CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n
"PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n
"CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n
"MissingReplicationOneBlocks" : 0,\n
"HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n
"HighestPriorityLowRedundancyECBlocks" : 0,\n
"BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" :
0,\n "TotalReplicatedBlocks" : 6339,\n "LowRedundancyECBlockGroups" :
0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n
"BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n
"TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n
"NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" :
0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" :
0,\n "BlockCapacity" : 536870912,\n "NumLiveDataNodes" : 5,\n
"NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n
"NumDecomDeadDataNodes" : 0,\n "NumInServiceLiveDataNodes" : 5,\n
"VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n
"NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n
"NumStaleStorages" : 0\n } ]\n}', u'')
2023-08-28 16:28:17,979 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
--negotiate -u : -s
'"'"'http://lgp-dat-cowk01.lgp.com:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"'
1>/tmp/tmp0BG2dk 2>/tmp/tmpeR9fqm''] {'quiet': False}
2023-08-28 16:28:18,072 - call returned (0, '')
2023-08-28 16:28:18,073 - get_user_call_output returned (0, u'{\n "beans" : [
{\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType"
: "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.EnabledEcPolicies" :
"RS-10-4-1024k, RS-6-3-1024k",\n "tag.HAState" : "standby",\n
"tag.TotalSyncTimes" : "",\n "tag.Hostname" : "lgp-dat-cowk01.lgp.com",\n
"MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats"
: 0,\n "TransactionsSinceLastCheckpoint" : 4553,\n
"TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 105325,\n
"LastCheckpointTime" : 1693199023018,\n "CapacityTotal" :
51134807408640,\n "CapacityTotalGB" : 47623.0,\n "CapacityUsed" :
237572857166,\n "CapacityUsedGB" : 221.0,\n "CapacityRemaining" :
50499015248333,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" :
47031.0,\n "CapacityUsedNonDFS" : 397117190834,\n "TotalLoad" : 18,\n
"SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones"
: 0,\n "CurrentTokensCount" : 4,\n "LockQueueLength" : 0,\n
"ReadLockLongHoldCount" : 0,\n "WriteLockLongHoldCount" : 0,\n
"BlocksTotal" : 6325,\n "NumFilesUnderConstruction" : 3,\n
"NumActiveClients" : 3,\n "FilesTotal" : 6582,\n
"PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n
"UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n
"CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n
"PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n
"CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n
"MissingReplicationOneBlocks" : 0,\n
"HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n
"HighestPriorityLowRedundancyECBlocks" : 0,\n
"BytesInFutureReplicatedBlocks" : 0,\n "ExcessBlocks" : 0,\n
"PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 6325,\n
"LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n
"MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n
"PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n
"NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" :
0,\n "PendingDataNodeMessageCount" : 57,\n "MillisSinceLastLoadedEdits" :
113409,\n "BlockCapacity" : 536870912,\n "NumLiveDataNodes" : 5,\n
"NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n
"NumDecomDeadDataNodes" : 0,\n "NumInServiceLiveDataNodes" : 5,\n
"VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n
"NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n
"NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n
"NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" :
0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'')
2023-08-28 16:28:18,075 - NameNode HA states: active_namenodes = [(u'nn1',
'lgp-dat-comas01.lgp.com:50070')], standby_namenodes = [(u'nn2',
'lgp-dat-cowk01.lgp.com:50070')], unknown_namenodes = []
2023-08-28 16:28:18,077 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
-sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length:
0'"'"' --negotiate -u :
'"'"'http://lgp-dat-comas01.lgp.com:50070/webhdfs/v1/warehouse/tablespace/external/hive/sys.db/dag_data?op=GETFILESTATUS'"'"'
1>/tmp/tmpRkhYG3 2>/tmp/tmp31KCaZ''] {'logoutput': None, 'quiet': False}
2023-08-28 16:28:18,160 - call returned (0, '')
2023-08-28 16:28:18,161 - get_user_call_output returned (0,
u'{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":0,"fileId":16439,"group":"hdfs","length":0,"modificationTime":1690530687568,"owner":"hive","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200',
u'')
2023-08-28 16:28:18,162 -
HdfsResource['/warehouse/tablespace/external/hive/sys.db/app_data']
{'security_enabled': True, 'hadoop_bin_dir': '/usr/bin', 'keytab':
'/etc/security/keytabs/hdfs.headless.keytab', 'dfs_type': 'HDFS', 'default_fs':
'hdfs://sandbox', 'hdfs_resource_ignore_file':
'/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ...,
'kinit_path_local': '/usr/bin/kinit', 'principal_name': '[email protected]',
'user': 'hdfs', 'owner': 'hive', 'hadoop_conf_dir': '/etc/hadoop/conf', 'type':
'directory', 'action': ['create_on_execute'], 'immutable_paths':
[u'/mr-history/done', u'/warehouse/tablespace/managed/hive',
u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 01777}
2023-08-28 16:28:18,163 - Execute['/usr/bin/kinit -kt
/etc/security/keytabs/hdfs.headless.keytab [email protected]'] {'user':
'hdfs'}
2023-08-28 16:28:18,253 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
--negotiate -u : -s
'"'"'http://lgp-dat-comas01.lgp.com:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"'
1>/tmp/tmpea0yPl 2>/tmp/tmpBXjAOI''] {'quiet': False}
2023-08-28 16:28:18,344 - call returned (0, '')
2023-08-28 16:28:18,344 - get_user_call_output returned (0, u'{\n "beans" : [
{\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType"
: "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.TotalSyncTimes" : "183
29 ",\n "tag.EnabledEcPolicies" : "RS-10-4-1024k, RS-6-3-1024k",\n
"tag.HAState" : "active",\n "tag.Hostname" : "lgp-dat-comas01.lgp.com",\n
"TotalSyncCount" : 111,\n "NumInMaintenanceLiveDataNodes" : 0,\n
"NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" :
0,\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n
"ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 4678,\n
"TransactionsSinceLastLogRoll" : 125,\n "LastWrittenTransactionId" :
109942,\n "LastCheckpointTime" : 1693199021628,\n "CapacityTotal" :
51134807408640,\n "CapacityTotalGB" : 47623.0,\n "CapacityUsed" :
237572857166,\n "CapacityUsedGB" : 221.0,\n "CapacityRemaining" :
50498944342333,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" :
47031.0,\n "CapacityUsedNonDFS" : 397185802930,\n "TotalLoad" : 18,\n
"SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones"
: 0,\n "CurrentTokensCount" : 4,\n "LockQueueLength" : 0,\n
"ReadLockLongHoldCount" : 0,\n "WriteLockLongHoldCount" : 1,\n
"BlocksTotal" : 6339,\n "NumFilesUnderConstruction" : 3,\n
"NumActiveClients" : 3,\n "FilesTotal" : 6590,\n
"PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n
"UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n
"CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n
"PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n
"CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n
"MissingReplicationOneBlocks" : 0,\n
"HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n
"HighestPriorityLowRedundancyECBlocks" : 0,\n
"BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" :
0,\n "TotalReplicatedBlocks" : 6339,\n "LowRedundancyECBlockGroups" :
0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n
"BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n
"TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n
"NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" :
0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" :
0,\n "BlockCapacity" : 536870912,\n "NumLiveDataNodes" : 5,\n
"NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n
"NumDecomDeadDataNodes" : 0,\n "NumInServiceLiveDataNodes" : 5,\n
"VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n
"NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n
"NumStaleStorages" : 0\n } ]\n}', u'')
2023-08-28 16:28:18,346 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
--negotiate -u : -s
'"'"'http://lgp-dat-cowk01.lgp.com:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"'
1>/tmp/tmpONirLp 2>/tmp/tmp1HmgCr''] {'quiet': False}
2023-08-28 16:28:18,432 - call returned (0, '')
2023-08-28 16:28:18,433 - get_user_call_output returned (0, u'{\n "beans" : [
{\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType"
: "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.EnabledEcPolicies" :
"RS-10-4-1024k, RS-6-3-1024k",\n "tag.HAState" : "standby",\n
"tag.TotalSyncTimes" : "",\n "tag.Hostname" : "lgp-dat-cowk01.lgp.com",\n
"MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats"
: 0,\n "TransactionsSinceLastCheckpoint" : 4553,\n
"TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 105325,\n
"LastCheckpointTime" : 1693199023018,\n "CapacityTotal" :
51134807408640,\n "CapacityTotalGB" : 47623.0,\n "CapacityUsed" :
237572857166,\n "CapacityUsedGB" : 221.0,\n "CapacityRemaining" :
50499015248333,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" :
47031.0,\n "CapacityUsedNonDFS" : 397117190834,\n "TotalLoad" : 18,\n
"SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones"
: 0,\n "CurrentTokensCount" : 4,\n "LockQueueLength" : 0,\n
"ReadLockLongHoldCount" : 0,\n "WriteLockLongHoldCount" : 0,\n
"BlocksTotal" : 6325,\n "NumFilesUnderConstruction" : 3,\n
"NumActiveClients" : 3,\n "FilesTotal" : 6582,\n
"PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n
"UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n
"CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n
"PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n
"CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n
"MissingReplicationOneBlocks" : 0,\n
"HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n
"HighestPriorityLowRedundancyECBlocks" : 0,\n
"BytesInFutureReplicatedBlocks" : 0,\n "ExcessBlocks" : 0,\n
"PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 6325,\n
"LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n
"MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n
"PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n
"NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" :
0,\n "PendingDataNodeMessageCount" : 57,\n "MillisSinceLastLoadedEdits" :
113409,\n "BlockCapacity" : 536870912,\n "NumLiveDataNodes" : 5,\n
"NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n
"NumDecomDeadDataNodes" : 0,\n "NumInServiceLiveDataNodes" : 5,\n
"VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n
"NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n
"NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n
"NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" :
0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'')
2023-08-28 16:28:18,434 - NameNode HA states: active_namenodes = [(u'nn1',
'lgp-dat-comas01.lgp.com:50070')], standby_namenodes = [(u'nn2',
'lgp-dat-cowk01.lgp.com:50070')], unknown_namenodes = []
2023-08-28 16:28:18,436 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl
-sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length:
0'"'"' --negotiate -u :
'"'"'http://lgp-dat-comas01.lgp.com:50070/webhdfs/v1/warehouse/tablespace/external/hive/sys.db/app_data?op=GETFILESTATUS'"'"'
1>/tmp/tmpnOJT60 2>/tmp/tmpfYwfOn''] {'logoutput': None, 'quiet': False}
2023-08-28 16:28:18,522 - call returned (0, '')
2023-08-28 16:28:18,522 - get_user_call_output returned (0,
u'{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":0,"fileId":16440,"group":"hdfs","length":0,"modificationTime":1690530687972,"owner":"hive","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200',
u'')
2023-08-28 16:28:18,524 - HdfsResource[None] {'security_enabled': True,
'hadoop_bin_dir': '/usr/bin', 'keytab':
'/etc/security/keytabs/hdfs.headless.keytab', 'dfs_type': 'HDFS', 'default_fs':
'hdfs://sandbox', 'hdfs_resource_ignore_file':
'/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ...,
'kinit_path_local': '/usr/bin/kinit', 'principal_name': '[email protected]',
'user': 'hdfs', 'action': ['execute'], 'hadoop_conf_dir': '/etc/hadoop/conf',
'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive',
u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp']}
2023-08-28 16:28:18,529 - Directory['/usr/lib/ambari-logsearch-logfeeder/conf']
{'create_parents': True, 'mode': 0755, 'cd_access': 'a'}
2023-08-28 16:28:18,529 - Generate Log Feeder config file:
/usr/lib/ambari-logsearch-logfeeder/conf/input.config-hive.json
2023-08-28 16:28:18,529 -
File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-hive.json']
{'content': Template('input.config-hive.json.j2'), 'mode': 0644}
2023-08-28 16:28:18,530 - Hive: Setup ranger: command retry not enabled thus
skipping if ranger admin is down !
Command failed after 1 tries
