[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled
[ https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Onischuk updated AMBARI-24942: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk > Dir creation fails if webhdfs is enabled > > > Key: AMBARI-24942 > URL: https://issues.apache.org/jira/browse/AMBARI-24942 > Project: Ambari > Issue Type: Bug >Reporter: Andrew Onischuk >Assignee: Andrew Onischuk >Priority: Major > Labels: pull-request-available > Fix For: 2.8.0 > > Attachments: AMBARI-24942.patch, AMBARI-24942.patch, > AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch > > Time Spent: 40m > Remaining Estimate: 0h > > The previous clusters had webhdfs disabled as a workaround. > With webHDFS turned back on, dir creation continues to fail. > > > > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 90, in > AmsCollector().execute() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", > line 345, in execute > method(env) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 48, in start > self.configure(env, action = 'start') # for security > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 43, in configure > hbase('master', action) > File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line > 89, in thunk > return fn(*args, **kwargs) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py", > line 228, in hbase > dfs_type=params.dfs_type > File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line > 166, in __init__ > self.env.run() > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 160, in run > self.run_action(resource, action) > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 124, in run_action > provider_action() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 712, in action_create_on_execute > self.action_delayed("create") > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 709, in action_delayed > self.get_hdfs_resource_executor().action_delayed(action_name, self) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 385, in action_delayed > self.action_delayed_for_nameservice(None, action_name, main_resource) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 407, in action_delayed_for_nameservice > self._assert_valid() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 346, in _assert_valid > self.target_status = self._get_file_status(target) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 509, in _get_file_status > list_status = self.util.run_command(target, 'GETFILESTATUS', > method='GET', ignore_status_codes=['404'], assertable_result=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 226, in run_command > return self._run_command(*args, **kwargs) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 294, in _run_command > _, out, err = get_user_call_output(cmd, user=self.run_user, > logoutput=self.logoutput, quiet=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py", > line 62, in get_user_call_output > raise ExecutionFailed(err_msg, code, files_output[0], files_output[1]) > resource_management.core.exceptions.ExecutionFailed: Execution of 'curl > -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' > 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs' > 1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve > host: fakelocalhost; Unknown error > 000 > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled
[ https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Onischuk updated AMBARI-24942: - Attachment: AMBARI-24942.patch > Dir creation fails if webhdfs is enabled > > > Key: AMBARI-24942 > URL: https://issues.apache.org/jira/browse/AMBARI-24942 > Project: Ambari > Issue Type: Bug >Reporter: Andrew Onischuk >Assignee: Andrew Onischuk >Priority: Major > Fix For: 2.8.0 > > Attachments: AMBARI-24942.patch > > > The previous clusters had webhdfs disabled as a workaround. > With webHDFS turned back on, dir creation continues to fail. > > > > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 90, in > AmsCollector().execute() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", > line 345, in execute > method(env) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 48, in start > self.configure(env, action = 'start') # for security > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 43, in configure > hbase('master', action) > File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line > 89, in thunk > return fn(*args, **kwargs) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py", > line 228, in hbase > dfs_type=params.dfs_type > File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line > 166, in __init__ > self.env.run() > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 160, in run > self.run_action(resource, action) > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 124, in run_action > provider_action() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 712, in action_create_on_execute > self.action_delayed("create") > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 709, in action_delayed > self.get_hdfs_resource_executor().action_delayed(action_name, self) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 385, in action_delayed > self.action_delayed_for_nameservice(None, action_name, main_resource) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 407, in action_delayed_for_nameservice > self._assert_valid() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 346, in _assert_valid > self.target_status = self._get_file_status(target) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 509, in _get_file_status > list_status = self.util.run_command(target, 'GETFILESTATUS', > method='GET', ignore_status_codes=['404'], assertable_result=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 226, in run_command > return self._run_command(*args, **kwargs) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 294, in _run_command > _, out, err = get_user_call_output(cmd, user=self.run_user, > logoutput=self.logoutput, quiet=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py", > line 62, in get_user_call_output > raise ExecutionFailed(err_msg, code, files_output[0], files_output[1]) > resource_management.core.exceptions.ExecutionFailed: Execution of 'curl > -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' > 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs' > 1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve > host: fakelocalhost; Unknown error > 000 > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled
[ https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated AMBARI-24942: Labels: pull-request-available (was: ) > Dir creation fails if webhdfs is enabled > > > Key: AMBARI-24942 > URL: https://issues.apache.org/jira/browse/AMBARI-24942 > Project: Ambari > Issue Type: Bug >Reporter: Andrew Onischuk >Assignee: Andrew Onischuk >Priority: Major > Labels: pull-request-available > Fix For: 2.8.0 > > Attachments: AMBARI-24942.patch, AMBARI-24942.patch, > AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch > > > The previous clusters had webhdfs disabled as a workaround. > With webHDFS turned back on, dir creation continues to fail. > > > > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 90, in > AmsCollector().execute() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", > line 345, in execute > method(env) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 48, in start > self.configure(env, action = 'start') # for security > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 43, in configure > hbase('master', action) > File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line > 89, in thunk > return fn(*args, **kwargs) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py", > line 228, in hbase > dfs_type=params.dfs_type > File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line > 166, in __init__ > self.env.run() > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 160, in run > self.run_action(resource, action) > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 124, in run_action > provider_action() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 712, in action_create_on_execute > self.action_delayed("create") > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 709, in action_delayed > self.get_hdfs_resource_executor().action_delayed(action_name, self) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 385, in action_delayed > self.action_delayed_for_nameservice(None, action_name, main_resource) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 407, in action_delayed_for_nameservice > self._assert_valid() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 346, in _assert_valid > self.target_status = self._get_file_status(target) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 509, in _get_file_status > list_status = self.util.run_command(target, 'GETFILESTATUS', > method='GET', ignore_status_codes=['404'], assertable_result=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 226, in run_command > return self._run_command(*args, **kwargs) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 294, in _run_command > _, out, err = get_user_call_output(cmd, user=self.run_user, > logoutput=self.logoutput, quiet=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py", > line 62, in get_user_call_output > raise ExecutionFailed(err_msg, code, files_output[0], files_output[1]) > resource_management.core.exceptions.ExecutionFailed: Execution of 'curl > -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' > 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs' > 1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve > host: fakelocalhost; Unknown error > 000 > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled
[ https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Onischuk updated AMBARI-24942: - Attachment: AMBARI-24942.patch > Dir creation fails if webhdfs is enabled > > > Key: AMBARI-24942 > URL: https://issues.apache.org/jira/browse/AMBARI-24942 > Project: Ambari > Issue Type: Bug >Reporter: Andrew Onischuk >Assignee: Andrew Onischuk >Priority: Major > Fix For: 2.8.0 > > Attachments: AMBARI-24942.patch, AMBARI-24942.patch, > AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch > > > The previous clusters had webhdfs disabled as a workaround. > With webHDFS turned back on, dir creation continues to fail. > > > > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 90, in > AmsCollector().execute() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", > line 345, in execute > method(env) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 48, in start > self.configure(env, action = 'start') # for security > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 43, in configure > hbase('master', action) > File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line > 89, in thunk > return fn(*args, **kwargs) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py", > line 228, in hbase > dfs_type=params.dfs_type > File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line > 166, in __init__ > self.env.run() > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 160, in run > self.run_action(resource, action) > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 124, in run_action > provider_action() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 712, in action_create_on_execute > self.action_delayed("create") > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 709, in action_delayed > self.get_hdfs_resource_executor().action_delayed(action_name, self) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 385, in action_delayed > self.action_delayed_for_nameservice(None, action_name, main_resource) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 407, in action_delayed_for_nameservice > self._assert_valid() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 346, in _assert_valid > self.target_status = self._get_file_status(target) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 509, in _get_file_status > list_status = self.util.run_command(target, 'GETFILESTATUS', > method='GET', ignore_status_codes=['404'], assertable_result=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 226, in run_command > return self._run_command(*args, **kwargs) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 294, in _run_command > _, out, err = get_user_call_output(cmd, user=self.run_user, > logoutput=self.logoutput, quiet=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py", > line 62, in get_user_call_output > raise ExecutionFailed(err_msg, code, files_output[0], files_output[1]) > resource_management.core.exceptions.ExecutionFailed: Execution of 'curl > -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' > 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs' > 1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve > host: fakelocalhost; Unknown error > 000 > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled
[ https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Onischuk updated AMBARI-24942: - Attachment: AMBARI-24942.patch > Dir creation fails if webhdfs is enabled > > > Key: AMBARI-24942 > URL: https://issues.apache.org/jira/browse/AMBARI-24942 > Project: Ambari > Issue Type: Bug >Reporter: Andrew Onischuk >Assignee: Andrew Onischuk >Priority: Major > Fix For: 2.8.0 > > Attachments: AMBARI-24942.patch, AMBARI-24942.patch, > AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch > > > The previous clusters had webhdfs disabled as a workaround. > With webHDFS turned back on, dir creation continues to fail. > > > > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 90, in > AmsCollector().execute() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", > line 345, in execute > method(env) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 48, in start > self.configure(env, action = 'start') # for security > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 43, in configure > hbase('master', action) > File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line > 89, in thunk > return fn(*args, **kwargs) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py", > line 228, in hbase > dfs_type=params.dfs_type > File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line > 166, in __init__ > self.env.run() > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 160, in run > self.run_action(resource, action) > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 124, in run_action > provider_action() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 712, in action_create_on_execute > self.action_delayed("create") > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 709, in action_delayed > self.get_hdfs_resource_executor().action_delayed(action_name, self) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 385, in action_delayed > self.action_delayed_for_nameservice(None, action_name, main_resource) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 407, in action_delayed_for_nameservice > self._assert_valid() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 346, in _assert_valid > self.target_status = self._get_file_status(target) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 509, in _get_file_status > list_status = self.util.run_command(target, 'GETFILESTATUS', > method='GET', ignore_status_codes=['404'], assertable_result=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 226, in run_command > return self._run_command(*args, **kwargs) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 294, in _run_command > _, out, err = get_user_call_output(cmd, user=self.run_user, > logoutput=self.logoutput, quiet=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py", > line 62, in get_user_call_output > raise ExecutionFailed(err_msg, code, files_output[0], files_output[1]) > resource_management.core.exceptions.ExecutionFailed: Execution of 'curl > -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' > 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs' > 1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve > host: fakelocalhost; Unknown error > 000 > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled
[ https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Onischuk updated AMBARI-24942: - Attachment: AMBARI-24942.patch > Dir creation fails if webhdfs is enabled > > > Key: AMBARI-24942 > URL: https://issues.apache.org/jira/browse/AMBARI-24942 > Project: Ambari > Issue Type: Bug >Reporter: Andrew Onischuk >Assignee: Andrew Onischuk >Priority: Major > Fix For: 2.8.0 > > Attachments: AMBARI-24942.patch, AMBARI-24942.patch, > AMBARI-24942.patch, AMBARI-24942.patch > > > The previous clusters had webhdfs disabled as a workaround. > With webHDFS turned back on, dir creation continues to fail. > > > > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 90, in > AmsCollector().execute() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", > line 345, in execute > method(env) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 48, in start > self.configure(env, action = 'start') # for security > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 43, in configure > hbase('master', action) > File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line > 89, in thunk > return fn(*args, **kwargs) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py", > line 228, in hbase > dfs_type=params.dfs_type > File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line > 166, in __init__ > self.env.run() > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 160, in run > self.run_action(resource, action) > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 124, in run_action > provider_action() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 712, in action_create_on_execute > self.action_delayed("create") > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 709, in action_delayed > self.get_hdfs_resource_executor().action_delayed(action_name, self) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 385, in action_delayed > self.action_delayed_for_nameservice(None, action_name, main_resource) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 407, in action_delayed_for_nameservice > self._assert_valid() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 346, in _assert_valid > self.target_status = self._get_file_status(target) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 509, in _get_file_status > list_status = self.util.run_command(target, 'GETFILESTATUS', > method='GET', ignore_status_codes=['404'], assertable_result=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 226, in run_command > return self._run_command(*args, **kwargs) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 294, in _run_command > _, out, err = get_user_call_output(cmd, user=self.run_user, > logoutput=self.logoutput, quiet=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py", > line 62, in get_user_call_output > raise ExecutionFailed(err_msg, code, files_output[0], files_output[1]) > resource_management.core.exceptions.ExecutionFailed: Execution of 'curl > -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' > 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs' > 1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve > host: fakelocalhost; Unknown error > 000 > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled
[ https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Onischuk updated AMBARI-24942: - Attachment: AMBARI-24942.patch > Dir creation fails if webhdfs is enabled > > > Key: AMBARI-24942 > URL: https://issues.apache.org/jira/browse/AMBARI-24942 > Project: Ambari > Issue Type: Bug >Reporter: Andrew Onischuk >Assignee: Andrew Onischuk >Priority: Major > Fix For: 2.8.0 > > Attachments: AMBARI-24942.patch, AMBARI-24942.patch, > AMBARI-24942.patch, AMBARI-24942.patch > > > The previous clusters had webhdfs disabled as a workaround. > With webHDFS turned back on, dir creation continues to fail. > > > > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 90, in > AmsCollector().execute() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", > line 345, in execute > method(env) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 48, in start > self.configure(env, action = 'start') # for security > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 43, in configure > hbase('master', action) > File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line > 89, in thunk > return fn(*args, **kwargs) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py", > line 228, in hbase > dfs_type=params.dfs_type > File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line > 166, in __init__ > self.env.run() > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 160, in run > self.run_action(resource, action) > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 124, in run_action > provider_action() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 712, in action_create_on_execute > self.action_delayed("create") > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 709, in action_delayed > self.get_hdfs_resource_executor().action_delayed(action_name, self) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 385, in action_delayed > self.action_delayed_for_nameservice(None, action_name, main_resource) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 407, in action_delayed_for_nameservice > self._assert_valid() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 346, in _assert_valid > self.target_status = self._get_file_status(target) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 509, in _get_file_status > list_status = self.util.run_command(target, 'GETFILESTATUS', > method='GET', ignore_status_codes=['404'], assertable_result=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 226, in run_command > return self._run_command(*args, **kwargs) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 294, in _run_command > _, out, err = get_user_call_output(cmd, user=self.run_user, > logoutput=self.logoutput, quiet=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py", > line 62, in get_user_call_output > raise ExecutionFailed(err_msg, code, files_output[0], files_output[1]) > resource_management.core.exceptions.ExecutionFailed: Execution of 'curl > -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' > 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs' > 1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve > host: fakelocalhost; Unknown error > 000 > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled
[ https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Onischuk updated AMBARI-24942: - Attachment: AMBARI-24942.patch > Dir creation fails if webhdfs is enabled > > > Key: AMBARI-24942 > URL: https://issues.apache.org/jira/browse/AMBARI-24942 > Project: Ambari > Issue Type: Bug >Reporter: Andrew Onischuk >Assignee: Andrew Onischuk >Priority: Major > Fix For: 2.8.0 > > Attachments: AMBARI-24942.patch, AMBARI-24942.patch > > > The previous clusters had webhdfs disabled as a workaround. > With webHDFS turned back on, dir creation continues to fail. > > > > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 90, in > AmsCollector().execute() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", > line 345, in execute > method(env) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 48, in start > self.configure(env, action = 'start') # for security > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 43, in configure > hbase('master', action) > File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line > 89, in thunk > return fn(*args, **kwargs) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py", > line 228, in hbase > dfs_type=params.dfs_type > File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line > 166, in __init__ > self.env.run() > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 160, in run > self.run_action(resource, action) > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 124, in run_action > provider_action() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 712, in action_create_on_execute > self.action_delayed("create") > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 709, in action_delayed > self.get_hdfs_resource_executor().action_delayed(action_name, self) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 385, in action_delayed > self.action_delayed_for_nameservice(None, action_name, main_resource) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 407, in action_delayed_for_nameservice > self._assert_valid() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 346, in _assert_valid > self.target_status = self._get_file_status(target) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 509, in _get_file_status > list_status = self.util.run_command(target, 'GETFILESTATUS', > method='GET', ignore_status_codes=['404'], assertable_result=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 226, in run_command > return self._run_command(*args, **kwargs) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 294, in _run_command > _, out, err = get_user_call_output(cmd, user=self.run_user, > logoutput=self.logoutput, quiet=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py", > line 62, in get_user_call_output > raise ExecutionFailed(err_msg, code, files_output[0], files_output[1]) > resource_management.core.exceptions.ExecutionFailed: Execution of 'curl > -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' > 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs' > 1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve > host: fakelocalhost; Unknown error > 000 > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled
[ https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Onischuk updated AMBARI-24942: - Status: Patch Available (was: Open) > Dir creation fails if webhdfs is enabled > > > Key: AMBARI-24942 > URL: https://issues.apache.org/jira/browse/AMBARI-24942 > Project: Ambari > Issue Type: Bug >Reporter: Andrew Onischuk >Assignee: Andrew Onischuk >Priority: Major > Fix For: 2.8.0 > > Attachments: AMBARI-24942.patch > > > The previous clusters had webhdfs disabled as a workaround. > With webHDFS turned back on, dir creation continues to fail. > > > > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 90, in > AmsCollector().execute() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", > line 345, in execute > method(env) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 48, in start > self.configure(env, action = 'start') # for security > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py", > line 43, in configure > hbase('master', action) > File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line > 89, in thunk > return fn(*args, **kwargs) > File > "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py", > line 228, in hbase > dfs_type=params.dfs_type > File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line > 166, in __init__ > self.env.run() > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 160, in run > self.run_action(resource, action) > File > "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line > 124, in run_action > provider_action() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 712, in action_create_on_execute > self.action_delayed("create") > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 709, in action_delayed > self.get_hdfs_resource_executor().action_delayed(action_name, self) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 385, in action_delayed > self.action_delayed_for_nameservice(None, action_name, main_resource) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 407, in action_delayed_for_nameservice > self._assert_valid() > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 346, in _assert_valid > self.target_status = self._get_file_status(target) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 509, in _get_file_status > list_status = self.util.run_command(target, 'GETFILESTATUS', > method='GET', ignore_status_codes=['404'], assertable_result=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 226, in run_command > return self._run_command(*args, **kwargs) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py", > line 294, in _run_command > _, out, err = get_user_call_output(cmd, user=self.run_user, > logoutput=self.logoutput, quiet=False) > File > "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py", > line 62, in get_user_call_output > raise ExecutionFailed(err_msg, code, files_output[0], files_output[1]) > resource_management.core.exceptions.ExecutionFailed: Execution of 'curl > -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' > 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs' > 1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve > host: fakelocalhost; Unknown error > 000 > -- This message was sent by Atlassian JIRA (v7.6.3#76005)