[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled

2019-05-13 Thread Andrew Onischuk (JIRA)


 [ 
https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Onischuk updated AMBARI-24942:
-
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Committed to trunk

> Dir creation fails if webhdfs is enabled
> 
>
> Key: AMBARI-24942
> URL: https://issues.apache.org/jira/browse/AMBARI-24942
> Project: Ambari
>  Issue Type: Bug
>Reporter: Andrew Onischuk
>Assignee: Andrew Onischuk
>Priority: Major
>  Labels: pull-request-available
> Fix For: 2.8.0
>
> Attachments: AMBARI-24942.patch, AMBARI-24942.patch, 
> AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> The previous clusters had webhdfs disabled as a workaround.
> With webHDFS turned back on, dir creation continues to fail.
> 
> 
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 90, in 
> AmsCollector().execute()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", 
> line 345, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 48, in start
> self.configure(env, action = 'start') # for security
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 43, in configure
> hbase('master', action)
>   File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 
> 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py",
>  line 228, in hbase
> dfs_type=params.dfs_type
>   File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 
> 166, in __init__
> self.env.run()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 124, in run_action
> provider_action()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 712, in action_create_on_execute
> self.action_delayed("create")
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 709, in action_delayed
> self.get_hdfs_resource_executor().action_delayed(action_name, self)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 385, in action_delayed
> self.action_delayed_for_nameservice(None, action_name, main_resource)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 407, in action_delayed_for_nameservice
> self._assert_valid()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 346, in _assert_valid
> self.target_status = self._get_file_status(target)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 509, in _get_file_status
> list_status = self.util.run_command(target, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 226, in run_command
> return self._run_command(*args, **kwargs)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 294, in _run_command
> _, out, err = get_user_call_output(cmd, user=self.run_user, 
> logoutput=self.logoutput, quiet=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py",
>  line 62, in get_user_call_output
> raise ExecutionFailed(err_msg, code, files_output[0], files_output[1])
> resource_management.core.exceptions.ExecutionFailed: Execution of 'curl 
> -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' 
> 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs'
>  1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve 
> host: fakelocalhost; Unknown error
> 000
> 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled

2018-11-22 Thread Andrew Onischuk (JIRA)


 [ 
https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Onischuk updated AMBARI-24942:
-
Attachment: AMBARI-24942.patch

> Dir creation fails if webhdfs is enabled
> 
>
> Key: AMBARI-24942
> URL: https://issues.apache.org/jira/browse/AMBARI-24942
> Project: Ambari
>  Issue Type: Bug
>Reporter: Andrew Onischuk
>Assignee: Andrew Onischuk
>Priority: Major
> Fix For: 2.8.0
>
> Attachments: AMBARI-24942.patch
>
>
> The previous clusters had webhdfs disabled as a workaround.
> With webHDFS turned back on, dir creation continues to fail.
> 
> 
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 90, in 
> AmsCollector().execute()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", 
> line 345, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 48, in start
> self.configure(env, action = 'start') # for security
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 43, in configure
> hbase('master', action)
>   File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 
> 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py",
>  line 228, in hbase
> dfs_type=params.dfs_type
>   File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 
> 166, in __init__
> self.env.run()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 124, in run_action
> provider_action()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 712, in action_create_on_execute
> self.action_delayed("create")
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 709, in action_delayed
> self.get_hdfs_resource_executor().action_delayed(action_name, self)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 385, in action_delayed
> self.action_delayed_for_nameservice(None, action_name, main_resource)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 407, in action_delayed_for_nameservice
> self._assert_valid()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 346, in _assert_valid
> self.target_status = self._get_file_status(target)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 509, in _get_file_status
> list_status = self.util.run_command(target, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 226, in run_command
> return self._run_command(*args, **kwargs)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 294, in _run_command
> _, out, err = get_user_call_output(cmd, user=self.run_user, 
> logoutput=self.logoutput, quiet=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py",
>  line 62, in get_user_call_output
> raise ExecutionFailed(err_msg, code, files_output[0], files_output[1])
> resource_management.core.exceptions.ExecutionFailed: Execution of 'curl 
> -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' 
> 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs'
>  1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve 
> host: fakelocalhost; Unknown error
> 000
> 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled

2018-11-22 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated AMBARI-24942:

Labels: pull-request-available  (was: )

> Dir creation fails if webhdfs is enabled
> 
>
> Key: AMBARI-24942
> URL: https://issues.apache.org/jira/browse/AMBARI-24942
> Project: Ambari
>  Issue Type: Bug
>Reporter: Andrew Onischuk
>Assignee: Andrew Onischuk
>Priority: Major
>  Labels: pull-request-available
> Fix For: 2.8.0
>
> Attachments: AMBARI-24942.patch, AMBARI-24942.patch, 
> AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch
>
>
> The previous clusters had webhdfs disabled as a workaround.
> With webHDFS turned back on, dir creation continues to fail.
> 
> 
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 90, in 
> AmsCollector().execute()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", 
> line 345, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 48, in start
> self.configure(env, action = 'start') # for security
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 43, in configure
> hbase('master', action)
>   File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 
> 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py",
>  line 228, in hbase
> dfs_type=params.dfs_type
>   File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 
> 166, in __init__
> self.env.run()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 124, in run_action
> provider_action()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 712, in action_create_on_execute
> self.action_delayed("create")
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 709, in action_delayed
> self.get_hdfs_resource_executor().action_delayed(action_name, self)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 385, in action_delayed
> self.action_delayed_for_nameservice(None, action_name, main_resource)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 407, in action_delayed_for_nameservice
> self._assert_valid()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 346, in _assert_valid
> self.target_status = self._get_file_status(target)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 509, in _get_file_status
> list_status = self.util.run_command(target, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 226, in run_command
> return self._run_command(*args, **kwargs)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 294, in _run_command
> _, out, err = get_user_call_output(cmd, user=self.run_user, 
> logoutput=self.logoutput, quiet=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py",
>  line 62, in get_user_call_output
> raise ExecutionFailed(err_msg, code, files_output[0], files_output[1])
> resource_management.core.exceptions.ExecutionFailed: Execution of 'curl 
> -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' 
> 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs'
>  1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve 
> host: fakelocalhost; Unknown error
> 000
> 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled

2018-11-22 Thread Andrew Onischuk (JIRA)


 [ 
https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Onischuk updated AMBARI-24942:
-
Attachment: AMBARI-24942.patch

> Dir creation fails if webhdfs is enabled
> 
>
> Key: AMBARI-24942
> URL: https://issues.apache.org/jira/browse/AMBARI-24942
> Project: Ambari
>  Issue Type: Bug
>Reporter: Andrew Onischuk
>Assignee: Andrew Onischuk
>Priority: Major
> Fix For: 2.8.0
>
> Attachments: AMBARI-24942.patch, AMBARI-24942.patch, 
> AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch
>
>
> The previous clusters had webhdfs disabled as a workaround.
> With webHDFS turned back on, dir creation continues to fail.
> 
> 
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 90, in 
> AmsCollector().execute()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", 
> line 345, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 48, in start
> self.configure(env, action = 'start') # for security
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 43, in configure
> hbase('master', action)
>   File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 
> 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py",
>  line 228, in hbase
> dfs_type=params.dfs_type
>   File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 
> 166, in __init__
> self.env.run()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 124, in run_action
> provider_action()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 712, in action_create_on_execute
> self.action_delayed("create")
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 709, in action_delayed
> self.get_hdfs_resource_executor().action_delayed(action_name, self)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 385, in action_delayed
> self.action_delayed_for_nameservice(None, action_name, main_resource)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 407, in action_delayed_for_nameservice
> self._assert_valid()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 346, in _assert_valid
> self.target_status = self._get_file_status(target)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 509, in _get_file_status
> list_status = self.util.run_command(target, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 226, in run_command
> return self._run_command(*args, **kwargs)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 294, in _run_command
> _, out, err = get_user_call_output(cmd, user=self.run_user, 
> logoutput=self.logoutput, quiet=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py",
>  line 62, in get_user_call_output
> raise ExecutionFailed(err_msg, code, files_output[0], files_output[1])
> resource_management.core.exceptions.ExecutionFailed: Execution of 'curl 
> -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' 
> 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs'
>  1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve 
> host: fakelocalhost; Unknown error
> 000
> 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled

2018-11-22 Thread Andrew Onischuk (JIRA)


 [ 
https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Onischuk updated AMBARI-24942:
-
Attachment: AMBARI-24942.patch

> Dir creation fails if webhdfs is enabled
> 
>
> Key: AMBARI-24942
> URL: https://issues.apache.org/jira/browse/AMBARI-24942
> Project: Ambari
>  Issue Type: Bug
>Reporter: Andrew Onischuk
>Assignee: Andrew Onischuk
>Priority: Major
> Fix For: 2.8.0
>
> Attachments: AMBARI-24942.patch, AMBARI-24942.patch, 
> AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch, AMBARI-24942.patch
>
>
> The previous clusters had webhdfs disabled as a workaround.
> With webHDFS turned back on, dir creation continues to fail.
> 
> 
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 90, in 
> AmsCollector().execute()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", 
> line 345, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 48, in start
> self.configure(env, action = 'start') # for security
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 43, in configure
> hbase('master', action)
>   File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 
> 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py",
>  line 228, in hbase
> dfs_type=params.dfs_type
>   File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 
> 166, in __init__
> self.env.run()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 124, in run_action
> provider_action()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 712, in action_create_on_execute
> self.action_delayed("create")
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 709, in action_delayed
> self.get_hdfs_resource_executor().action_delayed(action_name, self)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 385, in action_delayed
> self.action_delayed_for_nameservice(None, action_name, main_resource)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 407, in action_delayed_for_nameservice
> self._assert_valid()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 346, in _assert_valid
> self.target_status = self._get_file_status(target)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 509, in _get_file_status
> list_status = self.util.run_command(target, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 226, in run_command
> return self._run_command(*args, **kwargs)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 294, in _run_command
> _, out, err = get_user_call_output(cmd, user=self.run_user, 
> logoutput=self.logoutput, quiet=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py",
>  line 62, in get_user_call_output
> raise ExecutionFailed(err_msg, code, files_output[0], files_output[1])
> resource_management.core.exceptions.ExecutionFailed: Execution of 'curl 
> -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' 
> 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs'
>  1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve 
> host: fakelocalhost; Unknown error
> 000
> 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled

2018-11-22 Thread Andrew Onischuk (JIRA)


 [ 
https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Onischuk updated AMBARI-24942:
-
Attachment: AMBARI-24942.patch

> Dir creation fails if webhdfs is enabled
> 
>
> Key: AMBARI-24942
> URL: https://issues.apache.org/jira/browse/AMBARI-24942
> Project: Ambari
>  Issue Type: Bug
>Reporter: Andrew Onischuk
>Assignee: Andrew Onischuk
>Priority: Major
> Fix For: 2.8.0
>
> Attachments: AMBARI-24942.patch, AMBARI-24942.patch, 
> AMBARI-24942.patch, AMBARI-24942.patch
>
>
> The previous clusters had webhdfs disabled as a workaround.
> With webHDFS turned back on, dir creation continues to fail.
> 
> 
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 90, in 
> AmsCollector().execute()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", 
> line 345, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 48, in start
> self.configure(env, action = 'start') # for security
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 43, in configure
> hbase('master', action)
>   File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 
> 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py",
>  line 228, in hbase
> dfs_type=params.dfs_type
>   File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 
> 166, in __init__
> self.env.run()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 124, in run_action
> provider_action()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 712, in action_create_on_execute
> self.action_delayed("create")
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 709, in action_delayed
> self.get_hdfs_resource_executor().action_delayed(action_name, self)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 385, in action_delayed
> self.action_delayed_for_nameservice(None, action_name, main_resource)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 407, in action_delayed_for_nameservice
> self._assert_valid()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 346, in _assert_valid
> self.target_status = self._get_file_status(target)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 509, in _get_file_status
> list_status = self.util.run_command(target, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 226, in run_command
> return self._run_command(*args, **kwargs)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 294, in _run_command
> _, out, err = get_user_call_output(cmd, user=self.run_user, 
> logoutput=self.logoutput, quiet=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py",
>  line 62, in get_user_call_output
> raise ExecutionFailed(err_msg, code, files_output[0], files_output[1])
> resource_management.core.exceptions.ExecutionFailed: Execution of 'curl 
> -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' 
> 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs'
>  1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve 
> host: fakelocalhost; Unknown error
> 000
> 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled

2018-11-22 Thread Andrew Onischuk (JIRA)


 [ 
https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Onischuk updated AMBARI-24942:
-
Attachment: AMBARI-24942.patch

> Dir creation fails if webhdfs is enabled
> 
>
> Key: AMBARI-24942
> URL: https://issues.apache.org/jira/browse/AMBARI-24942
> Project: Ambari
>  Issue Type: Bug
>Reporter: Andrew Onischuk
>Assignee: Andrew Onischuk
>Priority: Major
> Fix For: 2.8.0
>
> Attachments: AMBARI-24942.patch, AMBARI-24942.patch, 
> AMBARI-24942.patch, AMBARI-24942.patch
>
>
> The previous clusters had webhdfs disabled as a workaround.
> With webHDFS turned back on, dir creation continues to fail.
> 
> 
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 90, in 
> AmsCollector().execute()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", 
> line 345, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 48, in start
> self.configure(env, action = 'start') # for security
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 43, in configure
> hbase('master', action)
>   File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 
> 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py",
>  line 228, in hbase
> dfs_type=params.dfs_type
>   File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 
> 166, in __init__
> self.env.run()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 124, in run_action
> provider_action()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 712, in action_create_on_execute
> self.action_delayed("create")
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 709, in action_delayed
> self.get_hdfs_resource_executor().action_delayed(action_name, self)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 385, in action_delayed
> self.action_delayed_for_nameservice(None, action_name, main_resource)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 407, in action_delayed_for_nameservice
> self._assert_valid()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 346, in _assert_valid
> self.target_status = self._get_file_status(target)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 509, in _get_file_status
> list_status = self.util.run_command(target, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 226, in run_command
> return self._run_command(*args, **kwargs)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 294, in _run_command
> _, out, err = get_user_call_output(cmd, user=self.run_user, 
> logoutput=self.logoutput, quiet=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py",
>  line 62, in get_user_call_output
> raise ExecutionFailed(err_msg, code, files_output[0], files_output[1])
> resource_management.core.exceptions.ExecutionFailed: Execution of 'curl 
> -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' 
> 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs'
>  1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve 
> host: fakelocalhost; Unknown error
> 000
> 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled

2018-11-22 Thread Andrew Onischuk (JIRA)


 [ 
https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Onischuk updated AMBARI-24942:
-
Attachment: AMBARI-24942.patch

> Dir creation fails if webhdfs is enabled
> 
>
> Key: AMBARI-24942
> URL: https://issues.apache.org/jira/browse/AMBARI-24942
> Project: Ambari
>  Issue Type: Bug
>Reporter: Andrew Onischuk
>Assignee: Andrew Onischuk
>Priority: Major
> Fix For: 2.8.0
>
> Attachments: AMBARI-24942.patch, AMBARI-24942.patch
>
>
> The previous clusters had webhdfs disabled as a workaround.
> With webHDFS turned back on, dir creation continues to fail.
> 
> 
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 90, in 
> AmsCollector().execute()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", 
> line 345, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 48, in start
> self.configure(env, action = 'start') # for security
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 43, in configure
> hbase('master', action)
>   File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 
> 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py",
>  line 228, in hbase
> dfs_type=params.dfs_type
>   File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 
> 166, in __init__
> self.env.run()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 124, in run_action
> provider_action()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 712, in action_create_on_execute
> self.action_delayed("create")
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 709, in action_delayed
> self.get_hdfs_resource_executor().action_delayed(action_name, self)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 385, in action_delayed
> self.action_delayed_for_nameservice(None, action_name, main_resource)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 407, in action_delayed_for_nameservice
> self._assert_valid()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 346, in _assert_valid
> self.target_status = self._get_file_status(target)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 509, in _get_file_status
> list_status = self.util.run_command(target, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 226, in run_command
> return self._run_command(*args, **kwargs)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 294, in _run_command
> _, out, err = get_user_call_output(cmd, user=self.run_user, 
> logoutput=self.logoutput, quiet=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py",
>  line 62, in get_user_call_output
> raise ExecutionFailed(err_msg, code, files_output[0], files_output[1])
> resource_management.core.exceptions.ExecutionFailed: Execution of 'curl 
> -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' 
> 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs'
>  1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve 
> host: fakelocalhost; Unknown error
> 000
> 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (AMBARI-24942) Dir creation fails if webhdfs is enabled

2018-11-22 Thread Andrew Onischuk (JIRA)


 [ 
https://issues.apache.org/jira/browse/AMBARI-24942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Onischuk updated AMBARI-24942:
-
Status: Patch Available  (was: Open)

> Dir creation fails if webhdfs is enabled
> 
>
> Key: AMBARI-24942
> URL: https://issues.apache.org/jira/browse/AMBARI-24942
> Project: Ambari
>  Issue Type: Bug
>Reporter: Andrew Onischuk
>Assignee: Andrew Onischuk
>Priority: Major
> Fix For: 2.8.0
>
> Attachments: AMBARI-24942.patch
>
>
> The previous clusters had webhdfs disabled as a workaround.
> With webHDFS turned back on, dir creation continues to fail.
> 
> 
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 90, in 
> AmsCollector().execute()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", 
> line 345, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 48, in start
> self.configure(env, action = 'start') # for security
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/metrics_collector.py",
>  line 43, in configure
> hbase('master', action)
>   File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 
> 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/AMBARI_METRICS/package/scripts/hbase.py",
>  line 228, in hbase
> dfs_type=params.dfs_type
>   File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 
> 166, in __init__
> self.env.run()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 
> 124, in run_action
> provider_action()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 712, in action_create_on_execute
> self.action_delayed("create")
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 709, in action_delayed
> self.get_hdfs_resource_executor().action_delayed(action_name, self)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 385, in action_delayed
> self.action_delayed_for_nameservice(None, action_name, main_resource)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 407, in action_delayed_for_nameservice
> self._assert_valid()
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 346, in _assert_valid
> self.target_status = self._get_file_status(target)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 509, in _get_file_status
> list_status = self.util.run_command(target, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 226, in run_command
> return self._run_command(*args, **kwargs)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/providers/hdfs_resource.py",
>  line 294, in _run_command
> _, out, err = get_user_call_output(cmd, user=self.run_user, 
> logoutput=self.logoutput, quiet=False)
>   File 
> "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/get_user_call_output.py",
>  line 62, in get_user_call_output
> raise ExecutionFailed(err_msg, code, files_output[0], files_output[1])
> resource_management.core.exceptions.ExecutionFailed: Execution of 'curl 
> -sS -L -w '%{http_code}' -X GET -d '' -H 'Content-Length: 0' 
> 'http://fakelocalhost:50070/webhdfs/v1s3a:/cloudhdp-dl-s3-2/c01/amshbase?op=GETFILESTATUS&user.name=hdfs'
>  1>/tmp/tmpsSkYRy 2>/tmp/tmpYQM8tv' returned 6. curl: (6) Could not resolve 
> host: fakelocalhost; Unknown error
> 000
> 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)