[jira] [Commented] (METRON-993) Quick dev broken with latest master - services unable to start
[
https://issues.apache.org/jira/browse/METRON-993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344569#comment-16344569
]
Anand Subramanian commented on METRON-993:
--
Quick dev deployment is now obsolete.
> Quick dev broken with latest master - services unable to start
> --
>
> Key: METRON-993
> URL: https://issues.apache.org/jira/browse/METRON-993
> Project: Metron
> Issue Type: Bug
>Affects Versions: 0.4.0
>Reporter: Anand Subramanian
>Priority: Major
>
> I am trying to bring up a quick dev environment using the latest bits from
> master and I noticed that metron services fails to come up. The below error
> is seen for Metron Enrichment in Ambari:
> {code}
> stderr:
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_master.py",
> line 84, in
> Enrichment().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 280, in execute
> method(env)
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_master.py",
> line 51, in start
> metron_service.load_global_config(params)
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/metron_service.py",
> line 76, in load_global_config
> init_config()
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/metron_service.py",
> line 31, in init_config
> path=ambari_format("{java_home}/bin")
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
> line 155, in __init__
> self.env.run()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 160, in run
> self.run_action(resource, action)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 124, in run_action
> provider_action()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 273, in action_run
> tries=self.resource.tries, try_sleep=self.resource.try_sleep)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 70, in inner
> result = function(command, **kwargs)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 92, in checked_call
> tries=tries, try_sleep=try_sleep)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 140, in _call_wrapper
> result = _call(command, **kwargs_copy)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 293, in _call
> raise ExecutionFailed(err_msg, code, out, err)
> resource_management.core.exceptions.ExecutionFailed: Execution of
> '/usr/metron/0.3.1/bin/zk_load_configs.sh --mode PUSH -i
> /usr/metron/0.3.1/config/zookeeper -z node1:2181' returned 127. /bin/bash:
> /usr/metron/0.3.1/bin/zk_load_configs.sh: No such file or directory
> stdout:
> 2017-06-09 09:32:22,007 - The hadoop conf dir
> /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for
> version 2.5.3.0-37
> 2017-06-09 09:32:22,007 - Checking if need to create versioned conf dir
> /etc/hadoop/2.5.3.0-37/0
> 2017-06-09 09:32:22,009 - call[('ambari-python-wrap', '/usr/bin/conf-select',
> 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.3.0-37',
> '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False,
> 'stderr': -1}
> 2017-06-09 09:32:22,097 - call returned (1, '/etc/hadoop/2.5.3.0-37/0 exist
> already', '')
> 2017-06-09 09:32:22,098 - checked_call[('ambari-python-wrap',
> '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop',
> '--stack-version', '2.5.3.0-37', '--conf-version', '0')] {'logoutput': False,
> 'sudo': True, 'quiet': False}
> 2017-06-09 09:32:22,304 - checked_call returned (0, '')
> 2017-06-09 09:32:22,306 - Ensuring that hadoop has the correct symlink
> structure
> 2017-06-09 09:32:22,306 - Using hadoop conf dir:
> /usr/hdp/current/hadoop-client/conf
> 2017-06-09 09:32:23,537 - The hadoop conf dir
> /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for
> version 2.5.3.0-37
> 2017-06-09 09:32:23,561 - Checking if need to create versioned conf dir
> /etc/hadoop/2.5.3.0-37/0
> 2017-06-09 09:32:23,562 - call[('ambari-python-wrap', '/usr/bin/conf-select',
> 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.3.0-37',
> '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False,
> 'stderr': -1}
> 2017-06-09 09:32:23,915 - call returned (1, '/etc/hadoop/2.5.3.0-37/0 exist
> already', '')
> 2017-06-09 09:32:23,918 - checked_call[('ambari-python-wrap',
> '/usr/bin/conf-select',
[jira] [Commented] (METRON-993) Quick dev broken with latest master - services unable to start
[
https://issues.apache.org/jira/browse/METRON-993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16160803#comment-16160803
]
Choi BongJae commented on METRON-993:
-
same issue
> Quick dev broken with latest master - services unable to start
> --
>
> Key: METRON-993
> URL: https://issues.apache.org/jira/browse/METRON-993
> Project: Metron
> Issue Type: Bug
>Affects Versions: 0.4.0
>Reporter: Anand Subramanian
>
> I am trying to bring up a quick dev environment using the latest bits from
> master and I noticed that metron services fails to come up. The below error
> is seen for Metron Enrichment in Ambari:
> {code}
> stderr:
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_master.py",
> line 84, in
> Enrichment().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 280, in execute
> method(env)
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_master.py",
> line 51, in start
> metron_service.load_global_config(params)
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/metron_service.py",
> line 76, in load_global_config
> init_config()
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/metron_service.py",
> line 31, in init_config
> path=ambari_format("{java_home}/bin")
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
> line 155, in __init__
> self.env.run()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 160, in run
> self.run_action(resource, action)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 124, in run_action
> provider_action()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 273, in action_run
> tries=self.resource.tries, try_sleep=self.resource.try_sleep)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 70, in inner
> result = function(command, **kwargs)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 92, in checked_call
> tries=tries, try_sleep=try_sleep)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 140, in _call_wrapper
> result = _call(command, **kwargs_copy)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 293, in _call
> raise ExecutionFailed(err_msg, code, out, err)
> resource_management.core.exceptions.ExecutionFailed: Execution of
> '/usr/metron/0.3.1/bin/zk_load_configs.sh --mode PUSH -i
> /usr/metron/0.3.1/config/zookeeper -z node1:2181' returned 127. /bin/bash:
> /usr/metron/0.3.1/bin/zk_load_configs.sh: No such file or directory
> stdout:
> 2017-06-09 09:32:22,007 - The hadoop conf dir
> /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for
> version 2.5.3.0-37
> 2017-06-09 09:32:22,007 - Checking if need to create versioned conf dir
> /etc/hadoop/2.5.3.0-37/0
> 2017-06-09 09:32:22,009 - call[('ambari-python-wrap', '/usr/bin/conf-select',
> 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.3.0-37',
> '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False,
> 'stderr': -1}
> 2017-06-09 09:32:22,097 - call returned (1, '/etc/hadoop/2.5.3.0-37/0 exist
> already', '')
> 2017-06-09 09:32:22,098 - checked_call[('ambari-python-wrap',
> '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop',
> '--stack-version', '2.5.3.0-37', '--conf-version', '0')] {'logoutput': False,
> 'sudo': True, 'quiet': False}
> 2017-06-09 09:32:22,304 - checked_call returned (0, '')
> 2017-06-09 09:32:22,306 - Ensuring that hadoop has the correct symlink
> structure
> 2017-06-09 09:32:22,306 - Using hadoop conf dir:
> /usr/hdp/current/hadoop-client/conf
> 2017-06-09 09:32:23,537 - The hadoop conf dir
> /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for
> version 2.5.3.0-37
> 2017-06-09 09:32:23,561 - Checking if need to create versioned conf dir
> /etc/hadoop/2.5.3.0-37/0
> 2017-06-09 09:32:23,562 - call[('ambari-python-wrap', '/usr/bin/conf-select',
> 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.3.0-37',
> '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False,
> 'stderr': -1}
> 2017-06-09 09:32:23,915 - call returned (1, '/etc/hadoop/2.5.3.0-37/0 exist
> already', '')
> 2017-06-09 09:32:23,918 - checked_call[('ambari-python-wrap',
> '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop',
> '--stack-version',
[jira] [Commented] (METRON-993) Quick dev broken with latest master - services unable to start
[
https://issues.apache.org/jira/browse/METRON-993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044977#comment-16044977
]
Nick Allen commented on METRON-993:
---
We need to rebuild the Metron image that gets deployed to Atlas. I tried over
the last couple days to build and deploy a new image to address this, but I
have been hitting a failure in building those images. I have not had a chance
to debug the issue yet. May just be something about my environment.
> Quick dev broken with latest master - services unable to start
> --
>
> Key: METRON-993
> URL: https://issues.apache.org/jira/browse/METRON-993
> Project: Metron
> Issue Type: Bug
>Affects Versions: 0.4
>Reporter: Anand Subramanian
>
> I am trying to bring up a quick dev environment using the latest bits from
> master and I noticed that metron services fails to come up. The below error
> is seen for Metron Enrichment in Ambari:
> {code}
> stderr:
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_master.py",
> line 84, in
> Enrichment().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 280, in execute
> method(env)
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_master.py",
> line 51, in start
> metron_service.load_global_config(params)
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/metron_service.py",
> line 76, in load_global_config
> init_config()
> File
> "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/metron_service.py",
> line 31, in init_config
> path=ambari_format("{java_home}/bin")
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
> line 155, in __init__
> self.env.run()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 160, in run
> self.run_action(resource, action)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 124, in run_action
> provider_action()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
> line 273, in action_run
> tries=self.resource.tries, try_sleep=self.resource.try_sleep)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 70, in inner
> result = function(command, **kwargs)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 92, in checked_call
> tries=tries, try_sleep=try_sleep)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 140, in _call_wrapper
> result = _call(command, **kwargs_copy)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 293, in _call
> raise ExecutionFailed(err_msg, code, out, err)
> resource_management.core.exceptions.ExecutionFailed: Execution of
> '/usr/metron/0.3.1/bin/zk_load_configs.sh --mode PUSH -i
> /usr/metron/0.3.1/config/zookeeper -z node1:2181' returned 127. /bin/bash:
> /usr/metron/0.3.1/bin/zk_load_configs.sh: No such file or directory
> stdout:
> 2017-06-09 09:32:22,007 - The hadoop conf dir
> /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for
> version 2.5.3.0-37
> 2017-06-09 09:32:22,007 - Checking if need to create versioned conf dir
> /etc/hadoop/2.5.3.0-37/0
> 2017-06-09 09:32:22,009 - call[('ambari-python-wrap', '/usr/bin/conf-select',
> 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.3.0-37',
> '--conf-version', '0')] {'logoutput': False, 'sudo': True, 'quiet': False,
> 'stderr': -1}
> 2017-06-09 09:32:22,097 - call returned (1, '/etc/hadoop/2.5.3.0-37/0 exist
> already', '')
> 2017-06-09 09:32:22,098 - checked_call[('ambari-python-wrap',
> '/usr/bin/conf-select', 'set-conf-dir', '--package', 'hadoop',
> '--stack-version', '2.5.3.0-37', '--conf-version', '0')] {'logoutput': False,
> 'sudo': True, 'quiet': False}
> 2017-06-09 09:32:22,304 - checked_call returned (0, '')
> 2017-06-09 09:32:22,306 - Ensuring that hadoop has the correct symlink
> structure
> 2017-06-09 09:32:22,306 - Using hadoop conf dir:
> /usr/hdp/current/hadoop-client/conf
> 2017-06-09 09:32:23,537 - The hadoop conf dir
> /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for
> version 2.5.3.0-37
> 2017-06-09 09:32:23,561 - Checking if need to create versioned conf dir
> /etc/hadoop/2.5.3.0-37/0
> 2017-06-09 09:32:23,562 - call[('ambari-python-wrap', '/usr/bin/conf-select',
> 'create-conf-dir', '--package', 'hadoop', '--stack-version', '2.5.3.0-37',
> '--conf-version', '0')] {'logoutput': False, 'sudo': True,
