[jira] [Commented] (SLIDER-337) Agent error when trying to deploy Accumulo
[
https://issues.apache.org/jira/browse/SLIDER-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103353#comment-14103353
]
Josh Elser commented on SLIDER-337:
---
I made the above change locally and it appears to have worked (external
verification still appreciated :D). I'll see if I can get a test for it
specifically, and I can fix this myself.
> Agent error when trying to deploy Accumulo
> ---
>
> Key: SLIDER-337
> URL: https://issues.apache.org/jira/browse/SLIDER-337
> Project: Slider
> Issue Type: Bug
> Components: agent-provider
> Environment: Gentoo Linux, develop branch (035ebbd),
> Hadoop-2.6.0-SNAPSHOT (r1619002)
>Reporter: Josh Elser
>
> Tried to start an Accumulo cluster:
> {noformat}
> slider create accumulo --image
> hdfs://localhost:8020/slider/agent/slider-agent.tar.gz --template
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/appConfig.json
> --resources
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/resources.json
> {noformat}
> SliderAM came up, but no Accumulo procs got started. Looking at the AM
> webapp, the Accumulo master container kept cycling. Dug around in the
> NM/container logs dir, and found the following stack:
> {noformat}
> Traceback (most recent call last):
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/app/definition/package/scripts/accumulo_master.py",
> line 24, in
> AccumuloScript('master').execute()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/libraries/script/script.py",
> line 114, in execute
> method(env)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 82, in start
> self.configure(env) # for security
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 76, in configure
> setup_conf_dir(name=self.component)
> File
> ".../tmp/nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_configuration.py",
> line 31, in setup_conf_dir
> recursive = True
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/base.py",
> line 148, in __init__
> self.env.run()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 149, in run
> self.run_action(resource, action)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 109, in run_action
> resource.provider)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/providers/__init__.py",
> line 72, in find_provider
> if resource in provider[env.system.os_family]:
> KeyError: 'gentoo base system'
> {noformat}
> I'm rusty on my Python, but I believe this means that in
> {{slider-agent/src/main/python/resource_management/core/providers/__init__.py}}
> {noformat}
> if resource in provider[env.system.os_family]:
> {noformat}
> should be
> {noformat}
> if env.system.os_family in provider:
> if resource in provider[env.system.os_family]:
> {noformat}
> to avoid the Exception when the key doesn't exist (alternatively try/except,
> too), and get down to the {{default}} case.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (SLIDER-337) Agent error when trying to deploy Accumulo
[
https://issues.apache.org/jira/browse/SLIDER-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103360#comment-14103360
]
Sumit Mohanty commented on SLIDER-337:
--
[~elserj], the change makes sense. Feel free to commit it.
> Agent error when trying to deploy Accumulo
> ---
>
> Key: SLIDER-337
> URL: https://issues.apache.org/jira/browse/SLIDER-337
> Project: Slider
> Issue Type: Bug
> Components: agent-provider
> Environment: Gentoo Linux, develop branch (035ebbd),
> Hadoop-2.6.0-SNAPSHOT (r1619002)
>Reporter: Josh Elser
>
> Tried to start an Accumulo cluster:
> {noformat}
> slider create accumulo --image
> hdfs://localhost:8020/slider/agent/slider-agent.tar.gz --template
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/appConfig.json
> --resources
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/resources.json
> {noformat}
> SliderAM came up, but no Accumulo procs got started. Looking at the AM
> webapp, the Accumulo master container kept cycling. Dug around in the
> NM/container logs dir, and found the following stack:
> {noformat}
> Traceback (most recent call last):
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/app/definition/package/scripts/accumulo_master.py",
> line 24, in
> AccumuloScript('master').execute()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/libraries/script/script.py",
> line 114, in execute
> method(env)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 82, in start
> self.configure(env) # for security
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 76, in configure
> setup_conf_dir(name=self.component)
> File
> ".../tmp/nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_configuration.py",
> line 31, in setup_conf_dir
> recursive = True
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/base.py",
> line 148, in __init__
> self.env.run()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 149, in run
> self.run_action(resource, action)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 109, in run_action
> resource.provider)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/providers/__init__.py",
> line 72, in find_provider
> if resource in provider[env.system.os_family]:
> KeyError: 'gentoo base system'
> {noformat}
> I'm rusty on my Python, but I believe this means that in
> {{slider-agent/src/main/python/resource_management/core/providers/__init__.py}}
> {noformat}
> if resource in provider[env.system.os_family]:
> {noformat}
> should be
> {noformat}
> if env.system.os_family in provider:
> if resource in provider[env.system.os_family]:
> {noformat}
> to avoid the Exception when the key doesn't exist (alternatively try/except,
> too), and get down to the {{default}} case.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (SLIDER-337) Agent error when trying to deploy Accumulo
[
https://issues.apache.org/jira/browse/SLIDER-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103362#comment-14103362
]
Josh Elser commented on SLIDER-337:
---
[~sumitmohanty] thanks! I should be able to get a rudimentary test for this
(falling back to the default on an unknown OS). I'll make some time for this
tmrw.
> Agent error when trying to deploy Accumulo
> ---
>
> Key: SLIDER-337
> URL: https://issues.apache.org/jira/browse/SLIDER-337
> Project: Slider
> Issue Type: Bug
> Components: agent-provider
> Environment: Gentoo Linux, develop branch (035ebbd),
> Hadoop-2.6.0-SNAPSHOT (r1619002)
>Reporter: Josh Elser
>
> Tried to start an Accumulo cluster:
> {noformat}
> slider create accumulo --image
> hdfs://localhost:8020/slider/agent/slider-agent.tar.gz --template
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/appConfig.json
> --resources
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/resources.json
> {noformat}
> SliderAM came up, but no Accumulo procs got started. Looking at the AM
> webapp, the Accumulo master container kept cycling. Dug around in the
> NM/container logs dir, and found the following stack:
> {noformat}
> Traceback (most recent call last):
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/app/definition/package/scripts/accumulo_master.py",
> line 24, in
> AccumuloScript('master').execute()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/libraries/script/script.py",
> line 114, in execute
> method(env)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 82, in start
> self.configure(env) # for security
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 76, in configure
> setup_conf_dir(name=self.component)
> File
> ".../tmp/nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_configuration.py",
> line 31, in setup_conf_dir
> recursive = True
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/base.py",
> line 148, in __init__
> self.env.run()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 149, in run
> self.run_action(resource, action)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 109, in run_action
> resource.provider)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/providers/__init__.py",
> line 72, in find_provider
> if resource in provider[env.system.os_family]:
> KeyError: 'gentoo base system'
> {noformat}
> I'm rusty on my Python, but I believe this means that in
> {{slider-agent/src/main/python/resource_management/core/providers/__init__.py}}
> {noformat}
> if resource in provider[env.system.os_family]:
> {noformat}
> should be
> {noformat}
> if env.system.os_family in provider:
> if resource in provider[env.system.os_family]:
> {noformat}
> to avoid the Exception when the key doesn't exist (alternatively try/except,
> too), and get down to the {{default}} case.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (SLIDER-337) Agent error when trying to deploy Accumulo
[
https://issues.apache.org/jira/browse/SLIDER-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104231#comment-14104231
]
Josh Elser commented on SLIDER-337:
---
[~sumitmohanty], any problems with me pushing this into develop? I wrote a new
test that failed, fixed the code and made sure that the other agent tests still
pass, so I feel good about it. I wasn't sure if I'd be getting in the way with
0.50.0.
> Agent error when trying to deploy Accumulo
> ---
>
> Key: SLIDER-337
> URL: https://issues.apache.org/jira/browse/SLIDER-337
> Project: Slider
> Issue Type: Bug
> Components: agent-provider
> Environment: Gentoo Linux, develop branch (035ebbd),
> Hadoop-2.6.0-SNAPSHOT (r1619002)
>Reporter: Josh Elser
>Assignee: Josh Elser
>
> Tried to start an Accumulo cluster:
> {noformat}
> slider create accumulo --image
> hdfs://localhost:8020/slider/agent/slider-agent.tar.gz --template
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/appConfig.json
> --resources
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/resources.json
> {noformat}
> SliderAM came up, but no Accumulo procs got started. Looking at the AM
> webapp, the Accumulo master container kept cycling. Dug around in the
> NM/container logs dir, and found the following stack:
> {noformat}
> Traceback (most recent call last):
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/app/definition/package/scripts/accumulo_master.py",
> line 24, in
> AccumuloScript('master').execute()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/libraries/script/script.py",
> line 114, in execute
> method(env)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 82, in start
> self.configure(env) # for security
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 76, in configure
> setup_conf_dir(name=self.component)
> File
> ".../tmp/nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_configuration.py",
> line 31, in setup_conf_dir
> recursive = True
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/base.py",
> line 148, in __init__
> self.env.run()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 149, in run
> self.run_action(resource, action)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 109, in run_action
> resource.provider)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/providers/__init__.py",
> line 72, in find_provider
> if resource in provider[env.system.os_family]:
> KeyError: 'gentoo base system'
> {noformat}
> I'm rusty on my Python, but I believe this means that in
> {{slider-agent/src/main/python/resource_management/core/providers/__init__.py}}
> {noformat}
> if resource in provider[env.system.os_family]:
> {noformat}
> should be
> {noformat}
> if env.system.os_family in provider:
> if resource in provider[env.system.os_family]:
> {noformat}
> to avoid the Exception when the key doesn't exist (alternatively try/except,
> too), and get down to the {{default}} case.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (SLIDER-337) Agent error when trying to deploy Accumulo
[
https://issues.apache.org/jira/browse/SLIDER-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104794#comment-14104794
]
ASF subversion and git services commented on SLIDER-337:
Commit 5d2f62642ac6aeeb0b64965b36ab52bae5fc0a19 in incubator-slider's branch
refs/heads/develop from [~elserj]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=5d2f626 ]
SLIDER-337 Check if the OS is known before accessing it.
There are a few providers for some common OSes. Using an
OS that isn't listed in this provider dict failed with a
KeyError before it could fall back to the default case.
> Agent error when trying to deploy Accumulo
> ---
>
> Key: SLIDER-337
> URL: https://issues.apache.org/jira/browse/SLIDER-337
> Project: Slider
> Issue Type: Bug
> Components: agent-provider
> Environment: Gentoo Linux, develop branch (035ebbd),
> Hadoop-2.6.0-SNAPSHOT (r1619002)
>Reporter: Josh Elser
>Assignee: Josh Elser
> Fix For: Slider 0.60
>
>
> Tried to start an Accumulo cluster:
> {noformat}
> slider create accumulo --image
> hdfs://localhost:8020/slider/agent/slider-agent.tar.gz --template
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/appConfig.json
> --resources
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/resources.json
> {noformat}
> SliderAM came up, but no Accumulo procs got started. Looking at the AM
> webapp, the Accumulo master container kept cycling. Dug around in the
> NM/container logs dir, and found the following stack:
> {noformat}
> Traceback (most recent call last):
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/app/definition/package/scripts/accumulo_master.py",
> line 24, in
> AccumuloScript('master').execute()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/libraries/script/script.py",
> line 114, in execute
> method(env)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 82, in start
> self.configure(env) # for security
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 76, in configure
> setup_conf_dir(name=self.component)
> File
> ".../tmp/nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_configuration.py",
> line 31, in setup_conf_dir
> recursive = True
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/base.py",
> line 148, in __init__
> self.env.run()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 149, in run
> self.run_action(resource, action)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 109, in run_action
> resource.provider)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/providers/__init__.py",
> line 72, in find_provider
> if resource in provider[env.system.os_family]:
> KeyError: 'gentoo base system'
> {noformat}
> I'm rusty on my Python, but I believe this means that in
> {{slider-agent/src/main/python/resource_management/core/providers/__init__.py}}
> {noformat}
> if resource in provider[env.system.os_family]:
> {noformat}
> should be
> {noformat}
> if env.system.os_family in provider:
> if resource in provider[env.system.os_family]:
> {noformat}
> to avoid the Exception when the key doesn't exist (alternatively try/except,
> too), and get down to the {{default}} case.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (SLIDER-337) Agent error when trying to deploy Accumulo
[
https://issues.apache.org/jira/browse/SLIDER-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105834#comment-14105834
]
ASF subversion and git services commented on SLIDER-337:
Commit 5d2f62642ac6aeeb0b64965b36ab52bae5fc0a19 in incubator-slider's branch
refs/heads/feature/SLIDER-151_REST_API from [~elserj]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=5d2f626 ]
SLIDER-337 Check if the OS is known before accessing it.
There are a few providers for some common OSes. Using an
OS that isn't listed in this provider dict failed with a
KeyError before it could fall back to the default case.
> Agent error when trying to deploy Accumulo
> ---
>
> Key: SLIDER-337
> URL: https://issues.apache.org/jira/browse/SLIDER-337
> Project: Slider
> Issue Type: Bug
> Components: agent-provider
> Environment: Gentoo Linux, develop branch (035ebbd),
> Hadoop-2.6.0-SNAPSHOT (r1619002)
>Reporter: Josh Elser
>Assignee: Josh Elser
> Fix For: Slider 0.60
>
>
> Tried to start an Accumulo cluster:
> {noformat}
> slider create accumulo --image
> hdfs://localhost:8020/slider/agent/slider-agent.tar.gz --template
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/appConfig.json
> --resources
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/resources.json
> {noformat}
> SliderAM came up, but no Accumulo procs got started. Looking at the AM
> webapp, the Accumulo master container kept cycling. Dug around in the
> NM/container logs dir, and found the following stack:
> {noformat}
> Traceback (most recent call last):
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/app/definition/package/scripts/accumulo_master.py",
> line 24, in
> AccumuloScript('master').execute()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/libraries/script/script.py",
> line 114, in execute
> method(env)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 82, in start
> self.configure(env) # for security
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 76, in configure
> setup_conf_dir(name=self.component)
> File
> ".../tmp/nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_configuration.py",
> line 31, in setup_conf_dir
> recursive = True
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/base.py",
> line 148, in __init__
> self.env.run()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 149, in run
> self.run_action(resource, action)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 109, in run_action
> resource.provider)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/providers/__init__.py",
> line 72, in find_provider
> if resource in provider[env.system.os_family]:
> KeyError: 'gentoo base system'
> {noformat}
> I'm rusty on my Python, but I believe this means that in
> {{slider-agent/src/main/python/resource_management/core/providers/__init__.py}}
> {noformat}
> if resource in provider[env.system.os_family]:
> {noformat}
> should be
> {noformat}
> if env.system.os_family in provider:
> if resource in provider[env.system.os_family]:
> {noformat}
> to avoid the Exception when the key doesn't exist (alternatively try/except,
> too), and get down to the {{default}} case.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (SLIDER-337) Agent error when trying to deploy Accumulo
[
https://issues.apache.org/jira/browse/SLIDER-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190918#comment-14190918
]
Siyuan Hua commented on SLIDER-337:
---
I may be wrong, but the right solution should be configurable. I'm using
linuxmint. It should belongs to AptProvider. So user should be able to set the
provider if the system cannot recognize
> Agent error when trying to deploy Accumulo
> ---
>
> Key: SLIDER-337
> URL: https://issues.apache.org/jira/browse/SLIDER-337
> Project: Slider
> Issue Type: Bug
> Components: agent-provider
> Environment: Gentoo Linux, develop branch (035ebbd),
> Hadoop-2.6.0-SNAPSHOT (r1619002)
>Reporter: Josh Elser
>Assignee: Josh Elser
> Fix For: Slider 0.60
>
>
> Tried to start an Accumulo cluster:
> {noformat}
> slider create accumulo --image
> hdfs://localhost:8020/slider/agent/slider-agent.tar.gz --template
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/appConfig.json
> --resources
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/resources.json
> {noformat}
> SliderAM came up, but no Accumulo procs got started. Looking at the AM
> webapp, the Accumulo master container kept cycling. Dug around in the
> NM/container logs dir, and found the following stack:
> {noformat}
> Traceback (most recent call last):
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/app/definition/package/scripts/accumulo_master.py",
> line 24, in
> AccumuloScript('master').execute()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/libraries/script/script.py",
> line 114, in execute
> method(env)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 82, in start
> self.configure(env) # for security
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 76, in configure
> setup_conf_dir(name=self.component)
> File
> ".../tmp/nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_configuration.py",
> line 31, in setup_conf_dir
> recursive = True
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/base.py",
> line 148, in __init__
> self.env.run()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 149, in run
> self.run_action(resource, action)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 109, in run_action
> resource.provider)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/providers/__init__.py",
> line 72, in find_provider
> if resource in provider[env.system.os_family]:
> KeyError: 'gentoo base system'
> {noformat}
> I'm rusty on my Python, but I believe this means that in
> {{slider-agent/src/main/python/resource_management/core/providers/__init__.py}}
> {noformat}
> if resource in provider[env.system.os_family]:
> {noformat}
> should be
> {noformat}
> if env.system.os_family in provider:
> if resource in provider[env.system.os_family]:
> {noformat}
> to avoid the Exception when the key doesn't exist (alternatively try/except,
> too), and get down to the {{default}} case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (SLIDER-337) Agent error when trying to deploy Accumulo
[
https://issues.apache.org/jira/browse/SLIDER-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190925#comment-14190925
]
Josh Elser commented on SLIDER-337:
---
[~hsy541], I think I'd agree with you. This was very much a work around to make
sure that we don't flat-out fail. I'm not familiar enough with how the library
providers are used, but you should feel free to open another issue to make them
configurable. We can have discussion there :)
> Agent error when trying to deploy Accumulo
> ---
>
> Key: SLIDER-337
> URL: https://issues.apache.org/jira/browse/SLIDER-337
> Project: Slider
> Issue Type: Bug
> Components: agent-provider
> Environment: Gentoo Linux, develop branch (035ebbd),
> Hadoop-2.6.0-SNAPSHOT (r1619002)
>Reporter: Josh Elser
>Assignee: Josh Elser
> Fix For: Slider 0.60
>
>
> Tried to start an Accumulo cluster:
> {noformat}
> slider create accumulo --image
> hdfs://localhost:8020/slider/agent/slider-agent.tar.gz --template
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/appConfig.json
> --resources
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/resources.json
> {noformat}
> SliderAM came up, but no Accumulo procs got started. Looking at the AM
> webapp, the Accumulo master container kept cycling. Dug around in the
> NM/container logs dir, and found the following stack:
> {noformat}
> Traceback (most recent call last):
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/app/definition/package/scripts/accumulo_master.py",
> line 24, in
> AccumuloScript('master').execute()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/libraries/script/script.py",
> line 114, in execute
> method(env)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 82, in start
> self.configure(env) # for security
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 76, in configure
> setup_conf_dir(name=self.component)
> File
> ".../tmp/nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_configuration.py",
> line 31, in setup_conf_dir
> recursive = True
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/base.py",
> line 148, in __init__
> self.env.run()
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 149, in run
> self.run_action(resource, action)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 109, in run_action
> resource.provider)
> File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/providers/__init__.py",
> line 72, in find_provider
> if resource in provider[env.system.os_family]:
> KeyError: 'gentoo base system'
> {noformat}
> I'm rusty on my Python, but I believe this means that in
> {{slider-agent/src/main/python/resource_management/core/providers/__init__.py}}
> {noformat}
> if resource in provider[env.system.os_family]:
> {noformat}
> should be
> {noformat}
> if env.system.os_family in provider:
> if resource in provider[env.system.os_family]:
> {noformat}
> to avoid the Exception when the key doesn't exist (alternatively try/except,
> too), and get down to the {{default}} case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: [jira] [Commented] (SLIDER-337) Agent error when trying to deploy Accumulo
Yes, lets open a JIRA. I also need to understand what it means to make it
configurable.
On Thu, Oct 30, 2014 at 3:04 PM, Josh Elser (JIRA) wrote:
>
> [
> https://issues.apache.org/jira/browse/SLIDER-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190925#comment-14190925
> ]
>
> Josh Elser commented on SLIDER-337:
> ---
>
> [~hsy541], I think I'd agree with you. This was very much a work around to
> make sure that we don't flat-out fail. I'm not familiar enough with how the
> library providers are used, but you should feel free to open another issue
> to make them configurable. We can have discussion there :)
>
> > Agent error when trying to deploy Accumulo
> > ---
> >
> > Key: SLIDER-337
> > URL: https://issues.apache.org/jira/browse/SLIDER-337
> > Project: Slider
> > Issue Type: Bug
> > Components: agent-provider
> > Environment: Gentoo Linux, develop branch (035ebbd),
> Hadoop-2.6.0-SNAPSHOT (r1619002)
> >Reporter: Josh Elser
> >Assignee: Josh Elser
> > Fix For: Slider 0.60
> >
> >
> > Tried to start an Accumulo cluster:
> > {noformat}
> > slider create accumulo --image
> hdfs://localhost:8020/slider/agent/slider-agent.tar.gz --template
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/appConfig.json
> --resources
> /home/elserj/slider/app-packages/accumulo/target/apache-slider-accumulo-1.6.0-app-package-0.40/resources.json
> > {noformat}
> > SliderAM came up, but no Accumulo procs got started. Looking at the AM
> webapp, the Accumulo master container kept cycling. Dug around in the
> NM/container logs dir, and found the following stack:
> > {noformat}
> > Traceback (most recent call last):
> > File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/app/definition/package/scripts/accumulo_master.py",
> line 24, in
> > AccumuloScript('master').execute()
> > File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/libraries/script/script.py",
> line 114, in execute
> > method(env)
> > File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 82, in start
> > self.configure(env) # for security
> > File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_script.py",
> line 76, in configure
> > setup_conf_dir(name=self.component)
> > File
> ".../tmp/nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/filecache/19/apache-slider-accumulo-1.6.0-app-package-0.40.zip/package/scripts/accumulo_configuration.py",
> line 31, in setup_conf_dir
> > recursive = True
> > File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/base.py",
> line 148, in __init__
> > self.env.run()
> > File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 149, in run
> > self.run_action(resource, action)
> > File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/environment.py",
> line 109, in run_action
> > resource.provider)
> > File
> ".../nm-local-dir/usercache/elserj/appcache/application_1408503547578_0002/container_1408503547578_0002_01_21/infra/agent/slider-agent/resource_management/core/providers/__init__.py",
> line 72, in find_provider
> > if resource in provider[env.system.os_family]:
> > KeyError: 'gentoo base system'
> > {noformat}
> > I'm rusty on my Python, but I believe this means that in
> {{slider-agent/src/main/python/resource_management/core/providers/__init__.py}}
> > {noformat}
> > if resource in provider[env.system.os_family]:
> > {noformat}
> > should be
> > {noformat}
> > if env.system.os_family in provider:
> > if resource in provider[env.system.os_family]:
> > {noformat}
> > to avoid the Exception when the key doesn't exist (alternatively
> try/except, too), and get down to the {{default}} case.
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicabl
