I think the permission error is in running the hbase_master.py script (something like python /home/pg1712/yarn-dev-panos/data/nm/usercache/ pg1712/appcache/application_1474990070300_0006/filecache/ 134/slider-hbase-app-package-1.2.3.zip/package/scripts/hbase_master.py [other args]). I haven't tried running this from a user's home directory before, so it's possible the user running the command doesn't have access to this file/directory. The user whose permissions you should check will depend on your configuration, but it might be "yarn".
Billie On Wed, Sep 28, 2016 at 6:21 AM, Panagiotis Garefalakis <[email protected]> wrote: > Hello all, > > I tried to compile Slider trunk code with Hadoop version 3.0.0. > I had to make some minor code changes and to update guice lib to v4.0 and > jersey to v1.19 to make it work. > > Everything looks fine but when I am trying to deploy hbase-1.2.3 package I > run into a weird Permission denied error when setting the PYTHONPATH! (log > attached). Any idea what could have gone wrong? Any hint would be greatly > appreciated! > > > Thanks in advance, > Panagiotis > > > INFO 2016-09-28 13:58:45,990 AgentToggleLogger.py:40 - Running command ['', > '-S', > u'/home/pg1712/yarn-dev-panos/data/nm/usercache/ > pg1712/appcache/application_1474990070300_0006/filecache/ > 134/slider-hbase-app-package-1.2.3.zip/package/scripts/hbase_master.py', > u'INSTALL', > '/home/pg1712/yarn-dev-panos/data/nm/logs/application_ > 1474990070300_0006/container_1474990070300_0006_01_000014/ > command-32.json', > '/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > appcache/application_1474990070300_0006/filecache/ > 134/slider-hbase-app-package-1.2.3.zip/package', > '/home/pg1712/yarn-dev-panos/data/nm/logs/application_ > 1474990070300_0006/container_1474990070300_0006_01_000014/ > structured-out-32.json', > 'INFO', > '/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > appcache/application_1474990070300_0006/container_ > 1474990070300_0006_01_000014'] > INFO 2016-09-28 13:58:45,990 AgentToggleLogger.py:40 - Setting env: > PYTHONPATH to /home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > appcache/application_1474990070300_0006/filecache/ > 84/slider-agent.tar.gz/slider-agent/jinja2:/home/pg1712/ > yarn-dev-panos/data/nm/usercache/pg1712/appcache/ > application_1474990070300_0006/filecache/84/slider- > agent.tar.gz/slider-agent > ERROR 2016-09-28 13:58:46,005 CustomServiceOrchestrator.py:171 - Caught > an exception while executing command: <type 'exceptions.OSError'>: [Errno > 13] Permission denied > Traceback (most recent call last): > File "/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > appcache/application_1474990070300_0006/filecache/ > 84/slider-agent.tar.gz/slider-agent/agent/CustomServiceOrchestrator.py", > line 158, in runCommand > environment_vars) > File "/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > appcache/application_1474990070300_0006/filecache/ > 84/slider-agent.tar.gz/slider-agent/agent/PythonExecutor.py", line 88, in > run_file > environment_vars) > File "/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > appcache/application_1474990070300_0006/filecache/ > 84/slider-agent.tar.gz/slider-agent/agent/PythonExecutor.py", line 158, > in launch_python_subprocess > stderr=tmperr, close_fds=close_fds, env=env) > File "/usr/lib/python2.7/subprocess.py", line 710, in __init__ > errread, errwrite) > File "/usr/lib/python2.7/subprocess.py", line 1327, in _execute_child > raise child_exception > OSError: [Errno 13] Permission denied > INFO 2016-09-28 13:58:46,089 AgentToggleLogger.py:40 - Queue result: > {'componentStatus': [], > 'reports': [{'actionId': u'32-1', > 'clusterName': u'hbcl12', > 'exitcode': 1, > 'reportResult': True, > 'role': u'HBASE_MASTER', > 'roleCommand': u'INSTALL', > 'serviceName': u'hbcl12', > 'status': 'FAILED', > 'stderr': "Caught an exception while executing command: > <type 'exceptions.OSError'>: [Errno 13] Permission denied", > 'stdout': "Caught an exception while executing command: > <type 'exceptions.OSError'>: [Errno 13] Permission denied", > 'structuredOut': '{}', > 'taskId': 32}]} > >
