Hello Billie, Thanks for the reply! It definitely seems like a permission issue but since its the user's home as you mentioned and *YARN* is actually running as the* same user *why would that be an issue? By the way, hbase user/group in the *appConf* should be set to the OS user/group or the HDFS ? (user/user vs user/supergroup) I will also try changing *YARN's* data and let you know.
Thanks, Panagiotis On Wed, Sep 28, 2016 at 6:23 PM, Billie Rinaldi <[email protected]> wrote: > I think the permission error is in running the hbase_master.py script > (something like python /home/pg1712/yarn-dev-panos/data/nm/usercache/ > pg1712/appcache/application_1474990070300_0006/filecache/ > 134/slider-hbase-app-package-1.2.3.zip/package/scripts/hbase_master.py > [other args]). I haven't tried running this from a user's home directory > before, so it's possible the user running the command doesn't have access > to this file/directory. The user whose permissions you should check will > depend on your configuration, but it might be "yarn". > > Billie > > On Wed, Sep 28, 2016 at 6:21 AM, Panagiotis Garefalakis < > [email protected]> > wrote: > > > Hello all, > > > > I tried to compile Slider trunk code with Hadoop version 3.0.0. > > I had to make some minor code changes and to update guice lib to v4.0 and > > jersey to v1.19 to make it work. > > > > Everything looks fine but when I am trying to deploy hbase-1.2.3 package > I > > run into a weird Permission denied error when setting the PYTHONPATH! > (log > > attached). Any idea what could have gone wrong? Any hint would be greatly > > appreciated! > > > > > > Thanks in advance, > > Panagiotis > > > > > > INFO 2016-09-28 13:58:45,990 AgentToggleLogger.py:40 - Running command > ['', > > '-S', > > u'/home/pg1712/yarn-dev-panos/data/nm/usercache/ > > pg1712/appcache/application_1474990070300_0006/filecache/ > > 134/slider-hbase-app-package-1.2.3.zip/package/scripts/hbase_master.py', > > u'INSTALL', > > '/home/pg1712/yarn-dev-panos/data/nm/logs/application_ > > 1474990070300_0006/container_1474990070300_0006_01_000014/ > > command-32.json', > > '/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > > appcache/application_1474990070300_0006/filecache/ > > 134/slider-hbase-app-package-1.2.3.zip/package', > > '/home/pg1712/yarn-dev-panos/data/nm/logs/application_ > > 1474990070300_0006/container_1474990070300_0006_01_000014/ > > structured-out-32.json', > > 'INFO', > > '/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > > appcache/application_1474990070300_0006/container_ > > 1474990070300_0006_01_000014'] > > INFO 2016-09-28 13:58:45,990 AgentToggleLogger.py:40 - Setting env: > > PYTHONPATH to /home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > > appcache/application_1474990070300_0006/filecache/ > > 84/slider-agent.tar.gz/slider-agent/jinja2:/home/pg1712/ > > yarn-dev-panos/data/nm/usercache/pg1712/appcache/ > > application_1474990070300_0006/filecache/84/slider- > > agent.tar.gz/slider-agent > > ERROR 2016-09-28 13:58:46,005 CustomServiceOrchestrator.py:171 - Caught > > an exception while executing command: <type 'exceptions.OSError'>: [Errno > > 13] Permission denied > > Traceback (most recent call last): > > File "/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > > appcache/application_1474990070300_0006/filecache/ > > 84/slider-agent.tar.gz/slider-agent/agent/CustomServiceOrchestrator.py", > > line 158, in runCommand > > environment_vars) > > File "/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > > appcache/application_1474990070300_0006/filecache/ > > 84/slider-agent.tar.gz/slider-agent/agent/PythonExecutor.py", line 88, > in > > run_file > > environment_vars) > > File "/home/pg1712/yarn-dev-panos/data/nm/usercache/pg1712/ > > appcache/application_1474990070300_0006/filecache/ > > 84/slider-agent.tar.gz/slider-agent/agent/PythonExecutor.py", line 158, > > in launch_python_subprocess > > stderr=tmperr, close_fds=close_fds, env=env) > > File "/usr/lib/python2.7/subprocess.py", line 710, in __init__ > > errread, errwrite) > > File "/usr/lib/python2.7/subprocess.py", line 1327, in _execute_child > > raise child_exception > > OSError: [Errno 13] Permission denied > > INFO 2016-09-28 13:58:46,089 AgentToggleLogger.py:40 - Queue result: > > {'componentStatus': [], > > 'reports': [{'actionId': u'32-1', > > 'clusterName': u'hbcl12', > > 'exitcode': 1, > > 'reportResult': True, > > 'role': u'HBASE_MASTER', > > 'roleCommand': u'INSTALL', > > 'serviceName': u'hbcl12', > > 'status': 'FAILED', > > 'stderr': "Caught an exception while executing command: > > <type 'exceptions.OSError'>: [Errno 13] Permission denied", > > 'stdout': "Caught an exception while executing command: > > <type 'exceptions.OSError'>: [Errno 13] Permission denied", > > 'structuredOut': '{}', > > 'taskId': 32}]} > > > > >
