[
https://issues.apache.org/jira/browse/SLIDER-876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14545674#comment-14545674
]
JP Bordenave commented on SLIDER-876:
-------------------------------------
i was restarted my nodes
but it get same issue, and all my node active, was not this problem, i return
to investigate zookeeper
et slider configuration
hduser@stargate:/usr/local/slider$ ./bin/slider create cl1 --template
appConfig.json --resources resources.json
2015-05-15 17:28:06,718 [main] INFO client.RMProxy - Connecting to
ResourceManager at stargate/192.168.0.11:8032
2015-05-15 17:28:07,325 [main] INFO agent.AgentClientProvider - Validating app
definition .slider/package/MEMCACHED/memcached.zip
2015-05-15 17:28:07,325 [main] INFO agent.AgentUtils - Reading metainfo at
.slider/package/MEMCACHED/memcached.zip
2015-05-15 17:28:07,460 [main] INFO tools.SliderUtils - Reading metainfo.xml
of size 2029
2015-05-15 17:28:07,561 [main] ERROR tools.CoreFileSystem - Dir
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1 exists:
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1/app_config.json 854
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1/confdir 0
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1/database 0
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1/generated 0
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1/history 0
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1/internal.json 1257
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1/resources.json 401
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1/snapshot 0
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1/tmp 0
2015-05-15 17:28:07,562 [main] ERROR main.ServiceLauncher - Application
Instance dir already exists:
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1
2015-05-15 17:28:07,563 [main] INFO util.ExitUtil - Exiting with status 75
hduser@stargate:/usr/local/slider$ ./bin/slider start cl1
2015-05-15 17:28:16,171 [main] INFO client.RMProxy - Connecting to
ResourceManager at stargate/192.168.0.11:8032
2015-05-15 17:28:16,886 [main] INFO agent.AgentUtils - Reading metainfo at
.slider/package/MEMCACHED/memcached.zip
2015-05-15 17:28:16,903 [main] INFO tools.SliderUtils - Reading metainfo.xml
of size 2029
2015-05-15 17:28:17,016 [main] INFO launch.AbstractLauncher - Log include
patterns:
2015-05-15 17:28:17,016 [main] INFO launch.AbstractLauncher - Log exclude
patterns:
2015-05-15 17:28:18,274 [main] INFO slideram.SliderAMClientProvider - Loading
all dependencies for AM.
2015-05-15 17:28:18,275 [main] INFO tools.SliderUtils - Loading all
dependencies from /usr/local/slider-0.61.0-incubating/lib
2015-05-15 17:28:23,544 [main] INFO agent.AgentClientProvider - Automatically
uploading the agent tarball at
hdfs://stargate:9000/user/hduser/.slider/cluster/cl1/tmp/application_1431703599364_0001/agent
2015-05-15 17:28:23,643 [main] INFO agent.AgentClientProvider - Validating app
definition .slider/package/MEMCACHED/memcached.zip
2015-05-15 17:28:23,643 [main] INFO agent.AgentUtils - Reading metainfo at
.slider/package/MEMCACHED/memcached.zip
2015-05-15 17:28:23,647 [main] INFO tools.SliderUtils - Reading metainfo.xml
of size 2029
2015-05-15 17:28:23,656 [main] INFO Configuration.deprecation -
slider.registry.path is deprecated. Instead, use hadoop.registry.zk.root
2015-05-15 17:28:23,658 [main] INFO launch.AppMasterLauncher - Submitting
application to Resource Manager
2015-05-15 17:28:23,846 [main] INFO impl.YarnClientImpl - Submitted
application application_1431703599364_0001
2015-05-15 17:28:23,848 [main] INFO util.ExitUtil - Exiting with status 0
hduser@stargate:/usr/local/slider$ ./bin/slider stop cl1
2015-05-15 17:28:32,385 [main] INFO client.RMProxy - Connecting to
ResourceManager at stargate/192.168.0.11:8032
2015-05-15 17:28:32,693 [main] INFO client.SliderClient - Cluster cl1 is in a
pre-running state ACCEPTED. Force killing it
2015-05-15 17:28:32,694 [main] INFO client.SliderYarnClientImpl - Killing
application 1431703599364 - Forced stop of cl1: stop command issued
2015-05-15 17:28:32,706 [main] INFO util.ExitUtil - Exiting with status 0
hduser@stargate:/usr/local/slider$ ./bin/slider destroy cl1
2015-05-15 17:28:49,170 [main] INFO client.RMProxy - Connecting to
ResourceManager at stargate/192.168.0.11:8032
2015-05-15 17:28:49,501 [main] INFO zk.BlockingZKWatcher - waiting for ZK event
2015-05-15 17:28:49,505 [main-SendThread(stargate:2180)] WARN
zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing
socket connection and attempting reconnect
Exception in thread Thread-2:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 763, in run
self.__target(*self.__args, **self.__kwargs)
File "/usr/local/slider-0.61.0-incubating/bin/slider.py", line 168, in
print_output
(line, done) = read(src, line)
File "/usr/local/slider-0.61.0-incubating/bin/slider.py", line 146, in read
o = c.decode('utf-8')
File "/usr/lib/python2.7/encodings/utf_8.py", line 16, in decode
return codecs.utf_8_decode(input, errors, True)
UnicodeDecodeError: 'utf8' codec can't decode byte 0xc3 in position 0:
unexpected end of data
> slider destroy instance fail UnicodeDecodeError: 'utf8' codec can't decode
> byte 0xc3 in position 0
> --------------------------------------------------------------------------------------------------
>
> Key: SLIDER-876
> URL: https://issues.apache.org/jira/browse/SLIDER-876
> Project: Slider
> Issue Type: Bug
> Components: process
> Affects Versions: Slider 0.61, Slider 0.70
> Environment: ubuntu 14.04, hadoop 2.6.0, python 2.7, slider 0.6.1,
> zookeeper 3.4.6
> Reporter: JP Bordenave
> Priority: Critical
> Labels: patch
> Attachments: screenshot-1.png, screenshot-2-SliderInRunningMode.png
>
>
> Hello,
> i install 0.61.0 slider
> after install application MEMCACHED for test slider under hadoop 2.6.0
> on hdfs
> i can create instance cl1 on hdfs
> i can start
> i can stop
> but when i destroy
> ./bin/slider destroy cl1
> i get exception python on utf8 (i have 2.7) and i must break destroy because
> it is hanging for ever. check log below
> after this fail, the cl1 instance is removed from cluster, if try to launch
> again, i get exit code 73 application in use on start/stop/destroy . i dont
> see any process actif.
> i test also with the version 0.70.1 slider, i get same error. i saw pyhton
> 2.6
> seem required by slider, but i use about 10 component in my ecosystem under
> my cluster all are working. hadoop 2.6.0 seem support python 2.7.
> Thanks for information and solution if possible, i consider slider
> interessing.
> for application deployment with hdfs
> i dont see any jira about this issue
> log below
> hduser@stargate:/usr/local/slider$ ./bin/slider destroy cl1
> 2015-05-15 01:33:08,218 [main] INFO client.RMProxy - Connecting to
> ResourceManager at stargate/192.168.0.11:8032
> 2015-05-15 01:33:08,603 [main] INFO zk.BlockingZKWatcher - waiting for ZK
> event
> 2015-05-15 01:33:08,607 [main-SendThread(stargate:2180)] WARN
> zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing
> socket connection and attempting reconnect
> Exception in thread Thread-2:
> Traceback (most recent call last):
> File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
> self.run()
> File "/usr/lib/python2.7/threading.py", line 763, in run
> self.__target(*self.__args, **self.__kwargs)
> File "/usr/local/slider-0.61.0-incubating/bin/slider.py", line 168, in
> print_output
> (line, done) = read(src, line)
> File "/usr/local/slider-0.61.0-incubating/bin/slider.py", line 146, in read
> o = c.decode('utf-8')
> File "/usr/lib/python2.7/encodings/utf_8.py", line 16, in decode
> return codecs.utf_8_decode(input, errors, True)
> UnicodeDecodeError: 'utf8' codec can't decode byte 0xc3 in position 0:
> unexpected end of data
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)