i tried this command ps -ef|grep 6703 and got this st 2991 2595 41 14:51 pts/3 00:05:19 java -server -Xmx768m -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dlogfile.name=worker-6703.log -Dstorm.home=/home/st/storm-0.8.2 -Dlog4j.configuration=storm.log.properties -cp /home/st/storm-0.8.2/storm-0.8.2.jar:/home/st/storm-0.8.2/lib/curator-client-1.0.1.jar:/home/st/storm-0.8.2/lib/zookeeper-3.4.5.jar:/home/st/storm-0.8.2/lib/objenesis-1.2.jar:/home/st/storm-0.8.2/lib/disruptor-2.10.1.jar:/home/st/storm-0.8.2/lib/servlet-api-2.5-20081211.jar:/home/st/storm-0.8.2/lib/ring-core-1.1.5.jar:/home/st/storm-0.8.2/lib/tools.logging-0.2.3.jar:/home/st/storm-0.8.2/lib/libthrift7-0.7.0.jar:/home/st/storm-0.8.2/lib/slf4j-api-1.5.8.jar:/home/st/storm-0.8.2/lib/hiccup-0.3.6.jar:/home/st/storm-0.8.2/lib/guava-13.0.jar:/home/st/storm-0.8.2/lib/junit-3.8.1.jar:/home/st/storm-0.8.2/lib/servlet-api-2.5.jar:/home/st/storm-0.8.2/lib/reflectasm-1.07-shaded.jar:/home/st/storm-0.8.2/lib/zookeeper-3.3.3.jar:/home/st/storm-0.8.2/lib/jzmq-2.1.0.jar:/home/st/storm-0.8.2/lib/jgrapht-0.8.3.jar:/home/st/storm-0.8.2/lib/httpclient-4.1.1.jar:/home/st/storm-0.8.2/lib/clojure-1.4.0.jar:/home/st/storm-0.8.2/lib/clout-1.0.1.jar:/home/st/storm-0.8.2/lib/core.incubator-0.1.0.jar:/home/st/storm-0.8.2/lib/ring-jetty-adapter-0.3.11.jar:/home/st/storm-0.8.2/lib/asm-4.0.jar:/home/st/storm-0.8.2/lib/commons-io-1.4.jar:/home/st/storm-0.8.2/lib/snakeyaml-1.9.jar:/home/st/storm-0.8.2/lib/slf4j-log4j12-1.5.8.jar:/home/st/storm-0.8.2/lib/tools.cli-0.2.2.jar:/home/st/storm-0.8.2/lib/commons-fileupload-1.2.1.jar:/home/st/storm-0.8.2/lib/commons-exec-1.1.jar:/home/st/storm-0.8.2/lib/minlog-1.2.jar:/home/st/storm-0.8.2/lib/ring-servlet-0.3.11.jar:/home/st/storm-0.8.2/lib/carbonite-1.5.0.jar:/home/st/storm-0.8.2/lib/clj-time-0.4.1.jar:/home/st/storm-0.8.2/lib/jetty-util-6.1.26.jar:/home/st/storm-0.8.2/lib/tools.macro-0.1.0.jar:/home/st/storm-0.8.2/lib/commons-codec-1.4.jar:/home/st/storm-0.8.2/lib/commons-logging-1.1.1.jar:/home/st/storm-0.8.2/lib/jetty-6.1.26.jar:/home/st/storm-0.8.2/lib/jline-0.9.94.jar:/home/st/storm-0.8.2/lib/json-simple-1.1.jar:/home/st/storm-0.8.2/lib/kryo-2.17.jar:/home/st/storm-0.8.2/lib/math.numeric-tower-0.0.1.jar:/home/st/storm-0.8.2/lib/compojure-1.1.3.jar:/home/st/storm-0.8.2/lib/httpcore-4.1.jar:/home/st/storm-0.8.2/lib/commons-lang-2.5.jar:/home/st/storm-0.8.2/lib/log4j-1.2.16.jar:/home/st/storm-0.8.2/lib/joda-time-2.0.jar:/home/st/storm-0.8.2/lib/curator-framework-1.0.1.jar:/home/st/storm-0.8.2/log4j:/home/st/storm-0.8.2/conf:/tmp/storm/supervisor/stormdist/fsd-1-1446555065/stormjar.jar backtype.storm.daemon.worker fsd-1-1446555065 3e3092ff-2722-400a-8aa9-362c9144a6fe 6703 0f68434a-d2f8-41c3-8d1b-9b0d0f2fcb6a st 3434 3217 2 15:04 pts/8 00:00:00 grep --color=auto 6703
and tried to change ip_local_port_range as you said but problem still so i'll try to upgrade the version but is there any other solution ? On Mon, Nov 2, 2015 at 2:40 PM, researcher cs <prog.researc...@gmail.com> wrote: > many many many thanks for replying and helping , i'll try what you said , > But the coder of the project that i used it , he used old version 0.8.2 so > i'm trying first to use it then upgrade the version > > On Mon, Nov 2, 2015 at 1:59 PM, Feng Longda <hustjac...@gmail.com> wrote: > >> I have resolved this problem several times. >> >> There are two root cause. >> (1) local temporary network ports are conflict with storm's ports. >> (2) the old worker failed to be killed when kill topology. >> >> Firstly, please do "ps -ef|grep 67xx" to check whether it is due to the >> second problem. if there is no worker using the port. it would be temporary >> port conflict. >> please do the following action with root privilege >> >> echo 'net.ipv4.ip_local_port_range = 10240 65535' >> /etc/sysctl.conf >> /sbin/sysctl -p >> >> why occur this, due to in every network connection, client will bind one >> temporary port, if the linux default temporary range is from 1024 to 65535, >> so it is still likely to conflict with storm's port. >> >> >> if there are some alive worker using the port, it is due to storm fail to >> kill worker when kill topology, when the OS's cpu usage is pretty high, >> this phenomenon will occur, but generally this case is pretty rare. By the >> way, in the jstorm (https://github.com/alibaba/jstorm), it resolves this >> issue. Fortunately, jstorm has been donated to storm, you will see the >> solution in a short time. >> >> >> By the way, I found you are using an old version storm, why don't try the >> storm 0.9.x, whose performance has been improved much. >> >> >> >> >> >> >> >> >> 2015-11-01 17:26 GMT+08:00 researcher cs <prog.researc...@gmail.com>: >> >>> after submitting topology >>> >>> supervisor log file >>> >>> 2015-11-01 09:59:48 executor [INFO] Loading executor b-1:[3 3] >>> 2015-11-01 09:59:50 executor [INFO] Loaded executor tasks b-1:[3 3][INFO] >>> Launching worker with assignment >>> #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id >>> "df-1-1446364738", :executors ([2 2] [35 35] [5 5] [38 38] [8 8] [41 41] >>> [11 11] [44 44] [14 14] [47 47] [17 17] [50 50] [20 20] [53 53] [23 23] [56 >>> 56] [26 26] [29 29] [32 32])} for this supervisor >>> fdd1e16a-650e-4d12-90f4-cb87336f29c3 on port 6702 with id >>> eb224d37-bc81-43ec-bbb9-8e5897c203fa >>> after >>> 2015-11-01 09:59:02 supervisor [INFO] >>> 0af4b32b-e14d-4f64-ba03-d61d79fa6405 still hasn't started 2015-11-01 >>> 09:59:03 supervisor [INFO] 0af4b32b-e14d-4f64-ba03-d61d79fa6405 still >>> hasn't started >>> !!!!!! >>> >>> but worker has data like >>> >>> 2015-11-01 09:59:48 executor [INFO] Loading executor b-1:[3 3] >>> 2015-11-01 09:59:50 executor [INFO] Loaded executor tasks b-1:[3 3] >>> >>> then i executed the command which launch worker with supervisor to know >>> where is the error exactly found this >>> in the worker log file >>> [ERROR] Async loop died! org.zeromq.ZMQException: Address already in >>> use(0x62) at org.zeromq.ZMQ$Socket.bind(Native Method) at >>> zilch.mq$bind.invoke(mq.clj:69) >>> at backtype.storm.messaging.zmq.ZMQContext.bind(zmq.clj:57) at >>> backtype.storm.messaging.loader$launch_receive_thread_BANG_$fn__1629.invoke(loader.clj:26) >>> at backtype.storm.util$async_loop$fn__465.invoke(util.clj:375) at >>> clojure.lang.AFn.run(AFn.java:24) at java.lang.Thread.run(Unknown Source) >>> 2015-11-01 10:03:19 util [INFO] Halting process >>> >>> >>> i'm on this error more than 3 weeks !! hope really can find someone help >>> >> >> >
