i upgraded the version to storm -0.9.5 and got in supervisor log file that
it hasn't start still but i executed tha commend that launch between
supervisor and worker and got this
[ERROR] Halting process: ("Error on initialization")
java.lang.RuntimeException: ("Error on initialization") at
backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:325)
[storm-core-0.9.5.jar:0.9.5] at clojure.lang.RestFn.invoke(RestFn.java:423)
[clojure-1.5.1.jar:na] at
backtype.storm.daemon.worker$fn__6959$mk_worker__7015.doInvoke(worker.clj:391)
[storm-core-0.9.5.jar:0.9.5] at clojure.lang.RestFn.invoke(RestFn.java:512)
[clojure-1.5.1.jar:na] at
backtype.storm.daemon.worker$_main.invoke(worker.clj:502)
[storm-core-0.9.5.jar:0.9.5] at
clojure.lang.AFn.applyToHelper(AFn.java:172) [clojure-1.5.1.jar:na] at
clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na] at
backtype.storm.daemon.worker.main(Unknown Source)
[storm-core-0.9.5.jar:0.9.5]On Tue, Nov 3, 2015 at 8:36 AM, researcher cs <prog.researc...@gmail.com> wrote: > i tried this command ps -ef|grep 6703 and got this > > st 2991 2595 41 14:51 pts/3 00:05:19 java -server -Xmx768m > -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib > -Dlogfile.name=worker-6703.log -Dstorm.home=/home/st/storm-0.8.2 > -Dlog4j.configuration=storm.log.properties -cp > /home/st/storm-0.8.2/storm-0.8.2.jar:/home/st/storm-0.8.2/lib/curator-client-1.0.1.jar:/home/st/storm-0.8.2/lib/zookeeper-3.4.5.jar:/home/st/storm-0.8.2/lib/objenesis-1.2.jar:/home/st/storm-0.8.2/lib/disruptor-2.10.1.jar:/home/st/storm-0.8.2/lib/servlet-api-2.5-20081211.jar:/home/st/storm-0.8.2/lib/ring-core-1.1.5.jar:/home/st/storm-0.8.2/lib/tools.logging-0.2.3.jar:/home/st/storm-0.8.2/lib/libthrift7-0.7.0.jar:/home/st/storm-0.8.2/lib/slf4j-api-1.5.8.jar:/home/st/storm-0.8.2/lib/hiccup-0.3.6.jar:/home/st/storm-0.8.2/lib/guava-13.0.jar:/home/st/storm-0.8.2/lib/junit-3.8.1.jar:/home/st/storm-0.8.2/lib/servlet-api-2.5.jar:/home/st/storm-0.8.2/lib/reflectasm-1.07-shaded.jar:/home/st/storm-0.8.2/lib/zookeeper-3.3.3.jar:/home/st/storm-0.8.2/lib/jzmq-2.1.0.jar:/home/st/storm-0.8.2/lib/jgrapht-0.8.3.jar:/home/st/storm-0.8.2/lib/httpclient-4.1.1.jar:/home/st/storm-0.8.2/lib/clojure-1.4.0.jar:/home/st/storm-0.8.2/lib/clout-1.0.1.jar:/home/st/storm-0.8.2/lib/core.incubator-0.1.0.jar:/home/st/storm-0.8.2/lib/ring-jetty-adapter-0.3.11.jar:/home/st/storm-0.8.2/lib/asm-4.0.jar:/home/st/storm-0.8.2/lib/commons-io-1.4.jar:/home/st/storm-0.8.2/lib/snakeyaml-1.9.jar:/home/st/storm-0.8.2/lib/slf4j-log4j12-1.5.8.jar:/home/st/storm-0.8.2/lib/tools.cli-0.2.2.jar:/home/st/storm-0.8.2/lib/commons-fileupload-1.2.1.jar:/home/st/storm-0.8.2/lib/commons-exec-1.1.jar:/home/st/storm-0.8.2/lib/minlog-1.2.jar:/home/st/storm-0.8.2/lib/ring-servlet-0.3.11.jar:/home/st/storm-0.8.2/lib/carbonite-1.5.0.jar:/home/st/storm-0.8.2/lib/clj-time-0.4.1.jar:/home/st/storm-0.8.2/lib/jetty-util-6.1.26.jar:/home/st/storm-0.8.2/lib/tools.macro-0.1.0.jar:/home/st/storm-0.8.2/lib/commons-codec-1.4.jar:/home/st/storm-0.8.2/lib/commons-logging-1.1.1.jar:/home/st/storm-0.8.2/lib/jetty-6.1.26.jar:/home/st/storm-0.8.2/lib/jline-0.9.94.jar:/home/st/storm-0.8.2/lib/json-simple-1.1.jar:/home/st/storm-0.8.2/lib/kryo-2.17.jar:/home/st/storm-0.8.2/lib/math.numeric-tower-0.0.1.jar:/home/st/storm-0.8.2/lib/compojure-1.1.3.jar:/home/st/storm-0.8.2/lib/httpcore-4.1.jar:/home/st/storm-0.8.2/lib/commons-lang-2.5.jar:/home/st/storm-0.8.2/lib/log4j-1.2.16.jar:/home/st/storm-0.8.2/lib/joda-time-2.0.jar:/home/st/storm-0.8.2/lib/curator-framework-1.0.1.jar:/home/st/storm-0.8.2/log4j:/home/st/storm-0.8.2/conf:/tmp/storm/supervisor/stormdist/fsd-1-1446555065/stormjar.jar > backtype.storm.daemon.worker fsd-1-1446555065 > 3e3092ff-2722-400a-8aa9-362c9144a6fe 6703 > 0f68434a-d2f8-41c3-8d1b-9b0d0f2fcb6a st 3434 3217 2 15:04 pts/8 00:00:00 > grep --color=auto 6703 > > and tried to change ip_local_port_range as you said but problem still > so i'll try to upgrade the version but is there any other solution ? > > On Mon, Nov 2, 2015 at 2:40 PM, researcher cs <prog.researc...@gmail.com> > wrote: > >> many many many thanks for replying and helping , i'll try what you said , >> But the coder of the project that i used it , he used old version 0.8.2 so >> i'm trying first to use it then upgrade the version >> >> On Mon, Nov 2, 2015 at 1:59 PM, Feng Longda <hustjac...@gmail.com> wrote: >> >>> I have resolved this problem several times. >>> >>> There are two root cause. >>> (1) local temporary network ports are conflict with storm's ports. >>> (2) the old worker failed to be killed when kill topology. >>> >>> Firstly, please do "ps -ef|grep 67xx" to check whether it is due to the >>> second problem. if there is no worker using the port. it would be temporary >>> port conflict. >>> please do the following action with root privilege >>> >>> echo 'net.ipv4.ip_local_port_range = 10240 65535' >> /etc/sysctl.conf >>> /sbin/sysctl -p >>> >>> why occur this, due to in every network connection, client will bind >>> one temporary port, if the linux default temporary range is from 1024 to >>> 65535, so it is still likely to conflict with storm's port. >>> >>> >>> if there are some alive worker using the port, it is due to storm fail >>> to kill worker when kill topology, when the OS's cpu usage is pretty high, >>> this phenomenon will occur, but generally this case is pretty rare. By the >>> way, in the jstorm (https://github.com/alibaba/jstorm), it resolves >>> this issue. Fortunately, jstorm has been donated to storm, you will see >>> the solution in a short time. >>> >>> >>> By the way, I found you are using an old version storm, why don't try >>> the storm 0.9.x, whose performance has been improved much. >>> >>> >>> >>> >>> >>> >>> >>> >>> 2015-11-01 17:26 GMT+08:00 researcher cs <prog.researc...@gmail.com>: >>> >>>> after submitting topology >>>> >>>> supervisor log file >>>> >>>> 2015-11-01 09:59:48 executor [INFO] Loading executor b-1:[3 3] >>>> 2015-11-01 09:59:50 executor [INFO] Loaded executor tasks b-1:[3 3][INFO] >>>> Launching worker with assignment >>>> #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id >>>> "df-1-1446364738", :executors ([2 2] [35 35] [5 5] [38 38] [8 8] [41 41] >>>> [11 11] [44 44] [14 14] [47 47] [17 17] [50 50] [20 20] [53 53] [23 23] [56 >>>> 56] [26 26] [29 29] [32 32])} for this supervisor >>>> fdd1e16a-650e-4d12-90f4-cb87336f29c3 on port 6702 with id >>>> eb224d37-bc81-43ec-bbb9-8e5897c203fa >>>> after >>>> 2015-11-01 09:59:02 supervisor [INFO] >>>> 0af4b32b-e14d-4f64-ba03-d61d79fa6405 still hasn't started 2015-11-01 >>>> 09:59:03 supervisor [INFO] 0af4b32b-e14d-4f64-ba03-d61d79fa6405 still >>>> hasn't started >>>> !!!!!! >>>> >>>> but worker has data like >>>> >>>> 2015-11-01 09:59:48 executor [INFO] Loading executor b-1:[3 3] >>>> 2015-11-01 09:59:50 executor [INFO] Loaded executor tasks b-1:[3 3] >>>> >>>> then i executed the command which launch worker with supervisor to know >>>> where is the error exactly found this >>>> in the worker log file >>>> [ERROR] Async loop died! org.zeromq.ZMQException: Address already in >>>> use(0x62) at org.zeromq.ZMQ$Socket.bind(Native Method) at >>>> zilch.mq$bind.invoke(mq.clj:69) >>>> at backtype.storm.messaging.zmq.ZMQContext.bind(zmq.clj:57) at >>>> backtype.storm.messaging.loader$launch_receive_thread_BANG_$fn__1629.invoke(loader.clj:26) >>>> at backtype.storm.util$async_loop$fn__465.invoke(util.clj:375) at >>>> clojure.lang.AFn.run(AFn.java:24) at java.lang.Thread.run(Unknown Source) >>>> 2015-11-01 10:03:19 util [INFO] Halting process >>>> >>>> >>>> i'm on this error more than 3 weeks !! hope really can find someone >>>> help >>>> >>> >>> >> >
