Hi there,
I'm getting this exception running a Storm topology on Windows.
D:\Stash\audit-refinery>*storm jar target\AuditApp-1.0-SNAPSHOT.jar
com.eze.exhaust.AuditTopology*
118 [main] INFO com.eze.exhaust.AuditTopology - Using file name
configuration.properties
121 [main] INFO com.eze.exhaust.AuditTopology - Using stream name
exhaust-bin
122 [main] INFO com.eze.exhaust.AuditTopology - Using initial position
LATEST (if a checkpoint is not found).
122 [main] INFO com.eze.exhaust.AuditTopology - Using zookeeper endpoint
10.164.0.226
122 [main] INFO com.eze.exhaust.AuditTopology - Using zookeeper prefix
kinesis_spout
122 [main] INFO com.eze.exhaust.AuditTopology - Using redis endpoint
www.ezecloud.net
122 [main] INFO com.eze.exhaust.AuditTopology - Using Region us-east-1
1504 [main] INFO backtype.storm.zookeeper - Starting inprocess zookeeper
at port 2000 and dir
C:\Users\RZACHA~1\AppData\Local\Temp\23148903-30cb-4e20-980a-0a8b5bb4224d
1597 [main] INFO backtype.storm.daemon.nimbus - Starting Nimbus with conf
{"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
"topology.tick.tuple.freq.secs" nil,
"topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java
600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64,
"topology.worker.shared.thread.pool.size" 4, "nimbus.host" "10.164.0.226",
"storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000,
"transactional.zooke
"topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
"topology.spout.wait.strategy"
"backtype.storm.spout.SleepSpoutWaitStrategy",
"nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
"storm.zookeeper.retr
actory" "backtype.storm.serialization.DefaultKryoFactory",
"drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1,
"storm.zookeeper.retry.times" 5, "storm.thrift.transport"
"backtype.storm.security.auth.SimpleTransportPlugi
1601 [main] INFO backtype.storm.daemon.nimbus - Using default scheduler
1622 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl -
Starting
1669 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
1708 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl -
Starting
1799 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl -
Starting
1817 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
1831 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl -
Starting
1833 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl -
Starting
1858 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
1870 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl -
Starting
1893 [main] INFO backtype.storm.daemon.supervisor - Starting Supervisor
with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
"topology.tick.tuple.freq.secs" nil,
"topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back
q.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads"
64, "topology.worker.shared.thread.pool.size" 4, "nimbus.host"
"10.164.0.226", "storm.messaging.netty.min_wait_ms" 100,
"storm.zookeeper.port" 2000, "transaction
secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
"topology.spout.wait.strategy"
"backtype.storm.spout.SleepSpoutWaitStrategy",
"nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
"storm.zookee
o.factory" "backtype.storm.serialization.DefaultKryoFactory",
"drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1,
"storm.zookeeper.retry.times" 5, "storm.thrift.transport"
"backtype.storm.security.auth.SimpleTransportPl
1903 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl -
Starting
1922 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
1936 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl -
Starting
1980 [main] INFO backtype.storm.daemon.supervisor - Starting supervisor
with id 8a72a3c2-5a56-4b7f-89d2-c17108fe8775 at host QAHOTEL12.ezesoft.net
1983 [main] INFO backtype.storm.daemon.supervisor - Starting Supervisor
with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper",
"topology.tick.tuple.freq.secs" nil,
"topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back
q.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads"
64, "topology.worker.shared.thread.pool.size" 4, "nimbus.host"
"10.164.0.226", "storm.messaging.netty.min_wait_ms" 100,
"storm.zookeeper.port" 2000, "transaction
secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 30,
"topology.spout.wait.strategy"
"backtype.storm.spout.SleepSpoutWaitStrategy",
"nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil,
"storm.zookee
o.factory" "backtype.storm.serialization.DefaultKryoFactory",
"drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1,
"storm.zookeeper.retry.times" 5, "storm.thrift.transport"
"backtype.storm.security.auth.SimpleTransportPl
1990 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl -
Starting
2008 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state
update: :connected:none
2022 [main] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl -
Starting
2057 [main] INFO backtype.storm.daemon.supervisor - Starting supervisor
with id 0bd3e572-d845-4d9d-a26a-b025c6866847 at host QAHOTEL12.ezesoft.net
2101 [main] INFO backtype.storm.daemon.nimbus - Received topology
submission for audit-count with conf {"topology.acker.executors" nil,
"topology.kryo.register" nil, "topology.kryo.decorators" (), "topology.name"
"audit-count", "storm.i
2135 [main] INFO backtype.storm.daemon.nimbus - Activating audit-count:
audit-count-1-1454379120
2206 [main] INFO backtype.storm.scheduler.EvenScheduler - Available slots:
(["8a72a3c2-5a56-4b7f-89d2-c17108fe8775" 1024]
["8a72a3c2-5a56-4b7f-89d2-c17108fe8775" 1025]
["8a72a3c2-5a56-4b7f-89d2-c17108fe8775" 1026] ["0bd3e572-d845-4d9d-a
2220 [main] INFO backtype.storm.daemon.nimbus - Setting new assignment for
topology id audit-count-1-1454379120:
#backtype.storm.daemon.common.Assignment{:master-code-dir
"C:\\Users\\RZACHA~1\\AppData\\Local\\Temp\\719a0e00-6e04-4e72-ba
2943 [Thread-5] INFO backtype.storm.daemon.supervisor - Downloading code
for storm id audit-count-1-1454379120 from
C:\Users\RZACHA~1\AppData\Local\Temp\719a0e00-6e04-4e72-baf9-f94e7a99ede2\nimbus\stormdist\audit-count-1-1454379120
3175 [Thread-5] INFO backtype.storm.daemon.supervisor - Copying resources
at
jar:file:/D:/Stash/audit-refinery/target/AuditApp-1.0-SNAPSHOT.jar!/resources
to
C:\Users\RZACHA~1\AppData\Local\Temp\2ab9336f-b8b6-4148-a271-de4afdcc1f86\supe
*3179 [Thread-5] ERROR backtype.storm.event - Error when processing event*
*java.io.FileNotFoundException: Source
'file:\D:\Stash\audit-refinery\target\AuditApp-1.0-SNAPSHOT.jar!\resources'
does not exist*
* at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:866)
~[commons-io-1.4.jar:1.4]*
* at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:770)
~[commons-io-1.4.jar:1.4]*
* at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:745)
~[commons-io-1.4.jar:1.4]*
* at
backtype.storm.daemon.supervisor$fn__6358.invoke(supervisor.clj:493)
~[storm-core-0.9.1-incubating-SNAPSHOT-12182013.jar:na]*
* at clojure.lang.MultiFn.invoke(MultiFn.java:172)
~[clojure-1.4.0.jar:na]*
* at
backtype.storm.daemon.supervisor$mk_synchronize_supervisor$this__6265.invoke(supervisor.clj:325)
~[storm-core-0.9.1-incubating-SNAPSHOT-12182013.jar:na]*
* at
backtype.storm.event$event_manager$fn__3067.invoke(event.clj:39)
~[storm-core-0.9.1-incubating-SNAPSHOT-12182013.jar:na]*
* at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na]*
* at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]*
*3187 [Thread-5] INFO backtype.storm.util - Halting process: ("Error when
processing an event")*
I'm using this version:
storm-0.9.1-incubating-SNAPSHOT-12182013
I set up my Windows Storm dev environment following these instructions
<http://ptgoetz.github.io/blog/2013/12/18/running-apache-storm-on-windows/>.
This is reporedly fixed <https://issues.apache.org/jira/browse/STORM-273>
in 0.9.2-incubating. However, I can't get that version of Storm to work on
Windows. When I try that version of the CLI, storm jar commands return
immediately with no output.
Is there a released version of Storm that works on Windows and has this
bugfix?
Thanks,
Ranjith
