[ https://issues.apache.org/jira/browse/KAFKA-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16502979#comment-16502979 ]
Grégory R. commented on KAFKA-4392: ----------------------------------- Same issue here on windows and kafka 1.1.0. 2018-06-06 10:06:43 ERROR StateDirectory:251 - stream-thread [bridgeWorkerData-e125bca4-5e2f-4b08-b0bc-b9f6eb5135ba-CleanupThread] Failed to lock the state directory due to an unexpected exception java.nio.file.AccessDeniedException: \tmp\kafka-streams\myapp1\0_0\.lock at sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:83) at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97) 2018-06-06 10:07:00 ERROR StateDirectory:251 - stream-thread [bridgeWorkerOutput-abfe4c31-cfa3-43a4-8e09-8590df4d2369-CleanupThread] Failed to lock the state directory due to an unexpected exception java.nio.file.AccessDeniedException: \tmp\kafka-streams\myapp2\0_0\.lock at sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:83) at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97) at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:102) at sun.nio.fs.WindowsFileSystemProvider.newFileChannel(WindowsFileSystemProvider.java:115) at java.nio.channels.FileChannel.open(FileChannel.java:287) at java.nio.channels.FileChannel.open(FileChannel.java:335) at org.apache.kafka.streams.processor.internals.StateDirectory.getOrCreateFileChannel(StateDirectory.java:294) at org.apache.kafka.streams.processor.internals.StateDirectory.lock(StateDirectory.java:148) at org.apache.kafka.streams.processor.internals.StateDirectory.cleanRemovedTasks(StateDirectory.java:240) at org.apache.kafka.streams.KafkaStreams$3.run(KafkaStreams.java:761) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-06-06 10:07:03 ERROR StateDirectory:251 - stream-thread [bridgeWorkerEvent-33463024-bcf5-4989-93fb-6c94034ea4ae-CleanupThread] Failed t o lock the state directory due to an unexpected exception java.nio.file.AccessDeniedException: \tmp\kafka-streams\myapp3\0_0\.lock at sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:83) at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97) at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:102) at sun.nio.fs.WindowsFileSystemProvider.newFileChannel(WindowsFileSystemProvider.java:115) at java.nio.channels.FileChannel.open(FileChannel.java:287) at java.nio.channels.FileChannel.open(FileChannel.java:335) at org.apache.kafka.streams.processor.internals.StateDirectory.getOrCreateFileChannel(StateDirectory.java:294) at org.apache.kafka.streams.processor.internals.StateDirectory.lock(StateDirectory.java:148) at org.apache.kafka.streams.processor.internals.StateDirectory.cleanRemovedTasks(StateDirectory.java:240) at org.apache.kafka.streams.KafkaStreams$3.run(KafkaStreams.java:761) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 3 streams started, 3 different paths and the issue is raised esxactly at the same time, the first time the exception is raised. Next, each 10 minutes, this exception is raised. > Failed to lock the state directory due to an unexpected exception > ----------------------------------------------------------------- > > Key: KAFKA-4392 > URL: https://issues.apache.org/jira/browse/KAFKA-4392 > Project: Kafka > Issue Type: Bug > Components: streams > Affects Versions: 0.10.1.0 > Reporter: Ara Ebrahimi > Assignee: Guozhang Wang > Priority: Major > Fix For: 0.10.2.0 > > > This happened on streaming startup, on a clean installation, no existing > folder. Here I was starting 4 instances of our streaming app on 4 machines > and one threw this exception. Seems to me there’s a race condition somewhere > when instances discover others, or something like that. > 2016-11-02 15:43:47 INFO StreamRunner:59 - Started http server successfully. > 2016-11-02 15:44:50 ERROR StateDirectory:147 - Failed to lock the state > directory due to an unexpected exception > java.nio.file.NoSuchFileException: > /data/1/kafka-streams/myapp-streams/7_21/.lock > at > sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) > at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) > at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) > at > sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:177) > at java.nio.channels.FileChannel.open(FileChannel.java:287) > at java.nio.channels.FileChannel.open(FileChannel.java:335) > at > org.apache.kafka.streams.processor.internals.StateDirectory.getOrCreateFileChannel(StateDirectory.java:176) > at > org.apache.kafka.streams.processor.internals.StateDirectory.lock(StateDirectory.java:90) > at > org.apache.kafka.streams.processor.internals.StateDirectory.cleanRemovedTasks(StateDirectory.java:140) > at > org.apache.kafka.streams.processor.internals.StreamThread.maybeClean(StreamThread.java:552) > at > org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:459) > at > org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:242) > ^C > [arae@a4 ~]$ ls -al /data/1/kafka-streams/myapp-streams/7_21/ > ls: cannot access /data/1/kafka-streams/myapp-streams/7_21/: No such file or > directory > [arae@a4 ~]$ ls -al /data/1/kafka-streams/myapp-streams/ > total 4 > drwxr-xr-x 74 root root 4096 Nov 2 15:44 . > drwxr-xr-x 3 root root 27 Nov 2 15:43 .. > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_1 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_13 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_14 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_16 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_2 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_22 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_28 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_3 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_31 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_5 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_7 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_8 > drwxr-xr-x 3 root root 32 Nov 2 15:43 0_9 > drwxr-xr-x 3 root root 32 Nov 2 15:43 1_1 > drwxr-xr-x 3 root root 32 Nov 2 15:43 1_10 > drwxr-xr-x 3 root root 32 Nov 2 15:43 1_14 > drwxr-xr-x 3 root root 32 Nov 2 15:43 1_15 > drwxr-xr-x 3 root root 32 Nov 2 15:43 1_16 > drwxr-xr-x 3 root root 32 Nov 2 15:43 1_17 > drwxr-xr-x 3 root root 32 Nov 2 15:43 1_18 > drwxr-xr-x 3 root root 32 Nov 2 15:43 1_3 > drwxr-xr-x 3 root root 32 Nov 2 15:43 1_5 > drwxr-xr-x 3 root root 60 Nov 2 15:43 2_1 > drwxr-xr-x 3 root root 60 Nov 2 15:43 2_10 > drwxr-xr-x 3 root root 60 Nov 2 15:43 2_12 > drwxr-xr-x 3 root root 60 Nov 2 15:43 2_20 > drwxr-xr-x 3 root root 60 Nov 2 15:43 2_24 > drwxr-xr-x 3 root root 61 Nov 2 15:43 3_10 > drwxr-xr-x 3 root root 61 Nov 2 15:43 3_11 > drwxr-xr-x 3 root root 61 Nov 2 15:43 3_19 > drwxr-xr-x 3 root root 61 Nov 2 15:43 3_20 > drwxr-xr-x 3 root root 61 Nov 2 15:43 3_25 > drwxr-xr-x 3 root root 61 Nov 2 15:43 3_26 > drwxr-xr-x 3 root root 61 Nov 2 15:43 3_3 > drwxr-xr-x 3 root root 64 Nov 2 15:43 4_11 > drwxr-xr-x 3 root root 64 Nov 2 15:43 4_12 > drwxr-xr-x 3 root root 64 Nov 2 15:43 4_18 > drwxr-xr-x 3 root root 64 Nov 2 15:43 4_19 > drwxr-xr-x 3 root root 64 Nov 2 15:43 4_24 > drwxr-xr-x 3 root root 64 Nov 2 15:43 4_25 > drwxr-xr-x 3 root root 64 Nov 2 15:43 4_26 > drwxr-xr-x 3 root root 64 Nov 2 15:43 4_4 > drwxr-xr-x 3 root root 64 Nov 2 15:43 4_9 > drwxr-xr-x 3 root root 58 Nov 2 15:43 5_1 > drwxr-xr-x 3 root root 58 Nov 2 15:43 5_10 > drwxr-xr-x 3 root root 58 Nov 2 15:43 5_11 > drwxr-xr-x 3 root root 58 Nov 2 15:43 5_13 > drwxr-xr-x 3 root root 58 Nov 2 15:43 5_15 > drwxr-xr-x 3 root root 58 Nov 2 15:43 5_17 > drwxr-xr-x 3 root root 58 Nov 2 15:43 5_18 > drwxr-xr-x 2 root root 18 Nov 2 15:43 6_13 > drwxr-xr-x 2 root root 18 Nov 2 15:43 6_15 > drwxr-xr-x 2 root root 18 Nov 2 15:43 6_18 > drwxr-xr-x 2 root root 18 Nov 2 15:43 6_19 > drwxr-xr-x 2 root root 18 Nov 2 15:43 6_20 > drwxr-xr-x 2 root root 18 Nov 2 15:43 6_21 > drwxr-xr-x 2 root root 18 Nov 2 15:43 6_24 > drwxr-xr-x 2 root root 18 Nov 2 15:43 6_4 > drwxr-xr-x 2 root root 18 Nov 2 15:43 6_7 > drwxr-xr-x 2 root root 18 Nov 2 15:43 6_8 > drwxr-xr-x 2 root root 18 Nov 2 15:43 7_16 > drwxr-xr-x 2 root root 18 Nov 2 15:43 7_19 > drwxr-xr-x 2 root root 18 Nov 2 15:43 7_20 > drwxr-xr-x 2 root root 18 Nov 2 15:43 7_25 > drwxr-xr-x 2 root root 18 Nov 2 15:43 7_28 > drwxr-xr-x 2 root root 18 Nov 2 15:43 7_31 > drwxr-xr-x 2 root root 18 Nov 2 15:43 7_7 > drwxr-xr-x 2 root root 18 Nov 2 15:43 8_13 > drwxr-xr-x 2 root root 18 Nov 2 15:43 8_21 > drwxr-xr-x 2 root root 18 Nov 2 15:43 8_23 > drwxr-xr-x 2 root root 18 Nov 2 15:43 8_26 > drwxr-xr-x 2 root root 18 Nov 2 15:43 8_31 -- This message was sent by Atlassian JIRA (v7.6.3#76005)