[
https://issues.apache.org/jira/browse/KAFKA-10886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenbing Shen updated KAFKA-10886:
---------------------------------
Description:
I tried using the [Kafka-9458|https://issues.apache.org/jira/browse/KAFKA-9458]
patch to fix the Kafka problem in the Windows environment, but it didn't seem
to work.These include restarting the Kafka service causing data to be deleted
by mistake, deleting a topic or a partition migration causing a disk to go
offline or the broker crashed.
[2020-12-23 17:26:11,124] ERROR (kafka-request-handler-11
kafka.server.LogDirFailureChannel 76) Error while renaming dir for test-1-1 in
log dir
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log[2020-12-23
17:26:11,124] ERROR (kafka-request-handler-11
kafka.server.LogDirFailureChannel 76) Error while renaming dir for test-1-1 in
log dir
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\logjava.nio.file.AccessDeniedException:
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1
->
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1.7c4fdeca40294cc38aed815b1a8e7663-delete
at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) at
sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at
sun.nio.fs.WindowsFileCopy.move(Unknown Source) at
sun.nio.fs.WindowsFileSystemProvider.move(Unknown Source) at
java.nio.file.Files.move(Unknown Source) at
org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:786) at
kafka.log.Log$$anonfun$renameDir$1.apply$mcV$sp(Log.scala:689) at
kafka.log.Log$$anonfun$renameDir$1.apply(Log.scala:687) at
kafka.log.Log$$anonfun$renameDir$1.apply(Log.scala:687) at
kafka.log.Log.maybeHandleIOException(Log.scala:1837) at
kafka.log.Log.renameDir(Log.scala:687) at
kafka.log.LogManager.asyncDelete(LogManager.scala:833) at
kafka.cluster.Partition$$anonfun$delete$1.apply(Partition.scala:267) at
kafka.cluster.Partition$$anonfun$delete$1.apply(Partition.scala:262) at
kafka.utils.CoreUtils$.inLock(CoreUtils.scala:256) at
kafka.utils.CoreUtils$.inWriteLock(CoreUtils.scala:264) at
kafka.cluster.Partition.delete(Partition.scala:262) at
kafka.server.ReplicaManager.stopReplica(ReplicaManager.scala:341) at
kafka.server.ReplicaManager$$anonfun$stopReplicas$2.apply(ReplicaManager.scala:371)
at
kafka.server.ReplicaManager$$anonfun$stopReplicas$2.apply(ReplicaManager.scala:369)
at scala.collection.Iterator$class.foreach(Iterator.scala:891) at
scala.collection.AbstractIterator.foreach(Iterator.scala:1334) at
scala.collection.IterableLike$class.foreach(IterableLike.scala:72) at
scala.collection.AbstractIterable.foreach(Iterable.scala:54) at
kafka.server.ReplicaManager.stopReplicas(ReplicaManager.scala:369) at
kafka.server.KafkaApis.handleStopReplicaRequest(KafkaApis.scala:222) at
kafka.server.KafkaApis.handle(KafkaApis.scala:113) at
kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:73) at
java.lang.Thread.run(Unknown Source) Suppressed:
java.nio.file.AccessDeniedException:
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1
->
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1.7c4fdeca40294cc38aed815b1a8e7663-delete
at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) at
sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at
sun.nio.fs.WindowsFileCopy.move(Unknown Source) at
sun.nio.fs.WindowsFileSystemProvider.move(Unknown Source) at
java.nio.file.Files.move(Unknown Source) at
org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:783) ...
23 more[2020-12-23 17:26:11,127] INFO (LogDirFailureHandler
kafka.server.ReplicaManager 66) [ReplicaManager broker=1002] Stopping serving
replicas in dir
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log
was:
I tried using the Kafka-9458 patch to fix the Kafka problem in the Windows
environment, but it didn't seem to work.These include restarting the Kafka
service causing data to be deleted by mistake, deleting a topic or a partition
migration causing a disk to go offline or the broker crashed.
[2020-12-23 17:26:11,124] ERROR (kafka-request-handler-11
kafka.server.LogDirFailureChannel 76) Error while renaming dir for test-1-1 in
log dir
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log[2020-12-23
17:26:11,124] ERROR (kafka-request-handler-11
kafka.server.LogDirFailureChannel 76) Error while renaming dir for test-1-1 in
log dir
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\logjava.nio.file.AccessDeniedException:
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1
->
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1.7c4fdeca40294cc38aed815b1a8e7663-delete
at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) at
sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at
sun.nio.fs.WindowsFileCopy.move(Unknown Source) at
sun.nio.fs.WindowsFileSystemProvider.move(Unknown Source) at
java.nio.file.Files.move(Unknown Source) at
org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:786) at
kafka.log.Log$$anonfun$renameDir$1.apply$mcV$sp(Log.scala:689) at
kafka.log.Log$$anonfun$renameDir$1.apply(Log.scala:687) at
kafka.log.Log$$anonfun$renameDir$1.apply(Log.scala:687) at
kafka.log.Log.maybeHandleIOException(Log.scala:1837) at
kafka.log.Log.renameDir(Log.scala:687) at
kafka.log.LogManager.asyncDelete(LogManager.scala:833) at
kafka.cluster.Partition$$anonfun$delete$1.apply(Partition.scala:267) at
kafka.cluster.Partition$$anonfun$delete$1.apply(Partition.scala:262) at
kafka.utils.CoreUtils$.inLock(CoreUtils.scala:256) at
kafka.utils.CoreUtils$.inWriteLock(CoreUtils.scala:264) at
kafka.cluster.Partition.delete(Partition.scala:262) at
kafka.server.ReplicaManager.stopReplica(ReplicaManager.scala:341) at
kafka.server.ReplicaManager$$anonfun$stopReplicas$2.apply(ReplicaManager.scala:371)
at
kafka.server.ReplicaManager$$anonfun$stopReplicas$2.apply(ReplicaManager.scala:369)
at scala.collection.Iterator$class.foreach(Iterator.scala:891) at
scala.collection.AbstractIterator.foreach(Iterator.scala:1334) at
scala.collection.IterableLike$class.foreach(IterableLike.scala:72) at
scala.collection.AbstractIterable.foreach(Iterable.scala:54) at
kafka.server.ReplicaManager.stopReplicas(ReplicaManager.scala:369) at
kafka.server.KafkaApis.handleStopReplicaRequest(KafkaApis.scala:222) at
kafka.server.KafkaApis.handle(KafkaApis.scala:113) at
kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:73) at
java.lang.Thread.run(Unknown Source) Suppressed:
java.nio.file.AccessDeniedException:
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1
->
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1.7c4fdeca40294cc38aed815b1a8e7663-delete
at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) at
sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at
sun.nio.fs.WindowsFileCopy.move(Unknown Source) at
sun.nio.fs.WindowsFileSystemProvider.move(Unknown Source) at
java.nio.file.Files.move(Unknown Source) at
org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:783) ...
23 more[2020-12-23 17:26:11,127] INFO (LogDirFailureHandler
kafka.server.ReplicaManager 66) [ReplicaManager broker=1002] Stopping serving
replicas in dir
E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log
> Kafka crashed in windows environment2
> -------------------------------------
>
> Key: KAFKA-10886
> URL: https://issues.apache.org/jira/browse/KAFKA-10886
> Project: Kafka
> Issue Type: Bug
> Components: log
> Affects Versions: 2.0.0
> Environment: Windows Server
> Reporter: Wenbing Shen
> Priority: Critical
> Labels: windows
>
> I tried using the
> [Kafka-9458|https://issues.apache.org/jira/browse/KAFKA-9458] patch to fix
> the Kafka problem in the Windows environment, but it didn't seem to
> work.These include restarting the Kafka service causing data to be deleted by
> mistake, deleting a topic or a partition migration causing a disk to go
> offline or the broker crashed.
> [2020-12-23 17:26:11,124] ERROR (kafka-request-handler-11
> kafka.server.LogDirFailureChannel 76) Error while renaming dir for test-1-1
> in log dir
> E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log[2020-12-23
> 17:26:11,124] ERROR (kafka-request-handler-11
> kafka.server.LogDirFailureChannel 76) Error while renaming dir for test-1-1
> in log dir
> E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\logjava.nio.file.AccessDeniedException:
>
> E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1
> ->
> E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1.7c4fdeca40294cc38aed815b1a8e7663-delete
> at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) at
> sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at
> sun.nio.fs.WindowsFileCopy.move(Unknown Source) at
> sun.nio.fs.WindowsFileSystemProvider.move(Unknown Source) at
> java.nio.file.Files.move(Unknown Source) at
> org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:786) at
> kafka.log.Log$$anonfun$renameDir$1.apply$mcV$sp(Log.scala:689) at
> kafka.log.Log$$anonfun$renameDir$1.apply(Log.scala:687) at
> kafka.log.Log$$anonfun$renameDir$1.apply(Log.scala:687) at
> kafka.log.Log.maybeHandleIOException(Log.scala:1837) at
> kafka.log.Log.renameDir(Log.scala:687) at
> kafka.log.LogManager.asyncDelete(LogManager.scala:833) at
> kafka.cluster.Partition$$anonfun$delete$1.apply(Partition.scala:267) at
> kafka.cluster.Partition$$anonfun$delete$1.apply(Partition.scala:262) at
> kafka.utils.CoreUtils$.inLock(CoreUtils.scala:256) at
> kafka.utils.CoreUtils$.inWriteLock(CoreUtils.scala:264) at
> kafka.cluster.Partition.delete(Partition.scala:262) at
> kafka.server.ReplicaManager.stopReplica(ReplicaManager.scala:341) at
> kafka.server.ReplicaManager$$anonfun$stopReplicas$2.apply(ReplicaManager.scala:371)
> at
> kafka.server.ReplicaManager$$anonfun$stopReplicas$2.apply(ReplicaManager.scala:369)
> at scala.collection.Iterator$class.foreach(Iterator.scala:891) at
> scala.collection.AbstractIterator.foreach(Iterator.scala:1334) at
> scala.collection.IterableLike$class.foreach(IterableLike.scala:72) at
> scala.collection.AbstractIterable.foreach(Iterable.scala:54) at
> kafka.server.ReplicaManager.stopReplicas(ReplicaManager.scala:369) at
> kafka.server.KafkaApis.handleStopReplicaRequest(KafkaApis.scala:222) at
> kafka.server.KafkaApis.handle(KafkaApis.scala:113) at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:73) at
> java.lang.Thread.run(Unknown Source) Suppressed:
> java.nio.file.AccessDeniedException:
> E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1
> ->
> E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log\test-1-1.7c4fdeca40294cc38aed815b1a8e7663-delete
> at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) at
> sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) at
> sun.nio.fs.WindowsFileCopy.move(Unknown Source) at
> sun.nio.fs.WindowsFileSystemProvider.move(Unknown Source) at
> java.nio.file.Files.move(Unknown Source) at
> org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:783)
> ... 23 more[2020-12-23 17:26:11,127] INFO (LogDirFailureHandler
> kafka.server.ReplicaManager 66) [ReplicaManager broker=1002] Stopping serving
> replicas in dir
> E:\bigdata\works\kafka-2.0.0.5\kafka-2.0.0.5\bin\windows\.\..\..\data01\kafka\log
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
