[ https://issues.apache.org/jira/browse/RATIS-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16666415#comment-16666415 ]
Hadoop QA commented on RATIS-377: --------------------------------- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 21s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s{color} | {color:blue} Findbugs executables are not available. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | {color:green} The patch appears to include 5 new or modified test files. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 8s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 16s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 3s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 31s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 45s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 6s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 11s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 2s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} javac {color} | {color:red} 1m 2s{color} | {color:red} root generated 2 new + 92 unchanged - 0 fixed = 94 total (was 92) {color} | | {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange} 0m 28s{color} | {color:orange} root: The patch generated 80 new + 734 unchanged - 24 fixed = 814 total (was 758) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 44s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:red}-1{color} | {color:red} unit {color} | {color:red} 6m 0s{color} | {color:red} root in the patch failed. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 9s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 13m 58s{color} | {color:black} {color} | \\ \\ || Reason || Tests || | Failed junit tests | ratis.server.simulation.TestRaftWithSimulatedRpc | | | ratis.server.simulation.TestRaftStateMachineExceptionWithSimulatedRpc | | | ratis.server.simulation.TestLeaderElectionWithSimulatedRpc | \\ \\ || Subsystem || Report/Notes || | Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/ratis:date2018-10-28 | | JIRA Issue | RATIS-377 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12945964/r377_20181028c.patch | | Optional Tests | asflicense javac javadoc unit findbugs checkstyle compile | | uname | Linux 3da9e45f0389 3.13.0-153-generic #203-Ubuntu SMP Thu Jun 14 08:52:28 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-RATIS-Build/yetus-personality.sh | | git revision | master / b901b3a | | Default Java | 1.8.0_181 | | javac | https://builds.apache.org/job/PreCommit-RATIS-Build/472/artifact/out/diff-compile-javac-root.txt | | checkstyle | https://builds.apache.org/job/PreCommit-RATIS-Build/472/artifact/out/diff-checkstyle-root.txt | | unit | https://builds.apache.org/job/PreCommit-RATIS-Build/472/artifact/out/patch-unit-root.txt | | Test Results | https://builds.apache.org/job/PreCommit-RATIS-Build/472/testReport/ | | modules | C: ratis-common ratis-server U: . | | Console output | https://builds.apache.org/job/PreCommit-RATIS-Build/472/console | | Powered by | Apache Yetus 0.5.0 http://yetus.apache.org | This message was automatically generated. > Tolerate partially written log header > ------------------------------------- > > Key: RATIS-377 > URL: https://issues.apache.org/jira/browse/RATIS-377 > Project: Ratis > Issue Type: Bug > Affects Versions: 0.3.0 > Reporter: Nilotpal Nandi > Assignee: Tsz Wo Nicholas Sze > Priority: Blocker > Attachments: r377_20181028c.patch > > > steps taken : > ------------------ > # wrote 5GB files through ozonefs > # stopped datanodes, scm , om. > # started all services. > # Tried to read the file. > One of the datanodes failed to start. Throwing > "java.lang.IllegalStateException: Corrupted log header" > > {noformat} > 2018-10-26 10:26:01,317 ERROR org.apache.ratis.server.storage.LogInputStream: > caught exception initializing log_inprogress_293 > java.lang.IllegalStateException: Corrupted log header: ^@^@^@^@^@^@^@^@ > at org.apache.ratis.util.Preconditions.assertTrue(Preconditions.java:60) > at > org.apache.ratis.server.storage.LogInputStream.init(LogInputStream.java:93) > at > org.apache.ratis.server.storage.LogInputStream.nextEntry(LogInputStream.java:120) > at > org.apache.ratis.server.storage.LogSegment.readSegmentFile(LogSegment.java:111) > at > org.apache.ratis.server.storage.LogSegment.loadSegment(LogSegment.java:133) > at > org.apache.ratis.server.storage.RaftLogCache.loadSegment(RaftLogCache.java:110) > at > org.apache.ratis.server.storage.SegmentedRaftLog.loadLogSegments(SegmentedRaftLog.java:151) > at > org.apache.ratis.server.storage.SegmentedRaftLog.open(SegmentedRaftLog.java:120) > at org.apache.ratis.server.impl.ServerState.initLog(ServerState.java:191) > at org.apache.ratis.server.impl.ServerState.<init>(ServerState.java:114) > at > org.apache.ratis.server.impl.RaftServerImpl.<init>(RaftServerImpl.java:106) > at > org.apache.ratis.server.impl.RaftServerProxy.lambda$newRaftServerImpl$2(RaftServerProxy.java:196) > at > java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590) > at > java.util.concurrent.CompletableFuture$AsyncSupply.exec(CompletableFuture.java:1582) > at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) > at > java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) > at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) > at > java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:157) > 2018-10-26 10:26:03,671 INFO > org.apache.hadoop.ozone.web.netty.ObjectStoreRestHttpServer: Listening HDDS > REST traffic on /0.0.0.0:9880 > 2018-10-26 10:26:03,672 INFO org.apache.hadoop.ozone.HddsDatanodeService: > Started plug-in org.apache.hadoop.ozone.web.OzoneHddsDatanodeService@1e411d81 > 2018-10-26 10:26:03,676 INFO > org.apache.hadoop.ozone.container.ozoneimpl.OzoneContainer: Attempting to > start container services. > 2018-10-26 10:26:03,676 INFO > org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis: > Starting XceiverServerRatis 0d7f5327-df16-40fe-ac88-7ed06e76a20f at port 9858 > 2018-10-26 10:26:03,702 ERROR > org.apache.hadoop.ozone.container.common.statemachine.DatanodeStateMachine: > Unable to start the DatanodeState Machine > java.io.IOException: java.lang.IllegalStateException: Corrupted log header: > ^@^@^@^@^@^@^@^@ > at org.apache.ratis.util.IOUtils.asIOException(IOUtils.java:51) > at > org.apache.ratis.server.storage.LogInputStream.nextEntry(LogInputStream.java:123) > at > org.apache.ratis.server.storage.LogSegment.readSegmentFile(LogSegment.java:111) > at > org.apache.ratis.server.storage.LogSegment.loadSegment(LogSegment.java:133) > at > org.apache.ratis.server.storage.RaftLogCache.loadSegment(RaftLogCache.java:110) > at > org.apache.ratis.server.storage.SegmentedRaftLog.loadLogSegments(SegmentedRaftLog.java:151) > at > org.apache.ratis.server.storage.SegmentedRaftLog.open(SegmentedRaftLog.java:120) > at org.apache.ratis.server.impl.ServerState.initLog(ServerState.java:191) > at org.apache.ratis.server.impl.ServerState.<init>(ServerState.java:114) > at > org.apache.ratis.server.impl.RaftServerImpl.<init>(RaftServerImpl.java:106) > at > org.apache.ratis.server.impl.RaftServerProxy.lambda$newRaftServerImpl$2(RaftServerProxy.java:196) > at > java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590) > at > java.util.concurrent.CompletableFuture$AsyncSupply.exec(CompletableFuture.java:1582) > at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) > at > java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) > at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) > at > java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:157) > Caused by: java.lang.IllegalStateException: Corrupted log header: > ^@^@^@^@^@^@^@^@ > at org.apache.ratis.util.Preconditions.assertTrue(Preconditions.java:60) > at > org.apache.ratis.server.storage.LogInputStream.init(LogInputStream.java:93) > at > org.apache.ratis.server.storage.LogInputStream.nextEntry(LogInputStream.java:120) > ... 15 more > 2018-10-26 10:26:03,703 ERROR org.apache.hadoop.ozone.HddsDatanodeService: > Exception in HddsDatanodeService. > java.lang.NullPointerException > at > org.apache.hadoop.ozone.container.common.statemachine.DatanodeStateMachine.join(DatanodeStateMachine.java:331) > at > org.apache.hadoop.ozone.HddsDatanodeService.join(HddsDatanodeService.java:191) > at > org.apache.hadoop.ozone.HddsDatanodeService.main(HddsDatanodeService.java:250) > 2018-10-26 10:26:03,706 INFO org.apache.hadoop.util.ExitUtil: Exiting with > status 1: java.lang.NullPointerException > 2018-10-26 10:26:03,714 WARN org.apache.hadoop.fs.CachingGetSpaceUsed: Thread > Interrupted waiting to refresh disk information: sleep interrupted > 2018-10-26 10:26:03,715 INFO org.apache.hadoop.ozone.HddsDatanodeService: > SHUTDOWN_MSG: > /************************************************************ > SHUTDOWN_MSG: Shutting down HddsDatanodeService at > ctr-e138-1518143905142-541661-01-000005.hwx.site/172.27.68. > {noformat} > -- This message was sent by Atlassian JIRA (v7.6.3#76005)