Ravi, Based on what you describe the only thing I could think of is that there was a partial write that was interrupted by a hard/power failure/disk unmount/etc.. that left the process having bytes needing to be flushed to disk that never made it - or actual corruption. In any event there is work underway and may even already be in 1.2.0/master line which helps be more tolerant.
On Sun, Apr 16, 2017 at 10:26 PM, Ravi Papisetti (rpapiset) <rpapi...@cisco.com> wrote: > No, NiFi partition is not full. I had to delete all repos to get it back up. > > > > Thanks, > > Ravi Papisetti > > > > From: Joe Witt <joe.w...@gmail.com> > Reply-To: "users@nifi.apache.org" <users@nifi.apache.org> > Date: Friday, April 14, 2017 at 5:48 PM > To: "users@nifi.apache.org" <users@nifi.apache.org> > Subject: Re: NiFi failed to restart after power outage on server > > > > Hello > > > > Did the partition nifi use get full? We are making the error handling in > such case more resilient as at time it can result in partial writes. > > > > Joe > > > > Thanks > > Joe > > > > On Apr 14, 2017 5:06 PM, "Ravi Papisetti (rpapiset)" <rpapi...@cisco.com> > wrote: > > Hi, > > > > NiFi version: 1.1.2, Linux > > > > Last night nifi servers got restarted and unable to bring nifi service back > up. I saw this thread > https://community.hortonworks.com/questions/75280/why-does-my-minifi-flow-fail-to-run-when-turning-o.html, > but don’t see any workaround for this. > > > > Below are log messages from nifi-app.log: > > 2017-04-14 05:52:09,988 WARN [main] org.apache.nifi.web.server.JettyServer > Failed to start web server... shutting down. > > org.apache.nifi.web.NiFiCoreException: Unable to start Flow Controller. > > at > org.apache.nifi.web.contextlistener.ApplicationStartupContextListener.contextInitialized(ApplicationStartupContextListener.java:85) > ~[na:na] > > at > org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:837) > ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:533) > ~[jetty-servlet-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:810) > ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:345) > ~[jetty-servlet-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1404) > ~[jetty-webapp-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1366) > ~[jetty-webapp-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:772) > ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:262) > ~[jetty-servlet-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:520) > ~[jetty-webapp-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132) > ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114) > ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61) > ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132) > ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:106) > ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61) > ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:231) > ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132) > ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517] > > at org.eclipse.jetty.server.Server.start(Server.java:411) > ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:106) > ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61) > ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517] > > at org.eclipse.jetty.server.Server.doStart(Server.java:378) > ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517] > > at > org.apache.nifi.web.server.JettyServer.start(JettyServer.java:675) > ~[nifi-jetty-1.1.2.jar:1.1.2] > > at org.apache.nifi.NiFi.<init>(NiFi.java:156) > [nifi-runtime-1.1.2.jar:1.1.2] > > at org.apache.nifi.NiFi.main(NiFi.java:262) > [nifi-runtime-1.1.2.jar:1.1.2] > > Caused by: java.io.IOException: Expected to read a Sentinel Byte of '1' but > got a value of '0' instead > > at > org.apache.nifi.repository.schema.SchemaRecordReader.readRecord(SchemaRecordReader.java:65) > ~[nifi-schema-utils-1.1.2.jar:1.1.2] > > at > org.apache.nifi.controller.repository.SchemaRepositoryRecordSerde.deserializeRecord(SchemaRepositoryRecordSerde.java:111) > ~[nifi-framework-core-1.1.2.jar:1.1.2] > > at > org.apache.nifi.controller.repository.SchemaRepositoryRecordSerde.deserializeEdit(SchemaRepositoryRecordSerde.java:105) > ~[nifi-framework-core-1.1.2.jar:1.1.2] > > at > org.apache.nifi.controller.repository.SchemaRepositoryRecordSerde.deserializeEdit(SchemaRepositoryRecordSerde.java:46) > ~[nifi-framework-core-1.1.2.jar:1.1.2] > > at > org.wali.MinimalLockingWriteAheadLog$Partition.recoverNextTransaction(MinimalLockingWriteAheadLog.java:1072) > ~[nifi-write-ahead-log-1.1.2.jar:1.1.2] > > at > org.wali.MinimalLockingWriteAheadLog.recoverFromEdits(MinimalLockingWriteAheadLog.java:459) > ~[nifi-write-ahead-log-1.1.2.jar:1.1.2] > > at > org.wali.MinimalLockingWriteAheadLog.recoverRecords(MinimalLockingWriteAheadLog.java:301) > ~[nifi-write-ahead-log-1.1.2.jar:1.1.2] > > at > org.apache.nifi.controller.repository.WriteAheadFlowFileRepository.loadFlowFiles(WriteAheadFlowFileRepository.java:346) > ~[nifi-framework-core-1.1.2.jar:1.1.2] > > at > org.apache.nifi.controller.FlowController.initializeFlow(FlowController.java:700) > ~[nifi-framework-core-1.1.2.jar:1.1.2] > > at > org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:701) > ~[nifi-framework-core-1.1.2.jar:1.1.2] > > at > org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:508) > ~[nifi-framework-core-1.1.2.jar:1.1.2] > > > > Appreciate any help on this issue. > > > > Thanks, > > Ravi Papisetti > >
