Thanks Joe, what you described might be the cause. Good to know that, this is
being addressed in 1.2.0.
On 4/16/17, 9:28 PM, "Joe Witt" <joe.w...@gmail.com> wrote:
Ravi,
Based on what you describe the only thing I could think of is that
there was a partial write that was interrupted by a hard/power
failure/disk unmount/etc.. that left the process having bytes needing
to be flushed to disk that never made it - or actual corruption. In
any event there is work underway and may even already be in
1.2.0/master line which helps be more tolerant.
On Sun, Apr 16, 2017 at 10:26 PM, Ravi Papisetti (rpapiset)
<rpapi...@cisco.com> wrote:
> No, NiFi partition is not full. I had to delete all repos to get it back
up.
>
>
>
> Thanks,
>
> Ravi Papisetti
>
>
>
> From: Joe Witt <joe.w...@gmail.com>
> Reply-To: "users@nifi.apache.org" <users@nifi.apache.org>
> Date: Friday, April 14, 2017 at 5:48 PM
> To: "users@nifi.apache.org" <users@nifi.apache.org>
> Subject: Re: NiFi failed to restart after power outage on server
>
>
>
> Hello
>
>
>
> Did the partition nifi use get full? We are making the error handling in
> such case more resilient as at time it can result in partial writes.
>
>
>
> Joe
>
>
>
> Thanks
>
> Joe
>
>
>
> On Apr 14, 2017 5:06 PM, "Ravi Papisetti (rpapiset)" <rpapi...@cisco.com>
> wrote:
>
> Hi,
>
>
>
> NiFi version: 1.1.2, Linux
>
>
>
> Last night nifi servers got restarted and unable to bring nifi service
back
> up. I saw this thread
>
https://community.hortonworks.com/questions/75280/why-does-my-minifi-flow-fail-to-run-when-turning-o.html,
> but don’t see any workaround for this.
>
>
>
> Below are log messages from nifi-app.log:
>
> 2017-04-14 05:52:09,988 WARN [main] org.apache.nifi.web.server.JettyServer
> Failed to start web server... shutting down.
>
> org.apache.nifi.web.NiFiCoreException: Unable to start Flow Controller.
>
> at
>
org.apache.nifi.web.contextlistener.ApplicationStartupContextListener.contextInitialized(ApplicationStartupContextListener.java:85)
> ~[na:na]
>
> at
>
org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:837)
> ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:533)
> ~[jetty-servlet-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:810)
> ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:345)
> ~[jetty-servlet-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1404)
> ~[jetty-webapp-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1366)
> ~[jetty-webapp-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:772)
> ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:262)
> ~[jetty-servlet-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
> org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:520)
> ~[jetty-webapp-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
> ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
> ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
> ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
> ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:106)
> ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
> ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:231)
> ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
> ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at org.eclipse.jetty.server.Server.start(Server.java:411)
> ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:106)
> ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
> ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at org.eclipse.jetty.server.Server.doStart(Server.java:378)
> ~[jetty-server-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
>
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517]
>
> at
> org.apache.nifi.web.server.JettyServer.start(JettyServer.java:675)
> ~[nifi-jetty-1.1.2.jar:1.1.2]
>
> at org.apache.nifi.NiFi.<init>(NiFi.java:156)
> [nifi-runtime-1.1.2.jar:1.1.2]
>
> at org.apache.nifi.NiFi.main(NiFi.java:262)
> [nifi-runtime-1.1.2.jar:1.1.2]
>
> Caused by: java.io.IOException: Expected to read a Sentinel Byte of '1'
but
> got a value of '0' instead
>
> at
>
org.apache.nifi.repository.schema.SchemaRecordReader.readRecord(SchemaRecordReader.java:65)
> ~[nifi-schema-utils-1.1.2.jar:1.1.2]
>
> at
>
org.apache.nifi.controller.repository.SchemaRepositoryRecordSerde.deserializeRecord(SchemaRepositoryRecordSerde.java:111)
> ~[nifi-framework-core-1.1.2.jar:1.1.2]
>
> at
>
org.apache.nifi.controller.repository.SchemaRepositoryRecordSerde.deserializeEdit(SchemaRepositoryRecordSerde.java:105)
> ~[nifi-framework-core-1.1.2.jar:1.1.2]
>
> at
>
org.apache.nifi.controller.repository.SchemaRepositoryRecordSerde.deserializeEdit(SchemaRepositoryRecordSerde.java:46)
> ~[nifi-framework-core-1.1.2.jar:1.1.2]
>
> at
>
org.wali.MinimalLockingWriteAheadLog$Partition.recoverNextTransaction(MinimalLockingWriteAheadLog.java:1072)
> ~[nifi-write-ahead-log-1.1.2.jar:1.1.2]
>
> at
>
org.wali.MinimalLockingWriteAheadLog.recoverFromEdits(MinimalLockingWriteAheadLog.java:459)
> ~[nifi-write-ahead-log-1.1.2.jar:1.1.2]
>
> at
>
org.wali.MinimalLockingWriteAheadLog.recoverRecords(MinimalLockingWriteAheadLog.java:301)
> ~[nifi-write-ahead-log-1.1.2.jar:1.1.2]
>
> at
>
org.apache.nifi.controller.repository.WriteAheadFlowFileRepository.loadFlowFiles(WriteAheadFlowFileRepository.java:346)
> ~[nifi-framework-core-1.1.2.jar:1.1.2]
>
> at
>
org.apache.nifi.controller.FlowController.initializeFlow(FlowController.java:700)
> ~[nifi-framework-core-1.1.2.jar:1.1.2]
>
> at
>
org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:701)
> ~[nifi-framework-core-1.1.2.jar:1.1.2]
>
> at
>
org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:508)
> ~[nifi-framework-core-1.1.2.jar:1.1.2]
>
>
>
> Appreciate any help on this issue.
>
>
>
> Thanks,
>
> Ravi Papisetti
>
>
