Ahhh - no need to send the logs now. Totally understand. We need to do something for your case for sure. We should startup and just have some sort of ghost/placeholder processor in the flow and prompt the user to select a new one.
https://issues.apache.org/jira/browse/NIFI-1052 On Wed, Oct 21, 2015 at 9:19 PM, Sumanth Chinthagunta <xmlk...@gmail.com> wrote: > My case is simple and easy to reproduce: > 1. Create a flow with custom processor (e.g. abc.MyProcesser ) > 2. Make sure flow is working. Then stop the server. > 3. Replace nar in lib with new nar after refactoring processor's package ( > e.g., xzy.MyProcesser) > 4. When you try to start nifi , it fails with error in the log saying class > not found ( obviously coz deployed flow is still looking for old class) > > My expectation is system should at least start and only throw error when > user try to start a flow that that had reference to class(processor) which > is no more available in the newly deployed nar. > I can send the my error log tonight > > On Wed, Oct 21, 2015, 5:58 PM Joe Witt <joe.w...@gmail.com> wrote: > >> Sumanth, >> >> Do you happen to still have the stack traces around? Unless we do >> some breaking/API unfriendly thing such issues should simply not >> occur. Want to make sure we understand what is happening here. >> >> Thanks >> Joe >> >> On Wed, Oct 21, 2015 at 8:56 PM, Sumanth Chinthagunta <xmlk...@gmail.com> >> wrote: >> > I noticed similar error when I have my flow using older version of a >> custom >> > nar and when I deployed new version of nar with package refactoring. >> > My workaround to bring the server back is to redeploy old nar, start nifi >> > and delete the flow then recreate the flow after deploying refactored >> nar. >> > Nifi should start even a nar file is replaced or removed. >> > >> > On Wed, Oct 21, 2015, 9:21 AM Joe Witt <joe.w...@gmail.com> wrote: >> > >> >> Ok so in seeing this part of the stackdump we know there is a >> >> 'classpath thing' going on >> >> >> >> "Caused by: java.lang.ClassNotFoundException: >> >> org.mitre.nifi.NiFiNITFReader" >> >> >> >> And we see from your provided info that your jar does contain such a >> class >> >> >> >> "22243 Wed Oct 21 10:36:46 EDT 2015 >> org/mitre/nifi/NiFiNITFReader.class" >> >> >> >> And we see that you have a service loader manifest >> >> >> >> "808 Wed Oct 21 10:36:42 EDT 2015 >> >> META-INF/services/org.apache.nifi.processor.Processor" >> >> >> >> QUESTIONS: >> >> ------------------- >> >> Can you please provide content of that service manifest file? >> >> >> >> Also can you please provide the log information that writes out on >> >> startup which shows the processors/extensions that load? >> >> >> >> It looks like this... >> >> >> >> 2015-10-21 09:20:32,520 INFO [main] >> >> org.apache.nifi.nar.ExtensionManager Extension Type Mapping to >> >> Classloader: >> >> === ProvenanceEventRepository type || Classloader === >> >> org.apache.nifi.provenance.PersistentProvenanceRepository || >> >> >> >> >> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-provenance-repository-nar-0.3.1-SNAPSHOT.nar-unpacked] >> >> org.apache.nifi.provenance.VolatileProvenanceRepository || >> >> >> >> >> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-provenance-repository-nar-0.3.1-SNAPSHOT.nar-unpacked] >> >> === End ProvenanceEventRepository types === >> >> === Processor type || Classloader === >> >> org.apache.nifi.processors.hl7.RouteHL7 || >> >> >> >> >> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-hl7-nar-0.3.1-SNAPSHOT.nar-unpacked] >> >> org.apache.nifi.processors.standard.MergeContent || >> >> >> >> >> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-standard-nar-0.3.1-SNAPSHOT.nar-unpacked] >> >> org.apache.nifi.processors.standard.EncryptContent || >> >> >> >> >> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-standard-nar-0.3.1-SNAPSHOT.nar-unpacked] >> >> org.apache.nifi.processors.aws.s3.PutS3Object || >> >> >> >> >> org.apache.nifi.nar.NarClassLoader[./work/nar/extensions/nifi-aws-nar-0.3.1-SNAPSHOT.nar-unpacked] >> >> ..... >> >> >> >> >> >> Thanks! >> >> Joe >> >> >> >> On Wed, Oct 21, 2015 at 8:51 AM, Jones, Patrick L. <p...@mitre.org> >> wrote: >> >> > Howdy, >> >> > >> >> > I have created my own processor which I have been >> testing >> >> with NiFi for a while now. This stuff used to work for me, now it >> doesn't. >> >> Today nifi won't start. The nifi-app.log is below >> >> > The processor reads in an image type NITF and does a few things with >> >> it. I do a: >> >> > $ mvn install >> >> > >> >> > from ~/nifi-0.3.0/nifi-mitre-bundle/ which is where my software is. I >> >> then >> >> > $ cp >> >> >> ~/nifi-0.3.0/nifi-mitre-bundle/nifi-mitre-nar/target/nifi-mitre-nar-1.0-SNAPSHOT.nar >> >> ../lib/ >> >> > >> >> > When I start nifi the nifi-app.log shows the below exception with the >> >> bottom line being >> >> > Caused by: java.lang.ClassNotFoundException: >> >> org.mitre.nifi.NiFiNITFReader >> >> > >> >> > I looked in my lib/nifi-mitre-nar-1.0-SNAPSHOT.nar it contains >> >> > 0 Wed Oct 21 10:36:50 EDT 2015 META-INF/ >> >> > 152 Wed Oct 21 10:36:48 EDT 2015 META-INF/MANIFEST.MF >> >> > 0 Wed Oct 21 10:36:48 EDT 2015 META-INF/bundled-dependencies/ >> >> > ... >> >> > 22201 Wed Oct 21 10:36:48 EDT 2015 >> >> META-INF/bundled-dependencies/nifi-mitre-processors-1.0-SNAPSHOT.jar >> >> > ... >> >> > 2963 Wed Oct 21 10:36:48 EDT 2015 META-INF/DEPENDENCIES >> >> > 11358 Wed Oct 21 10:36:48 EDT 2015 META-INF/LICENSE >> >> > 155 Wed Oct 21 10:36:48 EDT 2015 META-INF/NOTICE >> >> > 0 Wed Oct 21 10:36:50 EDT 2015 META-INF/maven/ >> >> > 0 Wed Oct 21 10:36:50 EDT 2015 META-INF/maven/mitre/ >> >> > 0 Wed Oct 21 10:36:50 EDT 2015 >> META-INF/maven/mitre/nifi-mitre-nar/ >> >> > 1562 Fri Oct 09 11:19:10 EDT 2015 >> >> META-INF/maven/mitre/nifi-mitre-nar/pom.xml >> >> > 111 Wed Oct 21 10:36:48 EDT 2015 >> >> META-INF/maven/mitre/nifi-mitre-nar/pom.properties >> >> > >> >> > I then unjarred the .nar file and looked at >> >> META-INF/bundled-dependencies/nifi-mitre-processors-1.0-SNAPSHOT.jar >> >> > >> >> > $ jar tvf >> >> >> ~/dum/META-INF/bundled-dependencies/nifi-mitre-processors-1.0-SNAPSHOT.jar >> >> > 0 Wed Oct 21 10:36:48 EDT 2015 META-INF/ >> >> > 412 Wed Oct 21 10:36:46 EDT 2015 META-INF/MANIFEST.MF >> >> > 0 Wed Oct 21 10:36:42 EDT 2015 META-INF/services/ >> >> > 0 Wed Oct 21 10:36:44 EDT 2015 org/ >> >> > 0 Wed Oct 21 10:36:44 EDT 2015 org/mitre/ >> >> > 0 Wed Oct 21 10:36:46 EDT 2015 org/mitre/nifi/ >> >> > 2730 Wed Oct 21 10:36:42 EDT 2015 META-INF/DEPENDENCIES >> >> > 11358 Wed Oct 21 10:36:42 EDT 2015 META-INF/LICENSE >> >> > 162 Wed Oct 21 10:36:42 EDT 2015 META-INF/NOTICE >> >> > 808 Wed Oct 21 10:36:42 EDT 2015 >> >> META-INF/services/org.apache.nifi.processor.Processor >> >> > 2796 Wed Oct 21 10:36:46 EDT 2015 >> org/mitre/nifi/NiFiNITFReader$1.class >> >> > 2025 Wed Oct 21 10:36:44 EDT 2015 >> org/mitre/nifi/NITFNiFiIoReader.class >> >> > 22243 Wed Oct 21 10:36:46 EDT 2015 org/mitre/nifi/NiFiNITFReader.class >> >> > 0 Wed Oct 21 10:36:48 EDT 2015 META-INF/maven/ >> >> > 0 Wed Oct 21 10:36:48 EDT 2015 META-INF/maven/mitre/ >> >> > 0 Wed Oct 21 10:36:48 EDT 2015 >> >> META-INF/maven/mitre/nifi-mitre-processors/ >> >> > 4053 Wed Oct 14 11:23:52 EDT 2015 >> >> META-INF/maven/mitre/nifi-mitre-processors/pom.xml >> >> > 118 Wed Oct 21 10:36:48 EDT 2015 >> >> META-INF/maven/mitre/nifi-mitre-processors/pom.properties >> >> > >> >> > I see org/mitre/nifi/NiFiNITFReader.class in the jar file. >> >> > >> >> > Any thoughts on what the problem is? >> >> > >> >> > Thank you >> >> > >> >> > Patrick Jones >> >> > >> >> > >> >> > >> >> > ------------- nifi-app.log --- >> >> > ... >> >> > 2015-10-21 10:44:44,147 INFO [main] >> >> o.a.n.w.c.ApplicationStartupContextListener Starting Flow Controller... >> >> > 2015-10-21 10:44:44,484 WARN [main] >> >> o.a.nifi.fingerprint.FingerprintFactory Unable to create Processor of >> type >> >> org.mitre.nifi.NiFiNITFReader due to >> >> org.apache.nifi.controller.exception.ProcessorInstantiationException: >> >> org.mitre.nifi.NiFiNITFReader; its default properties will be >> fingerprinted >> >> instead of being ignored. >> >> > 2015-10-21 10:44:44,536 WARN [main] >> >> o.a.nifi.fingerprint.FingerprintFactory Unable to create Processor of >> type >> >> org.mitre.nifi.NiFiNITFReader due to >> >> org.apache.nifi.controller.exception.ProcessorInstantiationException: >> >> org.mitre.nifi.NiFiNITFReader; its default properties will be >> fingerprinted >> >> instead of being ignored. >> >> > 2015-10-21 10:44:44,607 INFO [main] >> >> o.a.n.c.s.StandardControllerServiceProvider No Controller Services to >> enable >> >> > 2015-10-21 10:44:44,703 WARN [main] >> >> org.eclipse.jetty.webapp.WebAppContext Failed startup of context >> >> o.e.j.w.WebAppContext@59d5a6fd >> >> >> {/nifi-api,file:/home/plj/nifi-0.3.0/work/jetty/nifi-web-api-0.3.0.war/webapp/,STARTING}{./work/nar/framework/nifi-framework-nar-0.3.0.nar-unpacked/META-INF/bundled-dependencies/nifi-web-api-0.3.0.war} >> >> > org.apache.nifi.controller.FlowSynchronizationException: >> >> org.apache.nifi.controller.exception.ProcessorInstantiationException: >> >> org.mitre.nifi.NiFiNITFReader >> >> > at >> >> >> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:317) >> >> ~[nifi-framework-core-0.3.0.jar:0.3.0] >> >> > at >> >> >> org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1160) >> >> ~[nifi-framework-core-0.3.0.jar:0.3.0] >> >> > ... >> >> > at org.apache.nifi.NiFi.main(NiFi.java:227) >> >> [nifi-runtime-0.3.0.jar:0.3.0] >> >> > Caused by: >> >> org.apache.nifi.controller.exception.ProcessorInstantiationException: >> >> org.mitre.nifi.NiFiNITFReader >> >> > at >> >> >> org.apache.nifi.controller.FlowController.instantiateProcessor(FlowController.java:864) >> >> ~[nifi-framework-core-0.3.0.jar:0.3.0] >> >> > ... >> >> > ... 27 common frames omitted >> >> > Caused by: java.lang.ClassNotFoundException: >> >> org.mitre.nifi.NiFiNITFReader >> >> > at >> >> java.net.URLClassLoader.findClass(URLClassLoader.java:381) >> ~[na:1.8.0_60] >> >> > ... >> >> > at >> >> >> org.apache.nifi.controller.FlowController.instantiateProcessor(FlowController.java:850) >> >> ~[nifi-framework-core-0.3.0.jar:0.3.0] >> >> > ... 30 common frames omitted >> >> > 2015-10-21 10:44:45,345 INFO [main] >> >> o.e.jetty.server.handler.ContextHandler Started >> >> o.e.j.w.WebAppContext@5fd8dd66 >> >> {/nifi-content-viewer,file:/home/plj/nifi-... >> >> > 2015-10-21 10:44:45,631 INFO [main] org.eclipse.jetty.server.Server >> >> Started @33273ms >> >> > 2015-10-21 10:44:45,644 WARN [main] >> >> org.apache.nifi.web.server.JettyServer Failed to start web server... >> >> shutting down. >> >> > org.apache.nifi.controller.FlowSynchronizationException: >> >> org.apache.nifi.controller.exception.ProcessorInstantiationException: >> >> org.mitre.nifi.NiFiNITFReader >> >> > at >> >> >> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:317) >> >> ~[nifi-framework-core-0.3.0.jar:0.3.0] >> >> > ... >> >> > at org.apache.nifi.NiFi.<init>(NiFi.java:137) >> >> [nifi-runtime-0.3.0.jar:0.3.0] >> >> > at org.apache.nifi.NiFi.main(NiFi.java:227) >> >> [nifi-runtime-0.3.0.jar:0.3.0] >> >> > Caused by: >> >> org.apache.nifi.controller.exception.ProcessorInstantiationException: >> >> org.mitre.nifi.NiFiNITFReader >> >> > at >> >> >> org.apache.nifi.controller.FlowController.instantiateProcessor(FlowController.java:864) >> >> ~[nifi-framework-core-0.3.0.jar:0.3.0] >> >> > ... >> >> > at >> >> >> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:271) >> >> ~[nifi-framework-core-0.3.0.jar:0.3.0] >> >> > ... 27 common frames omitted >> >> > Caused by: java.lang.ClassNotFoundException: >> >> org.mitre.nifi.NiFiNITFReader >> >> > at >> >> java.net.URLClassLoader.findClass(URLClassLoader.java:381) >> ~[na:1.8.0_60] >> >> > at >> java.lang.ClassLoader.loadClass(ClassLoader.java:424) >> >> ~[na:1.8.0_60] >> >> > at >> java.lang.ClassLoader.loadClass(ClassLoader.java:357) >> >> ~[na:1.8.0_60] >> >> > at java.lang.Class.forName0(Native Method) >> ~[na:1.8.0_60] >> >> > at java.lang.Class.forName(Class.java:264) >> ~[na:1.8.0_60] >> >> > at >> >> >> org.apache.nifi.controller.FlowController.instantiateProcessor(FlowController.java:850) >> >> ~[nifi-framework-core-0.3.0.jar:0.3.0] >> >> > ... 30 common frames omitted >> >> > 2015-10-21 10:44:45,650 INFO [Thread-1] org.apache.nifi.NiFi >> Initiating >> >> shutdown of Jetty web server... >> >> >>
