Hi Andrew, After changing the file I'm getting the following error. I changed the lines you indicated.
Failed to auto configure default logger context Reported exception: ch.qos.logback.core.joran.spi.JoranException: Problem parsing XML document. See previously reported errors. at ch.qos.logback.core.joran.event.SaxEventRecorder.recordEvents(SaxEventRecorder.java:67) at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:134) at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:99) at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:49) at ch.qos.logback.classic.util.ContextInitializer.configureByResource(ContextInitializer.java:77) at ch.qos.logback.classic.util.ContextInitializer.autoConfig(ContextInitializer.java:152) at org.slf4j.impl.StaticLoggerBinder.init(StaticLoggerBinder.java:85) at org.slf4j.impl.StaticLoggerBinder.<clinit>(StaticLoggerBinder.java:55) at org.slf4j.LoggerFactory.bind(LoggerFactory.java:141) at org.slf4j.LoggerFactory.performInitialization(LoggerFactory.java:120) at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:331) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:283) at org.apache.nifi.bootstrap.RunNiFi.<init>(RunNiFi.java:117) at org.apache.nifi.bootstrap.RunNiFi.main(RunNiFi.java:199) Caused by: org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 1; Premature end of file. at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1239) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:642) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:326) at ch.qos.logback.core.joran.event.SaxEventRecorder.recordEvents(SaxEventRecorder.java:61) ... 13 more 06:16:11,055 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy] 06:16:11,055 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml] 06:16:11,055 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [file:/home/ec2-user/nifi/conf/logback.xml] 06:16:11,127 |-ERROR in ch.qos.logback.core.joran.event.SaxEventRecorder@682ea4b1 - XML_PARSING - Parsing fatal error on line 1 and column 1 org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 1; Premature end of file. at org.xml.sax.SAXParseException: Premature end of file. at at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(ErrorHandlerWrapper.java:198) at at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(ErrorHandlerWrapper.java:177) at at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:400) at at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:327) at at com.sun.org.apache.xerces.internal.impl.XMLScanner.reportFatalError(XMLScanner.java:1438) at at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:1019) at at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:606) at at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:118) at at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:510) at at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:848) at at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:777) at at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141) at at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213) at at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:642) at at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:326) at at ch.qos.logback.core.joran.event.SaxEventRecorder.recordEvents(SaxEventRecorder.java:61) at at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:134) at at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:99) at at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:49) at at ch.qos.logback.classic.util.ContextInitializer.configureByResource(ContextInitializer.java:77) at at ch.qos.logback.classic.util.ContextInitializer.autoConfig(ContextInitializer.java:152) at at org.slf4j.impl.StaticLoggerBinder.init(StaticLoggerBinder.java:85) at at org.slf4j.impl.StaticLoggerBinder.<clinit>(StaticLoggerBinder.java:55) at at org.slf4j.LoggerFactory.bind(LoggerFactory.java:141) at at org.slf4j.LoggerFactory.performInitialization(LoggerFactory.java:120) at at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:331) at at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:283) at at org.apache.nifi.bootstrap.RunNiFi.<init>(RunNiFi.java:117) at at org.apache.nifi.bootstrap.RunNiFi.main(RunNiFi.java:199) On Mon, Jun 6, 2016 at 4:10 PM Andrew Psaltis <psaltis.and...@gmail.com> wrote: > Hi Stephane, > In the conf directory of your nifi install there is a logback.xml file > that needs to be edited. This configuration file controls the internal > logging done by nifi. For each of the appenders you will see an XML > elements that reference the "logs" directory. For example here is the > config for the app.log > > <appender name="APP_FILE" > class="ch.qos.logback.core.rolling.RollingFileAppender"> > * <file>logs/nifi-app.log</file> <--- This should be changed* > <rollingPolicy > class="ch.qos.logback.core.rolling.TimeBasedRollingPolicy"> > <!-- > For daily rollover, use 'app_%d.log'. > For hourly rollover, use 'app_%d{yyyy-MM-dd_HH}.log'. > To GZIP rolled files, replace '.log' with '.log.gz'. > To ZIP rolled files, replace '.log' with '.log.zip'. > --> > * > <fileNamePattern>./logs/nifi-app_%d{yyyy-MM-dd_HH}.%i.log</fileNamePattern> > <--This should be changed* > <timeBasedFileNamingAndTriggeringPolicy > class="ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP"> > <maxFileSize>100MB</maxFileSize> > </timeBasedFileNamingAndTriggeringPolicy> > <!-- keep 30 log files worth of history --> > <maxHistory>30</maxHistory> > </rollingPolicy> > <encoder > class="ch.qos.logback.classic.encoder.PatternLayoutEncoder"> > <pattern>%date %level [%thread] %logger{40} %msg%n</pattern> > <immediateFlush>true</immediateFlush> > </encoder> > </appender> > > > You would want to change the references above in to your attached volume. > I have marked them with bold above. In the logback config file you will see > two other appenders as well, these same changes should be done there as > well. > > Thanks, > Andrew > > > On Mon, Jun 6, 2016 at 6:56 AM, Stéphane Maarek <stephane.maa...@gmail.com > > wrote: > >> Hi, >> >> I'm running NiFi on a t1.micro in AWS. I have attached a 100GB EBS volume >> at /mnt/xvdf and all the NiFi databases are there. I have a problem though. >> It seems that NiFi keeps an internal log and I can't change the position of >> it, so it's quickly clogging my t1.micro disk. See below. How can I improve >> / change that? And what's the "work" folder for? >> >> [ec2-user@ ~]$ du -s * >> 5271404 nifi >> [ec2-user@ ~]$ cd nifi >> [ec2-user@ nifi]$ du -s * >> 28 bin >> 756 conf >> 8412 docs >> 427468 lib >> 64 LICENSE >> 4331244 logs >> 44 NOTICE >> 8 README >> 144 state >> 503232 work >> >> >> Thanks! >> Stephane >> > > > > -- > Thanks, > Andrew > > Subscribe to my book: Streaming Data <http://manning.com/psaltis> > <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> > twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata> >