Good point there James. Phil definitely give that a look. Those commands need to be run on the repository at the right time as well so it doesn't import with the wrong line endings.
>From our github automated builds we have at: https://github.com/apache/nifi/blob/main/.github/workflows/ci-workflow.yml Here are key things to execute to run like we do there: git config --global core.autocrlf false git config --global core.longpaths true Checkout Code DEFAULT_MAVEN_OPTS: >- -Xmx3g -XX:ReservedCodeCacheSize=1g -XX:+UseG1GC -Dorg.slf4j.simpleLogger.defaultLogLevel=WARN -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false mvn package verify -P contrib-check -P include-grpc -P skip-nifi-bin-assembly On Tue, Apr 5, 2022 at 2:31 PM James Srinivasan <james.sriniva...@gmail.com> wrote: > Possibly not your problem, but did you follow the instructions for building > on Windows here: > > https://nifi.apache.org/quickstart.html > > On Tue, 5 Apr 2022, 12:42 Phil H, <gippyp...@gmail.com> wrote: > > > Okay, I started over with a completely new local repo. This is the exact > > sequence of commands I ran: > > > > $ git clone https://github.com/apache/nifi.git > > $ cd nifi > > $ git remote add upstream https://github.com/apache/nifi.git > > $ git clean -fxd > > $ mvn clean package verify -Pcontrib-check,include-grpc > > > > And after about 12 minutes: > > > > [ERROR] Failed to execute goal > > org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M5:test > (default-test) > > on project nifi-web-security: There are test failures. > > [ERROR] > > [ERROR] Please refer to > > > > > D:\nifi\nifi-nar-bundles\nifi-framework-bundle\nifi-framework\nifi-web\nifi-web-security\target\surefire-reports > > for the individual test results. > > [ERROR] Please refer to dump files (if any exist) [date].dump, > > [date]-jvmRun[N].dump and [date].dumpstream. > > > > The contents of the dumpfile at that location is: > > > > # Created at 2022-04-05T21:05:18.979 > > Boot Manifest-JAR contains absolute paths in classpath > > > > > 'D:\nifi\nifi-nar-bundles\nifi-framework-bundle\nifi-framework\nifi-web\nifi-web-security\target\test-classes' > > Hint: > > <argLine>-Djdk.net.URLClassPath.disableClassPathURLCheck=true</argLine> > > > > I'm sure there's some obvious mistake I'm making, or piece of > information I > > am missing, but I have no idea what they are! > > > > Thanks > > Phil > > > > On Tue, Apr 5, 2022 at 12:53 AM Joe Witt <joe.w...@gmail.com> wrote: > > > > > Phil > > > > > > I think you need to run 'git clean -fxd' from the nifi source root. > > > > > > Then try the build again. And allow the entire thing to run. > > > > > > Too many builds in different levels are leaving things around. > > > > > > Thanks > > > > > > On Mon, Apr 4, 2022 at 7:46 AM Phil H <gippyp...@gmail.com> wrote: > > > > > > > So, about that error that flashed past... > > > > > > > > [INFO] > > > > > > ------------------------------------------------------------------------ > > > > [INFO] BUILD FAILURE > > > > [INFO] > > > > > > ------------------------------------------------------------------------ > > > > [INFO] Total time: 22:21 min (Wall Clock) > > > > [INFO] Finished at: 2022-04-05T00:37:46+10:00 > > > > [INFO] > > > > > > ------------------------------------------------------------------------ > > > > [ERROR] Failed to execute goal > > > org.apache.rat:apache-rat-plugin:0.13:check > > > > (default) on project nifi-poi-processors: Too many files with > > unapproved > > > > license: 1 See RAT report in: > > > > > > > > > > > > > > D:\nifi.github\nifi\nifi-nar-bundles\nifi-poi-bundle\nifi-poi-processors\target\rat.txt > > > > -> [Help 1] > > > > > > > > The rat file contains the following: > > > > > > > > ***************************************************** > > > > Summary > > > > ------- > > > > Generated at: 2022-04-05T00:33:56+10:00 > > > > > > > > Notes: 0 > > > > Binaries: 4 > > > > Archives: 0 > > > > Standards: 7 > > > > > > > > Apache Licensed: 6 > > > > Generated Documents: 0 > > > > > > > > JavaDocs are generated, thus a license header is optional. > > > > Generated files do not require license headers. > > > > > > > > 1 Unknown Licenses > > > > > > > > ***************************************************** > > > > > > > > Files with unapproved licenses: > > > > > > > > > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > > > > > > > > ***************************************************** > > > > > > > > ***************************************************** > > > > Files with Apache License headers will be marked AL > > > > Binary files (which do not require any license headers) will be > > marked > > > B > > > > Compressed archives will be marked A > > > > Notices, licenses etc. will be marked N > > > > AL > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/pom.xml > > > > AL > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessor.java > > > > AL > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/docs/org.apache.nifi.processors.poi.ConvertExcelToCSVProcessor/additionalDetails.html > > > > AL > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/META-INF/services/org.apache.nifi.processor.Processor > > > > AL > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessorTest.java > > > > B > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/CollegeScorecard.xlsx > > > > B > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/dataformatting.xlsx > > > > AL > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/logback-test.xml > > > > B > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/TwoSheets.xlsx > > > > !????? > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > > > > B > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/with-blank-cells.xlsx > > > > > > > > ***************************************************** > > > > > > > > Printing headers for text files without a valid license header... > > > > > > > > ===================================================== > > > > == File: > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > > > > ===================================================== > > > > -- some binary stuff -- > > > > > > > > > > > > On Tue, Apr 5, 2022 at 12:30 AM Phil H <gippyp...@gmail.com> wrote: > > > > > > > > > Thanks Joe, it seems to be about half way through now - much > further > > > than > > > > > previously. I thought I saw some red text flash past, but nothing > > > > > stopped. Does one of those switches you suggested pile all the bad > > > news > > > > up > > > > > to deliver at the end, or can maven have "red errors" that aren't > > > > terminal? > > > > > > > > > > TIA, > > > > > Phil > > > > > > > > > > On Mon, Apr 4, 2022 at 11:48 PM Joe Witt <joe.w...@gmail.com> > wrote: > > > > > > > > > >> Phil > > > > >> > > > > >> Here is a command I commonly run to ensure I have nothing other > than > > > > >> what the source tree intends. > > > > >> > > > > >> mvn -T C1 clean package verify -Pcontrib-check,include-grpc > > > > >> > > > > >> This will do everything - build it all, run contrib check, and use > > all > > > > the > > > > >> cores. > > > > >> > > > > >> Thanks > > > > >> > > > > >> On Mon, Apr 4, 2022 at 6:38 AM Mike Thomsen < > mikerthom...@gmail.com > > > > > > > >> wrote: > > > > >> > > > > >> > Did you run "mvn install" from the root of the project before > > > > >> > attempting to run a full test of the code base? > > > > >> > > > > > >> > On Mon, Apr 4, 2022 at 9:36 AM Phil H <gippyp...@gmail.com> > > wrote: > > > > >> > > > > > > >> > > Hi there, > > > > >> > > > > > > >> > > So I got past this issue by running "mvn test" from the root > of > > > the > > > > >> nifi > > > > >> > > tree. After much compiling and testing, I am now getting the > > > > attached > > > > >> > > error. I think I am following the contributor guide in having > > my > > > > >> local > > > > >> > > branch track origin/main (currently "4a90334728: NIFI-9846 > > > Implement > > > > >> > > pagination listing for Azure List processors"). > > > > >> > > > > > > >> > > Is this some environmental issue on my machine somehow? Or > does > > > the > > > > >> main > > > > >> > > branch contain compilation errors, and I should be tracking > > > > something > > > > >> > else > > > > >> > > for my own branch? As I said in my previous email, I am new > to > > > > >> github, > > > > >> > so > > > > >> > > I'm not sure of the conventions there. > > > > >> > > > > > > >> > > Thanks in advance > > > > >> > > Phil > > > > >> > > > > > > >> > > (PS: this occur whethers I use JDK1.8 or JDK11, the two > options > > I > > > > have > > > > >> > > installed) > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > [ERROR] Failed to execute goal > > > > >> > > org.apache.maven.plugins:maven-compiler-plugin:3.9.0:compile > > > > >> > > (default-compile) on project nifi-h2-database-migrator: > > > Compilation > > > > >> > > failure: Compilation failure: > > > > >> > > [ERROR] > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[19,35] > > > > >> > > error: package org.apache.nifi.org.h2.jdbcx does not exist > > > > >> > > [ERROR] > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,8] > > > > >> > > error: cannot find symbol > > > > >> > > [ERROR] symbol: class JdbcDataSource > > > > >> > > [ERROR] location: class H2DatabaseMigrator > > > > >> > > [ERROR] > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,49] > > > > >> > > error: cannot find symbol > > > > >> > > [ERROR] symbol: class JdbcDataSource > > > > >> > > [ERROR] location: class H2DatabaseMigrator > > > > >> > > > > > > >> > > On Sat, Apr 2, 2022 at 10:20 PM Phil H <gippyp...@gmail.com> > > > wrote: > > > > >> > > > > > > >> > > > Hi there, > > > > >> > > > > > > > >> > > > Trying to build the nifi git repo for the first time and I'm > > > > getting > > > > >> > the > > > > >> > > > message below > > > > >> > > > > > > > >> > > > I'm used to working in offline development environments, so > > I'm > > > a > > > > >> bit > > > > >> > lost > > > > >> > > > with this online dependency stuff. I note that > > > > >> > > > https://repository.apache.org/snapshots/org/apache/nifi/ > > > doesn't > > > > >> > contain > > > > >> > > > any similar subdirectories to that in the URL. > > > > >> > > > > > > > >> > > > Help! > > > > >> > > > > > > > >> > > > Regards, > > > > >> > > > Phil > > > > >> > > > > > > > >> > > > [WARNING] The POM for > > > > >> org.apache.nifi:nifi-utils:jar:1.16.0-SNAPSHOT is > > > > >> > > > missing, no dependency information available > > > > >> > > > Downloading from apache.snapshots: > > > > >> > > > > > > > >> > > > > > >> > > > > > > > > > > https://repository.apache.org/snapshots/org/apache/nifi/nifi-utils/1.16.0-SNAPSHOT/nifi-utils-1.16.0-SNAPSHOT.jar > > > > >> > > > [INFO] > > > > >> > > > > > > > >> > > > > > > > ------------------------------------------------------------------------ > > > > >> > > > [INFO] Reactor Summary for nifi-standard-bundle > > 1.16.0-SNAPSHOT: > > > > >> > > > [INFO] > > > > >> > > > [INFO] nifi-standard-bundle ............................... > > > > SUCCESS > > > > >> > [01:07 > > > > >> > > > min] > > > > >> > > > [INFO] nifi-standard-utils ................................ > > > > FAILURE > > > > >> [ > > > > >> > > > 3.218 s] > > > > >> > > > [INFO] nifi-standard-processors ........................... > > > > SKIPPED > > > > >> > > > [INFO] nifi-standard-reporting-tasks ...................... > > > > SKIPPED > > > > >> > > > [INFO] nifi-standard-content-viewer ....................... > > > > SKIPPED > > > > >> > > > [INFO] nifi-jolt-transform-json-ui ........................ > > > > SKIPPED > > > > >> > > > [INFO] nifi-standard-nar .................................. > > > > SKIPPED > > > > >> > > > [INFO] > > > > >> > > > > > > > >> > > > > > > > ------------------------------------------------------------------------ > > > > >> > > > [INFO] BUILD FAILURE > > > > >> > > > [INFO] > > > > >> > > > > > > > >> > > > > > > > ------------------------------------------------------------------------ > > > > >> > > > [INFO] Total time: 01:43 min > > > > >> > > > [INFO] Finished at: 2022-04-02T21:58:47+10:00 > > > > >> > > > [INFO] > > > > >> > > > > > > > >> > > > > > > > ------------------------------------------------------------------------ > > > > >> > > > [ERROR] Failed to execute goal on project > nifi-standard-utils: > > > > Could > > > > >> > not > > > > >> > > > resolve dependencies for project > > > > >> > > > org.apache.nifi:nifi-standard-utils:jar:1.16.0-SNAPSHOT: > Could > > > not > > > > >> find > > > > >> > > > artifact org.apache.nifi:nifi-utils:jar:1.16.0-SNAPSHOT in > > > > >> > apache.snapshots > > > > >> > > > (https://repository.apache.org/snapshots) -> [Help 1] > > > > >> > > > > > > > >> > > > > > >> > > > > > > > > > > > > > > >
