Re: Missing maven dependencies when building nifi
Phil, You're welcome. I have also updated the NiFi Contributor Guide to mention minimum supported versions: https://cwiki.apache.org/confluence/display/NIFI/Contributor+Guide The latest version of Java 8 is currently update 322. The automated builds on GitHub run on Azul Zulu and Eclipse Temurin. Any standard OpenJDK-derived version should work. Regards, David Handermann On Wed, Apr 6, 2022 at 2:31 PM Phil H wrote: > Much appreciated. If I am upgrading the JDK on this VM (which I will only > use for NiFi contributions) should I be moving to a more modern version, > and if so, what is recommended? > > On Wed, 6 Apr 2022 at 22:32, David Handermann > > wrote: > > > Updating the minimum Java version in the build configuration would be > > helpful, I will look into submitting a pull request to include this > check. > > > > Regards, > > David Handermann > > > > On Wed, Apr 6, 2022 at 7:23 AM Chakravarty, G > wrote: > > > > > Just wondering if Nifi runs through any pre-install checks like minimum > > > java version, OS etc. like many other software. Will be nice if it does > > > basic checks to prevent common install failures. > > > > > > From: David Handermann > > > Sent: Wednesday, April 6, 2022 8:11 AM > > > To: dev@nifi.apache.org > > > Subject: Re: Missing maven dependencies when building nifi > > > > > > Phil, > > > > > > Recent versions of NiFi require Java 8 Update 251 or newer in order to > > > support modern signing algorithms. Java 8 Update 171 and newer include > > the > > > unrestricted Java Cryptography Extension Policy. Upgrading to the > latest > > > Java 8 version should resolve the illegal key size issue shown in the > > > build. > > > > > > Regards, > > > David Handermann > > > > > > On Wed, Apr 6, 2022 at 6:16 AM Phil H wrote: > > > > > > > Australia. Never had any other issues with OpenSSL stuff, etc > > > > > > > > On Wed, 6 Apr 2022 at 21:11, Otto Fowler > > > wrote: > > > > > > > > > What country are you in? Are you under export controls? > > > > > > > > > > From: Phil H > > > > > Reply: dev@nifi.apache.org < > > dev@nifi.apache.org> > > > > > Date: April 6, 2022 at 07:08:45 > > > > > To: dev@nifi.apache.org > > > > > > Subject: Re: Missing maven dependencies when building nifi > > > > > > > > > > So, I restarted the whole process inside a CentOS VM. The only way > I > > > > could > > > > > get the build to complete was by using -DskipTests in the maven > > > command. > > > > > > > > > > Trying to run the built nifi fails after maybe 15 seconds (see > > below): > > > > > > > > > > [phil@localhost nifi-1.17.0-SNAPSHOT]$ bin/nifi.sh run > > > > > > > > > > Java home: /usr/java/jdk1.8.0_131/ > > > > > NiFi home: /home/phil/nifi-1.17.0-SNAPSHOT > > > > > > > > > > Bootstrap Config File: > > > > /home/phil/nifi-1.17.0-SNAPSHOT/conf/bootstrap.conf > > > > > > > > > > 2022-04-06 21:02:19,292 INFO [main] > org.apache.nifi.bootstrap.Command > > > > > Generating Self-Signed Certificate: Expires on 2022-06-05 > > > > > 2022-04-06 21:02:20,426 ERROR [main] > > org.apache.nifi.bootstrap.Command > > > > > Self-Signed Certificate Generation Failed > > > > > java.io.IOException: exception encrypting data - > > > > > java.security.InvalidKeyException: Illegal key size > > > > > at > > > > > > > > > > > > > > > > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.wrapKey(Unknown > > > > > > > > > > Source) > > > > > at > > > > > > > > > > > > > > > > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.doStore(Unknown > > > > > > > > > > Source) > > > > > at > > > > > > > > > > > > > > > > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.engineStore(Unknown > > > > > > > > > > Source) > > > > > at > > > > > > > > > >
Re: Missing maven dependencies when building nifi
Much appreciated. If I am upgrading the JDK on this VM (which I will only use for NiFi contributions) should I be moving to a more modern version, and if so, what is recommended? On Wed, 6 Apr 2022 at 22:32, David Handermann wrote: > Updating the minimum Java version in the build configuration would be > helpful, I will look into submitting a pull request to include this check. > > Regards, > David Handermann > > On Wed, Apr 6, 2022 at 7:23 AM Chakravarty, G wrote: > > > Just wondering if Nifi runs through any pre-install checks like minimum > > java version, OS etc. like many other software. Will be nice if it does > > basic checks to prevent common install failures. > > > > From: David Handermann > > Sent: Wednesday, April 6, 2022 8:11 AM > > To: dev@nifi.apache.org > > Subject: Re: Missing maven dependencies when building nifi > > > > Phil, > > > > Recent versions of NiFi require Java 8 Update 251 or newer in order to > > support modern signing algorithms. Java 8 Update 171 and newer include > the > > unrestricted Java Cryptography Extension Policy. Upgrading to the latest > > Java 8 version should resolve the illegal key size issue shown in the > > build. > > > > Regards, > > David Handermann > > > > On Wed, Apr 6, 2022 at 6:16 AM Phil H wrote: > > > > > Australia. Never had any other issues with OpenSSL stuff, etc > > > > > > On Wed, 6 Apr 2022 at 21:11, Otto Fowler > > wrote: > > > > > > > What country are you in? Are you under export controls? > > > > > > > > From: Phil H > > > > Reply: dev@nifi.apache.org < > dev@nifi.apache.org> > > > > Date: April 6, 2022 at 07:08:45 > > > > To: dev@nifi.apache.org > > > > Subject: Re: Missing maven dependencies when building nifi > > > > > > > > So, I restarted the whole process inside a CentOS VM. The only way I > > > could > > > > get the build to complete was by using -DskipTests in the maven > > command. > > > > > > > > Trying to run the built nifi fails after maybe 15 seconds (see > below): > > > > > > > > [phil@localhost nifi-1.17.0-SNAPSHOT]$ bin/nifi.sh run > > > > > > > > Java home: /usr/java/jdk1.8.0_131/ > > > > NiFi home: /home/phil/nifi-1.17.0-SNAPSHOT > > > > > > > > Bootstrap Config File: > > > /home/phil/nifi-1.17.0-SNAPSHOT/conf/bootstrap.conf > > > > > > > > 2022-04-06 21:02:19,292 INFO [main] org.apache.nifi.bootstrap.Command > > > > Generating Self-Signed Certificate: Expires on 2022-06-05 > > > > 2022-04-06 21:02:20,426 ERROR [main] > org.apache.nifi.bootstrap.Command > > > > Self-Signed Certificate Generation Failed > > > > java.io.IOException: exception encrypting data - > > > > java.security.InvalidKeyException: Illegal key size > > > > at > > > > > > > > > > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.wrapKey(Unknown > > > > > > > > Source) > > > > at > > > > > > > > > > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.doStore(Unknown > > > > > > > > Source) > > > > at > > > > > > > > > > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.engineStore(Unknown > > > > > > > > Source) > > > > at > > > > > > > > > > > > > > org.bouncycastle.jcajce.provider.keystore.util.AdaptingKeyStoreSpi.engineStore(Unknown > > > > > > > > Source) > > > > at java.security.KeyStore.store(KeyStore.java:1377) > > > > at > > > > > > > > > > > > > > org.apache.nifi.security.util.KeyStoreUtils.createKeyStoreAndGetX509Certificate(KeyStoreUtils.java:540) > > > > > > > > at > > > > > > > > > > > > > > org.apache.nifi.security.util.KeyStoreUtils.createTlsConfigAndNewKeystoreTruststore(KeyStoreUtils.java:228) > > > > > > > > at > > > > > > > > > > > > > > org.apache.nifi.bootstrap.util.SecureNiFiConfigUtil.configureSecureNiFiProperties(SecureNiFiConfigUtil.java:123) > > > > > > > > at org.apache.nifi.bootstrap.RunNiFi.start(RunNiFi.java:1249) > > > > at org.
Re: Missing maven dependencies when building nifi
Updating the minimum Java version in the build configuration would be helpful, I will look into submitting a pull request to include this check. Regards, David Handermann On Wed, Apr 6, 2022 at 7:23 AM Chakravarty, G wrote: > Just wondering if Nifi runs through any pre-install checks like minimum > java version, OS etc. like many other software. Will be nice if it does > basic checks to prevent common install failures. > > From: David Handermann > Sent: Wednesday, April 6, 2022 8:11 AM > To: dev@nifi.apache.org > Subject: Re: Missing maven dependencies when building nifi > > Phil, > > Recent versions of NiFi require Java 8 Update 251 or newer in order to > support modern signing algorithms. Java 8 Update 171 and newer include the > unrestricted Java Cryptography Extension Policy. Upgrading to the latest > Java 8 version should resolve the illegal key size issue shown in the > build. > > Regards, > David Handermann > > On Wed, Apr 6, 2022 at 6:16 AM Phil H wrote: > > > Australia. Never had any other issues with OpenSSL stuff, etc > > > > On Wed, 6 Apr 2022 at 21:11, Otto Fowler > wrote: > > > > > What country are you in? Are you under export controls? > > > > > > From: Phil H > > > Reply: dev@nifi.apache.org > > > Date: April 6, 2022 at 07:08:45 > > > To: dev@nifi.apache.org > > > Subject: Re: Missing maven dependencies when building nifi > > > > > > So, I restarted the whole process inside a CentOS VM. The only way I > > could > > > get the build to complete was by using -DskipTests in the maven > command. > > > > > > Trying to run the built nifi fails after maybe 15 seconds (see below): > > > > > > [phil@localhost nifi-1.17.0-SNAPSHOT]$ bin/nifi.sh run > > > > > > Java home: /usr/java/jdk1.8.0_131/ > > > NiFi home: /home/phil/nifi-1.17.0-SNAPSHOT > > > > > > Bootstrap Config File: > > /home/phil/nifi-1.17.0-SNAPSHOT/conf/bootstrap.conf > > > > > > 2022-04-06 21:02:19,292 INFO [main] org.apache.nifi.bootstrap.Command > > > Generating Self-Signed Certificate: Expires on 2022-06-05 > > > 2022-04-06 21:02:20,426 ERROR [main] org.apache.nifi.bootstrap.Command > > > Self-Signed Certificate Generation Failed > > > java.io.IOException: exception encrypting data - > > > java.security.InvalidKeyException: Illegal key size > > > at > > > > > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.wrapKey(Unknown > > > > > > Source) > > > at > > > > > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.doStore(Unknown > > > > > > Source) > > > at > > > > > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.engineStore(Unknown > > > > > > Source) > > > at > > > > > > > > > org.bouncycastle.jcajce.provider.keystore.util.AdaptingKeyStoreSpi.engineStore(Unknown > > > > > > Source) > > > at java.security.KeyStore.store(KeyStore.java:1377) > > > at > > > > > > > > > org.apache.nifi.security.util.KeyStoreUtils.createKeyStoreAndGetX509Certificate(KeyStoreUtils.java:540) > > > > > > at > > > > > > > > > org.apache.nifi.security.util.KeyStoreUtils.createTlsConfigAndNewKeystoreTruststore(KeyStoreUtils.java:228) > > > > > > at > > > > > > > > > org.apache.nifi.bootstrap.util.SecureNiFiConfigUtil.configureSecureNiFiProperties(SecureNiFiConfigUtil.java:123) > > > > > > at org.apache.nifi.bootstrap.RunNiFi.start(RunNiFi.java:1249) > > > at org.apache.nifi.bootstrap.RunNiFi.main(RunNiFi.java:294) > > > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > > > Starting Apache NiFi... > > > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > > > Working Directory: /home/phil/nifi-1.17.0-SNAPSHOT > > > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > > > Command: /usr/java/jdk1.8.0_131/bin/java -classpath > > > > > > > > > /home/phil/nifi-1.17.0-SNAPSHOT/./conf:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/javax.servlet-api-3.1.0.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jetty-schemas-5.2.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-classic-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-core-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jcl-over-slf4j-1.7.36.ja
Re: Missing maven dependencies when building nifi
Just wondering if Nifi runs through any pre-install checks like minimum java version, OS etc. like many other software. Will be nice if it does basic checks to prevent common install failures. From: David Handermann Sent: Wednesday, April 6, 2022 8:11 AM To: dev@nifi.apache.org Subject: Re: Missing maven dependencies when building nifi Phil, Recent versions of NiFi require Java 8 Update 251 or newer in order to support modern signing algorithms. Java 8 Update 171 and newer include the unrestricted Java Cryptography Extension Policy. Upgrading to the latest Java 8 version should resolve the illegal key size issue shown in the build. Regards, David Handermann On Wed, Apr 6, 2022 at 6:16 AM Phil H wrote: > Australia. Never had any other issues with OpenSSL stuff, etc > > On Wed, 6 Apr 2022 at 21:11, Otto Fowler wrote: > > > What country are you in? Are you under export controls? > > > > From: Phil H > > Reply: dev@nifi.apache.org > > Date: April 6, 2022 at 07:08:45 > > To: dev@nifi.apache.org > > Subject: Re: Missing maven dependencies when building nifi > > > > So, I restarted the whole process inside a CentOS VM. The only way I > could > > get the build to complete was by using -DskipTests in the maven command. > > > > Trying to run the built nifi fails after maybe 15 seconds (see below): > > > > [phil@localhost nifi-1.17.0-SNAPSHOT]$ bin/nifi.sh run > > > > Java home: /usr/java/jdk1.8.0_131/ > > NiFi home: /home/phil/nifi-1.17.0-SNAPSHOT > > > > Bootstrap Config File: > /home/phil/nifi-1.17.0-SNAPSHOT/conf/bootstrap.conf > > > > 2022-04-06 21:02:19,292 INFO [main] org.apache.nifi.bootstrap.Command > > Generating Self-Signed Certificate: Expires on 2022-06-05 > > 2022-04-06 21:02:20,426 ERROR [main] org.apache.nifi.bootstrap.Command > > Self-Signed Certificate Generation Failed > > java.io.IOException: exception encrypting data - > > java.security.InvalidKeyException: Illegal key size > > at > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.wrapKey(Unknown > > > > Source) > > at > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.doStore(Unknown > > > > Source) > > at > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.engineStore(Unknown > > > > Source) > > at > > > > > org.bouncycastle.jcajce.provider.keystore.util.AdaptingKeyStoreSpi.engineStore(Unknown > > > > Source) > > at java.security.KeyStore.store(KeyStore.java:1377) > > at > > > > > org.apache.nifi.security.util.KeyStoreUtils.createKeyStoreAndGetX509Certificate(KeyStoreUtils.java:540) > > > > at > > > > > org.apache.nifi.security.util.KeyStoreUtils.createTlsConfigAndNewKeystoreTruststore(KeyStoreUtils.java:228) > > > > at > > > > > org.apache.nifi.bootstrap.util.SecureNiFiConfigUtil.configureSecureNiFiProperties(SecureNiFiConfigUtil.java:123) > > > > at org.apache.nifi.bootstrap.RunNiFi.start(RunNiFi.java:1249) > > at org.apache.nifi.bootstrap.RunNiFi.main(RunNiFi.java:294) > > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > > Starting Apache NiFi... > > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > > Working Directory: /home/phil/nifi-1.17.0-SNAPSHOT > > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > > Command: /usr/java/jdk1.8.0_131/bin/java -classpath > > > > > /home/phil/nifi-1.17.0-SNAPSHOT/./conf:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/javax.servlet-api-3.1.0.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jetty-schemas-5.2.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-classic-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-core-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jcl-over-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jul-to-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/log4j-over-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/slf4j-api-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-framework-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-server-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-runtime-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-nar-utils-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-properties-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-property-utils-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-stateless-bootstrap-1.17.0-SNAPSHOT.jar:/h
Re: Missing maven dependencies when building nifi
Phil, Recent versions of NiFi require Java 8 Update 251 or newer in order to support modern signing algorithms. Java 8 Update 171 and newer include the unrestricted Java Cryptography Extension Policy. Upgrading to the latest Java 8 version should resolve the illegal key size issue shown in the build. Regards, David Handermann On Wed, Apr 6, 2022 at 6:16 AM Phil H wrote: > Australia. Never had any other issues with OpenSSL stuff, etc > > On Wed, 6 Apr 2022 at 21:11, Otto Fowler wrote: > > > What country are you in? Are you under export controls? > > > > From: Phil H > > Reply: dev@nifi.apache.org > > Date: April 6, 2022 at 07:08:45 > > To: dev@nifi.apache.org > > Subject: Re: Missing maven dependencies when building nifi > > > > So, I restarted the whole process inside a CentOS VM. The only way I > could > > get the build to complete was by using -DskipTests in the maven command. > > > > Trying to run the built nifi fails after maybe 15 seconds (see below): > > > > [phil@localhost nifi-1.17.0-SNAPSHOT]$ bin/nifi.sh run > > > > Java home: /usr/java/jdk1.8.0_131/ > > NiFi home: /home/phil/nifi-1.17.0-SNAPSHOT > > > > Bootstrap Config File: > /home/phil/nifi-1.17.0-SNAPSHOT/conf/bootstrap.conf > > > > 2022-04-06 21:02:19,292 INFO [main] org.apache.nifi.bootstrap.Command > > Generating Self-Signed Certificate: Expires on 2022-06-05 > > 2022-04-06 21:02:20,426 ERROR [main] org.apache.nifi.bootstrap.Command > > Self-Signed Certificate Generation Failed > > java.io.IOException: exception encrypting data - > > java.security.InvalidKeyException: Illegal key size > > at > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.wrapKey(Unknown > > > > Source) > > at > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.doStore(Unknown > > > > Source) > > at > > > > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.engineStore(Unknown > > > > Source) > > at > > > > > org.bouncycastle.jcajce.provider.keystore.util.AdaptingKeyStoreSpi.engineStore(Unknown > > > > Source) > > at java.security.KeyStore.store(KeyStore.java:1377) > > at > > > > > org.apache.nifi.security.util.KeyStoreUtils.createKeyStoreAndGetX509Certificate(KeyStoreUtils.java:540) > > > > at > > > > > org.apache.nifi.security.util.KeyStoreUtils.createTlsConfigAndNewKeystoreTruststore(KeyStoreUtils.java:228) > > > > at > > > > > org.apache.nifi.bootstrap.util.SecureNiFiConfigUtil.configureSecureNiFiProperties(SecureNiFiConfigUtil.java:123) > > > > at org.apache.nifi.bootstrap.RunNiFi.start(RunNiFi.java:1249) > > at org.apache.nifi.bootstrap.RunNiFi.main(RunNiFi.java:294) > > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > > Starting Apache NiFi... > > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > > Working Directory: /home/phil/nifi-1.17.0-SNAPSHOT > > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > > Command: /usr/java/jdk1.8.0_131/bin/java -classpath > > > > > /home/phil/nifi-1.17.0-SNAPSHOT/./conf:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/javax.servlet-api-3.1.0.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jetty-schemas-5.2.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-classic-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-core-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jcl-over-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jul-to-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/log4j-over-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/slf4j-api-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-framework-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-server-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-runtime-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-nar-utils-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-properties-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-property-utils-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-stateless-bootstrap-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-stateless-api-1.17.0-SNAPSHOT.jar > > > > -Dorg.apache.jasper.compiler.disablejsr199=true -Xmx512m -Xms512m > > -Dcurator-log-only-first-connection-issue-as-error-level=true > > -Djavax.security.auth.useSubjectCredsOnly=true > > -Djava.security.egd=file:/dev/urandom > -Dzookeeper.ad
Re: Missing maven dependencies when building nifi
Australia. Never had any other issues with OpenSSL stuff, etc On Wed, 6 Apr 2022 at 21:11, Otto Fowler wrote: > What country are you in? Are you under export controls? > > From: Phil H > Reply: dev@nifi.apache.org > Date: April 6, 2022 at 07:08:45 > To: dev@nifi.apache.org > Subject: Re: Missing maven dependencies when building nifi > > So, I restarted the whole process inside a CentOS VM. The only way I could > get the build to complete was by using -DskipTests in the maven command. > > Trying to run the built nifi fails after maybe 15 seconds (see below): > > [phil@localhost nifi-1.17.0-SNAPSHOT]$ bin/nifi.sh run > > Java home: /usr/java/jdk1.8.0_131/ > NiFi home: /home/phil/nifi-1.17.0-SNAPSHOT > > Bootstrap Config File: /home/phil/nifi-1.17.0-SNAPSHOT/conf/bootstrap.conf > > 2022-04-06 21:02:19,292 INFO [main] org.apache.nifi.bootstrap.Command > Generating Self-Signed Certificate: Expires on 2022-06-05 > 2022-04-06 21:02:20,426 ERROR [main] org.apache.nifi.bootstrap.Command > Self-Signed Certificate Generation Failed > java.io.IOException: exception encrypting data - > java.security.InvalidKeyException: Illegal key size > at > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.wrapKey(Unknown > > Source) > at > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.doStore(Unknown > > Source) > at > > org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.engineStore(Unknown > > Source) > at > > org.bouncycastle.jcajce.provider.keystore.util.AdaptingKeyStoreSpi.engineStore(Unknown > > Source) > at java.security.KeyStore.store(KeyStore.java:1377) > at > > org.apache.nifi.security.util.KeyStoreUtils.createKeyStoreAndGetX509Certificate(KeyStoreUtils.java:540) > > at > > org.apache.nifi.security.util.KeyStoreUtils.createTlsConfigAndNewKeystoreTruststore(KeyStoreUtils.java:228) > > at > > org.apache.nifi.bootstrap.util.SecureNiFiConfigUtil.configureSecureNiFiProperties(SecureNiFiConfigUtil.java:123) > > at org.apache.nifi.bootstrap.RunNiFi.start(RunNiFi.java:1249) > at org.apache.nifi.bootstrap.RunNiFi.main(RunNiFi.java:294) > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > Starting Apache NiFi... > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > Working Directory: /home/phil/nifi-1.17.0-SNAPSHOT > 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command > Command: /usr/java/jdk1.8.0_131/bin/java -classpath > > /home/phil/nifi-1.17.0-SNAPSHOT/./conf:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/javax.servlet-api-3.1.0.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jetty-schemas-5.2.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-classic-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-core-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jcl-over-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jul-to-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/log4j-over-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/slf4j-api-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-framework-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-server-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-runtime-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-nar-utils-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-properties-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-property-utils-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-stateless-bootstrap-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-stateless-api-1.17.0-SNAPSHOT.jar > > -Dorg.apache.jasper.compiler.disablejsr199=true -Xmx512m -Xms512m > -Dcurator-log-only-first-connection-issue-as-error-level=true > -Djavax.security.auth.useSubjectCredsOnly=true > -Djava.security.egd=file:/dev/urandom -Dzookeeper.admin.enableServer=false > -Dsun.net.http.allowRestrictedHeaders=true -Djava.net.preferIPv4Stack=true > -Djava.awt.headless=true -Djava.protocol.handler.pkgs=sun.net.www.protocol > > -Dnifi.properties.file.path=/home/phil/nifi-1.17.0-SNAPSHOT/./conf/nifi.properties > > -Dnifi.bootstrap.listen.port=36117 -Dapp=NiFi > > -Dorg.apache.nifi.bootstrap.config.log.dir=/home/phil/nifi-1.17.0-SNAPSHOT/logs > > org.apache.nifi.NiFi > 2022-04-06 21:02:20,435 INFO [main] org.apache.nifi.bootstrap.Command > Launched Apache NiFi with Process ID 21977 > [phil@localhost nifi-1.17.0-SNAPSHOT]$ > > If I try and run the tests as part of the build process, I get similar > complaints about key size (here's one example) > > [INFO] Running org.apache.nifi.security.kms.FileBasedKeyPro
Re: Missing maven dependencies when building nifi
What country are you in? Are you under export controls? From: Phil H Reply: dev@nifi.apache.org Date: April 6, 2022 at 07:08:45 To: dev@nifi.apache.org Subject: Re: Missing maven dependencies when building nifi So, I restarted the whole process inside a CentOS VM. The only way I could get the build to complete was by using -DskipTests in the maven command. Trying to run the built nifi fails after maybe 15 seconds (see below): [phil@localhost nifi-1.17.0-SNAPSHOT]$ bin/nifi.sh run Java home: /usr/java/jdk1.8.0_131/ NiFi home: /home/phil/nifi-1.17.0-SNAPSHOT Bootstrap Config File: /home/phil/nifi-1.17.0-SNAPSHOT/conf/bootstrap.conf 2022-04-06 21:02:19,292 INFO [main] org.apache.nifi.bootstrap.Command Generating Self-Signed Certificate: Expires on 2022-06-05 2022-04-06 21:02:20,426 ERROR [main] org.apache.nifi.bootstrap.Command Self-Signed Certificate Generation Failed java.io.IOException: exception encrypting data - java.security.InvalidKeyException: Illegal key size at org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.wrapKey(Unknown Source) at org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.doStore(Unknown Source) at org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.engineStore(Unknown Source) at org.bouncycastle.jcajce.provider.keystore.util.AdaptingKeyStoreSpi.engineStore(Unknown Source) at java.security.KeyStore.store(KeyStore.java:1377) at org.apache.nifi.security.util.KeyStoreUtils.createKeyStoreAndGetX509Certificate(KeyStoreUtils.java:540) at org.apache.nifi.security.util.KeyStoreUtils.createTlsConfigAndNewKeystoreTruststore(KeyStoreUtils.java:228) at org.apache.nifi.bootstrap.util.SecureNiFiConfigUtil.configureSecureNiFiProperties(SecureNiFiConfigUtil.java:123) at org.apache.nifi.bootstrap.RunNiFi.start(RunNiFi.java:1249) at org.apache.nifi.bootstrap.RunNiFi.main(RunNiFi.java:294) 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command Starting Apache NiFi... 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command Working Directory: /home/phil/nifi-1.17.0-SNAPSHOT 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command Command: /usr/java/jdk1.8.0_131/bin/java -classpath /home/phil/nifi-1.17.0-SNAPSHOT/./conf:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/javax.servlet-api-3.1.0.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jetty-schemas-5.2.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-classic-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-core-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jcl-over-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jul-to-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/log4j-over-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/slf4j-api-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-framework-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-server-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-runtime-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-nar-utils-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-properties-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-property-utils-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-stateless-bootstrap-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-stateless-api-1.17.0-SNAPSHOT.jar -Dorg.apache.jasper.compiler.disablejsr199=true -Xmx512m -Xms512m -Dcurator-log-only-first-connection-issue-as-error-level=true -Djavax.security.auth.useSubjectCredsOnly=true -Djava.security.egd=file:/dev/urandom -Dzookeeper.admin.enableServer=false -Dsun.net.http.allowRestrictedHeaders=true -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Djava.protocol.handler.pkgs=sun.net.www.protocol -Dnifi.properties.file.path=/home/phil/nifi-1.17.0-SNAPSHOT/./conf/nifi.properties -Dnifi.bootstrap.listen.port=36117 -Dapp=NiFi -Dorg.apache.nifi.bootstrap.config.log.dir=/home/phil/nifi-1.17.0-SNAPSHOT/logs org.apache.nifi.NiFi 2022-04-06 21:02:20,435 INFO [main] org.apache.nifi.bootstrap.Command Launched Apache NiFi with Process ID 21977 [phil@localhost nifi-1.17.0-SNAPSHOT]$ If I try and run the tests as part of the build process, I get similar complaints about key size (here's one example) [INFO] Running org.apache.nifi.security.kms.FileBasedKeyProviderTest [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.003 s <<< FAILURE! - in org.apache.nifi.security.kms.FileBasedKeyProviderTest [ERROR] org.apache.nifi.security.kms.FileBasedKeyProviderTest.testGetKey Time elapsed: 0.001 s <<< ERROR! java.security.InvalidKeyException: Illegal key size at org.apache.nifi.security.kms.FileBasedKeyProviderTest.getSecretKeysPath(FileBasedKeyProviderTest.java:60) at org.apache.nifi.security.kms.FileBasedKeyProviderTest.testGetKey(FileBasedKeyProviderTest.java:47) On Wed, Apr 6, 2022 at 5:0
Re: Missing maven dependencies when building nifi
So, I restarted the whole process inside a CentOS VM. The only way I could get the build to complete was by using -DskipTests in the maven command. Trying to run the built nifi fails after maybe 15 seconds (see below): [phil@localhost nifi-1.17.0-SNAPSHOT]$ bin/nifi.sh run Java home: /usr/java/jdk1.8.0_131/ NiFi home: /home/phil/nifi-1.17.0-SNAPSHOT Bootstrap Config File: /home/phil/nifi-1.17.0-SNAPSHOT/conf/bootstrap.conf 2022-04-06 21:02:19,292 INFO [main] org.apache.nifi.bootstrap.Command Generating Self-Signed Certificate: Expires on 2022-06-05 2022-04-06 21:02:20,426 ERROR [main] org.apache.nifi.bootstrap.Command Self-Signed Certificate Generation Failed java.io.IOException: exception encrypting data - java.security.InvalidKeyException: Illegal key size at org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.wrapKey(Unknown Source) at org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.doStore(Unknown Source) at org.bouncycastle.jcajce.provider.keystore.pkcs12.PKCS12KeyStoreSpi.engineStore(Unknown Source) at org.bouncycastle.jcajce.provider.keystore.util.AdaptingKeyStoreSpi.engineStore(Unknown Source) at java.security.KeyStore.store(KeyStore.java:1377) at org.apache.nifi.security.util.KeyStoreUtils.createKeyStoreAndGetX509Certificate(KeyStoreUtils.java:540) at org.apache.nifi.security.util.KeyStoreUtils.createTlsConfigAndNewKeystoreTruststore(KeyStoreUtils.java:228) at org.apache.nifi.bootstrap.util.SecureNiFiConfigUtil.configureSecureNiFiProperties(SecureNiFiConfigUtil.java:123) at org.apache.nifi.bootstrap.RunNiFi.start(RunNiFi.java:1249) at org.apache.nifi.bootstrap.RunNiFi.main(RunNiFi.java:294) 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command Starting Apache NiFi... 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command Working Directory: /home/phil/nifi-1.17.0-SNAPSHOT 2022-04-06 21:02:20,428 INFO [main] org.apache.nifi.bootstrap.Command Command: /usr/java/jdk1.8.0_131/bin/java -classpath /home/phil/nifi-1.17.0-SNAPSHOT/./conf:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/javax.servlet-api-3.1.0.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jetty-schemas-5.2.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-classic-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/logback-core-1.2.11.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jcl-over-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/jul-to-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/log4j-over-slf4j-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/slf4j-api-1.7.36.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-framework-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-server-api-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-runtime-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-nar-utils-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-properties-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-property-utils-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-stateless-bootstrap-1.17.0-SNAPSHOT.jar:/home/phil/nifi-1.17.0-SNAPSHOT/./lib/nifi-stateless-api-1.17.0-SNAPSHOT.jar -Dorg.apache.jasper.compiler.disablejsr199=true -Xmx512m -Xms512m -Dcurator-log-only-first-connection-issue-as-error-level=true -Djavax.security.auth.useSubjectCredsOnly=true -Djava.security.egd=file:/dev/urandom -Dzookeeper.admin.enableServer=false -Dsun.net.http.allowRestrictedHeaders=true -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Djava.protocol.handler.pkgs=sun.net.www.protocol -Dnifi.properties.file.path=/home/phil/nifi-1.17.0-SNAPSHOT/./conf/nifi.properties -Dnifi.bootstrap.listen.port=36117 -Dapp=NiFi -Dorg.apache.nifi.bootstrap.config.log.dir=/home/phil/nifi-1.17.0-SNAPSHOT/logs org.apache.nifi.NiFi 2022-04-06 21:02:20,435 INFO [main] org.apache.nifi.bootstrap.Command Launched Apache NiFi with Process ID 21977 [phil@localhost nifi-1.17.0-SNAPSHOT]$ If I try and run the tests as part of the build process, I get similar complaints about key size (here's one example) [INFO] Running org.apache.nifi.security.kms.FileBasedKeyProviderTest [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.003 s <<< FAILURE! - in org.apache.nifi.security.kms.FileBasedKeyProviderTest [ERROR] org.apache.nifi.security.kms.FileBasedKeyProviderTest.testGetKey Time elapsed: 0.001 s <<< ERROR! java.security.InvalidKeyException: Illegal key size at org.apache.nifi.security.kms.FileBasedKeyProviderTest.getSecretKeysPath(FileBasedKeyProviderTest.java:60) at org.apache.nifi.security.kms.FileBasedKeyProviderTest.testGetKey(FileBasedKeyProviderTest.java:47) On Wed, Apr 6, 2022 at 5:08 PM Phil H wrote: > Hi guys, > > Yep - I made sure the global git settings held before the clone. > > I tried running with the options from the .yml file and got a bunch of > errors. > > So I started the contributor guide again (from a new clone) and
Re: Missing maven dependencies when building nifi
Hi guys, Yep - I made sure the global git settings held before the clone. I tried running with the options from the .yml file and got a bunch of errors. So I started the contributor guide again (from a new clone) and this time compiled with: mvn clean package verify. It ran for a while before dying on this [INFO] Running org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest [ERROR] Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 7.754 s <<< FAILURE! - in org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest [ERROR] org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerToken Time elapsed: 5.561 s <<< ERROR! java.lang.IllegalArgumentException: Signing Failed for Algorithm [PS512] Key Identifier [b8e23cf5-e508-4179-808a-83a5c2063a82] at org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerToken(StandardBearerTokenProviderTest.java:99) Caused by: com.nimbusds.jose.JOSEException: Unsupported RSASSA algorithm (after retry with alternative): SHA512withRSAandMGF1 Signature not available at org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerToken(StandardBearerTokenProviderTest.java:99) Caused by: java.security.NoSuchAlgorithmException: SHA512withRSAandMGF1 Signature not available at org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerToken(StandardBearerTokenProviderTest.java:99) [ERROR] org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMaximum Time elapsed: 0.327 s <<< ERROR! java.lang.IllegalArgumentException: Signing Failed for Algorithm [PS512] Key Identifier [3d301d5b-a81a-4bf8-8808-e144b52df197] at org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMaximum(StandardBearerTokenProviderTest.java:125) Caused by: com.nimbusds.jose.JOSEException: Unsupported RSASSA algorithm (after retry with alternative): SHA512withRSAandMGF1 Signature not available at org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMaximum(StandardBearerTokenProviderTest.java:125) Caused by: java.security.NoSuchAlgorithmException: SHA512withRSAandMGF1 Signature not available at org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMaximum(StandardBearerTokenProviderTest.java:125) [ERROR] org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMinimum Time elapsed: 1.859 s <<< ERROR! java.lang.IllegalArgumentException: Signing Failed for Algorithm [PS512] Key Identifier [986f3d55-e2e3-4116-a419-8fd2a928af8c] at org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMinimum(StandardBearerTokenProviderTest.java:144) Caused by: com.nimbusds.jose.JOSEException: Unsupported RSASSA algorithm (after retry with alternative): SHA512withRSAandMGF1 Signature not available at org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMinimum(StandardBearerTokenProviderTest.java:144) Caused by: java.security.NoSuchAlgorithmException: SHA512withRSAandMGF1 Signature not available at org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMinimum(StandardBearerTokenProviderTest.java:144) On Wed, Apr 6, 2022 at 7:58 AM Joe Witt wrote: > Good point there James. Phil definitely give that a look. Those commands > need to be run on the repository at the right time as well so it doesn't > import with the wrong line endings. > > From our github automated builds we have at: > https://github.com/apache/nifi/blob/main/.github/workflows/ci-workflow.yml > > Here are key things to execute to run like we do there: > > git config --global core.autocrlf false > git config --global core.longpaths true > Checkout Code > > DEFAULT_MAVEN_OPTS: >- > -Xmx3g > -XX:ReservedCodeCacheSize=1g > -XX:+UseG1GC > -Dorg.slf4j.simpleLogger.defaultLogLevel=WARN > -Dhttp.keepAlive=false > -Dmaven.wagon.http.pool=false > > mvn package verify > -P contrib-check > -P include-grpc > -P skip-nifi-bin-assembly > > On Tue, Apr 5, 2022 at 2:31 PM James Srinivasan < > james.sriniva...@gmail.com> > wrote: > > > Possibly not your problem, but did you follow the instructions for > building > > on Windows here: > > > > https://nifi.apache.org/quickstart.html > > > > On Tue, 5 Apr 2022, 12:42 Phil H, wrote: > > > > > Okay, I started over with a completely new local repo. This is the > exact > > > sequence of commands I ran: > > > > > > $ git clone https://github.com/apache/nifi.git > > > $ cd nifi > > > $ git remote add upstream https://github.com/apache/nifi.git > > > $ git clean -fxd > > > $ mvn clean package verify
Re: Missing maven dependencies when building nifi
Good point there James. Phil definitely give that a look. Those commands need to be run on the repository at the right time as well so it doesn't import with the wrong line endings. >From our github automated builds we have at: https://github.com/apache/nifi/blob/main/.github/workflows/ci-workflow.yml Here are key things to execute to run like we do there: git config --global core.autocrlf false git config --global core.longpaths true Checkout Code DEFAULT_MAVEN_OPTS: >- -Xmx3g -XX:ReservedCodeCacheSize=1g -XX:+UseG1GC -Dorg.slf4j.simpleLogger.defaultLogLevel=WARN -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false mvn package verify -P contrib-check -P include-grpc -P skip-nifi-bin-assembly On Tue, Apr 5, 2022 at 2:31 PM James Srinivasan wrote: > Possibly not your problem, but did you follow the instructions for building > on Windows here: > > https://nifi.apache.org/quickstart.html > > On Tue, 5 Apr 2022, 12:42 Phil H, wrote: > > > Okay, I started over with a completely new local repo. This is the exact > > sequence of commands I ran: > > > > $ git clone https://github.com/apache/nifi.git > > $ cd nifi > > $ git remote add upstream https://github.com/apache/nifi.git > > $ git clean -fxd > > $ mvn clean package verify -Pcontrib-check,include-grpc > > > > And after about 12 minutes: > > > > [ERROR] Failed to execute goal > > org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M5:test > (default-test) > > on project nifi-web-security: There are test failures. > > [ERROR] > > [ERROR] Please refer to > > > > > D:\nifi\nifi-nar-bundles\nifi-framework-bundle\nifi-framework\nifi-web\nifi-web-security\target\surefire-reports > > for the individual test results. > > [ERROR] Please refer to dump files (if any exist) [date].dump, > > [date]-jvmRun[N].dump and [date].dumpstream. > > > > The contents of the dumpfile at that location is: > > > > # Created at 2022-04-05T21:05:18.979 > > Boot Manifest-JAR contains absolute paths in classpath > > > > > 'D:\nifi\nifi-nar-bundles\nifi-framework-bundle\nifi-framework\nifi-web\nifi-web-security\target\test-classes' > > Hint: > > -Djdk.net.URLClassPath.disableClassPathURLCheck=true > > > > I'm sure there's some obvious mistake I'm making, or piece of > information I > > am missing, but I have no idea what they are! > > > > Thanks > > Phil > > > > On Tue, Apr 5, 2022 at 12:53 AM Joe Witt wrote: > > > > > Phil > > > > > > I think you need to run 'git clean -fxd' from the nifi source root. > > > > > > Then try the build again. And allow the entire thing to run. > > > > > > Too many builds in different levels are leaving things around. > > > > > > Thanks > > > > > > On Mon, Apr 4, 2022 at 7:46 AM Phil H wrote: > > > > > > > So, about that error that flashed past... > > > > > > > > [INFO] > > > > > > > > > > [INFO] BUILD FAILURE > > > > [INFO] > > > > > > > > > > [INFO] Total time: 22:21 min (Wall Clock) > > > > [INFO] Finished at: 2022-04-05T00:37:46+10:00 > > > > [INFO] > > > > > > > > > > [ERROR] Failed to execute goal > > > org.apache.rat:apache-rat-plugin:0.13:check > > > > (default) on project nifi-poi-processors: Too many files with > > unapproved > > > > license: 1 See RAT report in: > > > > > > > > > > > > > > D:\nifi.github\nifi\nifi-nar-bundles\nifi-poi-bundle\nifi-poi-processors\target\rat.txt > > > > -> [Help 1] > > > > > > > > The rat file contains the following: > > > > > > > > * > > > > Summary > > > > --- > > > > Generated at: 2022-04-05T00:33:56+10:00 > > > > > > > > Notes: 0 > > > > Binaries: 4 > > > > Archives: 0 > > > > Standards: 7 > > > > > > > > Apache Licensed: 6 > > > > Generated Documents: 0 > > > > > > > > JavaDocs are generated, thus a license header is optional. > > > > Generated files do not require license headers. > > > > > > > > 1 Unknown Licenses > > > > > > > > * > > > > > > > > Files with unapproved licenses: > > > > > > > > > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > > > > > > > > * > > > > > > > > * > > > > Files with Apache License headers will be marked AL > > > > Binary files (which do not require any license headers) will be > > marked > > > B > > > > Compressed archives will be marked A > > > > Notices, licenses etc. will be marked N > > > > AL > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/pom.xml > > > > AL > > > > > > > > > > > > > >
Re: Missing maven dependencies when building nifi
Possibly not your problem, but did you follow the instructions for building on Windows here: https://nifi.apache.org/quickstart.html On Tue, 5 Apr 2022, 12:42 Phil H, wrote: > Okay, I started over with a completely new local repo. This is the exact > sequence of commands I ran: > > $ git clone https://github.com/apache/nifi.git > $ cd nifi > $ git remote add upstream https://github.com/apache/nifi.git > $ git clean -fxd > $ mvn clean package verify -Pcontrib-check,include-grpc > > And after about 12 minutes: > > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M5:test (default-test) > on project nifi-web-security: There are test failures. > [ERROR] > [ERROR] Please refer to > > D:\nifi\nifi-nar-bundles\nifi-framework-bundle\nifi-framework\nifi-web\nifi-web-security\target\surefire-reports > for the individual test results. > [ERROR] Please refer to dump files (if any exist) [date].dump, > [date]-jvmRun[N].dump and [date].dumpstream. > > The contents of the dumpfile at that location is: > > # Created at 2022-04-05T21:05:18.979 > Boot Manifest-JAR contains absolute paths in classpath > > 'D:\nifi\nifi-nar-bundles\nifi-framework-bundle\nifi-framework\nifi-web\nifi-web-security\target\test-classes' > Hint: > -Djdk.net.URLClassPath.disableClassPathURLCheck=true > > I'm sure there's some obvious mistake I'm making, or piece of information I > am missing, but I have no idea what they are! > > Thanks > Phil > > On Tue, Apr 5, 2022 at 12:53 AM Joe Witt wrote: > > > Phil > > > > I think you need to run 'git clean -fxd' from the nifi source root. > > > > Then try the build again. And allow the entire thing to run. > > > > Too many builds in different levels are leaving things around. > > > > Thanks > > > > On Mon, Apr 4, 2022 at 7:46 AM Phil H wrote: > > > > > So, about that error that flashed past... > > > > > > [INFO] > > > > > > > [INFO] BUILD FAILURE > > > [INFO] > > > > > > > [INFO] Total time: 22:21 min (Wall Clock) > > > [INFO] Finished at: 2022-04-05T00:37:46+10:00 > > > [INFO] > > > > > > > [ERROR] Failed to execute goal > > org.apache.rat:apache-rat-plugin:0.13:check > > > (default) on project nifi-poi-processors: Too many files with > unapproved > > > license: 1 See RAT report in: > > > > > > > > > D:\nifi.github\nifi\nifi-nar-bundles\nifi-poi-bundle\nifi-poi-processors\target\rat.txt > > > -> [Help 1] > > > > > > The rat file contains the following: > > > > > > * > > > Summary > > > --- > > > Generated at: 2022-04-05T00:33:56+10:00 > > > > > > Notes: 0 > > > Binaries: 4 > > > Archives: 0 > > > Standards: 7 > > > > > > Apache Licensed: 6 > > > Generated Documents: 0 > > > > > > JavaDocs are generated, thus a license header is optional. > > > Generated files do not require license headers. > > > > > > 1 Unknown Licenses > > > > > > * > > > > > > Files with unapproved licenses: > > > > > > > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > > > > > > * > > > > > > * > > > Files with Apache License headers will be marked AL > > > Binary files (which do not require any license headers) will be > marked > > B > > > Compressed archives will be marked A > > > Notices, licenses etc. will be marked N > > > AL > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/pom.xml > > > AL > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessor.java > > > AL > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/docs/org.apache.nifi.processors.poi.ConvertExcelToCSVProcessor/additionalDetails.html > > > AL > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/META-INF/services/org.apache.nifi.processor.Processor > > > AL > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessorTest.java > > > B > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/CollegeScorecard.xlsx > > > B > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/dataformatting.xlsx > > > AL > > > > > > > > >
Re: Missing maven dependencies when building nifi
Okay, I started over with a completely new local repo. This is the exact sequence of commands I ran: $ git clone https://github.com/apache/nifi.git $ cd nifi $ git remote add upstream https://github.com/apache/nifi.git $ git clean -fxd $ mvn clean package verify -Pcontrib-check,include-grpc And after about 12 minutes: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M5:test (default-test) on project nifi-web-security: There are test failures. [ERROR] [ERROR] Please refer to D:\nifi\nifi-nar-bundles\nifi-framework-bundle\nifi-framework\nifi-web\nifi-web-security\target\surefire-reports for the individual test results. [ERROR] Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream. The contents of the dumpfile at that location is: # Created at 2022-04-05T21:05:18.979 Boot Manifest-JAR contains absolute paths in classpath 'D:\nifi\nifi-nar-bundles\nifi-framework-bundle\nifi-framework\nifi-web\nifi-web-security\target\test-classes' Hint: -Djdk.net.URLClassPath.disableClassPathURLCheck=true I'm sure there's some obvious mistake I'm making, or piece of information I am missing, but I have no idea what they are! Thanks Phil On Tue, Apr 5, 2022 at 12:53 AM Joe Witt wrote: > Phil > > I think you need to run 'git clean -fxd' from the nifi source root. > > Then try the build again. And allow the entire thing to run. > > Too many builds in different levels are leaving things around. > > Thanks > > On Mon, Apr 4, 2022 at 7:46 AM Phil H wrote: > > > So, about that error that flashed past... > > > > [INFO] > > > > [INFO] BUILD FAILURE > > [INFO] > > > > [INFO] Total time: 22:21 min (Wall Clock) > > [INFO] Finished at: 2022-04-05T00:37:46+10:00 > > [INFO] > > > > [ERROR] Failed to execute goal > org.apache.rat:apache-rat-plugin:0.13:check > > (default) on project nifi-poi-processors: Too many files with unapproved > > license: 1 See RAT report in: > > > > > D:\nifi.github\nifi\nifi-nar-bundles\nifi-poi-bundle\nifi-poi-processors\target\rat.txt > > -> [Help 1] > > > > The rat file contains the following: > > > > * > > Summary > > --- > > Generated at: 2022-04-05T00:33:56+10:00 > > > > Notes: 0 > > Binaries: 4 > > Archives: 0 > > Standards: 7 > > > > Apache Licensed: 6 > > Generated Documents: 0 > > > > JavaDocs are generated, thus a license header is optional. > > Generated files do not require license headers. > > > > 1 Unknown Licenses > > > > * > > > > Files with unapproved licenses: > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > > > > * > > > > * > > Files with Apache License headers will be marked AL > > Binary files (which do not require any license headers) will be marked > B > > Compressed archives will be marked A > > Notices, licenses etc. will be marked N > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/pom.xml > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessor.java > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/docs/org.apache.nifi.processors.poi.ConvertExcelToCSVProcessor/additionalDetails.html > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/META-INF/services/org.apache.nifi.processor.Processor > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessorTest.java > > B > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/CollegeScorecard.xlsx > > B > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/dataformatting.xlsx > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/logback-test.xml > > B > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/TwoSheets.xlsx > > !? > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > > B > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/with-blank-cells.xlsx > > > >
Re: Missing maven dependencies when building nifi
Thanks Joe! On Tue, 5 Apr 2022 at 00:53, Joe Witt wrote: > Phil > > I think you need to run 'git clean -fxd' from the nifi source root. > > Then try the build again. And allow the entire thing to run. > > Too many builds in different levels are leaving things around. > > Thanks > > On Mon, Apr 4, 2022 at 7:46 AM Phil H wrote: > > > So, about that error that flashed past... > > > > [INFO] > > > > [INFO] BUILD FAILURE > > [INFO] > > > > [INFO] Total time: 22:21 min (Wall Clock) > > [INFO] Finished at: 2022-04-05T00:37:46+10:00 > > [INFO] > > > > [ERROR] Failed to execute goal > org.apache.rat:apache-rat-plugin:0.13:check > > (default) on project nifi-poi-processors: Too many files with unapproved > > license: 1 See RAT report in: > > > > > D:\nifi.github\nifi\nifi-nar-bundles\nifi-poi-bundle\nifi-poi-processors\target\rat.txt > > -> [Help 1] > > > > The rat file contains the following: > > > > * > > Summary > > --- > > Generated at: 2022-04-05T00:33:56+10:00 > > > > Notes: 0 > > Binaries: 4 > > Archives: 0 > > Standards: 7 > > > > Apache Licensed: 6 > > Generated Documents: 0 > > > > JavaDocs are generated, thus a license header is optional. > > Generated files do not require license headers. > > > > 1 Unknown Licenses > > > > * > > > > Files with unapproved licenses: > > > > > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > > > > * > > > > * > > Files with Apache License headers will be marked AL > > Binary files (which do not require any license headers) will be marked > B > > Compressed archives will be marked A > > Notices, licenses etc. will be marked N > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/pom.xml > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessor.java > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/docs/org.apache.nifi.processors.poi.ConvertExcelToCSVProcessor/additionalDetails.html > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/META-INF/services/org.apache.nifi.processor.Processor > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessorTest.java > > B > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/CollegeScorecard.xlsx > > B > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/dataformatting.xlsx > > AL > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/logback-test.xml > > B > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/TwoSheets.xlsx > > !? > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > > B > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/with-blank-cells.xlsx > > > > * > > > > Printing headers for text files without a valid license header... > > > > = > > == File: > > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > > = > > -- some binary stuff -- > > > > > > On Tue, Apr 5, 2022 at 12:30 AM Phil H wrote: > > > > > Thanks Joe, it seems to be about half way through now - much further > than > > > previously. I thought I saw some red text flash past, but nothing > > > stopped. Does one of those switches you suggested pile all the bad > news > > up > > > to deliver at the end, or can maven have "red errors" that aren't > > terminal? > > > > > > TIA, > > > Phil > > > > > > On Mon, Apr 4, 2022 at 11:48 PM Joe Witt wrote: > > > > > >> Phil > > >> > > >> Here is a command I commonly run to ensure I have nothing other than > > >> what the source tree intends. > > >> > > >> mvn -T C1 clean package verify -Pcontrib-check,include-grpc > > >> > > >> This will do everything - build it all, run contrib check, and use all > > the > > >> cores. > > >> > > >> Thanks > > >> > > >> On Mon, Apr 4, 2022 at 6:38 AM Mike Thomsen > > >> wrote: > > >>
Re: Missing maven dependencies when building nifi
Phil I think you need to run 'git clean -fxd' from the nifi source root. Then try the build again. And allow the entire thing to run. Too many builds in different levels are leaving things around. Thanks On Mon, Apr 4, 2022 at 7:46 AM Phil H wrote: > So, about that error that flashed past... > > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 22:21 min (Wall Clock) > [INFO] Finished at: 2022-04-05T00:37:46+10:00 > [INFO] > > [ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.13:check > (default) on project nifi-poi-processors: Too many files with unapproved > license: 1 See RAT report in: > > D:\nifi.github\nifi\nifi-nar-bundles\nifi-poi-bundle\nifi-poi-processors\target\rat.txt > -> [Help 1] > > The rat file contains the following: > > * > Summary > --- > Generated at: 2022-04-05T00:33:56+10:00 > > Notes: 0 > Binaries: 4 > Archives: 0 > Standards: 7 > > Apache Licensed: 6 > Generated Documents: 0 > > JavaDocs are generated, thus a license header is optional. > Generated files do not require license headers. > > 1 Unknown Licenses > > * > > Files with unapproved licenses: > > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > > * > > * > Files with Apache License headers will be marked AL > Binary files (which do not require any license headers) will be marked B > Compressed archives will be marked A > Notices, licenses etc. will be marked N > AL > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/pom.xml > AL > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessor.java > AL > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/docs/org.apache.nifi.processors.poi.ConvertExcelToCSVProcessor/additionalDetails.html > AL > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/META-INF/services/org.apache.nifi.processor.Processor > AL > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessorTest.java > B > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/CollegeScorecard.xlsx > B > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/dataformatting.xlsx > AL > > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/logback-test.xml > B > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/TwoSheets.xlsx > !? > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > B > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/with-blank-cells.xlsx > > * > > Printing headers for text files without a valid license header... > > = > == File: > > D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls > = > -- some binary stuff -- > > > On Tue, Apr 5, 2022 at 12:30 AM Phil H wrote: > > > Thanks Joe, it seems to be about half way through now - much further than > > previously. I thought I saw some red text flash past, but nothing > > stopped. Does one of those switches you suggested pile all the bad news > up > > to deliver at the end, or can maven have "red errors" that aren't > terminal? > > > > TIA, > > Phil > > > > On Mon, Apr 4, 2022 at 11:48 PM Joe Witt wrote: > > > >> Phil > >> > >> Here is a command I commonly run to ensure I have nothing other than > >> what the source tree intends. > >> > >> mvn -T C1 clean package verify -Pcontrib-check,include-grpc > >> > >> This will do everything - build it all, run contrib check, and use all > the > >> cores. > >> > >> Thanks > >> > >> On Mon, Apr 4, 2022 at 6:38 AM Mike Thomsen > >> wrote: > >> > >> > Did you run "mvn install" from the root of the project before > >> > attempting to run a full test of the code base? > >> > > >> > On Mon, Apr 4, 2022 at 9:36 AM Phil H wrote: > >> > > > >> > > Hi there, > >> > > > >> > > So I got past this issue by running "mvn test" from the root of the > >> nifi > >> > > tree. After much compiling and
Re: Missing maven dependencies when building nifi
So, about that error that flashed past... [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 22:21 min (Wall Clock) [INFO] Finished at: 2022-04-05T00:37:46+10:00 [INFO] [ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.13:check (default) on project nifi-poi-processors: Too many files with unapproved license: 1 See RAT report in: D:\nifi.github\nifi\nifi-nar-bundles\nifi-poi-bundle\nifi-poi-processors\target\rat.txt -> [Help 1] The rat file contains the following: * Summary --- Generated at: 2022-04-05T00:33:56+10:00 Notes: 0 Binaries: 4 Archives: 0 Standards: 7 Apache Licensed: 6 Generated Documents: 0 JavaDocs are generated, thus a license header is optional. Generated files do not require license headers. 1 Unknown Licenses * Files with unapproved licenses: D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls * * Files with Apache License headers will be marked AL Binary files (which do not require any license headers) will be marked B Compressed archives will be marked A Notices, licenses etc. will be marked N AL D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/pom.xml AL D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessor.java AL D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/docs/org.apache.nifi.processors.poi.ConvertExcelToCSVProcessor/additionalDetails.html AL D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/META-INF/services/org.apache.nifi.processor.Processor AL D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessorTest.java B D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/CollegeScorecard.xlsx B D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/dataformatting.xlsx AL D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/logback-test.xml B D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/TwoSheets.xlsx !? D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls B D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/with-blank-cells.xlsx * Printing headers for text files without a valid license header... = == File: D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls = -- some binary stuff -- On Tue, Apr 5, 2022 at 12:30 AM Phil H wrote: > Thanks Joe, it seems to be about half way through now - much further than > previously. I thought I saw some red text flash past, but nothing > stopped. Does one of those switches you suggested pile all the bad news up > to deliver at the end, or can maven have "red errors" that aren't terminal? > > TIA, > Phil > > On Mon, Apr 4, 2022 at 11:48 PM Joe Witt wrote: > >> Phil >> >> Here is a command I commonly run to ensure I have nothing other than >> what the source tree intends. >> >> mvn -T C1 clean package verify -Pcontrib-check,include-grpc >> >> This will do everything - build it all, run contrib check, and use all the >> cores. >> >> Thanks >> >> On Mon, Apr 4, 2022 at 6:38 AM Mike Thomsen >> wrote: >> >> > Did you run "mvn install" from the root of the project before >> > attempting to run a full test of the code base? >> > >> > On Mon, Apr 4, 2022 at 9:36 AM Phil H wrote: >> > > >> > > Hi there, >> > > >> > > So I got past this issue by running "mvn test" from the root of the >> nifi >> > > tree. After much compiling and testing, I am now getting the attached >> > > error. I think I am following the contributor guide in having my >> local >> > > branch track origin/main (currently "4a90334728: NIFI-9846 Implement >> > > pagination listing for Azure List processors"). >> > > >> > > Is this some environmental issue on my machine somehow? Or does the >> main >> > > branch contain compilation errors, and I should be tracking something >> > else >> > > for my own branch? As I said in my previous email, I am new to >> github, >> > so >> > >
Re: Missing maven dependencies when building nifi
Thanks Joe, it seems to be about half way through now - much further than previously. I thought I saw some red text flash past, but nothing stopped. Does one of those switches you suggested pile all the bad news up to deliver at the end, or can maven have "red errors" that aren't terminal? TIA, Phil On Mon, Apr 4, 2022 at 11:48 PM Joe Witt wrote: > Phil > > Here is a command I commonly run to ensure I have nothing other than > what the source tree intends. > > mvn -T C1 clean package verify -Pcontrib-check,include-grpc > > This will do everything - build it all, run contrib check, and use all the > cores. > > Thanks > > On Mon, Apr 4, 2022 at 6:38 AM Mike Thomsen > wrote: > > > Did you run "mvn install" from the root of the project before > > attempting to run a full test of the code base? > > > > On Mon, Apr 4, 2022 at 9:36 AM Phil H wrote: > > > > > > Hi there, > > > > > > So I got past this issue by running "mvn test" from the root of the > nifi > > > tree. After much compiling and testing, I am now getting the attached > > > error. I think I am following the contributor guide in having my local > > > branch track origin/main (currently "4a90334728: NIFI-9846 Implement > > > pagination listing for Azure List processors"). > > > > > > Is this some environmental issue on my machine somehow? Or does the > main > > > branch contain compilation errors, and I should be tracking something > > else > > > for my own branch? As I said in my previous email, I am new to github, > > so > > > I'm not sure of the conventions there. > > > > > > Thanks in advance > > > Phil > > > > > > (PS: this occur whethers I use JDK1.8 or JDK11, the two options I have > > > installed) > > > > > > > > > > > > [ERROR] Failed to execute goal > > > org.apache.maven.plugins:maven-compiler-plugin:3.9.0:compile > > > (default-compile) on project nifi-h2-database-migrator: Compilation > > > failure: Compilation failure: > > > [ERROR] > > > > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[19,35] > > > error: package org.apache.nifi.org.h2.jdbcx does not exist > > > [ERROR] > > > > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,8] > > > error: cannot find symbol > > > [ERROR] symbol: class JdbcDataSource > > > [ERROR] location: class H2DatabaseMigrator > > > [ERROR] > > > > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,49] > > > error: cannot find symbol > > > [ERROR] symbol: class JdbcDataSource > > > [ERROR] location: class H2DatabaseMigrator > > > > > > On Sat, Apr 2, 2022 at 10:20 PM Phil H wrote: > > > > > > > Hi there, > > > > > > > > Trying to build the nifi git repo for the first time and I'm getting > > the > > > > message below > > > > > > > > I'm used to working in offline development environments, so I'm a bit > > lost > > > > with this online dependency stuff. I note that > > > > https://repository.apache.org/snapshots/org/apache/nifi/ doesn't > > contain > > > > any similar subdirectories to that in the URL. > > > > > > > > Help! > > > > > > > > Regards, > > > > Phil > > > > > > > > [WARNING] The POM for org.apache.nifi:nifi-utils:jar:1.16.0-SNAPSHOT > is > > > > missing, no dependency information available > > > > Downloading from apache.snapshots: > > > > > > > https://repository.apache.org/snapshots/org/apache/nifi/nifi-utils/1.16.0-SNAPSHOT/nifi-utils-1.16.0-SNAPSHOT.jar > > > > [INFO] > > > > > > > > > > [INFO] Reactor Summary for nifi-standard-bundle 1.16.0-SNAPSHOT: > > > > [INFO] > > > > [INFO] nifi-standard-bundle ... SUCCESS > > [01:07 > > > > min] > > > > [INFO] nifi-standard-utils FAILURE [ > > > > 3.218 s] > > > > [INFO] nifi-standard-processors ... SKIPPED > > > > [INFO] nifi-standard-reporting-tasks .. SKIPPED > > > > [INFO] nifi-standard-content-viewer ... SKIPPED > > > > [INFO] nifi-jolt-transform-json-ui SKIPPED > > > > [INFO] nifi-standard-nar .. SKIPPED > > > > [INFO] > > > > > > > > > > [INFO] BUILD FAILURE > > > > [INFO] > > > > > > > > > > [INFO] Total time: 01:43 min > > > > [INFO] Finished at: 2022-04-02T21:58:47+10:00 > > > > [INFO] > > > > > > > > > > [ERROR] Failed to execute goal on project nifi-standard-utils: Could > > not > > > > resolve dependencies for project > > > > org.apache.nifi:nifi-standard-utils:jar:1.16.0-SNAPSHOT: Could not >
Re: Missing maven dependencies when building nifi
Thanks Mike - that certainly moved the pieces along the board. Your patience for my ignorance is greatly appreciated ;-) Sidenote: I always thought mvn "install" was to do with packaging up binaries, and occurred after the "test" phase had completed? So, got a new new problem: [INFO] Running org.apache.nifi.controller.queue.clustered.server.ConnectionLoadBalanceServerTest [ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.551 s <<< FAILURE! - in org.apache.nifi.controller.queue.clustered.server.ConnectionLoadBalanceServerTest [ERROR] org.apache.nifi.controller.queue.clustered.server.ConnectionLoadBalanceServerTest.testRequestPeerListShouldUseTLS Time elapsed: 0.298 s <<< ERROR! java.io.IOException: Could not begin listening for incoming connections in order to load balance data across the cluster. Please verify the values of the 'nifi.cluster.load.balance.port' and 'nifi.cluster.load.balance.host' properties as well as the 'nifi.security.*' properties at org.apache.nifi.controller.queue.clustered.server.ConnectionLoadBalanceServerTest.testRequestPeerListShouldUseTLS(ConnectionLoadBalanceServerTest.groovy:77) Caused by: java.net.BindException: Address already in use: JVM_Bind at org.apache.nifi.controller.queue.clustered.server.ConnectionLoadBalanceServerTest.testRequestPeerListShouldUseTLS(ConnectionLoadBalanceServerTest.groovy:77) So I had a look at the test code, checked that nothing I was running elsewhere was binding on the port declared in the test (54321) and restarted the testing with "mvn install -rf :nifi-framework-core". It successfully ran the previous test (non-deterministic behaviour?? please no), but this time it hung up a few tests later: [INFO] Running org.apache.nifi.controller.state.server.TestZooKeeperStateServer [ERROR] Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.305 s <<< FAILURE! - in org.apache.nifi.controller.state.server.TestZooKeeperStateServer [ERROR] org.apache.nifi.controller.state.server.TestZooKeeperStateServer.testServerCreatePath Time elapsed: 0.272 s <<< ERROR! org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /test at org.apache.nifi.controller.state.server.TestZooKeeperStateServer.testServerCreatePath(TestZooKeeperStateServer.java:125) Re-running resulted in the same failure a second time (points for consistency!), but I'm not sure what to do about this one. Phil On Mon, Apr 4, 2022 at 11:38 PM Mike Thomsen wrote: > Did you run "mvn install" from the root of the project before > attempting to run a full test of the code base? > > On Mon, Apr 4, 2022 at 9:36 AM Phil H wrote: > > > > Hi there, > > > > So I got past this issue by running "mvn test" from the root of the nifi > > tree. After much compiling and testing, I am now getting the attached > > error. I think I am following the contributor guide in having my local > > branch track origin/main (currently "4a90334728: NIFI-9846 Implement > > pagination listing for Azure List processors"). > > > > Is this some environmental issue on my machine somehow? Or does the main > > branch contain compilation errors, and I should be tracking something > else > > for my own branch? As I said in my previous email, I am new to github, > so > > I'm not sure of the conventions there. > > > > Thanks in advance > > Phil > > > > (PS: this occur whethers I use JDK1.8 or JDK11, the two options I have > > installed) > > > > > > > > [ERROR] Failed to execute goal > > org.apache.maven.plugins:maven-compiler-plugin:3.9.0:compile > > (default-compile) on project nifi-h2-database-migrator: Compilation > > failure: Compilation failure: > > [ERROR] > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[19,35] > > error: package org.apache.nifi.org.h2.jdbcx does not exist > > [ERROR] > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,8] > > error: cannot find symbol > > [ERROR] symbol: class JdbcDataSource > > [ERROR] location: class H2DatabaseMigrator > > [ERROR] > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,49] > > error: cannot find symbol > > [ERROR] symbol: class JdbcDataSource > > [ERROR] location: class H2DatabaseMigrator > > > > On Sat, Apr 2, 2022 at 10:20 PM Phil H wrote: > > > > > Hi there, > > > > > > Trying to build the nifi git repo for the first time and I'm getting > the > > > message below > > > > > > I'm used to working in offline development environments, so I'm a bit > lost > > > with this online dependency stuff. I note that > > > https://repository.apache.org/snapshots/org/apache/nifi/ doesn't > contain > > > any similar subdirectories to that in the URL. > > > > > > Help! > > > > > > Regards, > > > Phil > > > > > >
Re: Missing maven dependencies when building nifi
Phil Here is a command I commonly run to ensure I have nothing other than what the source tree intends. mvn -T C1 clean package verify -Pcontrib-check,include-grpc This will do everything - build it all, run contrib check, and use all the cores. Thanks On Mon, Apr 4, 2022 at 6:38 AM Mike Thomsen wrote: > Did you run "mvn install" from the root of the project before > attempting to run a full test of the code base? > > On Mon, Apr 4, 2022 at 9:36 AM Phil H wrote: > > > > Hi there, > > > > So I got past this issue by running "mvn test" from the root of the nifi > > tree. After much compiling and testing, I am now getting the attached > > error. I think I am following the contributor guide in having my local > > branch track origin/main (currently "4a90334728: NIFI-9846 Implement > > pagination listing for Azure List processors"). > > > > Is this some environmental issue on my machine somehow? Or does the main > > branch contain compilation errors, and I should be tracking something > else > > for my own branch? As I said in my previous email, I am new to github, > so > > I'm not sure of the conventions there. > > > > Thanks in advance > > Phil > > > > (PS: this occur whethers I use JDK1.8 or JDK11, the two options I have > > installed) > > > > > > > > [ERROR] Failed to execute goal > > org.apache.maven.plugins:maven-compiler-plugin:3.9.0:compile > > (default-compile) on project nifi-h2-database-migrator: Compilation > > failure: Compilation failure: > > [ERROR] > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[19,35] > > error: package org.apache.nifi.org.h2.jdbcx does not exist > > [ERROR] > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,8] > > error: cannot find symbol > > [ERROR] symbol: class JdbcDataSource > > [ERROR] location: class H2DatabaseMigrator > > [ERROR] > > > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,49] > > error: cannot find symbol > > [ERROR] symbol: class JdbcDataSource > > [ERROR] location: class H2DatabaseMigrator > > > > On Sat, Apr 2, 2022 at 10:20 PM Phil H wrote: > > > > > Hi there, > > > > > > Trying to build the nifi git repo for the first time and I'm getting > the > > > message below > > > > > > I'm used to working in offline development environments, so I'm a bit > lost > > > with this online dependency stuff. I note that > > > https://repository.apache.org/snapshots/org/apache/nifi/ doesn't > contain > > > any similar subdirectories to that in the URL. > > > > > > Help! > > > > > > Regards, > > > Phil > > > > > > [WARNING] The POM for org.apache.nifi:nifi-utils:jar:1.16.0-SNAPSHOT is > > > missing, no dependency information available > > > Downloading from apache.snapshots: > > > > https://repository.apache.org/snapshots/org/apache/nifi/nifi-utils/1.16.0-SNAPSHOT/nifi-utils-1.16.0-SNAPSHOT.jar > > > [INFO] > > > > > > > [INFO] Reactor Summary for nifi-standard-bundle 1.16.0-SNAPSHOT: > > > [INFO] > > > [INFO] nifi-standard-bundle ... SUCCESS > [01:07 > > > min] > > > [INFO] nifi-standard-utils FAILURE [ > > > 3.218 s] > > > [INFO] nifi-standard-processors ... SKIPPED > > > [INFO] nifi-standard-reporting-tasks .. SKIPPED > > > [INFO] nifi-standard-content-viewer ... SKIPPED > > > [INFO] nifi-jolt-transform-json-ui SKIPPED > > > [INFO] nifi-standard-nar .. SKIPPED > > > [INFO] > > > > > > > [INFO] BUILD FAILURE > > > [INFO] > > > > > > > [INFO] Total time: 01:43 min > > > [INFO] Finished at: 2022-04-02T21:58:47+10:00 > > > [INFO] > > > > > > > [ERROR] Failed to execute goal on project nifi-standard-utils: Could > not > > > resolve dependencies for project > > > org.apache.nifi:nifi-standard-utils:jar:1.16.0-SNAPSHOT: Could not find > > > artifact org.apache.nifi:nifi-utils:jar:1.16.0-SNAPSHOT in > apache.snapshots > > > (https://repository.apache.org/snapshots) -> [Help 1] > > > >
Re: Missing maven dependencies when building nifi
Did you run "mvn install" from the root of the project before attempting to run a full test of the code base? On Mon, Apr 4, 2022 at 9:36 AM Phil H wrote: > > Hi there, > > So I got past this issue by running "mvn test" from the root of the nifi > tree. After much compiling and testing, I am now getting the attached > error. I think I am following the contributor guide in having my local > branch track origin/main (currently "4a90334728: NIFI-9846 Implement > pagination listing for Azure List processors"). > > Is this some environmental issue on my machine somehow? Or does the main > branch contain compilation errors, and I should be tracking something else > for my own branch? As I said in my previous email, I am new to github, so > I'm not sure of the conventions there. > > Thanks in advance > Phil > > (PS: this occur whethers I use JDK1.8 or JDK11, the two options I have > installed) > > > > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-compiler-plugin:3.9.0:compile > (default-compile) on project nifi-h2-database-migrator: Compilation > failure: Compilation failure: > [ERROR] > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[19,35] > error: package org.apache.nifi.org.h2.jdbcx does not exist > [ERROR] > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,8] > error: cannot find symbol > [ERROR] symbol: class JdbcDataSource > [ERROR] location: class H2DatabaseMigrator > [ERROR] > D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,49] > error: cannot find symbol > [ERROR] symbol: class JdbcDataSource > [ERROR] location: class H2DatabaseMigrator > > On Sat, Apr 2, 2022 at 10:20 PM Phil H wrote: > > > Hi there, > > > > Trying to build the nifi git repo for the first time and I'm getting the > > message below > > > > I'm used to working in offline development environments, so I'm a bit lost > > with this online dependency stuff. I note that > > https://repository.apache.org/snapshots/org/apache/nifi/ doesn't contain > > any similar subdirectories to that in the URL. > > > > Help! > > > > Regards, > > Phil > > > > [WARNING] The POM for org.apache.nifi:nifi-utils:jar:1.16.0-SNAPSHOT is > > missing, no dependency information available > > Downloading from apache.snapshots: > > https://repository.apache.org/snapshots/org/apache/nifi/nifi-utils/1.16.0-SNAPSHOT/nifi-utils-1.16.0-SNAPSHOT.jar > > [INFO] > > > > [INFO] Reactor Summary for nifi-standard-bundle 1.16.0-SNAPSHOT: > > [INFO] > > [INFO] nifi-standard-bundle ... SUCCESS [01:07 > > min] > > [INFO] nifi-standard-utils FAILURE [ > > 3.218 s] > > [INFO] nifi-standard-processors ... SKIPPED > > [INFO] nifi-standard-reporting-tasks .. SKIPPED > > [INFO] nifi-standard-content-viewer ... SKIPPED > > [INFO] nifi-jolt-transform-json-ui SKIPPED > > [INFO] nifi-standard-nar .. SKIPPED > > [INFO] > > > > [INFO] BUILD FAILURE > > [INFO] > > > > [INFO] Total time: 01:43 min > > [INFO] Finished at: 2022-04-02T21:58:47+10:00 > > [INFO] > > > > [ERROR] Failed to execute goal on project nifi-standard-utils: Could not > > resolve dependencies for project > > org.apache.nifi:nifi-standard-utils:jar:1.16.0-SNAPSHOT: Could not find > > artifact org.apache.nifi:nifi-utils:jar:1.16.0-SNAPSHOT in apache.snapshots > > (https://repository.apache.org/snapshots) -> [Help 1] > >
Re: Missing maven dependencies when building nifi
Hi there, So I got past this issue by running "mvn test" from the root of the nifi tree. After much compiling and testing, I am now getting the attached error. I think I am following the contributor guide in having my local branch track origin/main (currently "4a90334728: NIFI-9846 Implement pagination listing for Azure List processors"). Is this some environmental issue on my machine somehow? Or does the main branch contain compilation errors, and I should be tracking something else for my own branch? As I said in my previous email, I am new to github, so I'm not sure of the conventions there. Thanks in advance Phil (PS: this occur whethers I use JDK1.8 or JDK11, the two options I have installed) [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.9.0:compile (default-compile) on project nifi-h2-database-migrator: Compilation failure: Compilation failure: [ERROR] D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[19,35] error: package org.apache.nifi.org.h2.jdbcx does not exist [ERROR] D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,8] error: cannot find symbol [ERROR] symbol: class JdbcDataSource [ERROR] location: class H2DatabaseMigrator [ERROR] D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,49] error: cannot find symbol [ERROR] symbol: class JdbcDataSource [ERROR] location: class H2DatabaseMigrator On Sat, Apr 2, 2022 at 10:20 PM Phil H wrote: > Hi there, > > Trying to build the nifi git repo for the first time and I'm getting the > message below > > I'm used to working in offline development environments, so I'm a bit lost > with this online dependency stuff. I note that > https://repository.apache.org/snapshots/org/apache/nifi/ doesn't contain > any similar subdirectories to that in the URL. > > Help! > > Regards, > Phil > > [WARNING] The POM for org.apache.nifi:nifi-utils:jar:1.16.0-SNAPSHOT is > missing, no dependency information available > Downloading from apache.snapshots: > https://repository.apache.org/snapshots/org/apache/nifi/nifi-utils/1.16.0-SNAPSHOT/nifi-utils-1.16.0-SNAPSHOT.jar > [INFO] > > [INFO] Reactor Summary for nifi-standard-bundle 1.16.0-SNAPSHOT: > [INFO] > [INFO] nifi-standard-bundle ... SUCCESS [01:07 > min] > [INFO] nifi-standard-utils FAILURE [ > 3.218 s] > [INFO] nifi-standard-processors ... SKIPPED > [INFO] nifi-standard-reporting-tasks .. SKIPPED > [INFO] nifi-standard-content-viewer ... SKIPPED > [INFO] nifi-jolt-transform-json-ui SKIPPED > [INFO] nifi-standard-nar .. SKIPPED > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 01:43 min > [INFO] Finished at: 2022-04-02T21:58:47+10:00 > [INFO] > > [ERROR] Failed to execute goal on project nifi-standard-utils: Could not > resolve dependencies for project > org.apache.nifi:nifi-standard-utils:jar:1.16.0-SNAPSHOT: Could not find > artifact org.apache.nifi:nifi-utils:jar:1.16.0-SNAPSHOT in apache.snapshots > (https://repository.apache.org/snapshots) -> [Help 1] >