[nifi] annotated tag nifi-1.21.0-RC2 created (now df67f7a893)
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a change to annotated tag nifi-1.21.0-RC2 in repository https://gitbox.apache.org/repos/asf/nifi.git at df67f7a893 (tag) tagging 892f822107da84ca0dcfefdb5c91c5bc11dc3dc1 (commit) replaces rel/nifi-1.20.0 by Joe Witt on Mon Apr 3 14:40:07 2023 -0700 - Log - NIFI-11357-RC2 copy for tag nifi-1.21.0-RC2 --- No new revisions were added by this update.
[nifi] branch NIFI-11357-RC2 created (now 9c27ddcb1c)
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a change to branch NIFI-11357-RC2 in repository https://gitbox.apache.org/repos/asf/nifi.git at 9c27ddcb1c NIFI-11357-RC2 prepare for next development iteration This branch includes the following new commits: new 892f822107 NIFI-11357-RC2 prepare release nifi-1.21.0-RC2 new 9c27ddcb1c NIFI-11357-RC2 prepare for next development iteration The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
svn commit: r61034 - /dev/nifi/nifi-1.21.0/
Author: joewitt Date: Tue Apr 4 00:09:06 2023 New Revision: 61034 Log: Uploading RC2 artifacts for nifi-1.21.0 Modified: dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.asc dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.sha256 dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.sha512 dev/nifi/nifi-1.21.0/minifi-c2-1.21.0-bin.zip dev/nifi/nifi-1.21.0/minifi-c2-1.21.0-bin.zip.asc dev/nifi/nifi-1.21.0/minifi-c2-1.21.0-bin.zip.sha256 dev/nifi/nifi-1.21.0/minifi-c2-1.21.0-bin.zip.sha512 dev/nifi/nifi-1.21.0/minifi-toolkit-1.21.0-bin.zip dev/nifi/nifi-1.21.0/minifi-toolkit-1.21.0-bin.zip.asc dev/nifi/nifi-1.21.0/minifi-toolkit-1.21.0-bin.zip.sha256 dev/nifi/nifi-1.21.0/minifi-toolkit-1.21.0-bin.zip.sha512 dev/nifi/nifi-1.21.0/nifi-1.21.0-bin.zip dev/nifi/nifi-1.21.0/nifi-1.21.0-bin.zip.asc dev/nifi/nifi-1.21.0/nifi-1.21.0-bin.zip.sha256 dev/nifi/nifi-1.21.0/nifi-1.21.0-bin.zip.sha512 dev/nifi/nifi-1.21.0/nifi-1.21.0-source-release.zip dev/nifi/nifi-1.21.0/nifi-1.21.0-source-release.zip.asc dev/nifi/nifi-1.21.0/nifi-1.21.0-source-release.zip.sha256 dev/nifi/nifi-1.21.0/nifi-1.21.0-source-release.zip.sha512 dev/nifi/nifi-1.21.0/nifi-registry-1.21.0-bin.zip dev/nifi/nifi-1.21.0/nifi-registry-1.21.0-bin.zip.asc dev/nifi/nifi-1.21.0/nifi-registry-1.21.0-bin.zip.sha256 dev/nifi/nifi-1.21.0/nifi-registry-1.21.0-bin.zip.sha512 dev/nifi/nifi-1.21.0/nifi-registry-toolkit-1.21.0-bin.zip dev/nifi/nifi-1.21.0/nifi-registry-toolkit-1.21.0-bin.zip.asc dev/nifi/nifi-1.21.0/nifi-registry-toolkit-1.21.0-bin.zip.sha256 dev/nifi/nifi-1.21.0/nifi-registry-toolkit-1.21.0-bin.zip.sha512 dev/nifi/nifi-1.21.0/nifi-stateless-1.21.0-bin.zip dev/nifi/nifi-1.21.0/nifi-stateless-1.21.0-bin.zip.asc dev/nifi/nifi-1.21.0/nifi-stateless-1.21.0-bin.zip.sha256 dev/nifi/nifi-1.21.0/nifi-stateless-1.21.0-bin.zip.sha512 dev/nifi/nifi-1.21.0/nifi-toolkit-1.21.0-bin.zip dev/nifi/nifi-1.21.0/nifi-toolkit-1.21.0-bin.zip.asc dev/nifi/nifi-1.21.0/nifi-toolkit-1.21.0-bin.zip.sha256 dev/nifi/nifi-1.21.0/nifi-toolkit-1.21.0-bin.zip.sha512 Modified: dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip == Binary files - no diff available. Modified: dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.asc == --- dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.asc (original) +++ dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.asc Tue Apr 4 00:09:06 2023 @@ -1,11 +1,11 @@ -BEGIN PGP SIGNATURE- -iQEzBAABCgAdFiEE0vJLgJ/6seIa6gKDkJO/hU+BGhoFAmQksm4ACgkQkJO/hU+B -Ghri6QgApfRom37Z3bZ08bD/Lle3BXYKbwr9SwwTtHcF+GTMcKsWql7vJpFviU2+ -QA0S2CqvK9Mig5k9bfWePnirQ9Ld1rNcuJQN4PePumUc/ud5GHmjmeRJRe+DmMwp -HvxB/2NHUSO+HhqP+jKsGHUgsgUrbPBGPRvnWSBHLUwNlBCgtAU7/Mzm4BOAtIpS -pbepvtHo9K1APouYY7/q9XHZlk0ZCfavu39WxESJRIq7+iD5EbyVchEH74uDG2UM -z8yr6pQH7rhLS4ZmfazhQGCSAikSterTcODgJ97gcwV+3iTE9j/GkhePhp561pa1 -Q2WrdeFtKrfDSAAQhvezqS925nE0kQ== -=XYFt +iQEzBAABCgAdFiEE0vJLgJ/6seIa6gKDkJO/hU+BGhoFAmQrabYACgkQkJO/hU+B +Ghpj2wgAvQGB44M6t/LqMRAg+JCVD3fRqFVAINb+NM2dYUqltfoyJ0cBnGh7+ySU +ERK1KTcjUJ97HV6zKfTVXFdFVj4e8LB5JGXFYLLunlD+L3YKLtZ0EPP8F4x25jmU +22oWWaRvpfaR3JZPEVqPOsWvlrNZZB/XqDgWVYs8+UA3uXOkfSpJNAV1xPRDxMzs +NxpM4yKyW6fNdQwLst4aXPnBGWHwSeJQR4tlMAA+26m2VuKeUnKpW6Rk71pA2FSn +Gfqvl7ViS0bQcNgUpR5pTFyZMdTsq6Bo4T54is7Co99GA3VddnlMsktL3Yg99v+Y +NFH5Gw423anR18wHnrKMz51PAfAUBA== +=N7bP -END PGP SIGNATURE- Modified: dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.sha256 == --- dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.sha256 (original) +++ dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.sha256 Tue Apr 4 00:09:06 2023 @@ -1 +1 @@ -40d1780e2ed823379e914590dee6e3b571f6fa5afac2eec40e4c56e814216e13 +57500cd26f51298e71661ca81a8b1e262bb092c6ee57c32976764a8689b3c978 Modified: dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.sha512 == --- dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.sha512 (original) +++ dev/nifi/nifi-1.21.0/minifi-1.21.0-bin.zip.sha512 Tue Apr 4 00:09:06 2023 @@ -1 +1 @@ -b38d96957208a2d9e9177d7a8675bbeb3c661c9ffaee93aa917143391d68fddbeef8fa63f89cb172fdb9f9e06f8fb001aa2b58c73b320569bdb45a4bcb6094e4 +f4f12bfc6aaeba7c8cb7f659b4bb6d27bc74233fb2c277be5aa179b3ad510e3c77c92397e08b4c59fe3bd0cc86bd1a1befdf27d22af4fe5a301f347024899be2 Modified: dev/nifi/nifi-1.21.0/minifi-c2-1.21.0-bin.zip == Binary files - no diff available. Modified: dev/nifi/nifi-1.21.0/minifi-c2-1.21.0-bin.zip.asc == --- dev/nifi/nifi-1.21.0/minifi-c2-1.21.0-bin.zip.asc (original) +++ dev/nifi/nifi-1.21.0/minifi-c2-1.21.0-bin.zip.
[nifi] 03/04: NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a commit to branch support/nifi-1.x in repository https://gitbox.apache.org/repos/asf/nifi.git commit e3c550e73c082a24679c1a24c806d78aec35f677 Author: exceptionfactory AuthorDate: Mon Apr 3 11:19:08 2023 -0500 NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0 Signed-off-by: Joe Witt --- nifi-nar-bundles/nifi-iceberg-bundle/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/nifi-nar-bundles/nifi-iceberg-bundle/pom.xml b/nifi-nar-bundles/nifi-iceberg-bundle/pom.xml index 11c0d8a1c8..630ae15502 100644 --- a/nifi-nar-bundles/nifi-iceberg-bundle/pom.xml +++ b/nifi-nar-bundles/nifi-iceberg-bundle/pom.xml @@ -25,7 +25,7 @@ pom -1.1.0 +1.2.0 3.1.3
[nifi] 04/04: NIFI-11378 This closes #7115. Upgraded Jersey from 2.36 to 2.39.1
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a commit to branch support/nifi-1.x in repository https://gitbox.apache.org/repos/asf/nifi.git commit ebaff2c616142aa892232334924f52787fc1aabf Author: exceptionfactory AuthorDate: Mon Apr 3 12:36:10 2023 -0500 NIFI-11378 This closes #7115. Upgraded Jersey from 2.36 to 2.39.1 Signed-off-by: Joe Witt --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index caf67e5fd0..37e6ef20bf 100644 --- a/pom.xml +++ b/pom.xml @@ -134,7 +134,7 @@ 1.2.1 2.1.5 1.9.6 -2.36 +2.39.1 2.20.0 1.3.5 4.11.0
[nifi] 02/04: NIFI-11376 This closes #7112. Upgraded Jetty from 9.4.50 to 9.4.51
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a commit to branch support/nifi-1.x in repository https://gitbox.apache.org/repos/asf/nifi.git commit 435caa76008f9e86f16beb92e757846a9e44e8f0 Author: exceptionfactory AuthorDate: Mon Apr 3 10:42:44 2023 -0500 NIFI-11376 This closes #7112. Upgraded Jetty from 9.4.50 to 9.4.51 Signed-off-by: Joe Witt --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index d86855050a..caf67e5fd0 100644 --- a/pom.xml +++ b/pom.xml @@ -120,7 +120,7 @@ 1.17.6 2.0.7 2.4.0 -9.4.50.v20221201 +9.4.51.v20230217 2.14.2 1.11.1 2.3.5
[nifi] branch support/nifi-1.x updated (0510f8cca2 -> ebaff2c616)
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a change to branch support/nifi-1.x in repository https://gitbox.apache.org/repos/asf/nifi.git from 0510f8cca2 NIFI-11137 Add record support to Consume/PublishJMS (#6987) new 1e043d479b NIFI-11375 This closes #7111. Upgraded Surefire to 3.0.0 and upgraded other plugins new 435caa7600 NIFI-11376 This closes #7112. Upgraded Jetty from 9.4.50 to 9.4.51 new e3c550e73c NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0 new ebaff2c616 NIFI-11378 This closes #7115. Upgraded Jersey from 2.36 to 2.39.1 The 4 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: nifi-nar-bundles/nifi-iceberg-bundle/pom.xml | 2 +- pom.xml | 14 +++--- 2 files changed, 8 insertions(+), 8 deletions(-)
[nifi] 01/04: NIFI-11375 This closes #7111. Upgraded Surefire to 3.0.0 and upgraded other plugins
This is an automated email from the ASF dual-hosted git repository.
joewitt pushed a commit to branch support/nifi-1.x
in repository https://gitbox.apache.org/repos/asf/nifi.git
commit 1e043d479beab82862c39af3b91f85fd8eeef2b6
Author: exceptionfactory
AuthorDate: Mon Apr 3 09:40:00 2023 -0500
NIFI-11375 This closes #7111. Upgraded Surefire to 3.0.0 and upgraded other
plugins
- Upgraded Surefire Plugin from 3.0.0-M8 to 3.0.0
- Upgraded Compiler Plugin from 3.10.1 to 3.11.0
- Upgraded Assembly Plugin from 3.4.2 to 3.5.0
- Upgraded Javadoc Plugin from 3.4.1 to 3.5.0
- Upgraded Release Plugin from 3.0.0-M7 to 3.0.0
Signed-off-by: Joe Witt
---
pom.xml | 10 +-
1 file changed, 5 insertions(+), 5 deletions(-)
diff --git a/pom.xml b/pom.xml
index bcdd332141..d86855050a 100644
--- a/pom.xml
+++ b/pom.xml
@@ -129,7 +129,7 @@
2.4.10
3.0.14
3.0.8-01
-3.0.0-M8
+3.0.0
3.3.5
1.2.1
2.1.5
@@ -743,7 +743,7 @@
org.apache.maven.plugins
maven-compiler-plugin
-3.10.1
+3.11.0
true
${maven.compiler.showDeprecation}
@@ -783,7 +783,7 @@
org.apache.maven.plugins
maven-assembly-plugin
-3.4.2
+3.5.0
gnu
@@ -809,7 +809,7 @@
org.apache.maven.plugins
maven-javadoc-plugin
-3.4.1
+3.5.0
false
true
@@ -823,7 +823,7 @@
org.apache.maven.plugins
maven-release-plugin
-3.0.0-M7
+3.0.0
true
apache-release
[nifi] 01/04: NIFI-11375 This closes #7111. Upgraded Surefire to 3.0.0 and upgraded other plugins
This is an automated email from the ASF dual-hosted git repository.
joewitt pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/nifi.git
commit 86bc185abfcc206d6018507b129766f0a1933f91
Author: exceptionfactory
AuthorDate: Mon Apr 3 09:40:00 2023 -0500
NIFI-11375 This closes #7111. Upgraded Surefire to 3.0.0 and upgraded other
plugins
- Upgraded Surefire Plugin from 3.0.0-M8 to 3.0.0
- Upgraded Compiler Plugin from 3.10.1 to 3.11.0
- Upgraded Assembly Plugin from 3.4.2 to 3.5.0
- Upgraded Javadoc Plugin from 3.4.1 to 3.5.0
- Upgraded Release Plugin from 3.0.0-M7 to 3.0.0
Signed-off-by: Joe Witt
---
pom.xml | 10 +-
1 file changed, 5 insertions(+), 5 deletions(-)
diff --git a/pom.xml b/pom.xml
index 0416019679..f108c98251 100644
--- a/pom.xml
+++ b/pom.xml
@@ -129,7 +129,7 @@
2.4.10
3.0.14
3.0.8-01
-3.0.0-M8
+3.0.0
3.3.5
1.2.1
2.1.5
@@ -777,7 +777,7 @@
org.apache.maven.plugins
maven-compiler-plugin
-3.10.1
+3.11.0
true
${maven.compiler.showDeprecation}
@@ -817,7 +817,7 @@
org.apache.maven.plugins
maven-assembly-plugin
-3.4.2
+3.5.0
gnu
@@ -843,7 +843,7 @@
org.apache.maven.plugins
maven-javadoc-plugin
-3.4.1
+3.5.0
false
true
@@ -858,7 +858,7 @@
org.apache.maven.plugins
maven-release-plugin
-3.0.0-M7
+3.0.0
true
apache-release
[nifi] branch main updated (32df0fa484 -> a8a6d20659)
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git from 32df0fa484 NIFI-11137 Add record support to Consume/PublishJMS (#6987) new 86bc185abf NIFI-11375 This closes #7111. Upgraded Surefire to 3.0.0 and upgraded other plugins new 794f77c736 NIFI-11376 This closes #7112. Upgraded Jetty from 9.4.50 to 9.4.51 new dffad44a03 NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0 new a8a6d20659 NIFI-11378 This closes #7115. Upgraded Jersey from 2.36 to 2.39.1 The 4 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: nifi-nar-bundles/nifi-iceberg-bundle/pom.xml | 2 +- pom.xml | 14 +++--- 2 files changed, 8 insertions(+), 8 deletions(-)
[nifi] 03/04: NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git commit dffad44a03b6d3cad70debc3f7aaf645dadea43a Author: exceptionfactory AuthorDate: Mon Apr 3 11:19:08 2023 -0500 NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0 Signed-off-by: Joe Witt --- nifi-nar-bundles/nifi-iceberg-bundle/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/nifi-nar-bundles/nifi-iceberg-bundle/pom.xml b/nifi-nar-bundles/nifi-iceberg-bundle/pom.xml index cfbf8029f0..cc43069618 100644 --- a/nifi-nar-bundles/nifi-iceberg-bundle/pom.xml +++ b/nifi-nar-bundles/nifi-iceberg-bundle/pom.xml @@ -25,7 +25,7 @@ pom -1.1.0 +1.2.0 3.1.3
[nifi] 04/04: NIFI-11378 This closes #7115. Upgraded Jersey from 2.36 to 2.39.1
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git commit a8a6d2065920d4a9900e2a53af003d51fd26ed66 Author: exceptionfactory AuthorDate: Mon Apr 3 12:36:10 2023 -0500 NIFI-11378 This closes #7115. Upgraded Jersey from 2.36 to 2.39.1 Signed-off-by: Joe Witt --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index c47e65acb0..4b9519d6c6 100644 --- a/pom.xml +++ b/pom.xml @@ -134,7 +134,7 @@ 1.2.1 2.1.5 1.9.19 -2.36 +2.39.1 2.20.0 1.3.5 4.11.0
[nifi] 02/04: NIFI-11376 This closes #7112. Upgraded Jetty from 9.4.50 to 9.4.51
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git commit 794f77c7367bd45ad21040650d0e46b9cf37a195 Author: exceptionfactory AuthorDate: Mon Apr 3 10:42:44 2023 -0500 NIFI-11376 This closes #7112. Upgraded Jetty from 9.4.50 to 9.4.51 Signed-off-by: Joe Witt --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index f108c98251..c47e65acb0 100644 --- a/pom.xml +++ b/pom.xml @@ -120,7 +120,7 @@ 1.17.6 2.0.7 2.4.0 -9.4.50.v20221201 +9.4.51.v20230217 2.14.2 1.11.1 2.3.5
[nifi] branch support/nifi-1.x updated: NIFI-11137 Add record support to Consume/PublishJMS (#6987)
This is an automated email from the ASF dual-hosted git repository.
turcsanyi pushed a commit to branch support/nifi-1.x
in repository https://gitbox.apache.org/repos/asf/nifi.git
The following commit(s) were added to refs/heads/support/nifi-1.x by this push:
new 0510f8cca2 NIFI-11137 Add record support to Consume/PublishJMS (#6987)
0510f8cca2 is described below
commit 0510f8cca29a2f92c6008b345ba40c2bc33f2e75
Author: Nandor Soma Abonyi
AuthorDate: Sun Mar 12 22:58:55 2023 +0100
NIFI-11137 Add record support to Consume/PublishJMS (#6987)
---
.../nifi-jms-bundle/nifi-jms-processors/pom.xml| 22 ++
.../nifi/jms/processors/AbstractJMSProcessor.java | 16 ++
.../org/apache/nifi/jms/processors/ConsumeJMS.java | 204 ++---
.../apache/nifi/jms/processors/JMSConsumer.java| 194 ++--
.../apache/nifi/jms/processors/JMSPublisher.java | 2 +-
.../org/apache/nifi/jms/processors/PublishJMS.java | 140 +---
.../ioconcept/reader/FlowFileReader.java | 24 ++
.../ioconcept/reader/FlowFileReaderCallback.java | 24 ++
.../ioconcept/reader/MessageHandler.java | 21 ++
.../reader/StateTrackingFlowFileReader.java| 73 ++
.../reader/record/ProvenanceEventTemplates.java| 25 +++
.../ioconcept/reader/record/RecordSupplier.java| 82 +++
.../ioconcept/writer/AttributeSource.java | 23 ++
.../ioconcept/writer/FlowFileWriter.java | 25 +++
.../ioconcept/writer/FlowFileWriterCallback.java | 27 +++
.../processors/ioconcept/writer/Marshaller.java| 21 ++
.../ioconcept/writer/record/OutputStrategy.java| 57 +
.../ioconcept/writer/record/RecordUtils.java | 78 +++
.../ioconcept/writer/record/RecordWriter.java | 205 +
.../apache/nifi/jms/processors/ConsumeJMSIT.java | 199 +
.../jms/processors/JMSPublisherConsumerIT.java | 164 ++
.../apache/nifi/jms/processors/PublishJMSIT.java | 248 -
.../nifi/jms/processors/helpers/JMSTestUtil.java | 44
23 files changed, 1679 insertions(+), 239 deletions(-)
diff --git a/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/pom.xml
b/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/pom.xml
index d171a03946..e57e1f991a 100644
--- a/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/pom.xml
+++ b/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/pom.xml
@@ -58,6 +58,14 @@
commons-io
commons-io
+
+org.apache.nifi
+nifi-record-serialization-service-api
+
+
+org.apache.nifi
+nifi-record
+
org.apache.activemq
activemq-client
@@ -83,6 +91,20 @@
1.21.0-SNAPSHOT
test
+
+
+
+org.apache.nifi
+nifi-record-serialization-services
+1.21.0-SNAPSHOT
+test
+
+
+org.apache.nifi
+nifi-schema-registry-service-api
+1.21.0-SNAPSHOT
+test
+
diff --git
a/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/src/main/java/org/apache/nifi/jms/processors/AbstractJMSProcessor.java
b/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/src/main/java/org/apache/nifi/jms/processors/AbstractJMSProcessor.java
index aa8fa4dd64..470260cfc9 100644
---
a/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/src/main/java/org/apache/nifi/jms/processors/AbstractJMSProcessor.java
+++
b/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/src/main/java/org/apache/nifi/jms/processors/AbstractJMSProcessor.java
@@ -37,6 +37,8 @@ import org.apache.nifi.processor.ProcessSession;
import org.apache.nifi.processor.Processor;
import org.apache.nifi.processor.exception.ProcessException;
import org.apache.nifi.processor.util.StandardValidators;
+import org.apache.nifi.serialization.RecordReaderFactory;
+import org.apache.nifi.serialization.RecordSetWriterFactory;
import org.springframework.jms.connection.CachingConnectionFactory;
import org.springframework.jms.connection.SingleConnectionFactory;
import
org.springframework.jms.connection.UserCredentialsConnectionFactoryAdapter;
@@ -151,6 +153,20 @@ public abstract class AbstractJMSProcessor extends Abstract
.collect(Collectors.toList())
);
+static final PropertyDescriptor BASE_RECORD_READER = new
PropertyDescriptor.Builder()
+.name("record-reader")
+.displayName("Record Reader")
+.identifiesControllerService(RecordReaderFactory.class)
+.required(false)
+.build();
+
+static final PropertyDescriptor BASE_RECORD_WRITER = new
PropertyDescriptor.Builder()
+.name("record-writer")
+.displayName("Record Writer")
+.identifiesControllerService(RecordSetWriterFactory.class)
+.de
[nifi] branch main updated: NIFI-11137 Add record support to Consume/PublishJMS (#6987)
This is an automated email from the ASF dual-hosted git repository.
turcsanyi pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/nifi.git
The following commit(s) were added to refs/heads/main by this push:
new 32df0fa484 NIFI-11137 Add record support to Consume/PublishJMS (#6987)
32df0fa484 is described below
commit 32df0fa4849325d742d36e57b686cb88bd65d2b6
Author: Nandor Soma Abonyi
AuthorDate: Mon Apr 3 21:42:27 2023 +0200
NIFI-11137 Add record support to Consume/PublishJMS (#6987)
---
.../nifi-jms-bundle/nifi-jms-processors/pom.xml| 22 ++
.../nifi/jms/processors/AbstractJMSProcessor.java | 16 ++
.../org/apache/nifi/jms/processors/ConsumeJMS.java | 204 ++---
.../apache/nifi/jms/processors/JMSConsumer.java| 194 ++--
.../apache/nifi/jms/processors/JMSPublisher.java | 2 +-
.../org/apache/nifi/jms/processors/PublishJMS.java | 140 +---
.../ioconcept/reader/FlowFileReader.java | 24 ++
.../ioconcept/reader/FlowFileReaderCallback.java | 24 ++
.../ioconcept/reader/MessageHandler.java | 21 ++
.../reader/StateTrackingFlowFileReader.java| 73 ++
.../reader/record/ProvenanceEventTemplates.java| 25 +++
.../ioconcept/reader/record/RecordSupplier.java| 82 +++
.../ioconcept/writer/AttributeSource.java | 23 ++
.../ioconcept/writer/FlowFileWriter.java | 25 +++
.../ioconcept/writer/FlowFileWriterCallback.java | 27 +++
.../processors/ioconcept/writer/Marshaller.java| 21 ++
.../ioconcept/writer/record/OutputStrategy.java| 57 +
.../ioconcept/writer/record/RecordUtils.java | 78 +++
.../ioconcept/writer/record/RecordWriter.java | 205 +
.../apache/nifi/jms/processors/ConsumeJMSIT.java | 199 +
.../jms/processors/JMSPublisherConsumerIT.java | 164 ++
.../apache/nifi/jms/processors/PublishJMSIT.java | 248 -
.../nifi/jms/processors/helpers/JMSTestUtil.java | 44
23 files changed, 1679 insertions(+), 239 deletions(-)
diff --git a/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/pom.xml
b/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/pom.xml
index b05909b360..ebfe0f6dbc 100644
--- a/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/pom.xml
+++ b/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/pom.xml
@@ -58,6 +58,14 @@
commons-io
commons-io
+
+org.apache.nifi
+nifi-record-serialization-service-api
+
+
+org.apache.nifi
+nifi-record
+
org.apache.activemq
activemq-client
@@ -83,6 +91,20 @@
2.0.0-SNAPSHOT
test
+
+
+
+org.apache.nifi
+nifi-record-serialization-services
+2.0.0-SNAPSHOT
+test
+
+
+org.apache.nifi
+nifi-schema-registry-service-api
+2.0.0-SNAPSHOT
+test
+
diff --git
a/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/src/main/java/org/apache/nifi/jms/processors/AbstractJMSProcessor.java
b/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/src/main/java/org/apache/nifi/jms/processors/AbstractJMSProcessor.java
index aa8fa4dd64..470260cfc9 100644
---
a/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/src/main/java/org/apache/nifi/jms/processors/AbstractJMSProcessor.java
+++
b/nifi-nar-bundles/nifi-jms-bundle/nifi-jms-processors/src/main/java/org/apache/nifi/jms/processors/AbstractJMSProcessor.java
@@ -37,6 +37,8 @@ import org.apache.nifi.processor.ProcessSession;
import org.apache.nifi.processor.Processor;
import org.apache.nifi.processor.exception.ProcessException;
import org.apache.nifi.processor.util.StandardValidators;
+import org.apache.nifi.serialization.RecordReaderFactory;
+import org.apache.nifi.serialization.RecordSetWriterFactory;
import org.springframework.jms.connection.CachingConnectionFactory;
import org.springframework.jms.connection.SingleConnectionFactory;
import
org.springframework.jms.connection.UserCredentialsConnectionFactoryAdapter;
@@ -151,6 +153,20 @@ public abstract class AbstractJMSProcessor extends Abstract
.collect(Collectors.toList())
);
+static final PropertyDescriptor BASE_RECORD_READER = new
PropertyDescriptor.Builder()
+.name("record-reader")
+.displayName("Record Reader")
+.identifiesControllerService(RecordReaderFactory.class)
+.required(false)
+.build();
+
+static final PropertyDescriptor BASE_RECORD_WRITER = new
PropertyDescriptor.Builder()
+.name("record-writer")
+.displayName("Record Writer")
+.identifiesControllerService(RecordSetWriterFactory.class)
+.dependsOn(BASE_RECORD_READER)
[nifi] branch support/nifi-1.x updated: NIFI-11352 Upgraded PostgreSQL JDBC from 42.5.3 to 42.6.0
This is an automated email from the ASF dual-hosted git repository. exceptionfactory pushed a commit to branch support/nifi-1.x in repository https://gitbox.apache.org/repos/asf/nifi.git The following commit(s) were added to refs/heads/support/nifi-1.x by this push: new 37a63d39c5 NIFI-11352 Upgraded PostgreSQL JDBC from 42.5.3 to 42.6.0 37a63d39c5 is described below commit 37a63d39c5dac1d5b614c45b8e21bae4c6d07fae Author: mr1716 AuthorDate: Mon Apr 3 10:54:43 2023 -0400 NIFI-11352 Upgraded PostgreSQL JDBC from 42.5.3 to 42.6.0 This closes #7114 Signed-off-by: David Handermann (cherry picked from commit 3fa25b6f119576144e95b17213f98bd729f39ed6) --- nifi-registry/nifi-registry-core/nifi-registry-test/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/nifi-registry/nifi-registry-core/nifi-registry-test/pom.xml b/nifi-registry/nifi-registry-core/nifi-registry-test/pom.xml index 39833b4237..21362cae37 100644 --- a/nifi-registry/nifi-registry-core/nifi-registry-test/pom.xml +++ b/nifi-registry/nifi-registry-core/nifi-registry-test/pom.xml @@ -75,7 +75,7 @@ org.postgresql postgresql -42.5.3 +42.6.0 junit
[nifi] branch main updated: NIFI-11352 Upgraded PostgreSQL JDBC from 42.5.3 to 42.6.0
This is an automated email from the ASF dual-hosted git repository. exceptionfactory pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git The following commit(s) were added to refs/heads/main by this push: new 3fa25b6f11 NIFI-11352 Upgraded PostgreSQL JDBC from 42.5.3 to 42.6.0 3fa25b6f11 is described below commit 3fa25b6f119576144e95b17213f98bd729f39ed6 Author: mr1716 AuthorDate: Mon Apr 3 10:54:43 2023 -0400 NIFI-11352 Upgraded PostgreSQL JDBC from 42.5.3 to 42.6.0 This closes #7114 Signed-off-by: David Handermann --- nifi-registry/nifi-registry-core/nifi-registry-test/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/nifi-registry/nifi-registry-core/nifi-registry-test/pom.xml b/nifi-registry/nifi-registry-core/nifi-registry-test/pom.xml index d3cd8e8e88..b70b68b7ac 100644 --- a/nifi-registry/nifi-registry-core/nifi-registry-test/pom.xml +++ b/nifi-registry/nifi-registry-core/nifi-registry-test/pom.xml @@ -75,7 +75,7 @@ org.postgresql postgresql -42.5.3 +42.6.0 junit
[nifi-minifi-cpp] branch main updated (38aec9608 -> 976b0a165)
This is an automated email from the ASF dual-hosted git repository. szaszm pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git from 38aec9608 MINIFICPP-2021 Auto-generate the remaining parts of PROCESSORS.md new 31e6e6b6a MINIFICPP-1716 Recover core dumps from CI up to 1G new 1a71c3563 MINIFICPP-2087 Fix deadlock when fetching initial flow from C2 url new 976b0a165 MINIFICPP-2090 Update version number to 0.14.0 The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/ci.yml | 91 -- CMakeLists.txt | 2 +- cmake/DockerConfig.cmake | 6 ++ docker/DockerBuild.sh | 6 +- .../integration/MiNiFi_integration_test_driver.py | 8 ++ docker/test/integration/cluster/ContainerStore.py | 3 + .../test/integration/cluster/DockerTestCluster.py | 3 + .../cluster/containers/MinifiContainer.py | 12 ++- .../integration/features/minifi_c2_server.feature | 9 +++ docker/test/integration/steps/steps.py | 11 +++ libminifi/CMakeLists.txt | 2 +- libminifi/src/FlowController.cpp | 5 +- 12 files changed, 145 insertions(+), 13 deletions(-)
[nifi-minifi-cpp] 03/03: MINIFICPP-2090 Update version number to 0.14.0
This is an automated email from the ASF dual-hosted git repository. szaszm pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git commit 976b0a165387250a846d13e22b7084fa7c0fb9d3 Author: Gabor Gyimesi AuthorDate: Mon Apr 3 17:46:57 2023 +0200 MINIFICPP-2090 Update version number to 0.14.0 Closes #1547 Signed-off-by: Marton Szasz --- CMakeLists.txt | 2 +- libminifi/CMakeLists.txt | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/CMakeLists.txt b/CMakeLists.txt index 8b39bf4f1..b9ac69d6c 100644 --- a/CMakeLists.txt +++ b/CMakeLists.txt @@ -24,7 +24,7 @@ if (CMAKE_VERSION VERSION_GREATER_EQUAL 3.24) cmake_policy(SET CMP0135 NEW) # policy to set the timestamps of extracted contents to the time of extraction endif() -project(nifi-minifi-cpp VERSION 0.13.0) +project(nifi-minifi-cpp VERSION 0.14.0) set(PROJECT_NAME "nifi-minifi-cpp") # Optional build number for linux distribution targets' tar.gz output diff --git a/libminifi/CMakeLists.txt b/libminifi/CMakeLists.txt index dc51d0148..883948c39 100644 --- a/libminifi/CMakeLists.txt +++ b/libminifi/CMakeLists.txt @@ -22,7 +22,7 @@ cmake_policy(SET CMP0096 NEW) # policy to preserve the leading zeros in PROJECT_ if (CMAKE_VERSION VERSION_GREATER_EQUAL 3.24) cmake_policy(SET CMP0135 NEW) # policy to set the timestamps of extracted contents to the time of extraction endif() -project(nifi-libcore-minifi VERSION 0.13.0) +project(nifi-libcore-minifi VERSION 0.14.0) set(PROJECT_NAME "nifi-libcore-minifi") if (WIN32)
[nifi-minifi-cpp] 02/03: MINIFICPP-2087 Fix deadlock when fetching initial flow from C2 url
This is an automated email from the ASF dual-hosted git repository.
szaszm pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git
commit 1a71c3563c9d51ad6c756f54c6d46aa9750ebe73
Author: Gabor Gyimesi
AuthorDate: Mon Apr 3 17:46:18 2023 +0200
MINIFICPP-2087 Fix deadlock when fetching initial flow from C2 url
Closes #1546
Signed-off-by: Marton Szasz
---
docker/test/integration/MiNiFi_integration_test_driver.py| 8
docker/test/integration/cluster/ContainerStore.py| 3 +++
docker/test/integration/cluster/DockerTestCluster.py | 3 +++
.../test/integration/cluster/containers/MinifiContainer.py | 12 ++--
docker/test/integration/features/minifi_c2_server.feature| 9 +
docker/test/integration/steps/steps.py | 11 +++
libminifi/src/FlowController.cpp | 5 +++--
7 files changed, 47 insertions(+), 4 deletions(-)
diff --git a/docker/test/integration/MiNiFi_integration_test_driver.py
b/docker/test/integration/MiNiFi_integration_test_driver.py
index 34dbfb502..56ce946cb 100644
--- a/docker/test/integration/MiNiFi_integration_test_driver.py
+++ b/docker/test/integration/MiNiFi_integration_test_driver.py
@@ -77,6 +77,11 @@ class MiNiFi_integration_test:
self.cluster.deploy_container('opensearch')
assert self.cluster.wait_for_container_startup_to_finish('opensearch')
+def start_minifi_c2_server(self):
+self.cluster.acquire_container("minifi-c2-server", "minifi-c2-server")
+self.cluster.deploy_container('minifi-c2-server')
+assert
self.cluster.wait_for_container_startup_to_finish('minifi-c2-server')
+
def start(self, container_name=None):
if container_name is not None:
logging.info("Starting container %s", container_name)
@@ -310,6 +315,9 @@ class MiNiFi_integration_test:
def enable_c2_with_ssl_in_minifi(self):
self.cluster.enable_c2_with_ssl_in_minifi()
+def fetch_flow_config_from_c2_url_in_minifi(self):
+self.cluster.fetch_flow_config_from_c2_url_in_minifi()
+
def enable_prometheus_in_minifi(self):
self.cluster.enable_prometheus_in_minifi()
diff --git a/docker/test/integration/cluster/ContainerStore.py
b/docker/test/integration/cluster/ContainerStore.py
index 1f7126c41..8a2e3d847 100644
--- a/docker/test/integration/cluster/ContainerStore.py
+++ b/docker/test/integration/cluster/ContainerStore.py
@@ -151,6 +151,9 @@ class ContainerStore:
def enable_c2_with_ssl_in_minifi(self):
self.minifi_options.enable_c2_with_ssl = True
+def fetch_flow_config_from_c2_url_in_minifi(self):
+self.minifi_options.use_flow_config_from_url = True
+
def enable_prometheus_in_minifi(self):
self.minifi_options.enable_prometheus = True
diff --git a/docker/test/integration/cluster/DockerTestCluster.py
b/docker/test/integration/cluster/DockerTestCluster.py
index d62d56a58..c71e04af5 100644
--- a/docker/test/integration/cluster/DockerTestCluster.py
+++ b/docker/test/integration/cluster/DockerTestCluster.py
@@ -76,6 +76,9 @@ class DockerTestCluster:
def enable_c2_with_ssl_in_minifi(self):
self.container_store.enable_c2_with_ssl_in_minifi()
+def fetch_flow_config_from_c2_url_in_minifi(self):
+self.container_store.fetch_flow_config_from_c2_url_in_minifi()
+
def enable_prometheus_in_minifi(self):
self.container_store.enable_prometheus_in_minifi()
diff --git a/docker/test/integration/cluster/containers/MinifiContainer.py
b/docker/test/integration/cluster/containers/MinifiContainer.py
index 409ad6f60..def15df26 100644
--- a/docker/test/integration/cluster/containers/MinifiContainer.py
+++ b/docker/test/integration/cluster/containers/MinifiContainer.py
@@ -32,6 +32,7 @@ class MinifiOptions:
self.enable_prometheus = False
self.enable_sql = False
self.config_format = "json"
+self.use_flow_config_from_url = False
class MinifiContainer(FlowContainer):
@@ -102,12 +103,16 @@ class MinifiContainer(FlowContainer):
f.write("nifi.metrics.publisher.PrometheusMetricsPublisher.port=9936\n")
f.write("nifi.metrics.publisher.metrics=RepositoryMetrics,QueueMetrics,PutFileMetrics,processorMetrics/Get.*,FlowInformation,DeviceInfoNode,AgentStatus\n")
+if self.options.use_flow_config_from_url:
+
f.write("nifi.c2.flow.url=http://minifi-c2-server:10090/c2/config?class=minifi-test-class\n";)
+
def _setup_config(self):
-self._create_config()
self._create_properties()
+if not self.options.use_flow_config_from_url:
+self._create_config()
+self.vols[os.path.join(self.container_specific_config_dir,
'config.yml')] = {"bind": os.path.join(MinifiContainer.MINIFI_ROOT, 'conf',
'config.yml'), "mode": "rw"}
self.vols[os.path.join(
[nifi-minifi-cpp] 01/03: MINIFICPP-1716 Recover core dumps from CI up to 1G
This is an automated email from the ASF dual-hosted git repository.
szaszm pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git
commit 31e6e6b6a9fc53ca011776aea30892a5290e1d3d
Author: Gabor Gyimesi
AuthorDate: Mon Apr 3 17:43:02 2023 +0200
MINIFICPP-1716 Recover core dumps from CI up to 1G
- Keep RelWithDebInfo in clang build only
Closes #1511
Signed-off-by: Marton Szasz
---
.github/workflows/ci.yml | 91
cmake/DockerConfig.cmake | 6
docker/DockerBuild.sh| 6 +++-
3 files changed, 96 insertions(+), 7 deletions(-)
diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml
index 402871f95..185639af3 100644
--- a/.github/workflows/ci.yml
+++ b/.github/workflows/ci.yml
@@ -39,9 +39,27 @@ jobs:
# CPPFLAGS are not recognized by cmake, so we have to force them to
CFLAGS and CXXFLAGS to have flex 2.6 working
./bootstrap.sh -e -t && cd build && cmake
-DCMAKE_BUILD_TYPE=Release -DCI_BUILD=ON -DCMAKE_C_FLAGS="${CPPFLAGS}
${CFLAGS}" -DCMAKE_CXX_FLAGS="${CPPFLAGS} ${CXXFLAGS}"
-DENABLE_PYTHON_SCRIPTING=ON -DENABLE_LUA_SCRIPTING=ON -DENABLE_SQL=ON
-DUSE_REAL_ODBC_TEST_DRIVER=ON -DENABLE_AZURE=ON -DENABLE_GCP=ON
-DCMAKE_VERBOSE_MAKEFILE=ON -DCMAKE_RULE_MESSAGES=OFF -DSTRICT_GSL_CHECKS=AUDIT
-DFAIL_ON_WARNINGS=ON .. && cmake --build . --parallel 4
- name: test
-run: cd build && make test ARGS="--timeout 300 -j4 --output-on-failure"
+id: test
+run: |
+ # Set core file size limit to 1GiB
+ ulimit -c 1048576
+ cd build && make test ARGS="--timeout 300 -j4 --output-on-failure"
- name: linter
run: cd build && make -j4 linter
+ - name: check-cores
+if: ${{ failure() && steps.test.conclusion == 'failure' }}
+run: |
+ if [ "$(ls -A /cores)" ]; then echo "CORES_EXIST=true" >>
$GITHUB_ENV; fi
+ - uses: actions/upload-artifact@v3.1.2
+if: ${{ failure() && env.CORES_EXIST == 'true' }}
+with:
+ name: macos-coredumps
+ path: /cores
+ - uses: actions/upload-artifact@v3.1.2
+if: ${{ failure() && env.CORES_EXIST == 'true' }}
+with:
+ name: macos-binaries
+ path: build/bin
windows_VS2019:
name: "windows-2019"
runs-on: windows-2019
@@ -107,7 +125,25 @@ jobs:
-DENABLE_AZURE=OFF -DENABLE_SPLUNK=OFF -DENABLE_GCP=OFF
-DENABLE_PROCFS=OFF -DENABLE_BUSTACHE=ON -DENABLE_PCAP=ON -DENABLE_JNI=ON
-DENABLE_SFTP=ON ..
make -j$(nproc) VERBOSE=1
- name: test
-run: cd build && make test ARGS="--timeout 300 -j2 --output-on-failure"
+id: test
+run: |
+ # Set core file size limit to 1GiB
+ ulimit -c 1048576
+ cd build && make test ARGS="--timeout 300 -j8 --output-on-failure"
+ - name: check-cores
+if: ${{ failure() && steps.test.conclusion == 'failure' }}
+run: |
+ if [ "$(ls -A /var/lib/apport/coredump/)" ]; then echo
"CORES_EXIST=true" >> $GITHUB_ENV; fi
+ - uses: actions/upload-artifact@v3.1.2
+if: ${{ failure() && env.CORES_EXIST == 'true' }}
+with:
+ name: ubuntu-coredumps
+ path: /var/lib/apport/coredump/
+ - uses: actions/upload-artifact@v3.1.2
+if: ${{ failure() && env.CORES_EXIST == 'true' }}
+with:
+ name: ubuntu-binaries
+ path: build/bin
ubuntu_20_04_clang:
name: "ubuntu-20.04-clang"
runs-on: ubuntu-20.04
@@ -142,14 +178,18 @@ jobs:
export CXX=clang++-14
export CXXFLAGS="${CXXFLAGS} -stdlib=libc++"
export LDFLAGS="${LDFLAGS} -stdlib=libc++"
- cmake -DUSE_SHARED_LIBS=ON -DCMAKE_BUILD_TYPE=Release -DCI_BUILD=ON
-DSTRICT_GSL_CHECKS=AUDIT -DFAIL_ON_WARNINGS=ON -DENABLE_AWS=ON
-DENABLE_AZURE=ON -DENABLE_BUSTACHE=ON -DENABLE_COAP=ON \
+ cmake -DUSE_SHARED_LIBS=ON -DCMAKE_BUILD_TYPE=RelWithDebInfo
-DCI_BUILD=ON -DSTRICT_GSL_CHECKS=AUDIT -DFAIL_ON_WARNINGS=ON -DENABLE_AWS=ON
-DENABLE_AZURE=ON -DENABLE_BUSTACHE=ON -DENABLE_COAP=ON \
-DENABLE_ENCRYPT_CONFIG=ON -DENABLE_GPS=ON
-DENABLE_LIBRDKAFKA=ON -DENABLE_MQTT=ON -DENABLE_NANOFI=ON -DENABLE_OPC=ON
-DENABLE_OPENCV=ON \
-DENABLE_OPENWSMAN=ON -DENABLE_OPS=ON -DENABLE_PCAP=ON
-DENABLE_SENSORS=ON -DENABLE_SQL=ON -DENABLE_SYSTEMD=ON -DENABLE_TENSORFLOW=OFF
\
-DENABLE_USB_CAMERA=ON -DENABLE_PYTHON_SCRIPTING=ON
-DENABLE_LUA_SCRIPTING=ON -DENABLE_KUBERNETES=ON -DENABLE_GCP=ON
-DENABLE_PROCFS=ON -DENABLE_PROMETHEUS=ON -DENABLE_ELASTICSEARCH=ON \
-DCMAKE_EXPORT_COMPILE_COMMANDS=ON ..
cmake --build . --parallel $(nproc)
- name: test
-run: cd build && make test ARGS="--timeout 300 -j8 --output-on-failure"
+id: test
+run: |
+ # Set core file size limit to 1GiB
+ ulimit -
[nifi-minifi-cpp] 02/02: MINIFICPP-2021 Auto-generate the remaining parts of PROCESSORS.md
This is an automated email from the ASF dual-hosted git repository. lordgamez pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git commit 38aec9608c0dec3d607206d7fde06736a9a4773a Author: Ferenc Gerlits AuthorDate: Tue Jan 3 19:10:03 2023 +0100 MINIFICPP-2021 Auto-generate the remaining parts of PROCESSORS.md Signed-off-by: Gabor Gyimesi This closes #1492 --- PROCESSORS.md | 253 +++-- extensions/gcp/processors/DeleteGCSObject.h| 5 + extensions/gcp/processors/FetchGCSObject.h | 5 + .../processors/GCSProcessorStaticDefinitions.cpp | 57 + extensions/gcp/processors/ListGCSBucket.h | 49 extensions/gcp/processors/PutGCSObject.h | 53 + extensions/http-curl/processors/InvokeHTTP.cpp | 7 + extensions/http-curl/processors/InvokeHTTP.h | 13 ++ extensions/jni/jvm/NarClassLoader.h| 4 +- extensions/python/PythonCreator.h | 2 +- extensions/sql/processors/QueryDatabaseTable.h | 3 + .../processors/SQLProcessorStaticDefinitions.cpp | 4 + .../standard-processors/processors/ListFile.cpp| 16 ++ .../standard-processors/processors/ListFile.h | 21 ++ .../processors/ListenSyslog.cpp| 15 ++ .../standard-processors/processors/ListenSyslog.h | 35 +++ .../standard-processors/processors/ListenTCP.cpp | 3 + .../standard-processors/processors/ListenTCP.h | 4 + .../standard-processors/processors/ListenUDP.cpp | 3 + .../standard-processors/processors/ListenUDP.h | 4 + .../processors/RetryFlowFile.cpp | 20 +- .../standard-processors/processors/RetryFlowFile.h | 12 + .../standard-processors/processors/RouteText.cpp | 9 +- .../standard-processors/processors/RouteText.h | 6 + libminifi/include/agent/agent_docs.h | 23 +- libminifi/include/core/DynamicProperty.h | 58 + .../include/core/OutputAttribute.h | 44 ++-- libminifi/include/core/Processor.h | 6 + .../include/core/state/nodes/AgentInformation.h| 4 +- libminifi/include/utils/StringUtils.h | 96 +++- libminifi/src/agent/JsonSchema.cpp | 8 +- libminifi/src/agent/agent_docs.cpp | 24 +- libminifi/test/unit/StringUtilsTests.cpp | 36 ++- minifi_main/AgentDocs.cpp | 91 ++-- minifi_main/TableFormatter.cpp | 62 ++--- minifi_main/TableFormatter.h | 8 - 36 files changed, 733 insertions(+), 330 deletions(-) diff --git a/PROCESSORS.md b/PROCESSORS.md index 2910c6cd9..70de1ceed 100644 --- a/PROCESSORS.md +++ b/PROCESSORS.md @@ -593,11 +593,12 @@ In the list below, the names of required properties appear in bold. Any other pr ### Output Attributes -| Attribute| Relationship | Description | -|--|--|-| -| _gcs.status.message_ | failure | The status message received from google cloud. | -| _gcs.error.reason_ | failure | The description of the error occurred during operation. | -| _gcs.error.domain_ | failure | The domain of the error occurred during operation. | +| Attribute | Relationship | Description | +||--|-| +| gcs.status.message | failure | The status message received from google cloud. | +| gcs.error.reason | failure | The description of the error occurred during operation. | +| gcs.error.domain | failure | The domain of the error occurred during operation. | + ## DeleteS3Object @@ -903,11 +904,11 @@ In the list below, the names of required properties appear in bold. Any other pr ### Output Attributes -| Attribute| Relationship | Description | -|--|--|-| -| _gcs.status.message_ | failure | The status message received from google cloud. | -| _gcs.error.reason_ | failure | The description of the error occurred during operation. | -| _gcs.error.domain_ | failure | The domain of the error occurred during operation. | +| Attribute | Relationship | Description | +||--|-| +| gcs.status.message | failure | The status message received from google cloud. | +| gcs.error.reason | failure | The description of the error occurred during operat
[nifi-minifi-cpp] branch main updated (7771c651a -> 38aec9608)
This is an automated email from the ASF dual-hosted git repository.
lordgamez pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git
from 7771c651a MINIFICPP-2072 Docker test for ListenSyslog/ReplaceText
workflow
new f808e840d MINIFICPP-2019 Fix the auto-generation of PROCESSORS.md
new 38aec9608 MINIFICPP-2021 Auto-generate the remaining parts of
PROCESSORS.md
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CMakeLists.txt |2 +
PROCESSORS.md | 2125 +++-
extensions/aws/processors/DeleteS3Object.h |2 +-
extensions/aws/processors/PutS3Object.h|5 +-
extensions/gcp/processors/DeleteGCSObject.h|5 +
extensions/gcp/processors/FetchGCSObject.h |5 +
.../processors/GCSProcessorStaticDefinitions.cpp | 59 +-
extensions/gcp/processors/ListGCSBucket.h | 49 +
extensions/gcp/processors/PutGCSObject.h | 53 +
extensions/http-curl/processors/InvokeHTTP.cpp |7 +
extensions/http-curl/processors/InvokeHTTP.h | 13 +
extensions/jni/jvm/NarClassLoader.h|4 +-
.../librdkafka/KafkaProcessorStaticDefinitions.cpp |2 +-
.../AbstractMQTTProcessorStaticDefinitions.cpp | 14 +-
extensions/pdh/PerformanceDataMonitor.cpp |4 +-
extensions/pdh/PerformanceDataMonitor.h|4 +-
extensions/python/ExecutePythonProcessor.h |2 +-
extensions/python/PythonCreator.h |2 +-
extensions/splunk/PutSplunkHTTP.h | 18 +-
extensions/splunk/QuerySplunkIndexingStatus.h | 25 +-
extensions/sql/processors/ExecuteSQL.h |6 +-
extensions/sql/processors/PutSQL.h |5 +-
extensions/sql/processors/QueryDatabaseTable.h |7 +-
.../processors/SQLProcessorStaticDefinitions.cpp |4 +
.../standard-processors/processors/ListFile.cpp| 16 +
.../standard-processors/processors/ListFile.h | 21 +
.../processors/ListenSyslog.cpp| 15 +
.../standard-processors/processors/ListenSyslog.h | 35 +
.../standard-processors/processors/ListenTCP.cpp |3 +
.../standard-processors/processors/ListenTCP.h |4 +
.../standard-processors/processors/ListenUDP.cpp |3 +
.../standard-processors/processors/ListenUDP.h |4 +
.../processors/RetryFlowFile.cpp | 20 +-
.../standard-processors/processors/RetryFlowFile.h | 12 +
.../processors/RouteOnAttribute.h |5 +-
.../standard-processors/processors/RouteText.cpp |9 +-
.../standard-processors/processors/RouteText.h |6 +
extensions/systemd/ConsumeJournald.cpp |4 +-
extensions/systemd/ConsumeJournald.h |4 +-
.../windows-event-log/ConsumeWindowsEventLog.cpp |2 +-
libminifi/include/agent/agent_docs.h | 23 +-
.../core/{Relationship.h => DynamicProperty.h} | 48 +-
.../core/{Relationship.h => OutputAttribute.h} | 47 +-
libminifi/include/core/Processor.h |6 +
.../include/core/state/nodes/AgentInformation.h|4 +-
libminifi/include/utils/StringUtils.h | 96 +-
libminifi/src/agent/JsonSchema.cpp |8 +-
libminifi/src/agent/agent_docs.cpp | 24 +-
libminifi/test/unit/StringUtilsTests.cpp | 36 +-
minifi_main/AgentDocs.cpp | 197 +-
minifi_main/CMakeLists.txt |2 +-
minifi_main/TableFormatter.cpp | 78 +
.../JsonSchema.h => minifi_main/TableFormatter.h | 15 +-
.../systemd => minifi_main}/tests/CMakeLists.txt | 24 +-
minifi_main/tests/TableFormatterTests.cpp | 53 +
55 files changed, 1995 insertions(+), 1251 deletions(-)
copy libminifi/include/core/{Relationship.h => DynamicProperty.h} (56%)
copy libminifi/include/core/{Relationship.h => OutputAttribute.h} (58%)
create mode 100644 minifi_main/TableFormatter.cpp
copy libminifi/include/agent/JsonSchema.h => minifi_main/TableFormatter.h (70%)
copy {extensions/systemd => minifi_main}/tests/CMakeLists.txt (56%)
create mode 100644 minifi_main/tests/TableFormatterTests.cpp
[nifi] branch support/nifi-1.x updated: NIFI-11344 Make minifi fips compatible
This is an automated email from the ASF dual-hosted git repository. bejancsaba pushed a commit to branch support/nifi-1.x in repository https://gitbox.apache.org/repos/asf/nifi.git The following commit(s) were added to refs/heads/support/nifi-1.x by this push: new 5d50950534 NIFI-11344 Make minifi fips compatible 5d50950534 is described below commit 5d50950534509876bbce9baa196706f2460d0f78 Author: Ferenc Erdei AuthorDate: Wed Mar 29 14:17:07 2023 +0200 NIFI-11344 Make minifi fips compatible This closes #7098. (cherry picked form commit 595b1b4dd3c92255c4d90dca77966d8f78102eec) --- minifi/minifi-assembly/pom.xml | 15 +++ .../main/assembly/dependencies-windows-service.xml | 2 + .../src/main/assembly/dependencies.xml | 2 + minifi/minifi-bootstrap/pom.xml| 14 +++ .../ingestors/RestChangeIngestor.java | 70 - ...InvokeHttpMiNiFiProxyNoPasswordTemplateTest.yml | 2 +- .../InvokeHttpMiNiFiProxyPasswordTemplateTest.yml | 2 +- .../src/test/resources/MINIFI-216/config.yml | 2 +- .../test/resources/MINIFI-216/configOverrides.yml | 2 +- .../resources/MINIFI-216/nifi.properties.before| 2 +- .../src/test/resources/MINIFI-245/config.yml | 2 +- .../resources/MINIFI-245/nifi.properties.before| 2 +- .../src/test/resources/MINIFI-277/config.yml | 2 +- .../src/test/resources/MINIFI-277/nifi.properties | 2 +- .../src/test/resources/MINIFI-516/config.yml | 2 +- .../src/test/resources/NIFI-8753/config.yml| 2 +- .../resources/NIFI-8753/nifi.properties.before | 2 +- .../test/resources/SimpleRPGToLogAttributes.yml| 2 +- .../bootstrap-provenance-reporting/config.yml | 2 +- .../test/resources/bootstrap-ssl-ctx/config.yml| 2 +- .../src/test/resources/config-funnel-and-rpg.yml | 2 +- .../src/test/resources/config-malformed-field.yml | 2 +- .../resources/config-missing-required-field.yml| 2 +- .../src/test/resources/config-multiple-RPGs.yml| 2 +- .../test/resources/config-multiple-input-ports.yml | 2 +- .../test/resources/config-multiple-problems.yml| 2 +- .../test/resources/config-multiple-processors.yml | 2 +- .../src/test/resources/config-process-groups.yml | 2 +- .../src/test/resources/config-reporting-task.yml | 2 +- .../src/test/resources/config-v1.yml | 2 +- .../minifi-bootstrap/src/test/resources/config.yml | 2 +- .../resources/stress-test-framework-funnel.yml | 2 +- .../minifi/c2/api/properties/C2Properties.java | 38 +-- .../src/main/resources/bin/c2.sh | 4 +- .../src/main/resources/conf/authorizations.yaml| 4 - .../main/resources/files/raspi3/config.text.yml.v1 | 2 +- .../src/test/resources/files/config.text.yaml.v1 | 2 +- .../resources/c2/files/raspi2/config.text.yml.v1 | 2 +- .../resources/c2/files/raspi3/config.text.yml.v1 | 2 +- .../resources/c2/files/raspi3/config.text.yml.v2 | 2 +- minifi/minifi-c2/minifi-c2-jetty/pom.xml | 12 +++ .../apache/nifi/minifi/c2/jetty/JettyServer.java | 110 +++-- .../minifi-c2-provider-util/pom.xml| 4 + .../minifi/c2/provider/util/HttpConnector.java | 91 + .../nifi/minifi/c2/service/ConfigService.java | 62 ++-- .../minifi-commons/minifi-commons-schema/pom.xml | 4 + .../commons/schema/SecurityPropertiesSchema.java | 11 ++- .../files/edge1/raspi3/config.text.yml.v1 | 2 +- .../files/edge2/raspi2/config.text.yml.v1 | 2 +- .../files/edge3/raspi3/config.text.yml.v1 | 2 +- .../src/test/resources/conf/nifi.properties| 2 +- .../standalone/v1/CsvToJson/yml/CsvToJson.yml | 2 +- .../yml/DecompressionCircularFlow.yml | 2 +- .../yml/MiNiFiTailLogAttribute.yml | 2 +- ...eplaceTextExpressionLanguageCSVReformatting.yml | 2 +- .../yml/MultipleRelationships.yml | 2 +- .../v2/ProcessGroups/yml/ProcessGroups.yml | 2 +- .../yml/StressTestFramework.yml| 2 +- minifi/pom.xml | 5 + 59 files changed, 338 insertions(+), 196 deletions(-) diff --git a/minifi/minifi-assembly/pom.xml b/minifi/minifi-assembly/pom.xml index b7be9e4912..e922d81955 100644 --- a/minifi/minifi-assembly/pom.xml +++ b/minifi/minifi-assembly/pom.xml @@ -262,6 +262,21 @@ limitations under the License. com.fasterxml.jackson.core jackson-databind + +org.eclipse.jetty +jetty-server +compile + + +org.eclipse.jetty +jetty-servlet +compile + + +org.eclipse.jetty +jetty-util +compile + diff --git a/minifi/minifi-ass
[nifi-minifi-cpp] branch MINIFICPP-2019_Fix-autogeneration-of-processors-md updated (5331a2377 -> 49f605fef)
This is an automated email from the ASF dual-hosted git repository. fgerlits pushed a change to branch MINIFICPP-2019_Fix-autogeneration-of-processors-md in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git omit 5331a2377 fix a typo in the Description of PutS3Object omit 4a69170c4 add unit tests for TableFormatter omit b617491a4 rename: find_widths() -> findWidths() omit e256beadd merge fixes omit 12427fbd5 rebase fix omit d27a9cecd add a missing include guard omit 96e8583cc fix a typo omit e33e5ff50 update PROCESSORS.md and unify Description strings with descriptions in PROCESSORS.md omit afcf304d7 MINIFICPP-2019 Fix the auto-generation of PROCESSORS.md add 556407c86 MINIFICPP-2024 Refactor repository hierarchy add 2600a98f8 MINIFICPP-2044 Make listing processors single threaded add e63a287fe MINIFICPP-1997 Fix transiently failing FileSystemRepositoryTests add ce288b920 MINIFICPP-2035 NiFi flow json format support add 5a9c1c334 MINIFICPP-2034 Cache SID lookups in CWEL add 7e8c5c49c MINIFICPP-2045 Synchronous flow file reloading add 2c7f989ae MINIFICPP-2007 Add rocksdb compression options add c4c80e630 MINIFICPP-2047 added reverseDnsLookup to EL add f27e349b5 MINIFICPP-1887 Add default connection size limits add 9c5e2996b MINIFICPP-2041 Fix transient failure of HttpPostIntegrationTestChunked add 268985995 MINIFICPP-2057 Improve the performance of ListFile add 7942e0e7f MINIFICPP-2053 Reduce CentOS image size in CI build add 0a937973e MINIFICPP-2055 Remove C2 metrics from default configuration add 32043f51f MINIFICPP-2061 reverseDnsLookup shouldn't throw on timeout add 7425983a1 MINIFICPP-2054 Periodically run rocksdb compaction add 033ef9d0a MINIFICPP-2059 Handle content repository remove failures add 62ec9a5fd MINIFICPP-2064 Skip extensions which have not been loaded add a57e38c75 MINIFICPP-2065 Only accept configuration format the agent can handle add d12c354ea MINIFICPP-2056 CWEL: support UserData in json Closes #1515 add ab396b7aa MINIFICPP-2066 Close handle when querying file owner on Windows Closes #1523 add 09153adc6 MINIFICPP-2067 Remove OpenSSL system dependency from MQTT add 70015a3a5 MINIFICPP-1961 Use Python stable ABI instead of pybind11 add 314fd81d6 MINIFICPP-1869 Metrics-related refactoring add 7ad624d19 MINIFICPP-2028 Remove SerializableComponent dependency from Repository add 06d5467c6 MINIFICPP-2048 ARM64 support part 1 add 551be5b55 MINIFICPP-2068 Fix transiently failing "Reverse DNS lookup with valid timeout parameter" testcase add 247393bf4 MINIFICPP-2078 Remove cleanup from __del__ functions closes #1533 add 333971ad5 MINIFICPP-2079 Fix OOM in python.feature add be34911e8 MINIFICPP-2075 Fix flaky PutTCPTests testcase add e775efaff MINIFICPP-1713 Fix transient segfault in RepoTests add 28087bfa7 MINIFICPP-2080 Add missing processors to README.md add dc94061d8 MINIFICPP-2085 Clear stale processor controller cache on flow update add 29659402e MINIFICPP-2086 Add more specific flow media type add 7771c651a MINIFICPP-2072 Docker test for ListenSyslog/ReplaceText workflow add 5f44a0cc6 MINIFICPP-2019 Fix the auto-generation of PROCESSORS.md add 027c1849a update PROCESSORS.md and unify Description strings with descriptions in PROCESSORS.md add fb961705a fix a typo add 6e5648366 add a missing include guard add e43537335 rebase fix add 7f2121e6e merge fixes add 9e9a71cd7 rename: find_widths() -> findWidths() add fcbc203ef add unit tests for TableFormatter add ee90f7f19 fix a typo in the Description of PutS3Object add 7769fcf5e Fix the description of ConsumeJournald::TimestampFormat add db384d7d5 Fix a typo in the description of ConsumeKafka::HeadersToAddAsAttributes add 94f0a3f79 Change the order of the allowed values in ConsumeWindowsEventLog::JSONFormat add 2af3e5ee2 Expand the description of the GCP Credentials Provider Service property. add 33616e4aa Expand the description of ExecutePythonProcessor. add 49f605fef Restore the description of ExecuteSQL. This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (5331a2377) \ N -- N -- N refs/heads/MINIFICPP-2019_Fix-autogeneration-of-processors-md (49f605fef) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever.
