svn commit: r57088 - /dev/nifi/nifi-1.18.0/
Author: joewitt Date: Thu Sep 29 19:20:32 2022 New Revision: 57088 Log: Uploading RC3 artifacts for nifi-1.18.0 Modified: dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/minifi-toolkit-1.18.0-bin.zip dev/nifi/nifi-1.18.0/minifi-toolkit-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/minifi-toolkit-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/minifi-toolkit-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/nifi-1.18.0-bin.zip dev/nifi/nifi-1.18.0/nifi-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/nifi-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/nifi-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/nifi-1.18.0-source-release.zip dev/nifi/nifi-1.18.0/nifi-1.18.0-source-release.zip.asc dev/nifi/nifi-1.18.0/nifi-1.18.0-source-release.zip.sha256 dev/nifi/nifi-1.18.0/nifi-1.18.0-source-release.zip.sha512 dev/nifi/nifi-1.18.0/nifi-registry-1.18.0-bin.zip dev/nifi/nifi-1.18.0/nifi-registry-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/nifi-registry-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/nifi-registry-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/nifi-registry-toolkit-1.18.0-bin.zip dev/nifi/nifi-1.18.0/nifi-registry-toolkit-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/nifi-registry-toolkit-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/nifi-registry-toolkit-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/nifi-stateless-1.18.0-bin.zip dev/nifi/nifi-1.18.0/nifi-stateless-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/nifi-stateless-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/nifi-stateless-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/nifi-toolkit-1.18.0-bin.zip dev/nifi/nifi-1.18.0/nifi-toolkit-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/nifi-toolkit-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/nifi-toolkit-1.18.0-bin.zip.sha512 Modified: dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip == Binary files - no diff available. Modified: dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.asc == --- dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.asc (original) +++ dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.asc Thu Sep 29 19:20:32 2022 @@ -1,11 +1,11 @@ -BEGIN PGP SIGNATURE- -iQEzBAABCgAdFiEE0vJLgJ/6seIa6gKDkJO/hU+BGhoFAmM1SasACgkQkJO/hU+B -GhpZDQgAhqnzAbFgCD+An4mQ4eqib/Lz18I6gMBnXpdBG/I7oqL9m9P3YF2bKig4 -ye3A8lrW/vd7y8eGSm0fLySBpB/HrO21TPWWh93AUjv8U1SPpJQUNpPd8xywlTKb -BJIPTlH3rtxsTnsGLhPglLOgBrXwmxG8SvDOyHdk1A+oBkWdeJ+m4hwVB5OjCS+n -ii4nYJ+NGdQyWaCmWsGj124ZKjqJAqkaf7gL8TPsnRimgpK5Comk5sRMhvf00rl3 -dVu9EC/9+78CGVcGyPnqcZtqf3z4K2bmHwBESUEPMK5sRp7qbwhjvDDsK73ia0eJ -X4BAyxIDeywn/JEBjHrfrcO8VRAe3w== -=h8VP +iQEzBAABCgAdFiEE0vJLgJ/6seIa6gKDkJO/hU+BGhoFAmM17zcACgkQkJO/hU+B +GhrbhAf7BBztQZfhdAnad+Tne2m80RvbtECBcWGgSsdBVUM9/tORgKxD13WM1vwC +9W+qLyZTmKU1J71nVlcvix47FxVW2sv0/zilHqHBzSWggs3Erz1bJbvK8w+lpX6M +i0yrrtBhQLQvWH+wydEIsNPpXg8tlmdYEg9vlF48uFaWUmTdqTrX9oaSqLToVH2a +QwbGmuDN2HbaSDSdyWxQGNdF3WxkWUrXIzWmzCG/r75XGUS88Ip6HPmZDpunQK40 +bctvfIZEmwtOmip9OpRXMNEuCWDj+feu/fcLN7VSV0L/a1CXVMbRKzAcoQwp6HAk +xAQZJitttWof/5+LPRHm2rKpFd9fTw== +=8agX -END PGP SIGNATURE- Modified: dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha256 == --- dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha256 (original) +++ dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha256 Thu Sep 29 19:20:32 2022 @@ -1 +1 @@ -dcdcab1225c75aa63701e1d078cec2841ef03179f9c7df917334197ee8fcd40f +9ecf9b0aec9d3641b379436a852ef5bdc547b66f26ba7d9c0c4332ae773bf8a9 Modified: dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha512 == --- dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha512 (original) +++ dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha512 Thu Sep 29 19:20:32 2022 @@ -1 +1 @@ -1110682295cf6612a7fca172fa733a3800bf634dca2d28e948e586dd327005dffb50a9ccdd51bf1b3354af2461fa79369b5c3a30d9040219fa0ea518bfef82b9 +817e2a799dc715c86a248de71b8f8a6f587e90b72d10b9b63ff5049013961be3f99048ab5c6ae5890b2bdfa92f96cf11bd74a6d4b2f1b3d2e601f9b5c572aaa1 Modified: dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip == Binary files - no diff available. Modified: dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.asc == --- dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.asc (original) +++ dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.
[nifi] annotated tag nifi-1.18.0-RC3 created (now e11739dafc)
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a change to annotated tag nifi-1.18.0-RC3 in repository https://gitbox.apache.org/repos/asf/nifi.git at e11739dafc (tag) tagging 5bc64c812b2c76ee2879d8081ceadf62d5e3c702 (commit) replaces rel/nifi-1.17.0 by Joe Witt on Thu Sep 29 10:24:39 2022 -0700 - Log - NIFI-10521-RC3 copy for tag nifi-1.18.0-RC3 --- No new revisions were added by this update.
[nifi] branch NIFI-10521-RC3 created (now db763b5f8f)
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a change to branch NIFI-10521-RC3 in repository https://gitbox.apache.org/repos/asf/nifi.git at db763b5f8f NIFI-10521-RC3 prepare for next development iteration This branch includes the following new commits: new 5bc64c812b NIFI-10521-RC3 prepare release nifi-1.18.0-RC3 new db763b5f8f NIFI-10521-RC3 prepare for next development iteration The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[nifi] branch main updated: NIFI-10192 Caffeine cache schema request for reuse
This is an automated email from the ASF dual-hosted git repository.
mthomsen pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/nifi.git
The following commit(s) were added to refs/heads/main by this push:
new 4b691b133b NIFI-10192 Caffeine cache schema request for reuse
4b691b133b is described below
commit 4b691b133b231cdec04290afaf1fe433b6047717
Author: Aerilym
AuthorDate: Fri Sep 9 12:47:49 2022 +1000
NIFI-10192 Caffeine cache schema request for reuse
This closes #6364
Signed-off-by: Mike Thomsen
---
.../nifi/processors/standard/LookupRecord.java | 43 +-
1 file changed, 41 insertions(+), 2 deletions(-)
diff --git
a/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/LookupRecord.java
b/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/LookupRecord.java
index 7301c26f63..7e4285ad2f 100644
---
a/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/LookupRecord.java
+++
b/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/LookupRecord.java
@@ -17,6 +17,8 @@
package org.apache.nifi.processors.standard;
+import com.github.benmanes.caffeine.cache.Cache;
+import com.github.benmanes.caffeine.cache.Caffeine;
import org.apache.nifi.annotation.behavior.DynamicProperty;
import org.apache.nifi.annotation.behavior.EventDriven;
import org.apache.nifi.annotation.behavior.InputRequirement;
@@ -45,6 +47,7 @@ import org.apache.nifi.processor.ProcessSession;
import org.apache.nifi.processor.Relationship;
import org.apache.nifi.processor.exception.ProcessException;
import org.apache.nifi.processor.io.InputStreamCallback;
+import org.apache.nifi.processor.util.StandardValidators;
import org.apache.nifi.record.path.FieldValue;
import org.apache.nifi.record.path.RecordPath;
import org.apache.nifi.record.path.RecordPathResult;
@@ -194,6 +197,18 @@ public class LookupRecord extends AbstractProcessor {
.required(true)
.build();
+static final PropertyDescriptor CACHE_SIZE = new
PropertyDescriptor.Builder()
+.name("record-path-lookup-miss-result-cache-size")
+.displayName("Cache Size")
+.description("Specifies how many lookup values/records should be
cached."
++ "Setting this property to zero means no caching will be done
and the table will be queried for each lookup value in each record. If the
lookup "
++ "table changes often or the most recent data must be
retrieved, do not use the cache.")
+.addValidator(StandardValidators.NON_NEGATIVE_INTEGER_VALIDATOR)
+.expressionLanguageSupported(ExpressionLanguageScope.VARIABLE_REGISTRY)
+.defaultValue("0")
+.required(true)
+.build();
+
static final Relationship REL_MATCHED = new Relationship.Builder()
.name("matched")
.description("All records for which the lookup returns a value will be
routed to this relationship")
@@ -238,6 +253,7 @@ public class LookupRecord extends AbstractProcessor {
properties.add(ROUTING_STRATEGY);
properties.add(RESULT_CONTENTS);
properties.add(REPLACEMENT_STRATEGY);
+properties.add(CACHE_SIZE);
return properties;
}
@@ -451,7 +467,7 @@ public class LookupRecord extends AbstractProcessor {
if (isInPlaceReplacement) {
return new InPlaceReplacementStrategy();
} else {
-return new RecordPathReplacementStrategy();
+return new RecordPathReplacementStrategy(context);
}
}
@@ -536,6 +552,19 @@ public class LookupRecord extends AbstractProcessor {
private class RecordPathReplacementStrategy implements ReplacementStrategy
{
private int lookupCount = 0;
+private volatile Cache, Optional> cache;
+
+public RecordPathReplacementStrategy(ProcessContext context) {
+
+final int cacheSize =
context.getProperty(CACHE_SIZE).evaluateAttributeExpressions().asInteger();
+
+if (this.cache == null || cacheSize > 0) {
+this.cache = Caffeine.newBuilder()
+.maximumSize(cacheSize)
+.build();
+}
+}
+
@Override
public Set lookup(final Record record, final
ProcessContext context, final LookupContext lookupContext) {
lookupCount++;
@@ -548,8 +577,15 @@ public class LookupRecord extends AbstractProcessor {
final FlowFile flowFile = lookupContext.getOriginalFlowFile();
final Optional lookupValueOption;
+final Optional lookupValueCacheOption;
+
try {
-lookupValueOption = lookupService.lookup(lookupCoordinates,
flowFile.getAttributes());
+
[nifi] branch main updated: NIFI-9636: Adding AwsSecretsManagerParameterProvider
This is an automated email from the ASF dual-hosted git repository. exceptionfactory pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git The following commit(s) were added to refs/heads/main by this push: new 315e54a812 NIFI-9636: Adding AwsSecretsManagerParameterProvider 315e54a812 is described below commit 315e54a812947494f1fb32fb49997505f0339d3c Author: Joe Gresock AuthorDate: Sat Sep 10 10:01:58 2022 -0400 NIFI-9636: Adding AwsSecretsManagerParameterProvider This closes #6392 Signed-off-by: David Handermann --- .../nifi-aws-bundle/nifi-aws-nar/pom.xml | 5 + .../pom.xml| 43 ++- .../aws/AwsSecretsManagerParameterProvider.java| 297 + .../org.apache.nifi.parameter.ParameterProvider| 16 ++ .../additionalDetails.html | 62 + .../TestAwsSecretsManagerParameterProvider.java| 199 ++ nifi-nar-bundles/nifi-aws-bundle/pom.xml | 1 + 7 files changed, 612 insertions(+), 11 deletions(-) diff --git a/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-nar/pom.xml b/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-nar/pom.xml index ea980b7490..984f1b179b 100644 --- a/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-nar/pom.xml +++ b/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-nar/pom.xml @@ -41,6 +41,11 @@ nifi-aws-processors 1.18.0-SNAPSHOT + +org.apache.nifi +nifi-aws-parameter-providers +1.18.0-SNAPSHOT + org.apache.nifi nifi-aws-parameter-value-providers diff --git a/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-nar/pom.xml b/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-parameter-providers/pom.xml similarity index 59% copy from nifi-nar-bundles/nifi-aws-bundle/nifi-aws-nar/pom.xml copy to nifi-nar-bundles/nifi-aws-bundle/nifi-aws-parameter-providers/pom.xml index ea980b7490..282f89f576 100644 --- a/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-nar/pom.xml +++ b/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-parameter-providers/pom.xml @@ -15,40 +15,61 @@ --> http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd";> 4.0.0 - org.apache.nifi nifi-aws-bundle 1.18.0-SNAPSHOT -nifi-aws-nar -nar - -true -true - +nifi-aws-parameter-providers +jar org.apache.nifi -nifi-aws-service-api-nar +nifi-api + + +org.apache.nifi +nifi-aws-service-api 1.18.0-SNAPSHOT -nar +provided org.apache.nifi -nifi-aws-processors +nifi-ssl-context-service-api 1.18.0-SNAPSHOT +provided org.apache.nifi -nifi-aws-parameter-value-providers +nifi-utils 1.18.0-SNAPSHOT +provided org.slf4j jcl-over-slf4j + +com.fasterxml.jackson.core +jackson-databind + + +com.amazonaws +aws-java-sdk-secretsmanager + + +org.apache.nifi +nifi-expression-language +1.18.0-SNAPSHOT +test + + +org.apache.nifi +nifi-mock +1.18.0-SNAPSHOT +test + diff --git a/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-parameter-providers/src/main/java/org/apache/nifi/parameter/aws/AwsSecretsManagerParameterProvider.java b/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-parameter-providers/src/main/java/org/apache/nifi/parameter/aws/AwsSecretsManagerParameterProvider.java new file mode 100644 index 00..4cab6fa9a2 --- /dev/null +++ b/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-parameter-providers/src/main/java/org/apache/nifi/parameter/aws/AwsSecretsManagerParameterProvider.java @@ -0,0 +1,297 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the s
[nifi] branch main updated: NIFI-10563 This closes #6461. Added commons-lang3 dependency to nifi-bootstrap
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git The following commit(s) were added to refs/heads/main by this push: new fa193ca14b NIFI-10563 This closes #6461. Added commons-lang3 dependency to nifi-bootstrap fa193ca14b is described below commit fa193ca14ba9e9b5e3cc1718780c069d07480b06 Author: exceptionfactory AuthorDate: Thu Sep 29 10:15:31 2022 -0500 NIFI-10563 This closes #6461. Added commons-lang3 dependency to nifi-bootstrap - Added commons-lang3 include to Ranger assembly configuration Signed-off-by: Joe Witt --- nifi-assembly/src/main/assembly/ranger.xml | 1 + nifi-bootstrap/pom.xml | 4 2 files changed, 5 insertions(+) diff --git a/nifi-assembly/src/main/assembly/ranger.xml b/nifi-assembly/src/main/assembly/ranger.xml index da3a3ce14d..2c911b7723 100644 --- a/nifi-assembly/src/main/assembly/ranger.xml +++ b/nifi-assembly/src/main/assembly/ranger.xml @@ -64,6 +64,7 @@ org.apache.nifi:nifi-ranger-resources:jar org.slf4j:slf4j-api org.slf4j:jcl-over-slf4j +org.apache.commons:commons-lang3 diff --git a/nifi-bootstrap/pom.xml b/nifi-bootstrap/pom.xml index b3c5d26927..8b56029d11 100644 --- a/nifi-bootstrap/pom.xml +++ b/nifi-bootstrap/pom.xml @@ -90,6 +90,10 @@ language governing permissions and limitations under the License. --> nifi-expression-language 1.18.0-SNAPSHOT + +org.apache.commons +commons-lang3 + com.squareup.okhttp3 okhttp
[nifi] branch main updated: NIFI-10436 Initial basic brotli support NIFI-10436 Add Brotli-compressed SampleFile.txt.br for unit testing NIFI-10436 Fixup basic usage of Brotli4j API NIFI-10436 NOTICE o
This is an automated email from the ASF dual-hosted git repository.
mthomsen pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/nifi.git
The following commit(s) were added to refs/heads/main by this push:
new 3e60414d48 NIFI-10436 Initial basic brotli support NIFI-10436 Add
Brotli-compressed SampleFile.txt.br for unit testing NIFI-10436 Fixup basic
usage of Brotli4j API NIFI-10436 NOTICE ok, LICENSE updated NIFI-10436 style
fixup CompressContent.java NIFI-10436 Update CompressContent.java
3e60414d48 is described below
commit 3e60414d486342ee59cee65818c79f3612946d3d
Author: Matthew Hawkins
AuthorDate: Sat Sep 17 21:13:30 2022 +1000
NIFI-10436 Initial basic brotli support
NIFI-10436 Add Brotli-compressed SampleFile.txt.br for unit testing
NIFI-10436 Fixup basic usage of Brotli4j API
NIFI-10436 NOTICE ok, LICENSE updated
NIFI-10436 style fixup CompressContent.java
NIFI-10436 Update CompressContent.java
This closes #6432
Signed-off-by: Mike Thomsen
---
nifi-assembly/LICENSE | 5 +++-
.../nifi-standard-processors/pom.xml | 5
.../nifi/processors/standard/CompressContent.java | 29 +---
.../processors/standard/TestCompressContent.java | 30 +
.../resources/CompressedData/SampleFile.txt.br | Bin 0 -> 71 bytes
nifi-nar-bundles/nifi-standard-bundle/pom.xml | 5
6 files changed, 69 insertions(+), 5 deletions(-)
diff --git a/nifi-assembly/LICENSE b/nifi-assembly/LICENSE
index 4ecd35df8a..e6842290a4 100644
--- a/nifi-assembly/LICENSE
+++ b/nifi-assembly/LICENSE
@@ -3120,4 +3120,7 @@ which is available under an MIT license.
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
-THE SOFTWARE.
\ No newline at end of file
+THE SOFTWARE.
+
+This product bundles 'Brotli4j' which is available under the Apache License 2.0
+
diff --git
a/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/pom.xml
b/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/pom.xml
index 3ea60c1647..0a7b197ae8 100644
--- a/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/pom.xml
+++ b/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/pom.xml
@@ -229,6 +229,11 @@
com.github.luben
zstd-jni
+
+com.aayushatharva.brotli4j
+brotli4j
+1.8.0
+
org.tukaani
xz
diff --git
a/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/CompressContent.java
b/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/CompressContent.java
index 6ad4192cd1..605b25cf97 100644
---
a/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/CompressContent.java
+++
b/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/CompressContent.java
@@ -25,6 +25,10 @@ import
org.apache.commons.compress.compressors.gzip.GzipCompressorInputStream;
import
org.apache.commons.compress.compressors.lz4.FramedLZ4CompressorInputStream;
import
org.apache.commons.compress.compressors.zstandard.ZstdCompressorInputStream;
import
org.apache.commons.compress.compressors.zstandard.ZstdCompressorOutputStream;
+import com.aayushatharva.brotli4j.decoder.BrotliInputStream;
+import com.aayushatharva.brotli4j.encoder.BrotliOutputStream;
+import com.aayushatharva.brotli4j.Brotli4jLoader;
+import com.aayushatharva.brotli4j.encoder.Encoder;
import org.apache.nifi.annotation.behavior.EventDriven;
import org.apache.nifi.annotation.behavior.InputRequirement;
import org.apache.nifi.annotation.behavior.InputRequirement.Requirement;
@@ -84,7 +88,7 @@ import java.util.zip.InflaterInputStream;
@SideEffectFree
@SupportsBatching
@InputRequirement(Requirement.INPUT_REQUIRED)
-@Tags({"content", "compress", "decompress", "gzip", "bzip2", "lzma",
"xz-lzma2", "snappy", "snappy-hadoop", "snappy framed", "lz4-framed",
"deflate", "zstd"})
+@Tags({"content", "compress", "decompress", "gzip", "bzip2", "lzma",
"xz-lzma2", "snappy", "snappy-hadoop", "snappy framed", "lz4-framed",
"deflate", "zstd", "brotli"})
@CapabilityDescription("Compresses or decompresses the contents of FlowFiles
using a user-specified compression algorithm and updates the mime.type "
+ "attribute as appropriate. This processor operates in a very memory
efficient way so very large objects well beyond the heap size "
+ "are generally fine to process")
@@ -107,16 +111,17 @@ public class CompressContent extends AbstractProcessor {
public static
[nifi] branch main updated: NIFI-10557 Upgrade MongoDB driver to 4.7.1
This is an automated email from the ASF dual-hosted git repository. mthomsen pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git The following commit(s) were added to refs/heads/main by this push: new 8c2b8cb6bc NIFI-10557 Upgrade MongoDB driver to 4.7.1 8c2b8cb6bc is described below commit 8c2b8cb6bc089f91ba37d5b0619232272795cfb5 Author: Lance Kinley AuthorDate: Wed Sep 28 10:49:31 2022 -0700 NIFI-10557 Upgrade MongoDB driver to 4.7.1 This closes #6455 Fully supports MongoDB 6.0 Signed-off-by: Mike Thomsen --- nifi-nar-bundles/nifi-mongodb-bundle/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/nifi-nar-bundles/nifi-mongodb-bundle/pom.xml b/nifi-nar-bundles/nifi-mongodb-bundle/pom.xml index 5493e55981..5d4481e953 100644 --- a/nifi-nar-bundles/nifi-mongodb-bundle/pom.xml +++ b/nifi-nar-bundles/nifi-mongodb-bundle/pom.xml @@ -35,7 +35,7 @@ -4.5.0 +4.7.1
[nifi] branch main updated: NIFI-10213: Create GetShopify processor
This is an automated email from the ASF dual-hosted git repository. tpalfy pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git The following commit(s) were added to refs/heads/main by this push: new da05ba0165 NIFI-10213: Create GetShopify processor da05ba0165 is described below commit da05ba0165615bc53248ad0cc8fc1eb0a30c7d02 Author: Lehel AuthorDate: Tue Aug 16 00:08:55 2022 +0200 NIFI-10213: Create GetShopify processor This closes #6303. Signed-off-by: Tamas Palfy --- nifi-assembly/pom.xml | 6 + .../nifi-shopify-bundle/nifi-shopify-nar/pom.xml | 46 +++ .../src/main/resources/META-INF/LICENSE| 202 ++ .../src/main/resources/META-INF/NOTICE | 37 ++ .../nifi-shopify-processors/pom.xml| 96 + .../apache/nifi/processors/shopify/GetShopify.java | 411 + .../shopify/model/IncrementalLoadingParameter.java | 23 ++ .../nifi/processors/shopify/model/Resource.java| 26 ++ .../shopify/model/ResourceDirectory.java | 152 .../processors/shopify/model/ResourceType.java | 129 +++ .../processors/shopify/model/ShopifyResource.java | 66 .../shopify/rest/ShopifyRestService.java | 121 ++ .../processors/shopify/util/IncrementalTimers.java | 66 .../services/org.apache.nifi.processor.Processor | 15 + .../additionalDetails.html | 83 + .../nifi/processors/shopify/GetShopifyIT.java | 215 +++ .../shopify/rest/ShopifyRestServiceTest.java | 119 ++ .../shopify/util/TestIncrementalTimers.java| 81 .../src/test/resources/collection_listings.json| 26 ++ .../src/test/resources/simple_response.json| 235 nifi-nar-bundles/nifi-shopify-bundle/pom.xml | 32 ++ nifi-nar-bundles/pom.xml | 1 + 22 files changed, 2188 insertions(+) diff --git a/nifi-assembly/pom.xml b/nifi-assembly/pom.xml index 05ec98e555..54ebecbea0 100644 --- a/nifi-assembly/pom.xml +++ b/nifi-assembly/pom.xml @@ -922,6 +922,12 @@ language governing permissions and limitations under the License. --> 1.18.0-SNAPSHOT nar + +org.apache.nifi +nifi-shopify-nar +1.18.0-SNAPSHOT +nar + diff --git a/nifi-nar-bundles/nifi-shopify-bundle/nifi-shopify-nar/pom.xml b/nifi-nar-bundles/nifi-shopify-bundle/nifi-shopify-nar/pom.xml new file mode 100644 index 00..f2ad595f1d --- /dev/null +++ b/nifi-nar-bundles/nifi-shopify-bundle/nifi-shopify-nar/pom.xml @@ -0,0 +1,46 @@ + + +http://maven.apache.org/POM/4.0.0"; + xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; + xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> + +nifi-shopify-bundle +org.apache.nifi +1.18.0-SNAPSHOT + +4.0.0 + +nifi-shopify-nar + +nar + +true +true + + + +org.apache.nifi +nifi-shopify-processors +1.18.0-SNAPSHOT + + +org.apache.nifi +nifi-standard-services-api-nar +1.18.0-SNAPSHOT +nar + + + diff --git a/nifi-nar-bundles/nifi-shopify-bundle/nifi-shopify-nar/src/main/resources/META-INF/LICENSE b/nifi-nar-bundles/nifi-shopify-bundle/nifi-shopify-nar/src/main/resources/META-INF/LICENSE new file mode 100644 index 00..d645695673 --- /dev/null +++ b/nifi-nar-bundles/nifi-shopify-bundle/nifi-shopify-nar/src/main/resources/META-INF/LICENSE @@ -0,0 +1,202 @@ + + Apache License + Version 2.0, January 2004 +http://www.apache.org/licenses/ + + TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION + + 1. Definitions. + + "License" shall mean the terms and conditions for use, reproduction, + and distribution as defined by Sections 1 through 9 of this document. + + "Licensor" shall mean the copyright owner or entity authorized by + the copyright owner that is granting the License. + + "Legal Entity" shall mean the union of the acting entity and all + other entities that control, are controlled by, or are under common + control with that entity. For the purposes of this definition, + "control" means (i) the power, direct or indirect, to cause the + direction or management of such entity, whether by contract or + otherwise, or (ii) ownership of fifty percent (50%) or more of the + outstanding shares, or (iii) beneficial ownership of such entity. + + "You" (or "Your") shall mean an individual or Legal Entity + exercising permissions granted by this License. + + "Source" form shall mean the preferr
[nifi] 02/02: NIFI-10548 Updated Jetty version
This is an automated email from the ASF dual-hosted git repository. mthomsen pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git commit 85d08d39665e7a85f6a9028a5b7c603f372b7d0a Author: mr1716 AuthorDate: Mon Sep 26 09:32:53 2022 -0400 NIFI-10548 Updated Jetty version This closes #6449 Signed-off-by: Mike Thomsen --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index e85b30fc95..ffeaaca13a 100644 --- a/pom.xml +++ b/pom.xml @@ -117,7 +117,7 @@ 1.17.3 1.7.36 2.3.0 -9.4.48.v20220622 +9.4.49.v20220914 2.13.4 1.11.1 2.3.5
[nifi] 01/02: NIFI-10517 Updated Flyway-Core version
This is an automated email from the ASF dual-hosted git repository. mthomsen pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git commit 9ad898f4d7225620ddb739831ea2ad78fb433aa3 Author: UcanInfosec <107478475+ucaninfo...@users.noreply.github.com> AuthorDate: Fri Sep 16 19:47:08 2022 -0400 NIFI-10517 Updated Flyway-Core version This closes #6427 Signed-off-by: Mike Thomsen --- nifi-registry/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/nifi-registry/pom.xml b/nifi-registry/pom.xml index a6a9492193..1afe72f87b 100644 --- a/nifi-registry/pom.xml +++ b/nifi-registry/pom.xml @@ -37,7 +37,7 @@ 2.1 2.7.2 -8.4.2 +8.5.13 7.0.0 3.12.0 3.4.0-01
[nifi] branch main updated (0dec6bfbe1 -> 85d08d3966)
This is an automated email from the ASF dual-hosted git repository. mthomsen pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git from 0dec6bfbe1 NIFI-10560 This closes #6459. Excluded Elasticsearch and Solr Auto Configuration from Registry new 9ad898f4d7 NIFI-10517 Updated Flyway-Core version new 85d08d3966 NIFI-10548 Updated Jetty version The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: nifi-registry/pom.xml | 2 +- pom.xml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
[nifi] annotated tag nifi-1.18.0-RC2 created (now 6228b85beb)
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a change to annotated tag nifi-1.18.0-RC2 in repository https://gitbox.apache.org/repos/asf/nifi.git at 6228b85beb (tag) tagging a2307ff874b45210472c158a96b5f31298e6c4fc (commit) replaces rel/nifi-1.17.0 by Joe Witt on Wed Sep 28 22:22:34 2022 -0700 - Log - NIFI-10521-RC2 copy for tag nifi-1.18.0-RC2 --- No new revisions were added by this update.
[nifi] branch NIFI-10521-RC2 created (now c76f30bc3e)
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a change to branch NIFI-10521-RC2 in repository https://gitbox.apache.org/repos/asf/nifi.git at c76f30bc3e NIFI-10521-RC2 prepare for next development iteration This branch includes the following new commits: new a2307ff874 NIFI-10521-RC2 prepare release nifi-1.18.0-RC2 new c76f30bc3e NIFI-10521-RC2 prepare for next development iteration The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
svn commit: r57074 - /dev/nifi/nifi-1.18.0/
Author: joewitt Date: Thu Sep 29 07:32:55 2022 New Revision: 57074 Log: Uploading RC2 artifacts for nifi-1.18.0 Modified: dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/minifi-toolkit-1.18.0-bin.zip dev/nifi/nifi-1.18.0/minifi-toolkit-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/minifi-toolkit-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/minifi-toolkit-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/nifi-1.18.0-bin.zip dev/nifi/nifi-1.18.0/nifi-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/nifi-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/nifi-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/nifi-1.18.0-source-release.zip dev/nifi/nifi-1.18.0/nifi-1.18.0-source-release.zip.asc dev/nifi/nifi-1.18.0/nifi-1.18.0-source-release.zip.sha256 dev/nifi/nifi-1.18.0/nifi-1.18.0-source-release.zip.sha512 dev/nifi/nifi-1.18.0/nifi-registry-1.18.0-bin.zip dev/nifi/nifi-1.18.0/nifi-registry-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/nifi-registry-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/nifi-registry-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/nifi-registry-toolkit-1.18.0-bin.zip dev/nifi/nifi-1.18.0/nifi-registry-toolkit-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/nifi-registry-toolkit-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/nifi-registry-toolkit-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/nifi-stateless-1.18.0-bin.zip dev/nifi/nifi-1.18.0/nifi-stateless-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/nifi-stateless-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/nifi-stateless-1.18.0-bin.zip.sha512 dev/nifi/nifi-1.18.0/nifi-toolkit-1.18.0-bin.zip dev/nifi/nifi-1.18.0/nifi-toolkit-1.18.0-bin.zip.asc dev/nifi/nifi-1.18.0/nifi-toolkit-1.18.0-bin.zip.sha256 dev/nifi/nifi-1.18.0/nifi-toolkit-1.18.0-bin.zip.sha512 Modified: dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip == Binary files - no diff available. Modified: dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.asc == --- dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.asc (original) +++ dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.asc Thu Sep 29 07:32:55 2022 @@ -1,11 +1,11 @@ -BEGIN PGP SIGNATURE- -iQEzBAABCgAdFiEE0vJLgJ/6seIa6gKDkJO/hU+BGhoFAmM0e1MACgkQkJO/hU+B -GhrZFAgAtYsOCUJpRi5YxvA4U0d1PNVUgUub5i5qaPPZUtOUW5PIYbC+H+qKDZYO -181RB+d5heSNUbRF58rMz14lH5Wat8PEY8+n56tddqj8tGR08nGpenJ8Myn89eOs -ahYheJ/UzZYUwe79nfQ32q93kM2O6a6sQXCrJeGKX5TegQFbm95OCEVKC4XiwTof -ZgPEBC5NX4Lx2zCBH0uN6xSmTAv8qJ905VTcftKKWHQlRViWakVnOxxNKX7sK5vX -khXvEPUwE5a/fUia4IZFW0t8qn1rREgkCP7Oz91uH2NVf/+s1BZ9fCxYHp6lwYjm -XGq6ojRj9+aeKF0WthstUFATjdpsTQ== -=Xo/4 +iQEzBAABCgAdFiEE0vJLgJ/6seIa6gKDkJO/hU+BGhoFAmM1SasACgkQkJO/hU+B +GhpZDQgAhqnzAbFgCD+An4mQ4eqib/Lz18I6gMBnXpdBG/I7oqL9m9P3YF2bKig4 +ye3A8lrW/vd7y8eGSm0fLySBpB/HrO21TPWWh93AUjv8U1SPpJQUNpPd8xywlTKb +BJIPTlH3rtxsTnsGLhPglLOgBrXwmxG8SvDOyHdk1A+oBkWdeJ+m4hwVB5OjCS+n +ii4nYJ+NGdQyWaCmWsGj124ZKjqJAqkaf7gL8TPsnRimgpK5Comk5sRMhvf00rl3 +dVu9EC/9+78CGVcGyPnqcZtqf3z4K2bmHwBESUEPMK5sRp7qbwhjvDDsK73ia0eJ +X4BAyxIDeywn/JEBjHrfrcO8VRAe3w== +=h8VP -END PGP SIGNATURE- Modified: dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha256 == --- dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha256 (original) +++ dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha256 Thu Sep 29 07:32:55 2022 @@ -1 +1 @@ -112344a27267dbd3e8cff094a99348d8af6db3b5b60ea01032eeb0b5d69a3712 +dcdcab1225c75aa63701e1d078cec2841ef03179f9c7df917334197ee8fcd40f Modified: dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha512 == --- dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha512 (original) +++ dev/nifi/nifi-1.18.0/minifi-1.18.0-bin.zip.sha512 Thu Sep 29 07:32:55 2022 @@ -1 +1 @@ -9b59fdf044882413823c9caa48e0174f7132df836994ad11b2e2a2d885b808dac487a416a3d93e1781281534c05df6ce02547c293146e0b62c50598ad785 +1110682295cf6612a7fca172fa733a3800bf634dca2d28e948e586dd327005dffb50a9ccdd51bf1b3354af2461fa79369b5c3a30d9040219fa0ea518bfef82b9 Modified: dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip == Binary files - no diff available. Modified: dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.asc == --- dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.asc (original) +++ dev/nifi/nifi-1.18.0/minifi-c2-1.18.0-bin.zip.
