(nifi) 01/02: NIFI-12792 Deprecated nifi-spark-bundle components for removal This closes #8408
This is an automated email from the ASF dual-hosted git repository.
joewitt pushed a commit to branch support/nifi-1.x
in repository https://gitbox.apache.org/repos/asf/nifi.git
commit 463e965f588ec405e1e9d49d5246f81b069a70e2
Author: exceptionfactory
AuthorDate: Wed Feb 14 15:03:11 2024 -0600
NIFI-12792 Deprecated nifi-spark-bundle components for removal
This closes #8408
Signed-off-by: Joseph Witt
---
.../java/org/apache/nifi/controller/livy/LivySessionController.java | 2 ++
.../java/org/apache/nifi/processors/livy/ExecuteSparkInteractive.java | 2 ++
2 files changed, 4 insertions(+)
diff --git
a/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-controller-service/src/main/java/org/apache/nifi/controller/livy/LivySessionController.java
b/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-controller-service/src/main/java/org/apache/nifi/controller/livy/LivySessionController.java
index f691346c17..904fe75183 100644
---
a/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-controller-service/src/main/java/org/apache/nifi/controller/livy/LivySessionController.java
+++
b/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-controller-service/src/main/java/org/apache/nifi/controller/livy/LivySessionController.java
@@ -36,6 +36,7 @@ import org.apache.http.entity.StringEntity;
import org.apache.http.impl.client.BasicCredentialsProvider;
import org.apache.http.impl.client.HttpClientBuilder;
import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.DeprecationNotice;
import org.apache.nifi.annotation.documentation.Tags;
import org.apache.nifi.annotation.lifecycle.OnDisabled;
import org.apache.nifi.annotation.lifecycle.OnEnabled;
@@ -84,6 +85,7 @@ import java.util.concurrent.ConcurrentHashMap;
import java.util.concurrent.TimeUnit;
import java.util.stream.Collectors;
+@DeprecationNotice(reason = "Unmaintained and planned for removal in version
2.0")
@Tags({"Livy", "REST", "Spark", "http"})
@CapabilityDescription("Manages pool of Spark sessions over HTTP")
public class LivySessionController extends AbstractControllerService
implements LivySessionService {
diff --git
a/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-processors/src/main/java/org/apache/nifi/processors/livy/ExecuteSparkInteractive.java
b/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-processors/src/main/java/org/apache/nifi/processors/livy/ExecuteSparkInteractive.java
index 41eaac0152..99181eca3d 100644
---
a/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-processors/src/main/java/org/apache/nifi/processors/livy/ExecuteSparkInteractive.java
+++
b/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-processors/src/main/java/org/apache/nifi/processors/livy/ExecuteSparkInteractive.java
@@ -44,6 +44,7 @@ import org.apache.http.client.methods.HttpPost;
import org.apache.http.entity.StringEntity;
import org.apache.nifi.annotation.behavior.InputRequirement;
import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.DeprecationNotice;
import org.apache.nifi.annotation.documentation.Tags;
import org.apache.nifi.components.PropertyDescriptor;
import org.apache.nifi.controller.api.livy.exception.SessionManagerException;
@@ -64,6 +65,7 @@ import org.codehaus.jettison.json.JSONObject;
import org.apache.nifi.controller.api.livy.LivySessionService;
import org.apache.nifi.expression.ExpressionLanguageScope;
+@DeprecationNotice(reason = "Unmaintained and planned for removal in version
2.0")
@InputRequirement(InputRequirement.Requirement.INPUT_REQUIRED)
@Tags({"spark", "livy", "http", "execute"})
@CapabilityDescription("Execute Spark Code over a Livy-managed HTTP session to
a live Spark context. Supports cached RDD sharing.")
(nifi) branch support/nifi-1.x updated (b262f96b56 -> f9b89b7248)
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a change to branch support/nifi-1.x in repository https://gitbox.apache.org/repos/asf/nifi.git from b262f96b56 NIFI-12777 Add support for UUID record field type in QueryRecord processor new 463e965f58 NIFI-12792 Deprecated nifi-spark-bundle components for removal This closes #8408 new f9b89b7248 NIFI-12770 Deprecated Ranger Authorizers for Removal This closes #8387 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin/pom.xml | 4 .../org/apache/nifi/ranger/authorization/RangerNiFiAuthorizer.java | 6 +- .../java/org/apache/nifi/controller/livy/LivySessionController.java | 2 ++ .../org/apache/nifi/processors/livy/ExecuteSparkInteractive.java| 2 ++ .../nifi-registry-ranger/nifi-registry-ranger-plugin/pom.xml| 5 + .../main/java/org/apache/nifi/registry/ranger/RangerAuthorizer.java | 4 6 files changed, 22 insertions(+), 1 deletion(-)
(nifi) 02/02: NIFI-12770 Deprecated Ranger Authorizers for Removal This closes #8387
This is an automated email from the ASF dual-hosted git repository.
joewitt pushed a commit to branch support/nifi-1.x
in repository https://gitbox.apache.org/repos/asf/nifi.git
commit f9b89b7248d343e07cbe49108855cdd292080ee5
Author: exceptionfactory
AuthorDate: Fri Feb 9 16:21:34 2024 -0600
NIFI-12770 Deprecated Ranger Authorizers for Removal
This closes #8387
Signed-off-by: Joseph Witt
---
nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin/pom.xml | 4
.../org/apache/nifi/ranger/authorization/RangerNiFiAuthorizer.java | 6 +-
.../nifi-registry-ranger/nifi-registry-ranger-plugin/pom.xml| 5 +
.../main/java/org/apache/nifi/registry/ranger/RangerAuthorizer.java | 4
4 files changed, 18 insertions(+), 1 deletion(-)
diff --git a/nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin/pom.xml
b/nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin/pom.xml
index 0c4f47ed18..6e26203268 100644
--- a/nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin/pom.xml
+++ b/nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin/pom.xml
@@ -41,6 +41,10 @@
org.slf4j
jcl-over-slf4j
+
+org.apache.nifi
+nifi-deprecation-log
+
org.apache.ranger
ranger-plugins-common
diff --git
a/nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin/src/main/java/org/apache/nifi/ranger/authorization/RangerNiFiAuthorizer.java
b/nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin/src/main/java/org/apache/nifi/ranger/authorization/RangerNiFiAuthorizer.java
index d7513d7d6f..a96eb83910 100644
---
a/nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin/src/main/java/org/apache/nifi/ranger/authorization/RangerNiFiAuthorizer.java
+++
b/nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin/src/main/java/org/apache/nifi/ranger/authorization/RangerNiFiAuthorizer.java
@@ -33,6 +33,8 @@ import
org.apache.nifi.authorization.exception.AuthorizationAccessException;
import org.apache.nifi.authorization.exception.AuthorizerCreationException;
import org.apache.nifi.authorization.exception.AuthorizerDestructionException;
import org.apache.nifi.components.PropertyValue;
+import org.apache.nifi.deprecation.log.DeprecationLogger;
+import org.apache.nifi.deprecation.log.DeprecationLoggerFactory;
import org.apache.nifi.util.NiFiProperties;
import org.apache.ranger.audit.model.AuthzAuditEvent;
import org.apache.ranger.authorization.hadoop.config.RangerConfiguration;
@@ -85,9 +87,11 @@ public class RangerNiFiAuthorizer implements Authorizer,
AuthorizationAuditor {
private volatile NiFiProperties nifiProperties;
private final NumberFormat numberFormat = NumberFormat.getInstance();
+private final DeprecationLogger deprecationLogger =
DeprecationLoggerFactory.getLogger(getClass());
+
@Override
public void initialize(AuthorizerInitializationContext
initializationContext) throws AuthorizerCreationException {
-
+deprecationLogger.warn("Apache Ranger integration does not support
Jetty 12 and related libraries required for NiFi 2.0");
}
@Override
diff --git
a/nifi-registry/nifi-registry-extensions/nifi-registry-ranger/nifi-registry-ranger-plugin/pom.xml
b/nifi-registry/nifi-registry-extensions/nifi-registry-ranger/nifi-registry-ranger-plugin/pom.xml
index a328668f71..67ef61339b 100644
---
a/nifi-registry/nifi-registry-extensions/nifi-registry-ranger/nifi-registry-ranger-plugin/pom.xml
+++
b/nifi-registry/nifi-registry-extensions/nifi-registry-ranger/nifi-registry-ranger-plugin/pom.xml
@@ -78,6 +78,11 @@
org.slf4j
jcl-over-slf4j
+
+org.apache.nifi
+nifi-deprecation-log
+1.26.0-SNAPSHOT
+
diff --git
a/nifi-registry/nifi-registry-extensions/nifi-registry-ranger/nifi-registry-ranger-plugin/src/main/java/org/apache/nifi/registry/ranger/RangerAuthorizer.java
b/nifi-registry/nifi-registry-extensions/nifi-registry-ranger/nifi-registry-ranger-plugin/src/main/java/org/apache/nifi/registry/ranger/RangerAuthorizer.java
index ee90729b69..98edcb2c91 100644
---
a/nifi-registry/nifi-registry-extensions/nifi-registry-ranger/nifi-registry-ranger-plugin/src/main/java/org/apache/nifi/registry/ranger/RangerAuthorizer.java
+++
b/nifi-registry/nifi-registry-extensions/nifi-registry-ranger/nifi-registry-ranger-plugin/src/main/java/org/apache/nifi/registry/ranger/RangerAuthorizer.java
@@ -19,6 +19,8 @@ package org.apache.nifi.registry.ranger;
import org.apache.commons.lang.StringUtils;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.security.UserGroupInformation;
+import org.apache.nifi.deprecation.log.DeprecationLogger;
+import org.apache.nifi.deprecation.log.DeprecationLoggerFactory;
import org.apache.nifi.registry.properties.NiFiRegistryProperties;
import org.apache.nifi.registry.security.authorization.AccessPolicy;
(nifi) branch main updated: NIFI-12793 Removed deprecated nifi-spark-bundle This closes #8409
This is an automated email from the ASF dual-hosted git repository. joewitt pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git The following commit(s) were added to refs/heads/main by this push: new fcaaa566e8 NIFI-12793 Removed deprecated nifi-spark-bundle This closes #8409 fcaaa566e8 is described below commit fcaaa566e89ea52250e02fb0af1446aec27cc75d Author: exceptionfactory AuthorDate: Wed Feb 14 14:59:14 2024 -0600 NIFI-12793 Removed deprecated nifi-spark-bundle This closes #8409 Signed-off-by: Joseph Witt --- nifi-code-coverage/pom.xml | 15 - .../nifi-livy-controller-service-api-nar/pom.xml | 39 -- .../src/main/resources/META-INF/LICENSE| 257 - .../src/main/resources/META-INF/NOTICE | 63 --- .../nifi-livy-controller-service-api/pom.xml | 40 -- .../controller/api/livy/LivySessionService.java| 33 -- .../livy/exception/SessionManagerException.java| 27 - .../nifi-livy-controller-service/pom.xml | 85 --- .../controller/livy/LivySessionController.java | 572 - .../org.apache.nifi.controller.ControllerService | 16 - .../nifi-spark-bundle/nifi-livy-nar/pom.xml| 48 -- .../src/main/resources/META-INF/LICENSE| 257 - .../src/main/resources/META-INF/NOTICE | 89 .../nifi-spark-bundle/nifi-livy-processors/pom.xml | 89 .../processors/livy/ExecuteSparkInteractive.java | 316 .../services/org.apache.nifi.processor.Processor | 16 - .../livy/TestExecuteSparkInteractive.java | 115 - nifi-nar-bundles/nifi-spark-bundle/pom.xml | 82 --- nifi-nar-bundles/pom.xml | 1 - 19 files changed, 2160 deletions(-) diff --git a/nifi-code-coverage/pom.xml b/nifi-code-coverage/pom.xml index 5dad4ff268..ec929c0331 100644 --- a/nifi-code-coverage/pom.xml +++ b/nifi-code-coverage/pom.xml @@ -1469,21 +1469,6 @@ nifi-solr-processors 2.0.0-SNAPSHOT - -org.apache.nifi -nifi-livy-controller-service -2.0.0-SNAPSHOT - - -org.apache.nifi -nifi-livy-controller-service-api -2.0.0-SNAPSHOT - - -org.apache.nifi -nifi-livy-processors -2.0.0-SNAPSHOT - org.apache.nifi nifi-splunk-processors diff --git a/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-controller-service-api-nar/pom.xml b/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-controller-service-api-nar/pom.xml deleted file mode 100644 index ca5dbcc2e6..00 --- a/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-controller-service-api-nar/pom.xml +++ /dev/null @@ -1,39 +0,0 @@ - -http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd;> -4.0.0 - -org.apache.nifi -nifi-spark-bundle -2.0.0-SNAPSHOT - - -nifi-livy-controller-service-api-nar -nar - - - -org.apache.nifi -nifi-standard-services-api-nar -2.0.0-SNAPSHOT -nar - - -org.apache.nifi -nifi-livy-controller-service-api -2.0.0-SNAPSHOT - - - \ No newline at end of file diff --git a/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-controller-service-api-nar/src/main/resources/META-INF/LICENSE b/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-controller-service-api-nar/src/main/resources/META-INF/LICENSE deleted file mode 100644 index d86d9641f1..00 --- a/nifi-nar-bundles/nifi-spark-bundle/nifi-livy-controller-service-api-nar/src/main/resources/META-INF/LICENSE +++ /dev/null @@ -1,257 +0,0 @@ - - Apache License - Version 2.0, January 2004 -http://www.apache.org/licenses/ - - TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION - - 1. Definitions. - - "License" shall mean the terms and conditions for use, reproduction, - and distribution as defined by Sections 1 through 9 of this document. - - "Licensor" shall mean the copyright owner or entity authorized by - the copyright owner that is granting the License. - - "Legal Entity" shall mean the union of the acting entity and all - other entities that control, are controlled by, or are under common - control with that entity. For the purposes of this definition, - "control" means (i) the power, direct or indirect, to cause the - direction or management of such entity, whether by contract or - otherwise, or (ii) ownership of fifty percent (50%) or more of the - outstanding shares, or (iii) beneficial ownership of
(nifi) branch main updated (22de416ffc -> 2792aa7038)
This is an automated email from the ASF dual-hosted git repository.
mcgilman pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/nifi.git
from 22de416ffc [NIFI-12774] configure RPG (#8398)
add 2792aa7038 [NIFI-12754] - Flow Configuration History (#8399)
No new revisions were added by this update.
Summary of changes:
.../src/main/nifi/src/app/app-routing.module.ts| 8 +
.../flow-configuration-history-routing.module.ts | 33 +++
.../flow-configuration-history.component.html | 26 ++
.../flow-configuration-history.component.scss} | 0
.../flow-configuration-history.component.spec.ts | 53
.../flow-configuration-history.component.ts| 25 ++
.../feature/flow-configuration-history.module.ts | 41 +++
.../service/flow-configuration-history.service.ts | 38 +++
.../flow-configuration-history-listing.actions.ts | 60
.../flow-configuration-history-listing.effects.ts | 154 ++
.../flow-configuration-history-listing.reducer.ts | 86 ++
...flow-configuration-history-listing.selectors.ts | 55
.../flow-configuration-history-listing/index.ts| 113
.../flow-configuration-history/state/index.ts | 39 +++
.../action-details/action-details.component.html | 213 ++
.../action-details/action-details.component.scss | 31 ++
.../action-details.component.spec.ts | 56
.../action-details/action-details.component.ts | 92 ++
...ow-configuration-history-listing.component.html | 131 +
...ow-configuration-history-listing.component.scss | 22 ++
...configuration-history-listing.component.spec.ts | 41 +++
...flow-configuration-history-listing.component.ts | 317 +
...flow-configuration-history-table.component.html | 100 +++
...flow-configuration-history-table.component.scss | 25 ++
...w-configuration-history-table.component.spec.ts | 39 +++
.../flow-configuration-history-table.component.ts | 110 +++
.../purge-history/purge-history.component.html | 65 +
.../purge-history/purge-history.component.scss | 33 +++
.../purge-history/purge-history.component.spec.ts | 43 +++
.../purge-history/purge-history.component.ts | 93 ++
.../provenance-search-dialog.component.html| 4 +-
.../provenance-search-dialog.component.ts | 13 +-
.../ui/common/navigation/navigation.component.html | 2 +-
33 files changed, 2155 insertions(+), 6 deletions(-)
create mode 100644
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-configuration-history/feature/flow-configuration-history-routing.module.ts
create mode 100644
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-configuration-history/feature/flow-configuration-history.component.html
copy
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/{settings/ui/parameter-providers/create-parameter-provider/create-parameter-provider.component.scss
=>
flow-configuration-history/feature/flow-configuration-history.component.scss}
(100%)
create mode 100644
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-configuration-history/feature/flow-configuration-history.component.spec.ts
create mode 100644
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-configuration-history/feature/flow-configuration-history.component.ts
create mode 100644
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-configuration-history/feature/flow-configuration-history.module.ts
create mode 100644
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-configuration-history/service/flow-configuration-history.service.ts
create mode 100644
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-configuration-history/state/flow-configuration-history-listing/flow-configuration-history-listing.actions.ts
create mode 100644
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-configuration-history/state/flow-configuration-history-listing/flow-configuration-history-listing.effects.ts
create mode 100644
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-configuration-history/state/flow-configuration-history-listing/flow-configuration-history-listing.reducer.ts
create mode 100644
(nifi) branch main updated: [NIFI-12774] configure RPG (#8398)
This is an automated email from the ASF dual-hosted git repository.
mcgilman pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/nifi.git
The following commit(s) were added to refs/heads/main by this push:
new 22de416ffc [NIFI-12774] configure RPG (#8398)
22de416ffc is described below
commit 22de416ffc90df7eaa1788353959f2ec6bcdac38
Author: Scott Aslan
AuthorDate: Wed Feb 14 12:52:01 2024 -0500
[NIFI-12774] configure RPG (#8398)
* [NIFI-12774] configure RPG
* address review feedback
* conditionally dispatch selectComponents action
This closes #8398
---
.../pages/flow-designer/state/flow/flow.actions.ts | 5 +
.../pages/flow-designer/state/flow/flow.effects.ts | 60 +++-
.../create-remote-process-group.component.spec.ts | 2 +-
.../create-remote-process-group.component.ts | 1 -
.../edit-remote-process-group.component.html | 109 +
.../edit-remote-process-group.component.scss | 26 +
.../edit-remote-process-group.component.spec.ts} | 44 +++--
.../edit-remote-process-group.component.ts | 98 ++
8 files changed, 331 insertions(+), 14 deletions(-)
diff --git
a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/state/flow/flow.actions.ts
b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/state/flow/flow.actions.ts
index c1238cb382..89eeccfd49 100644
---
a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/state/flow/flow.actions.ts
+++
b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/state/flow/flow.actions.ts
@@ -383,6 +383,11 @@ export const openEditProcessGroupDialog = createAction(
props<{ request: EditComponentDialogRequest }>()
);
+export const openEditRemoteProcessGroupDialog = createAction(
+`${CANVAS_PREFIX} Open Edit Remote Process Group Dialog`,
+props<{ request: EditComponentDialogRequest }>()
+);
+
export const updateComponent = createAction(
`${CANVAS_PREFIX} Update Component`,
props<{ request: UpdateComponentRequest }>()
diff --git
a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/state/flow/flow.effects.ts
b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/state/flow/flow.effects.ts
index 97343047c0..eff3dba2cd 100644
---
a/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/state/flow/flow.effects.ts
+++
b/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/state/flow/flow.effects.ts
@@ -95,7 +95,7 @@ import { RegistryService } from
'../../service/registry.service';
import { ImportFromRegistry } from
'../../ui/canvas/items/flow/import-from-registry/import-from-registry.component';
import { selectCurrentUser } from
'../../../../state/current-user/current-user.selectors';
import { NoRegistryClientsDialog } from
'../../ui/common/no-registry-clients-dialog/no-registry-clients-dialog.component';
-import { showOkDialog } from './flow.actions';
+import { EditRemoteProcessGroup } from
'../../ui/canvas/items/remote-process-group/edit-remote-process-group/edit-remote-process-group.component';
@Injectable()
export class FlowEffects {
@@ -348,7 +348,10 @@ export class FlowEffects {
this.flowService.goToRemoteProcessGroup(request);
} else {
this.store.dispatch(
-showOkDialog({ title: 'Remote Process Group',
message: 'No target URI defined.' })
+FlowActions.showOkDialog({
+title: 'Remote Process Group',
+message: 'No target URI defined.'
+})
);
}
})
@@ -926,6 +929,8 @@ export class FlowEffects {
return of(FlowActions.openEditConnectionDialog({
request }));
case ComponentType.ProcessGroup:
return of(FlowActions.openEditProcessGroupDialog({
request }));
+case ComponentType.RemoteProcessGroup:
+return
of(FlowActions.openEditRemoteProcessGroupDialog({ request }));
case ComponentType.InputPort:
case ComponentType.OutputPort:
return of(FlowActions.openEditPortDialog({ request }));
@@ -1250,6 +1255,57 @@ export class FlowEffects {
{ dispatch: false }
(nifi) branch main updated: NIFI-12739 - Import ProcessPoolExecutor to fix bug in python 3.9+ (#8357)
This is an automated email from the ASF dual-hosted git repository. markap14 pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git The following commit(s) were added to refs/heads/main by this push: new e03329e01f NIFI-12739 - Import ProcessPoolExecutor to fix bug in python 3.9+ (#8357) e03329e01f is described below commit e03329e01f491b88f6f90e5285cb034e204d9363 Author: Alex Ethier <39684038+alexeth...@users.noreply.github.com> AuthorDate: Wed Feb 14 12:50:01 2024 -0500 NIFI-12739 - Import ProcessPoolExecutor to fix bug in python 3.9+ (#8357) * NIFI-12739 Import ProcessPoolExecutor to fix bug in python 3.9+ that causes Exceptions to be raised incorrectly in multi-threaded applications (https://bugs.python.org/issue42647) * Removed extraneous whitespace. --- .../src/main/python/framework/Controller.py | 9 + 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/nifi-nar-bundles/nifi-py4j-bundle/nifi-python-framework/src/main/python/framework/Controller.py b/nifi-nar-bundles/nifi-py4j-bundle/nifi-python-framework/src/main/python/framework/Controller.py index 4425fd26b3..8919924c06 100644 --- a/nifi-nar-bundles/nifi-py4j-bundle/nifi-python-framework/src/main/python/framework/Controller.py +++ b/nifi-nar-bundles/nifi-py4j-bundle/nifi-python-framework/src/main/python/framework/Controller.py @@ -15,18 +15,19 @@ import logging import os -from concurrent.futures import ThreadPoolExecutor +from concurrent.futures import ThreadPoolExecutor, ProcessPoolExecutor from py4j.java_gateway import JavaGateway, CallbackServerParameters, GatewayParameters import ExtensionManager -# We do not use ThreadPoolExecutor, but it must be kept here. Python introduced a bug in 3.9 that causes Exceptions to be raised +# We do not use ThreadPoolExecutor or ProcessPoolExecutor, but they must be kept here. Python introduced a bug in 3.9 that causes Exceptions to be raised # incorrectly in multi-threaded applications (https://bugs.python.org/issue42647). This works around the bug. -# What is actually necessary is to import ThreadPoolExecutor. +# What is actually necessary is to import ThreadPoolExecutor and ProcessPoolExecutor. # Unfortunately, IntelliJ often likes to cleanup the unused import. So we assign a bogus variable just so -# that we have some reference to ThreadPoolExecutor in order to prevent the IDE from cleaning up the import +# that we have some reference to ThreadPoolExecutor and ProcessPoolExecutor in order to prevent the IDE from cleaning up the import threadpool_attrs = dir(ThreadPoolExecutor) +processpool_attrs = dir(ProcessPoolExecutor) # Initialize logging
(nifi) branch main updated: NIFI-12767: Error handling in Provenance and Lineage (#8386)
This is an automated email from the ASF dual-hosted git repository. rfellows pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git The following commit(s) were added to refs/heads/main by this push: new da8f86b7e7 NIFI-12767: Error handling in Provenance and Lineage (#8386) da8f86b7e7 is described below commit da8f86b7e7994064dfb256952f6c4e0f12f005b8 Author: Matt Gilman AuthorDate: Wed Feb 14 11:11:26 2024 -0500 NIFI-12767: Error handling in Provenance and Lineage (#8386) * NIFI-12767: - Error handling in Provenance and Lineage. * NIFI-12767: - Addressing review feedback. * NIFI-12767: - Restoring empty initial state for completed request that allows showing a banner error over an empty table instead of an empty page. * NIFI-12767: - Restoring error state to ensure that the loading spinner stops on error. This closes #8386 --- .../add-tenant-to-policy-dialog.component.spec.ts | 4 +- .../override-policy-dialog.component.spec.ts | 4 +- .../create-connection.component.spec.ts| 4 +- .../destination-process-group.component.spec.ts| 4 +- ...tination-remote-process-group.component.spec.ts | 4 +- .../edit-connection.component.spec.ts | 4 +- .../source-process-group.component.spec.ts | 4 +- .../source-remote-process-group.component.spec.ts | 4 +- .../import-from-registry.component.spec.ts | 4 +- .../port/create-port/create-port.component.spec.ts | 4 +- .../port/edit-port/edit-port.component.spec.ts | 4 +- .../create-process-group.component.spec.ts | 4 +- .../edit-process-group.component.spec.ts | 4 +- .../group-components.component.spec.ts | 4 +- .../create-processor.component.spec.ts | 4 +- .../edit-processor.component.spec.ts | 4 +- .../ui/login-form/login-form.component.spec.ts | 4 +- .../edit-parameter-context.component.spec.ts | 4 +- .../pages/provenance/service/provenance.service.ts | 6 +- .../app/pages/provenance/state/lineage/index.ts| 4 +- .../provenance/state/lineage/lineage.actions.ts| 2 + .../provenance/state/lineage/lineage.effects.ts| 124 +- .../provenance/state/lineage/lineage.reducer.ts| 41 +++- .../provenance/state/lineage/lineage.selectors.ts | 9 +- .../state/provenance-event-listing/index.ts| 4 +- .../provenance-event-listing.actions.ts| 2 + .../provenance-event-listing.effects.ts| 272 - .../provenance-event-listing.reducer.ts| 52 +++- .../provenance-event-listing.selectors.ts | 16 +- .../provenance-event-listing.component.html| 1 + .../provenance-event-listing.component.ts | 14 +- .../provenance-event-table.component.html | 3 +- .../provenance-event-table.component.spec.ts | 19 +- .../provenance-event-table.component.ts| 14 +- .../provenance-search-dialog.component.html| 5 + .../provenance-search-dialog.component.scss| 4 + .../provenance-search-dialog.component.spec.ts | 4 +- .../app/pages/queue/state/queue-listing/index.ts | 2 +- .../state/queue-listing/queue-listing.reducer.ts | 4 +- .../flowfile-dialog.component.spec.ts | 4 +- .../flowfile-table.component.spec.ts | 4 +- .../parameter-providers.effects.ts | 4 +- .../create-flow-analysis-rule.component.spec.ts| 4 +- .../edit-flow-analysis-rule.component.spec.ts | 4 +- .../flow-analysis-rule-table.component.spec.ts | 4 +- .../general-form/general-form.component.spec.ts| 4 +- .../create-registry-client.component.spec.ts | 4 +- .../edit-registry-client.component.spec.ts | 4 +- .../registry-client-table.component.spec.ts| 4 +- .../create-reporting-task.component.spec.ts| 4 +- .../edit-reporting-task.component.spec.ts | 4 +- .../user-access-policies.component.spec.ts | 4 +- .../component-state.component.spec.ts | 4 +- .../controller-service-table.component.spec.ts | 4 +- .../create-controller-service.component.spec.ts| 4 +- .../disable-controller-service.component.spec.ts | 4 +- .../edit-controller-service.component.spec.ts | 4 +- .../enable-controller-service.component.spec.ts| 4 +- .../edit-parameter-dialog.component.spec.ts| 4 +- .../edit-tenant-dialog.component.spec.ts | 4 +- .../extension-creation.component.spec.ts | 4 +- .../new-property-dialog.component.spec.ts | 4 +- .../combo-editor/combo-editor.component.spec.ts| 4 +- .../provenance-event-dialog.component.html | 6 +- .../provenance-event-dialog.component.spec.ts | 4 +- 65 files changed, 462 insertions(+), 318 deletions(-)
(nifi) branch main updated: NIFI-12787 [MiNiFi] Update list of out-of-the-box supported processors in quickstart guide
This is an automated email from the ASF dual-hosted git repository. ferdei pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/nifi.git The following commit(s) were added to refs/heads/main by this push: new 4f030fefca NIFI-12787 [MiNiFi] Update list of out-of-the-box supported processors in quickstart guide 4f030fefca is described below commit 4f030fefcabf109d7ac834831d4c740f2dbf1200 Author: Ferenc Kis AuthorDate: Wed Feb 14 13:28:16 2024 +0100 NIFI-12787 [MiNiFi] Update list of out-of-the-box supported processors in quickstart guide Signed-off-by: Ferenc Erdei This closes #8402. --- .../main/markdown/minifi-java-agent-quick-start.md | 76 ++ 1 file changed, 65 insertions(+), 11 deletions(-) diff --git a/minifi/minifi-docs/src/main/markdown/minifi-java-agent-quick-start.md b/minifi/minifi-docs/src/main/markdown/minifi-java-agent-quick-start.md index fcf6afdf94..3cd4aeb242 100644 --- a/minifi/minifi-docs/src/main/markdown/minifi-java-agent-quick-start.md +++ b/minifi/minifi-docs/src/main/markdown/minifi-java-agent-quick-start.md @@ -155,68 +155,121 @@ For more details about the C2 protocol please visit [Apache NiFi - MiNiFi C2 wik ## Using Processors Not Packaged with MiNiFi MiNiFi is able to use the following processors out of the box: -* UpdateAttribute +* AttributesToCSV * AttributesToJSON -* Base64EncodeContent +* CalculateRecordStats * CompressContent * ControlRate * ConvertCharacterSet +* ConvertJSONToSQL +* ConvertRecord +* CountText +* CryptographicHashContent +* DebugFlow +* DeduplicateRecord +* DetectDuplicate +* DistributeLoad * DuplicateFlowFile +* EncodeContent +* EnforceOrder * EvaluateJsonPath -* EvaluateRegularExpression * EvaluateXPath * EvaluateXQuery * ExecuteProcess +* ExecuteSQL +* ExecuteSQLRecord * ExecuteStreamCommand +* ExtractGrok +* ExtractRecordSchema * ExtractText +* FetchDistributedMapCache +* FetchFTP * FetchFile * FetchSFTP +* FilterAttribute +* FlattenJson +* ForkEnrichment +* ForkRecord * GenerateFlowFile +* GenerateRecord +* GenerateTableFetch * GetFTP * GetFile -* GetHTTP -* GetJMSQueue -* GetJMSTopic * GetSFTP -* HashAttribute -* HashContent +* HandleHttpRequest +* HandleHttpResponse * IdentifyMimeType * InvokeHTTP +* JoinEnrichment +* JoltTransformJSON +* ListDatabaseTables +* ListFTP * ListFile * ListSFTP +* ListenFTP * ListenHTTP * ListenRELP * ListenSyslog * ListenTCP +* ListenTCPRecord * ListenUDP +* ListenUDPRecord * LogAttribute +* LogMessage +* LookupAttribute +* LookupRecord * MergeContent +* MergeRecord * ModifyBytes * MonitorActivity +* Notify +* PackageFlowFile +* ParseCEF * ParseSyslog -* PostHTTP +* ParseSyslog5424 +* PartitionRecord +* PutDatabaseRecord +* PutDistributedMapCache * PutEmail * PutFTP * PutFile -* PutJMS +* PutRecord * PutSFTP +* PutSQL * PutSyslog +* PutTCP +* PutUDP +* QueryDatabaseTable +* QueryDatabaseTableRecord +* QueryRecord +* RemoveRecordField +* RenameRecordField * ReplaceText * ReplaceTextWithMapping +* RetryFlowFile * RouteOnAttribute * RouteOnContent * RouteText +* SampleRecord * ScanAttribute * ScanContent * SegmentContent * SplitContent * SplitJson +* SplitRecord * SplitText * SplitXml * TailFile * TransformXml * UnpackContent +* UpdateCounter +* UpdateDatabaseTable +* UpdateRecord +* ValidateCsv +* ValidateJson +* ValidateRecord * ValidateXml +* Wait MiNiFi is able to use the StandardSSLContextService out of the box. @@ -231,8 +284,9 @@ If you want to create a dataflow with a processor not shipped with MiNiFi, you c * ConvertJSONToSQL * PutSQL * GenerateTableFetch - * ListDatabaseTable + * ListDatabaseTables * QueryDatabaseTable + * QueryDatabaseTableRecord * ExecuteSQL * nifi-distributed-cache-services-nar * DetectDuplicate
(nifi-minifi-cpp) branch MINIFICPP-2277 updated (7e63d5791 -> acd393e3a)
This is an automated email from the ASF dual-hosted git repository. lordgamez pushed a change to branch MINIFICPP-2277 in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git discard 7e63d5791 MINIFICPP-2277 Add virtualenv support for python processors add acd393e3a MINIFICPP-2277 Add virtualenv support for python processors This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (7e63d5791) \ N -- N -- N refs/heads/MINIFICPP-2277 (acd393e3a) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: extensions/python/ExecutePythonProcessor.cpp | 28 --- extensions/python/ExecutePythonProcessor.h | 2 - extensions/python/PYTHON.md | 2 +- extensions/python/PythonConfigState.h| 67 +++ extensions/python/PythonCreator.h| 2 +- extensions/python/PythonScriptEngine.cpp | 117 +-- extensions/python/PythonScriptEngine.h | 9 +-- 7 files changed, 146 insertions(+), 81 deletions(-) create mode 100644 extensions/python/PythonConfigState.h
