Re: How to iterate over all dynamic properties in python invokeScriptedProcessor?

ndex.html> [2] https://github.com/Chaffelson/nipyapi/blob/master/nipyapi/nifi/models/processor_config_dto.py <https://github.com/Chaffelson/nipyapi/blob/master/nipyapi/nifi/models/processor_config_dto.py> [3] https://github.com/Chaffelson/nipyapi/blob/master/nipyapi/canvas.py#L225 <htt

Re: Storing output of shellscript in s3 bucket

r with the path in the filename attribute (update using an UpdateAttribute processor if necessary). I would recommend the first option as a cleaner and more robust solution. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E

Re: Include parent fields into the output record fields in XML data

CSV. You can also use the QueryRecord processor to perform SQL-like queries over large datasets in a flowfile which might be helpful in forming the output you’re looking for. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E

Re: Avro Single Object Binary Encoding

ira/projects/NIFI/issues> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Apr 20, 2020, at 2:59 AM, nathan.engl...@bt.com wrote: > > Hi There, > > Apologies if this has been asked bef

Re: UpdateAttribute processor question...

, but I think currently the API doesn’t request that order so it would require a code change there, with a default practice being “order as received". Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69

Re: UpdateAttribute processor question...

but would still not provide the result you’re expecting. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Apr 22, 2020, at 12:38 PM, Andy LoPresto wrote: > > Dan, > > Unfortunately I don

Re: OIDC Redirect loop

easy way to validate this would be to change the stateful set # to 1 node and attempt the same sequence of operations. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Apr 27, 2020, at 8:12 AM,

Re: POST multipart/form-data with Invokehttp

ExecuteProcess and ExecuteStreamCommand both allow shell commands to be run; ExecuteProcess does not allow incoming flowfiles but ExecuteStreamCommand does. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69

Re: ConsumeIMAP certificates issue

the following truststores, one at a time, in this order: 1. JRE cacerts (copy the actual cacerts and ensure you have a backup before you start modifying it) 2. The NiFi truststore configured in nifi.properties Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint

Re: Is provenance data preserved when processors are deleted?

endorsement, but there are other metadata storage systems like Apache Atlas [1] which you may want to look at for longer retention and some of the features you’re looking for, like a UI for lineage graphs. [1] https://atlas.apache.org/#/ <https://atlas.apache.org/#/> Andy LoPresto alopre...@apac

Re: NiFi and real-time data lake

Thanks Boris, this is really interesting to read and I appreciate that you’re sharing it with the community. We’re glad NiFi can help with these important use cases. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B

Re: Secure Nifi with DigiCert

certificate, which you the user (your browser) verify and decide to trust. When you visit a NiFi instance which is secured and has no other authentication mechanism configured, the only way to authenticate is to present a client certificate. Andy LoPresto alopre...@apache.org alopresto.apa

Re: ExecuteProcess processor with TLS1.2 error: "failed setting cipher list"

. 3. Run curl -vvv to see increased verbosity output. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On May 22, 2020, at 8:08 AM, Eric Chaves wrote: > > Hi folks, > > I have a flow

Re: Use of SNI routing in Nifi ?

Hi Pat, Are you asking if NiFi’s internal web server supports SNI or if NiFi processors/framework connecting to external services can resolve SNI? Maybe some more context around your question would help us answer. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP

Re: Use of SNI routing in Nifi ?

you have a specific desired scenario, I can try to analyze it, but the entire concept of having multiple NiFi services or NiFi + other services be exposed on the same port and use SNI to differentiate seems unnecessary to me. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him

Re: Connecting Controller Services Automatically

constraints on future flow development. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On May 22, 2020, at 3:01 PM, Eric Secules wrote: > > Hello everyone, > > I am running into an issue

Re: Connecting Controller Services Automatically

If you want the process to be completely automated, you would have to enforce the controller service IDs to be identical across environments. Otherwise deployment would need a manual intervention to reference the specific controller service in the proper component. Andy LoPresto alopre

Re: Connecting Controller Services Automatically

manual manipulation of the flow.xml.gz in various environments and frequent restarts of the NiFi service. I do not recommend this. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On May 23, 2020, at 11

Re: Connecting Controller Services Automatically

Yes, I should have clarified this. Thanks Bryan. This is the solution for the generic use case. The original question was about reducing the controller to only a single instance of a specific controller service implementation, which is how the tangent got started. Andy LoPresto alopre

Re: ExecuteProcess processor with TLS1.2 error: "failed setting cipher list"

Thanks Eric. Glad to know what the issue was and this should help people in the future. Always appreciate when people follow up and document a solved problem for the benefit of the community. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6

Re: Error to connect using ConsumeAMQP processor

t? I suspect the issue is with Docker networking making those ports available to resolve within the other container. Have you followed the steps in [1]? [1] https://www.rabbitmq.com/troubleshooting-networking.html <https://www.rabbitmq.com/troubleshooting-networking.html> Andy LoPre

Re: Accessing flow attributes from ExecuteStreamCommand

t or InvokeScriptedProcessor, in which case the NiFi session API is available to your code and you can interact directly with attributes. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On May 28, 202

Re: Prometheus reporting task

.nabble.com/Metrics-via-Prometheus-tp9102p9107.html <http://apache-nifi-users-list.2361937.n4.nabble.com/Metrics-via-Prometheus-tp9102p9107.html> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 >

Re: Prometheus reporting task

At a quick glance it does not look like there is much logging. Perhaps Matt Burgess can offer more context around this? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 1, 2020, at 2:45 PM, Pave

Re: Execute Script - Groovy get attribute

It also seems like you would rather set the flowfile batch count as a _property_ on the ExecuteScript processor and obtain it from the session, rather than check a specific flowfile for an attribute which may or may not exist. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He

Re: MergeContent resulting in corrupted JSON

It may just be a copy/paste or retyping issue, but in the example you provided, I see unpaired double quotes (the hexBytes values have trailing quotes but not leading ones), which could be causing issues in parsing… Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP

Re: MergeContent resulting in corrupted JSON

and delegate that to an implementation, or I could have a giant switch statement and the raw crypto primitive code all in a giant spaghetti method/callback definition. I know I would prefer the former. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC

Re: Expression language null value

uide> [4] https://nifi.apache.org/developer-guide.html <https://nifi.apache.org/developer-guide.html> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 11, 2020, at 7:40 AM, Fabrizio Sp

Re: NiFi Expression Language in UpdateAttribute

Russell, I think it would be fine to include an example like this in the Expression Language Guide. You can submit a PR to add that if you like. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun

Re: MergeContent resulting in corrupted JSON

contributors with a date in the last couple years, I trust it much more than even code by those same people from 5 years ago (which was likely written even longer ago than that; time “starts” from the initial import in 2014). Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP

Re: In memoriam of Jeff Storck

Jeff loved mocks, both friendly impressions and in his tests. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 15, 2020, at 12:12 PM, Jeremy Dyer wrote: > > This is shocking and heartbrea

Re: AmazonDocumentDB

If that was the issue, you can also import those PEM files into a Java Keystore (.jks) file and configure the SSL Context Service your Mongo processors use to reference it as a truststore. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F

Re: 3 node of nifi generating 3 different flow files

secure these values and you want to migrate to a new key. When starting a new cluster, set the nifi.sensitive.props.key value to the desired value on all cluster nodes, and NiFi will automatically encrypt and decrypt the sensitive processor properties with it. Andy LoPresto alopre

Re: 3 node of nifi generating 3 different flow files

Sanjeet, If this is for a new cluster, you can delete the flow.xml.gz file from all nodes and restart NiFi. When the nodes start up again, they will create the new flow definition file on each node respectively with the synced root process group ID. Andy LoPresto alopre...@apache.org

Re: 3 node of nifi generating 3 different flow files

Sanjeet, Did you stop every node in the cluster before deleting these files? Can you share the actual output of the log files? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 18, 2020, at 5:15

Re: Replacing a base64-encoded field in a JSON-document with its decoded/converted value

pe this helps. [1] https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#base64decode <https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#base64decode> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5

Re: Duplicate Attribute Values in Extract Text Processor Output

. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 25, 2020, at 8:27 AM, muhyid72 wrote: > > Dear All > I need an information about Flow Files Attribute of Extract Text Processor. >

Re: Replacing a base64-encoded field in a JSON-document with its decoded/converted value

using the Groovy script to perform those steps in tandem is probably the most performant and logical approach here. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 24, 2020, at 11:25 PM, Mykleb

Re: Duplicate Attribute Values in Extract Text Processor Output

line (minus the final character) into an attribute, and then sends the values to Syslog. You may want to look at the record processors to improve the performance and simplicity of the flow substantially. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC

Re: unsubscribe

Please send a message to users-unsubscr...@nifi.apache.org <mailto:users-unsubscr...@nifi.apache.org> to unsubscribe. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 29, 2020, at 8:36 AM

Re: Replacing a base64-encoded field in a JSON-document with its decoded/converted value

org/json.html#> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 29, 2020, at 7:41 AM, Myklebust, Bjørn Magnar > wrote: > > Andy, just a quick followup on this. > > I wanted to test a

Re: PutFile set Last Modified Time without file.creationTime

/nifi-docs/html/expression-language-guide.html#todate <https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#todate> [2] https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#format Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him

Re: Processor setup - Outbound Proxy Config

://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-proxy-configuration-nar/1.11.4/org.apache.nifi.proxy.StandardProxyConfigurationService/index.html Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69

Re: Issue with Secured NiFi on kubernetes using Helm charts

/nifi-docs/html/administration-guide.html#security_configuration <https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#security_configuration> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7

Re: Issue with Secured NiFi on kubernetes using Helm charts

misunderstanding your statement, but I am curious why the toolkit can’t run on the node — if you don’t have Java available, how does NiFi itself run? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jul

Re: Template not saving parameter context assignment

segments directly to/from a NiFi instance without NiFi Registry but they are not released yet. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jul 28, 2020, at 2:00 PM, bsavard wrote: > > Hi, >

Re: Nifi security of local filesystem and hdfs in multitenant hdfs use cases

processes are running as a single OS user, so all of the keytabs will need to be readable by that OS user, and the OS can’t detect which Java process is acting as which application user. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4

Re: SSL/LDAP Configuration

er-tls-ssl-against-active-directory#post1908811> [2] https://devconnected.com/how-to-search-ldap-using-ldapsearch-examples/ <https://devconnected.com/how-to-search-ldap-using-ldapsearch-examples/> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E

Re: SSL/LDAP Configuration

https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#ldapusergroupprovider <https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#ldapusergroupprovider> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

you mean n...@x.net <mailto:n...@x.net>?” Or even potentially trying to do case-conversion internally as a fallback. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 5, 2020, at 2:50 PM, dan yo

Re: External Access using InvokeHTTP_Test processor and StandardSSLContextService

lqw/index.html> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 6, 2020, at 6:32 AM, Jorge Machado wrote: > > Hi Dan, > > Seems like this is a jvm issue. &g

Re: Get all available variables in the InvokeScriptedProcessor

variables starting with prefix: def varsStartingWithABC = this.binding.variables.findAll { k,v -> k.startsWith(“a.b.c”) } Find all attributes starting with prefix: def attrsStartingWithABC = flowfile.getAttributes().findAll { k,v -> k.startsWith(“a.b.c”) } Andy LoPresto

Re: External Access using InvokeHTTP_Test processor and StandardSSLContextService

, obtain the public certificate of that endpoint and manually create a truststore containing that cert. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 7, 2020, at 1:14 AM, Valentina Ivanova wr

Re: Get all available variables in the InvokeScriptedProcessor

can define dynamic properties on the processor config and reference those directly in code (see any existing processor source for examples). Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 9, 2

Re: Data Provenance Stops Working

tes> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 10, 2020, at 10:00 AM, Shawn Weeks wrote: > > I’m running a three node NiFi Cluster on AWS EC2s using integrated Zookeeper &g

Re: FetchSFTP: Rename file on move

You can also use an UpdateAttribute processor to change the “filename” attribute, which is what any “file persistence” processor (PutSFTP, PutFile, etc.) will use when writing the file out. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6

Re: Nifi takes too long to start(~ 30 minutes)

instance? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 16, 2020, at 10:28 PM, Mohit Jain wrote: > > Hi Pierre, > > No, the election process takes only a minute or two max, reaching

Re: NiFi 1.12.0 - KeyStores with multiple certificates are not supported

stantial refactoring in the core framework and is not planned for any immediate attention. [1] https://nifi.apache.org/docs/nifi-docs/html/toolkit-guide.html#wildcard_certificates Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4

Re: Flow.xml.gz gets overwritten with Empty Flow.xml

very interested in pursuing this approach. [1] https://issues.apache.org/jira/browse/NIFI-6999 <https://issues.apache.org/jira/browse/NIFI-6999> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 &g

Re: SSL/LDAP Configuration

all my usual resources available, but hopefully this guides you in the right direction. If not, please let me know and tomorrow I can provide more specific instructions. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F6

Re: SSL/LDAP Configuration

, you can copy/paste as many as you want to define them. Again, this is not the ideal situation; most of this should be possible through the UI but I’m not sitting there to diagnose the issue. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6

Re: Site to Site with multi-entry keystore?

certificate trust; the user identity is proxied in the request itself and used for authorization)? Have you checked the logs/nifi-app.log and logs/nifi-user.log files to see what identity the incoming authentication request is presenting? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com

Re: Connect NiFi to MongoDB(Atlas)

This was discussed in the Slack channel [1] and NIFI-7768 [2] was filed to address it. [1] https://apachenifi.slack.com/archives/C0L9VCD47/p1598402012117700 [2] https://issues.apache.org/jira/browse/NIFI-7768 Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint

Re: Jks password migration issue

#encrypt_config_tool <https://nifi.apache.org/docs/nifi-docs/html/toolkit-guide.html#encrypt_config_tool> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 27, 2020, at 6:52 AM, sanjeet ra

Re: WebSocket Service - Using Trusted Certificates

s there a reason you’re using web sockets between two NiFi instances? The NiFi Site-to-site protocol [1] offers a number of advantages. [1] https://medium.com/@abdelkrim.hadjidj/hub-and-spoke-architectures-with-nifi-site-to-site-communications-at-any-level-a-nifi-1-10-a8702f77c66e Andy LoPres

[ANNOUNCE] Apache NiFi CVE-2020-9486, CVE-2020-9487, CVE-2020-9491, CVE-2020-13940

values in plaintext. Mitigation: Implemented Argon2 secure hashing to provide a deterministic loggable value which does not reveal the sensitive value. Users running any previous NiFi release should upgrade to the latest release. Credit: This issue was discovered by Andy LoPresto and Pierre

Re: Securing MiNiFi

You can use the toolkit to generate another “server/node” certificate just as you did for the NiFi instance (do this from the same toolkit instance & directory to ensure both are signed by the same CA) and this will generate both the keystore and truststore JKS to use for MiNiFi.

Re: Securing MiNiFi

MiNiFi’s flow definition is persisted in the config.yml file. You should examine that file for the plaintext URL below and update it with the HTTPS URL (protocol & port). That will indicate that it should connect over TLS. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He

Re: [EXT] sslcontext certs

components reference those parameters in the path properties. [1] https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#Parameters Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Oct 15, 2020, at 7

Re: Securing MiNiFi

you just not share that portion? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Oct 21, 2020, at 11:18 AM, scotty wrote: > > Hi, > > Here's the info: > >

Re: Securing MiNiFi

We’ll try to clean up the NiFi docs, but vendor documentation is out of our control. Glad it’s working for you now. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Oct 21, 2020, at 17:46, sco

Re: Run Nifi in IntelliJ to debug?

breakpoints within your code. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Oct 27, 2020, at 9:08 AM, Darren Govoni wrote: > > Hello, >So i was able to get intelliJ to debug nifi but onl

Re: nifi 0.4.1 does not start

Hi Frank, Sorry to hear you are having trouble. Can you please provide a full stack trace? It should help us narrow down the issue. Andy LoPresto alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jan 14, 2016, at 2:23 PM, Frank Martínez wr

Re: nifi 0.4.1 does not start

Thanks Frank. Glad to hear it is resolved. Good luck using NiFi. Andy LoPresto alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jan 14, 2016, at 3:31 PM, Frank Martínez wrote: > > Hi Andy, > > Thanks for your interest. But pl

Re: Nifi api - SSL_ERROR_WEAK_SERVER_EPHEMERAL_DH_KEY

[1] https://community.hortonworks.com/articles/886/securing-nifi-step-by-step.html [2] https://www.openssl.org/docs/manmaster/apps/s_client.html [3] https://github.com/jvehent/cipherscan Andy LoPresto alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On

Re: Nifi api - SSL_ERROR_WEAK_SERVER_EPHEMERAL_DH_KEY

org/Security/Server_Side_TLS#DHE_and_Java Andy LoPresto alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Feb 2, 2016, at 12:28 PM, Chakrader Dewaragatla > wrote: > > Andy – > > http://pastebin.com/yse0DXU3 <http://pastebin.com/

Re: File Upload to a ListenHTTP Processor

Andrew, You may also want to change the content type you are providing. I understand you may not know the format a priori, but “form-data” is probably not what you want. Look at `-H "Content-Type: text/xml”` or `-H “Content-Type: application/octet-stream”` for arbitrary binary data.

Re: File Upload to a ListenHTTP Processor

instance. Andy LoPresto alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Feb 8, 2016, at 12:46 PM, Andrew Serff wrote: > > Thanks for the suggestions everyone, but they don’t seem to work. A couple > of problems: > using --data

Re: NiFi logging

rocessor/AbstractProcessor.java [4] http://www.slf4j.org/legacy.html Andy LoPresto alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Feb 10, 2016, at 7:54 PM, sudeep mishra wrote: > > Hi, > > What is the preferred practice for logg

Re: Regular Expressions

I use Patterns on OS X. It hasn’t been updated in a few years but it’s done everything I need it to. https://itunes.apple.com/us/app/patterns-the-regex-app/id429449079?mt=12 Andy LoPresto alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Ma

Re: User Authentication with username and password

isn’t. Andy LoPresto alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Mar 10, 2016, at 1:55 PM, Matt Gilman wrote: > > When NiFi is running over HTTP everyone accesses the application as an > anonymous user and has full access. >

Re: Can't use PutS3Object with user names containing commas

tps://issues.apache.org/jira/secure/CreateIssue!default.jspa> Andy LoPresto alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Mar 18, 2016, at 7:55 AM, Joseph E. Gottman > wrote: > > I'm trying to use a PutS3Object processor and

Re: HTTP and OAuth

gt; Pierre, > > I'm no OAuth expert but maybe you could have a flow that hits the OAuth > service for a token (scheduled for the same duration as the token lifetime), > then stores it in a DistributedMapCache, then your other flows can fetch the > token for the desired op

Re: Where can I find documentation of implementing custom processor?

t;https://nifi.apache.org/docs/nifi-docs/html/developer-guide.html> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Apr 20, 2016, at 3:42 PM, Keith Lim wrote: > > Is there any good example of impleme

Re: Doing development on nifi

mponents/org.apache.nifi.processors.standard.LogAttribute/index.html> [2] https://nifi.apache.org/videos.html <https://nifi.apache.org/videos.html> [3] https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#replaying-a-flowfile <https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#replaying-a-flowf

Re: Starting Nifi encounters "unexpected error"

repositories when recovering from a server failure unless further debugging demonstrates it is absolutely required. NiFi is fairly resilient about resuming processing after the machine is restored. Let us know if this does not help. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP

Re: Need to measure start and end time for a processor

will include the Kafka batching time, as the provenance metrics are NiFi-only. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On May 27, 2016, at 2:43 PM, Lee Laim wrote: > > Igor, > > Her

Re: Wildcard character in the Command Argument field of the ExecuteStreamCommand processor

would not need to set the working directory Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On May 31, 2016, at 7:02 AM, Huagen peng wrote: > > Hi, I would like to run a md5sum command on all the *.gz fi

Re: Wildcard character in the Command Argument field of the ExecuteStreamCommand processor

/nifi/processors/script/ExecuteScript.java <https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-scripting-bundle/nifi-scripting-processors/src/main/java/org/apache/nifi/processors/script/ExecuteScript.java> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Finge

Re: RegEx not catching all tags

‘-‘, etc. but that should be well-documented by Twitter. /(#[\w]+\b)/g [1] https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.ExtractText/index.html [2] https://regex101.com/r/gV3mO5/1 Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint

Re: Wildcard character in the Command Argument field of the ExecuteStreamCommand processor

gspot.com/2016/02/invokescriptedprocessor-hello-world.html> [4] http://funnifi.blogspot.com/2016/02/writing-reusable-scripted-processors-in.html <http://funnifi.blogspot.com/2016/02/writing-reusable-scripted-processors-in.html> Andy LoPresto alopre...@apache.org alopresto.ap

Re: Combining outputs in parallel returns a random output

getting the final result of the additive operation into the destination processor. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 1, 2016, at 22:25, Kavinaesh Dheenadayalan wrote: > > Hi Team,

Re: Combining outputs in parallel returns a random output

] first. I am not guaranteeing this will work, but I would encourage you to explore it. [1] http://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.MergeContent/index.html [2] https://nifi.apache.org/docs/nifi-docs/html/user-guide.html Andy LoPresto alopre

Re: Combining outputs in parallel returns a random output

Glad the tool is capable of what you are looking for, Kavinaesh. Good luck. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 2, 2016, at 2:34 PM, Kavinaesh Dheenadayalan > wrote: > > Hi All,

Re: RegEx not catching all tags

Thanks Sven. Could I ask you to open a Jira [1] requesting a boolean option in the ExtractText processor properties that allows for global results? [1] https://issues.apache.org/jira/browse/NIFI Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F

Re: Merge multiple flowfiles

incoming connection to MergeContent. Please let us know if this helps, and if not, please share a template and some sample input if possible. Thanks. [1] https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.MergeContent/index.html Andy LoPresto alopre

Re: Funnel

Connection independently. [1] https://nifi.apache.org/docs/nifi-docs/html/user-guide.html Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 9, 2016, at 14:35, Igor Kravzov wrote: > > Guys, what is t

Re: Standard SSL context always requires keystore/truststore?

I opened NIFI-1477 [1] to address this a little while ago. I am working on a large refactor of the SSL code throughout the application for 1.0 and I am hoping to have an answer for some of these issues. [1] https://issues.apache.org/jira/browse/NIFI-1477 Andy LoPresto alopre...@apache.org

Re: Custom processor is failing for concurrency

Glad to hear it is working, Kumiko. Matt Foley's suggestion was very good. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 18, 2016, at 14:34, Kumiko Yada wrote: > > Thank you, An

Re: IDE-specific setup

tps://cwiki.apache.org/confluence/display/NIFI/Contributor+Guide#ContributorGuide-CodeStyle> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 21, 2016, at 9:57 AM, Kumiko Yada wrote: > > Hello, > > Is the

<    1   2   3   4   5   >