Announcing ApacheCon @Home 2020

2020-06-29 Thread Rich Bowen
Hi, Apache enthusiast! (You’re receiving this because you’re subscribed to one or more dev or user mailing lists for an Apache Software Foundation project.) The ApacheCon Planners and the Apache Software Foundation are pleased to announce that ApacheCon @Home will be held online, September 29

Re: NiFi-light for analysts

2020-06-29 Thread Boris Tyukin
Hi Mark, thanks for the great comments and for working on these improvements. these are great enhancements that we can certainly benefit from - I am thinking of two projects at least we support today. As far as making it more user-friendly, at some point I looked at Kylo.io and it was quite an int

unsubscribe

2020-06-29 Thread obaidul karim

Re: unsubscribe

2020-06-29 Thread Andy LoPresto
Please send a message to users-unsubscr...@nifi.apache.org to unsubscribe. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 29, 2020, at 8:36 AM, obaidul k

Re: NiFi-light for analysts

2020-06-29 Thread Mike Thomsen
As far as I can tell, Kylo is dead based on their public github activity. Mark, Would it make sense for us to start modularizing nifi-assembly with more profiles? That way people like Boris could run something like this: mvn install -Pinclude-grpc,include-graph,!include-kafka,!include-mongodb O

Re: NiFi-light for analysts

2020-06-29 Thread Joe Witt
That would be a fine option for those users who are capable to run maven builds. I think evolving the nifi registry and nifi integration to source all nars as needed at runtime from the registry would be the best user experience and deployment answer over time. Thanks On Mon, Jun 29, 2020 at 9:57

Re: NiFi-light for analysts

2020-06-29 Thread Juan Pablo Gardella
I actually do it manually in docker file: RUN mv /opt/nifi/nifi-current/lib/*.nar /opt/nifi/nifi-current/lib.original/ RUN cp /opt/nifi/nifi-current/lib.original/nifi-avro-nar-$NIFI_VER.nar /opt/nifi/nifi-current/lib RUN cp /opt/nifi/nifi-current/lib.original/nifi-update-attribute-nar-$NIFI_VER.na

Enrichment of record data with a REST API

2020-06-29 Thread Mike Thomsen
Does anyone know a good pattern using the Record API to enrich a data set record by record with a REST API? Thanks, Mike

Re: Enrichment of record data with a REST API

2020-06-29 Thread Matt Burgess
Mike, I think you can use LookupRecord with a RestLookupService to do this. If it's missing features or it otherwise doesn't work for your use case, please let us know and/or write up whatever Jiras you feel are appropriate. Regards, Matt On Mon, Jun 29, 2020 at 4:56 PM Mike Thomsen wrote: > >

Re: Enrichment of record data with a REST API

2020-06-29 Thread Mike Thomsen
Matt, Yeah, I was thinking about that, but there are a lot of variables that have come up since I wrote that service. One of the big ones is how to take partial responses and merge them? There's no transformer API for that service. Nothing like a Groovy script, JOLT, etc. What do you think? I thi

Session state in cluster HandleHttpRequest and HandleHttpReponse

2020-06-29 Thread Jeremy Pemberton-Pigott
Hi, I have a cluster of 3 nodes and the incoming request on one node's HandleHttpRequest may be replied to by a different node's HandleHttpResponse, in between there is a Spark streaming job process. Is there any example how to do that, maybe with DistributeMapCacheService? So that I can still r