Re: Getting org.springframework.web.client.HttpClientErrorException: 409 Conflict on DELETE ProcessGroup

Nirmal, If you consume the body of the response it should indicate the reason for the 409. On failed responses, the response body should be text/plain. Let me know if that helps. Thanks Matt On Mon, Dec 5, 2016 at 11:29 PM, Nirmal Kumar wrote: > Hi All, > > > > I am getting the following exc

Re: Flow File Stuck for no reason

Hello This part of the stack dump is the only thing that appears out of place to me. it appears to be attempting to read from the socket or stuck there. Perhaps you can use a more recent client library for that custom HD processor? "Timer-Driven Process Thread-8" Id=78 RUNNABLE (in native code

Data SLA

Hello, I'm working on a project that I'd like to use Nifi for, however I'm trying to figure out if there's a way to alert on the availability of data being provided correctly to an agreement. Example: 1. Team X has agreed to provide files in directory Y in HDFS 2. Team X has agreed to provide tho

Re: Data SLA

Richard, In addition to the flow that loads those files and performs whatever follow-on transformation and routing, you can have a parallel flow which monitors the directory and uses cron scheduling to run at a specific time (0900 daily) and is configured to expect a threshold number of files a

RE: Getting org.springframework.web.client.HttpClientErrorException: 409 Conflict on DELETE ProcessGroup

Thanks but as I calling it programmatically using Spring RestTemplate I just get the stack trace as mentioned in my below mail. -Nirmal From: Matt Gilman [mailto:matt.c.gil...@gmail.com] Sent: Tuesday, December 6, 2016 6:58 PM To: users@nifi.apache.org Subject: Re: Getting org.springframework.we

Re: Getting org.springframework.web.client.HttpClientErrorException: 409 Conflict on DELETE ProcessGroup

I'm not familiar with Spring RestTemplate but I'm sure they offer the ability to get at the response body. Maybe it's possible to implement a custom error handler or something. Without knowing more, I could venture a guess that your requests are failing intermittently because you not passing along

Re: Data SLA

Richard, Piggy backing on Andy's comment, you could also use getHDFS to seek files based on the date/time or whatever parameters then use the failure relationship to post to Slack or send an email. On Tue, Dec 6, 2016 at 10:23 AM, Andy LoPresto wrote: > Richard, > > In addition to the flow that

How do I use Cassandra CQL V3 protocol with Nifi?

How do I use Cassandra CQL V3 protocol with Nifi?

Re: How do I use Cassandra CQL V3 protocol with Nifi?

What version of NiFi are you using? In NiFi 0.7.0 and 1.0.0 (with the inclusion of NIFI-1998 [1] ), they use the Cassandra 3.0.x driver which supports the V3 protocol [2] (actually v1-v4 protocols). Regards, Matt [1] https://issues.apache.org/jira/browse/NIFI-1998 [2] http://docs.datastax.com/en

Re: How do I use Cassandra CQL V3 protocol with Nifi?

Hi Matt, Thanks for the response! I am very new to Nifi so I will use the latest version. I am still trying to understand its capabilities. It sounds awesome to me . This talk https://www.youtube.com/watch?v=sQCgtCoZyFQ is very good. I just want see to little bit more concrete examples on 1) ho

Large scale Secure MiNiFi deployments

All, Is anyone else using a large number of MiNiFi agents together with secure Site to Site? How are you managing the authorization policy so that MiNiFi agents can connect to the remote process groups ports? Cheers

How to integrate a custom protocol with Apache Nifi

HI All, I understand that Apache Nifi has integration with many systems but what If I have an application that talks a custom protocol ? How do I integrate Apache Nifi with the custom protocol? Thanks, kant

Re: How to integrate a custom protocol with Apache Nifi

Kant, Look into a custom processor. You have a choice of either implementing e.g. a parser for your data, or, if the protocol is more involved, implement a receiver in the processor as well which would spit out meaningful data messages next. Andrew On Tue, Dec 6, 2016, 7:47 PM kant kodali wrote

Re: How to integrate a custom protocol with Apache Nifi

Kant Typically this is as simple as creating your processor to utilize that protocol. Take a look at the developer guide [1] and of course you can always look at the many example processors and components that come in NiFi out of the box [2]. [1] https://nifi.apache.org/docs.html [2] https://git

Re: How to integrate a custom protocol with Apache Nifi

Hi Kant What you’re trying to accomplish is definitely possible, however more information may be needed from you. For example, the way I understand your statement about “integration with many systems” is something like JMS, Kafka, TCP, FTP etc…. If that is the case such integration is definitel

Re: How to integrate a custom protocol with Apache Nifi

Thanks a ton guys! Didn't expect Nifi community to be so good! (Another convincing reason!) Coming back to the problem, We use NSQ a lot (although not my favorite) and want to be able integrate Nifi with NSQ to other systems such as Kafka, Spark, Cassandra, ElasticSearch, some micro services that

RE: Getting org.springframework.web.client.HttpClientErrorException: 409 Conflict on DELETE ProcessGroup

Each time I fire the DELETE request I first GET the ProcessGroup details and then fetch the *version*. So I am passing the correct version in DELETE request. Thanks, -Nirmal From: Matt Gilman [mailto:matt.c.gil...@gmail.com] Sent: Wednesday, December 7, 2016 12:37 AM To: users@nifi.apache.org Su