Re: How to validate records in Hadoop using NiFi?

Hello Sudeep, "Which NiFi processor can I use to split each record (separated by a new line character)" For this the SplitText processor is rather helpful if you want to split each line. I recommend you do two SplitText processors in a chain where one splits on every 1000 lines for example and

Fwd: How to validate records in Hadoop using NiFi?

Hi, I am pushing some database records into HDFS using Sqoop. I want to perform some validations on each record in the HDFS data. Which NiFi processor can I use to split each record (separated by a new line character) and perform validations? For validations I want to verify a particular column

Re: NIFI connecting to Activemq

Chris, Thanks for sending the screenshot. The NullPointerException is trivially reproduced using your settings. I didn't even need a JMS server to cause it. Have created a JIRA for this: https://issues.apache.org/jira/browse/NIFI-1378 Thanks! Joe On Sat, Jan 9, 2016 at 3:21 PM, Oleg Zhurako

Re: Testing a nifi flow via junit

This is definitely possible and been done. What makes it difficult at times is to have all required NiFi dependencies in the process space of a given test. I've actually proposed a separate module for these types of 'headless' flow tests. It actually helped me to discover some of the bugs as wel

Re: Nifi cluster features - Questions

The sending node (where the remote process group is) will distribute the data evenly across the two nodes, so an individual file will only be sent to one of the nodes. You could think of it as if a separate NiFi instance was sending directly to a two node cluster, it would be evenly distributing th

Re: Nifi cluster features - Questions

Bryan – Thanks, how do the nodes distribute the load for a input port. As port is open and listening on two nodes, does it copy same files on both the nodes? I need to try this setup to see the results, appreciate your help. Thanks, -Chakri From: Bryan Bende mailto:bbe...@gmail.com>> Reply-To:

Re: NIFI connecting to Activemq

Chris Are you sure you are providing the correct logs? I can’t see a single mention of JMS nor any stack traces which would definitely be there given what you see in UI. Also, the fact that you see NPE is definitely a bug that we have to fix (user’s should never see NPE), so that can be filed.