NiFi Clustering Issue

2016-04-29 Thread Christopher Wilson
I spent some time over the past few days attempting to cluster 3 NiFi nodes. I thought I had the nifi.properties file properly configured, but kept getting "unexpected error occurs" from the UI. Long story short, you have to specifically set the nifi.web.http.host setting equal to your hostname

Re: Nifi JSON event storage in HDFS

2016-03-02 Thread Christopher Wilson
I used the ConvertJsonToAvro and PutHDFS processors to land files into a Hive warehouse . Once you get the AVRO schema right it's easy. Look at the avro-tools jar file to help with the schema. Chris On Wed, Mar 2, 2016, 4:59 AM Conrad Crampton wrote: > Hi, > I

Unix epoch time to string issue

2016-01-20 Thread Christopher Wilson
I'm working with a JSON formatted flowfile that contains a Unix epoch time, which I pull out time and assign it to an attribute. 1. When I use AttributesToJSON and then attempt to InvokeHTTP to POST that information I find that the time is now a string formatted as '1.234567E9'. 2. If I attempt

Re: StoreInKiteDataset help

2015-10-16 Thread Christopher Wilson
kou...@hortonworks.com> wrote: > Chris > > Could you elaborate on your use case a bit more? Specifically about where > is the source of data you want to pump into hive (e.g., Streaming, bulk > file load etc.) > > Cheers > Oleg > > On Oct 16, 2015, at 8:56 AM, Christopher

MergeContent Question

2015-10-01 Thread Christopher Wilson
I posted a question earlier today regarding pulling JSON out of a string from a log file. I want to aggregate those logs into a file using ReplaceText and MergeContent processors. I'm having an issue where the aggregated logs are concatenated into one large string instead of line by line (with a

Re: ExtractText usage

2015-09-09 Thread Christopher Wilson
les are >> > equal and there may be some that just get read in a la carte and >> > discriminating between line 10 and 100 may be important. I also think >> > that adding an attribute and then sending it along could be >> > short-circuited with just a "match and