I spent some time over the past few days attempting to cluster 3 NiFi
nodes. I thought I had the nifi.properties file properly configured, but
kept getting "unexpected error occurs" from the UI.
Long story short, you have to specifically set the nifi.web.http.host
setting equal to your hostname
I used the ConvertJsonToAvro and PutHDFS processors to land files into a
Hive warehouse . Once you get the AVRO schema right it's easy. Look at the
avro-tools jar file to help with the schema.
Chris
On Wed, Mar 2, 2016, 4:59 AM Conrad Crampton
wrote:
> Hi,
> I
I'm working with a JSON formatted flowfile that contains a Unix epoch time,
which I pull out time and assign it to an attribute.
1. When I use AttributesToJSON and then attempt to InvokeHTTP to POST that
information I find that the time is now a string formatted as
'1.234567E9'.
2. If I attempt
kou...@hortonworks.com> wrote:
> Chris
>
> Could you elaborate on your use case a bit more? Specifically about where
> is the source of data you want to pump into hive (e.g., Streaming, bulk
> file load etc.)
>
> Cheers
> Oleg
>
> On Oct 16, 2015, at 8:56 AM, Christopher
I posted a question earlier today regarding pulling JSON out of a string
from a log file. I want to aggregate those logs into a file using
ReplaceText and MergeContent processors. I'm having an issue where the
aggregated logs are concatenated into one large string instead of line by
line (with a
les are
>> > equal and there may be some that just get read in a la carte and
>> > discriminating between line 10 and 100 may be important. I also think
>> > that adding an attribute and then sending it along could be
>> > short-circuited with just a "match and