I will give it a shot.
Thanks for the hint
From: Bryan Bende
Sent: Friday, April 5, 2019 2:46 PM
To: users@nifi.apache.org
Subject: Re: Best way to wait until everything is finished
Since you are using SplitJson, it should be adding the standard
"fragment"
Since you are using SplitJson, it should be adding the standard
"fragment" attributes to each flow file.
You can then use MergeContent in Defragment mode, which uses those
attributes to merge all the fragments back together.
On Fri, Apr 5, 2019 at 2:39 PM Jean-Sebastien Vachon
wrote:
>
> Hi
Hi again,
one of the last issue I am facing with my flow right now is to make one of my
MergeContent processor wait until everything has been processed before merging
everything into a CSV.
What would be the best way to implement this? is this through Wait/Notify? a
counter?
My whole process
Attribute processor to change the filename attribute and
> since then I am not able to either view or download the file even if NIfi
> reports its size correctly.
>
> My first thought was a disk full but that is not the case.
>
> the filename after the updateAttribute looks like
r view or download the file even if NIfi
reports its size correctly.
My first thought was a disk full but that is not the case.
the filename after the updateAttribute looks like this:
20190405-180910.269-xxx-1.0.csv
where xxx is the name of the customer which does not contain any illegal
cha
either view or download the file even if
> NIfi reports its size correctly.
>
> My first thought was a disk full but that is not the case.
>
> the filename after the updateAttribute looks like this:
>
> 20190405-180910.269-xxx-1.0.csv
>
> where xxx is the name of the cust
like this:
20190405-180910.269-xxx-1.0.csv
where xxx is the name of the customer which does not contain any illegal
character.
Any idea?
Hi Dwane,
Does the Pig job puts HBase data with custom timestamps? For example,
the loading data contains last_modified timestamp, and it's used as
HBase cell timestamp.
If that's the case, GetHbase may miss some HBase rows, unless the Pig
job loads raws ordered by the timestamp when Pig and