Keaton,
Glad you are liking it. Honestly DistCP is purpose built for the case
of copying from one cluster to another. I don't think I'd recommend
NiFi over DistCP for that very focused use case. DistCP should be by
design the best at that.
NiFI definitely is used extensively for data center to
Jeff,
Regarding hot deploy of new dataflows:
Absolutely. The ability to have interactive command and control is a
key feature/concept of NiFi so you can certainly create, alter, remove
dataflows while the systems is running by design. This isn't just for
a person controlling the flow through UI
ing, prefer simple flow.xml configuration and combine NiFi
> instances together for more complex scenarios?
>
> On Tue, Feb 16, 2016 at 3:16 PM, Joe Witt wrote:
>>
>> Jeff,
>>
>> Regarding hot deploy of new dataflows:
>> Absolutely. The ability to have interactiv
Jeff,
We don't have any support for altering the timezone NiFi honors while
it is running at this time. Time information is fairly important to a
number of low level mechanisms.
Thanks
Joe
On Tue, Feb 16, 2016 at 5:02 PM, Jeff - Data Bean Australia
wrote:
> Hi,
>
> I started my Linux box with
Jeff,
For each of the input files could it be that you would pull data from
multiple URLs?
Have you had a chance to learn about the NiFi Expression language?
That will come in quite handy for constructing the URL used in
InvokeHTTP.
The general pattern I think makes sense here is:
- Gather Data
Lars,
You are right about the thought process. We've never provided solid
guidance here but we should. It is definitely the case that flow file
content is streamed to and from the underlying repository and the only
way to access it is through that API. Thus well behaved extensions
and the frame
Jeff
I think what you're doing is just fine for now. To Oleg's point we
should make it better.
We do also have a database where each flow change is being written to
from a audit perspective and so we can show in the UI who made what
changes last. That is less about true CM and more about provid
Jeff,
"do we have some tool to compare two flow.xml.gz for some subtle changes?"
Unfortunately no. That is what Oleg was referring to. We're finding
an increasing number of people that are interested in this sort of
Git/Diff capability so we def need to get some momentum on it.
Making ordering
Vincent,
Yeah you're hitting the nail on the head from what we're hearing more
and more. We have a couple really nice roadmap items to make these
work more like you're doing now.
Thanks
Joe
On Wed, Feb 17, 2016 at 5:27 PM, Vincent Russell
wrote:
> My team has played around with versioning cont
And also what version of Kafka are you using?
On Feb 20, 2016 3:37 PM, "Oleg Zhurakousky"
wrote:
> Josh
>
> Any chance to attache the app-log or relevant stack trace?
>
> Thanks
> Oleg
>
> On Feb 20, 2016, at 3:30 PM, West, Joshua wrote:
>
> Hi folks,
>
> I've upgraded from Nifi 0.4.1 to 0.5.0 a
Kyle
Can you try connecting to that nifi port using telnet and see if you are
able?
Use the same host and port as you are in your spark job.
Thanks
Joe
On Feb 20, 2016 4:55 PM, "Kyle Burke" wrote:
> All,
>I’m attempting to connect Spark to Nifi but I’m getting a “connect
> timed out” error
; we’ve upgraded client libraries to Kafka 0.9 and between 0.8 and 0.9 Kafka
> introduced wire protocol changes that break compatibility.
> I am still digging so stay tuned.
>
> Oleg
>
> On Feb 20, 2016, at 4:10 PM, West, Joshua wrote:
>
> Hi Oleg and Joe,
>
> Kafka
We are working to have an RC for it any day. We're very close so
today is feasible.
Thanks
Joe
On Mon, Feb 22, 2016 at 10:18 AM, Conrad Crampton
wrote:
> Matt,
> Thanks for the update. I trawled the user list archive for anything similar,
> didn’t think to check the issue log.
> Is there a date
tfully,
>
> Kyle Burke | Data Science Engineer
> IgnitionOne - Marketing Technology. Simplified.
> Office: 1545 Peachtree St NE, Suite 500 | Atlanta, GA | 30309
> Direct: 404.961.3918
>
>
> From: Joe Witt
> Reply-To: "users@nifi.apache.org"
> Date: Saturday, Febr
Sorry to clarify it working against all three of these at once:
- Kafka 0.8.1.1
- Kafka 0.8.2.1
- Kafka 0.9.0.1
Thanks
Joe
On Mon, Feb 22, 2016 at 4:12 PM, Joe Witt wrote:
> All just as a point of reference we now have a live system running
> that is on NiFi 0.5.0 and feeding three versi
eading my 0.8.2.1 stream. Not elegant but glad it worked.
>
>
> Respectfully,
>
> Kyle Burke | Data Science Engineer
> IgnitionOne - Marketing Technology. Simplified.
> Office: 1545 Peachtree St NE, Suite 500 | Atlanta, GA | 30309
> Direct: 404.961.3918
>
>
> From: J
Sudeep
A funnel simply allows you to take multiple connections and combine
them into a single connection. Think of it as merging queues into a
single queue. This is useful when you want to control prioritization,
simplify connection logic to some downstream component, etc..
For the case you're
Claudio
Hello there and welcome to the nifi community. There are some
processors available now that allow you to store values in distributed
(across the cluster) maps and to retrieve them. And now within
processors there is the ability interact with state management
features built into the frame
Shekhar
You can switch from the default persistent repository to instead use
an in-memory only repository. This can be controlled in the
nifi.properties file. Simply change this
# Provenance Repository Properties
nifi.provenance.repository.implementation=org.apache.nifi.provenance.PersistentPro
Hello Uwe,
I agree with your ideas very much and will simply state we have work
to do to fully realize the value that templates can bring. Take a
look here. I am happy to add you to the wiki permissions list so you
can update the doc with your thoughts directly.
https://cwiki.apache.org/conflue
No. But we need to and plan to
https://cwiki.apache.org/confluence/display/NIFI/Variable+Registry
On Fri, Mar 4, 2016 at 1:22 PM, Uwe Geercken wrote:
> Matthew,
>
> does NiFi itself allow to define such things as constants? The idea would be
> to re-use these constants (e.g. a path) in different
r the Variable Registry should consider is being able to
> mark sensitive properties so that things like passwords can remain secure.
>
>
> On Fri, Mar 4, 2016 at 1:24 PM, Joe Witt wrote:
>>
>> No. But we need to and plan to
>> https://cwiki.apache.org/confluence/display/
To clarify about 'HA and master node' - that is for the control plane
itself. The data continues to flow on all nodes even if the NCM is
down. That said, we are working to solve it now with zero-master
clustering.
Thanks
Joe
On Sun, Mar 13, 2016 at 12:20 PM, 刘岩 wrote:
> Hi Thad
>
> Thank you
er?
>
>
>
> where can i find demos/examples for each processor？
>
>
> Thank you very much
>
>
> Yan Liu
> Hortonworks Service Division
>
> Richinfo, Shenzhen, China (PR)
>
> 14/03/20
>
>
>
>
> 邮件原文
> 发件人：Joe Witt
> 收件人
Hello
In a running instance of NIFi you can click help. Or, you can click
here https://nifi.apache.org/docs.html
>From that page scroll all the way down to the bottom. You'll see a
developer section that says "REST API". Click on that and you're
there.
Thanks
Joe
On Tue, Mar 15, 2016 at 12:5
,
>
> Sudeep
>
>
> On Tue, Mar 15, 2016 at 10:26 AM, Joe Witt wrote:
>>
>> Hello
>>
>> In a running instance of NIFi you can click help. Or, you can click
>> here https://nifi.apache.org/docs.html
>>
>> From that page scroll all the way down
Seems like we need a user guide for setup with NiFi and NGINX.
On Tue, Mar 15, 2016 at 8:50 AM, Matt Gilman wrote:
> From the screenshot it looks as though only /nifi is getting through the
> proxy. Even requests for resources under /nifi don't seem to get through. I
> see from your configuration
org.I0Itec.zkclient.ZkEventThread Terminate ZkClient event thread.
>> 2016-03-15 07:45:17,638 INFO [Timer-Driven Process Thread-3]
>> org.apache.zookeeper.ZooKeeper Session: 0x1535e2aa53b3f61 closed
>> 2016-03-15 07:45:17,638 INFO [Timer-Driven Process Thread-3]
>> k.consumer.ZookeeperConsumerConnec
(MSDU -
STaTS/StorefrontRemote) wrote:
> Joe,
>
> I’ll checkout the disk-space. We are running 0.9. If disk space is not the
> issue we’ll give 0.8 a try.
>
> Thanks very much for your quick reply.
>
> Cheers,
> Chris
>
>
>
> On 3/16/16, 11:04 AM, "Joe Wit
Conrad,
The issue you discovered and reported is now merged into master and
fixed. Should make it into the 0.6.0 release.
https://issues.apache.org/jira/browse/NIFI-1632
Thanks
Joe
On Wed, Mar 16, 2016 at 11:27 AM, Joe Witt wrote:
> Full stop if you ever see a NullPointerException coming
Conrad,
Ahhh i *think* you have found a bug that is present. It appears to be
this line. We should be doing a null check there before checking
length of value.
https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi
g into it.
> Regards
> Conrad
>
>
>
> On 16/03/2016, 15:16, "Joe Witt" wrote:
>
>>Conrad,
>>
>>Ahhh i *think* you have found a bug that is present. It appears to be
>>this line. We should be doing a null check there before checking
>>len
>
> On 3/16/16, 11:41 AM, "McDermott, Chris Kevin (MSDU -
> STaTS/StorefrontRemote)" wrote:
>
>>Joe,
>>
>>I’ll checkout the disk-space. We are running 0.9. If disk space is not the
>>issue we’ll give 0.8 a try.
>>
>>Thanks very much
Chris,
I have seen that when the diskspace kafka relies on is full. We've
seen a number of interesting exceptions recently in testing various
configurations. But recommend checking that.
Also, what version of Kafka broker are you using? With Apache NiFi
0.5.x we moved to the kafka client 0.9. I
Dmitry,
Good questions and things to think about. You are right into the
heart of the framework. So there are three repositories to consider
that I'll talk about here but they are probably pretty well covered on
the existing guides. I know Joe Percivall has a 'day in the life of a
flow file' do
Dmitry,
You can control various settings related to provenance. Those are
talked about here [1]
Look for the section that talks about the 'Provenance Repository'.
There is some strong language there about changing the implementation.
But there is a volatile repository you can use. That is less
Dmitry,
While it is not uncommon to see such comparisons made by various
apache projects against other tools (commercial or otherwise) there
have been apache threads recently suggesting this can be poor form.
So, I'd prefer to see this thread stay focused how we as a community
see NiFi rather than
Chris,
Sounds like you have the right flow in mind already. EvaluateJSONPath
does not write content. It merely evaluates the given jsonpath
expression against the content of the flowfile and if appropriate
creates a flowfile attribute of what it finds.
For example if you have JSON from Twitter
lowFile content, so that I can process it with
>> EvaluateJsonPath, and then read content I squirreled away back into the
>> FlowFile content. I considered using the the DistributedMapCache, but there
>> would be no guarantee what I added to the cache would still be there when I
Andre,
In general the system is designed to tolerate disk space being filled.
It cannot continue to function in a meaningful way obviously but it
should be safely recoverable. There will indeed be errors while full
and during recovery because a number of steps couldn't happen cleanly.
Those shoul
Hello
It is certainly possible to support hot deployment for only new things
but this would likely leave a really rough user experience. I think
you make a great point about it being easier for things not currently
being used. I suspect though people will be upgrading/redeploying
things that the
> org.apache.nifi.controller.repository.WriteAheadFlowFileRepository.updateRepository(WriteAheadFlowFileRepository.java:201)
> ~[nifi-framework-core-0.4.2-SNAPSHOT.jar:0.4.2-SNAPSHOT]
> at
> org.apache.nifi.controller.repository.WriteAheadFlowFileRepository.updateRepository(WriteAheadF
Totally agree with you.
How about his for now
https://cwiki.apache.org/confluence/display/NIFI/Example+Dataflow+Templates
And we can come up with something better (like the registry) in the future.
Thanks
Joe
On Thu, Mar 24, 2016 at 11:00 AM, Uwe Geercken wrote:
> I believe it would be cool to
st
> be lots of good ideas around.
>
> can we not collect templates on github somewhere?
>
> rgds
>
> uwe
> --
> Diese Nachricht wurde von meinem Android Mobiltelefon mit WEB.DE Mail
> gesendet.
> Am 24.03.2016, 18:03, Joe Witt schrieb:
>>
>> Totally agre
Chase,
To unsubscribe send an e-mail here users-unsubscr...@nifi.apache.org
Madhukar,
As Bryan mentioned attributes are always serialized as Strings. Their
type is really a function of when they are being evaluated/used. Can
you describe a bit more about what you'd like AttributesToJson to do
Aurélien
As you progress here please let us know how it goes. If you think
there is more the framework should do for such cases let's talk
through it.
Thanks
Joe
On Fri, Mar 25, 2016 at 4:42 AM, Aurélien DEHAY
wrote:
>
> thanks for the answer.
>
>
> I understand that It's mostly up to me. I th
quot;}
>
> This what i expect
>
> {"rt_loadtime":260,"rt_firstbyte":20,"referrer":"http://localhost:63342/Beacon/test.html","rt_lastbyte":240}
>
> Thanks
>
> On Fri, Mar 25, 2016 at 10:47 AM, Joe Witt wrote:
>>
>> Chase,
>&
On Fri, Mar 25, 2016 at 12:07 PM, Madhukar Thota
> wrote:
>>
>> Joe,
>>
>> I attached the screenshot for UpdateAttributes and AttributesToJson.
>> Please let me know if this is not something your are looking for.
>>
>> On Fri, Mar 25, 2016 at 11:58 AM, Joe W
; is this dynamic Property works today with AttributesToJSON today?
>
> property name: rt_firstbyte
> property value: Integer
>
> -Madhu
>
> On Sat, Mar 26, 2016 at 1:13 PM, Joe Witt wrote:
>>
>> What Madhukar is trying to do seems totally reasonable. As an
>>
Vincent,
Not really and that would largely be by design. Can you describe the
use case more so we can suggest alternatives or perhaps understand the
motivation better?
Thanks
Joe
On Mon, Mar 28, 2016 at 4:00 PM, Vincent Russell
wrote:
>
> Is it possible to have one processor block while anothe
Hello
Take a look at the example usage of ${fileSize} as shown here [1]
It has been this way for quite a while so you should have no problem
accessing it using the expression language while configuring the flow.
Could you share a template of your flow that is not working?
[1]
https://nifi.apach
Dmitry,
This indicates you're using Java 7 most likely. Look here [1] which
points to [2].
Specifically you'll want to update conf/bootstrap.properties
To have these lines uncommented
java.arg.11=-XX:PermSize=128M
java.arg.12=-XX:MaxPermSize=128M
You can choose different values than 128M as y
Dmitry these are great questions and Chris that was in my opinion a
pretty excellent response - 'noob' or not.
The only thing I'd add Dmitry is that some of what you're saying
regarding templates themselves is very true. We can do better and so
much more than we are. We have a feature proposal/d
Thad,
Can you share the full stack trace that should be present in the log
with that? There is clearly a bit of Java code attempting to load the
native library and unable to find it. Placing the jar file in the
classpath which contains the native library may well not be enough
because loading th
Thad
This thread [1] seems related. Take a look and see if that helps.
The basic gist as I understand it is we won't have access to that
native library unless it is pointed to somewhere or unless the Java
code that calls it knows how to set/find it for you.
[1]
http://apache-nifi-developer-list
Did you set the LD_LIBRARY_PATH as Burgress mentioned at the end?
I am not in a good position to dig in at the moment so my apologies
for the half-help here. The loading of native libs as I recall is a
pretty specific process. I know a few folks are familiar with it in
the community so let's kee
Chase,
It is a self-driven subscribe and unsubscribe process. Please see
here https://nifi.apache.org/mailing_lists.html
Thanks
Joe
On Wed, Mar 30, 2016 at 9:18 AM, Chase Cunningham wrote:
> take me off this list...
>
> unsubscribe
>
>
> On 3/30/16 10:13 AM, Joe Witt wrote:
Hello
>From your screenshot it shows you have both success and failure
looping back to Kafka. Do not loop success and you should be fine.
Thanks
Joe
On Wed, Mar 30, 2016 at 11:16 AM, Madhukar Thota
wrote:
> I was able to construct the Json with right data type output from
> ExecuteScript and s
Chris,
How many flow files do you have actively in the flow? The archive
goal says 50% of total space and the space appears to be 148GB so
archive should start removing old files around 70ish GB. But for data
actually sitting in the flow NiFi will retain that.
Thanks
Joe
On Sun, Apr 3, 2016 at
Chris
What version of nifi are you on?
If you happen to see such as case again please do take a thread dump of
nifi as well.bin/nifi.sh dump
Thanks
Joe
Thanks
Joe
On Apr 3, 2016 8:20 PM, "Andre" wrote:
> Chris,
>
> Can you navigate under /opt/mount2/nifi_data/content_repository and run
>
IFI-1726>
>
>
> Thanks,
> Chris
>
>
>
>
> On 4/4/16, 11:40 AM, "McDermott, Chris Kevin (MSDU - STaTS/StorefrontRemote)"
> wrote:
>
>>Hi Joe,
>>
>>I am running fro 16108467c19f59 plus the pull request for NIFI-1660
>>
>>Wi
Ali
It is very possible you're being bitten by a bug we have with
PutKafka. It is fixed in this branch which we're in the release
motions for right now.
https://github.com/apache/nifi/tree/support/nifi-0.6.x
Thanks
Joe
On Wed, Apr 6, 2016 at 10:07 AM, Ali Karray wrote:
> I'm using the last ve
> ?
>
> Thanks
> Ali
>
> On Wed, Apr 6, 2016 at 4:14 PM, Joe Witt wrote:
>> Ali
>>
>> It is very possible you're being bitten by a bug we have with
>> PutKafka. It is fixed in this branch which we're in the release
>> motions for right now.
sure it is on 0.7 and 1.x line as well.
Big thanks to Chris for helping dig into the details needed to find the issue.
Thanks
Joe
On Mon, Apr 4, 2016 at 3:24 PM, Joe Witt wrote:
> Sounds good. Let's dig in on this one. I've added some replies to the JIRA.
>
> On Mon
Philippe
As far as I know here is the state of affairs for this:
1) You can use EvaluateJSONPath and ReplaceText in a combination for
some cases but it is more awkward and difficult than it should be.
2) You can use the execute script processors to write a groovy,
javascript, or other type of scr
Agreed Michal. What do you think about the above comment i made
regarding a current idea found in Github
"I think though what we just need to do is finally tackle
'https://issues.apache.org/jira/browse/NIFI-361' and here is a great
example to base it on. The work Frank started here
'https://gith
Awesome analysis/input Thad and great references. Reading through
now. The flagging of the lack of stream orientation to the library is
great.
Somewhat related we've pondered adding an annotation that can be
placed on processors so that those which are able to operate on input
and output streams
Prabhu,
If the dataset being processed can be split up and still retain the
necessary meaning when input to HBase I'd recommend doing that. NiFI
itself, as a framework, can handle very large objects because its API
doesn't force loading of entire objects into memory. However, various
processors
Guillaume,
If you look at the processors in the UI do the EvaluateXPath
processors show as invalid and if you hover over them what do they
show as the reason?
I just setup something similar to the configuration you describe and I
cannot recreate what you're seeing yet.
Thanks
Joe
On Mon, Apr 11
ddress' is invalid because Unable to
> initialize XPath engine due to
> javax.xml.xpath.XPathFactoryConfigurationException: No XPathFactory
> implementation found for the object model: http://saxon.sf.net/jaxp/xpath/om
>
> I haven't figured out what change is the root cause, but the trail seems to
> lead in
Madhu,
Do you have any information you can point to for the registry? I know
of the Confluent one but I am not sure of its interfaces. If there
are open source friendly ones available it certainly would be a fine
thing to support. Can you point us to what you are looking at
specifically?
Thank
istry/docs/index.html
>
> -Madhu
>
> On Wed, Apr 13, 2016 at 1:48 PM, Joe Witt wrote:
>>
>> Madhu,
>>
>> Do you have any information you can point to for the registry? I know
>> of the Confluent one but I am not sure of its interfaces. If there
>>
Tom,
Ok that is pretty interesting and we'd want to get to the bottom of
it. If you happen to see that state again could you please run
./bin/nifi.sh dump and send the logs/nifi-bootstrap.log that results.
Thanks
Joe
On Wed, Apr 13, 2016 at 2:36 PM, Tom Stewart wrote:
> Yes I have three nodes
https://issues.apache.org/jira/browse/NIFI-1763
Please feel free to add your thoughts to that JIRA.
On Wed, Apr 13, 2016 at 2:17 PM, Joe Witt wrote:
> Ok will look into a bit and put in a JIRA for this idea. Will send
> that on this thread to ensure it captures your thoughts and of
Ahh - great idea James!
On Fri, Apr 15, 2016 at 1:34 PM, James Wing wrote:
> Have you looked at a combination of ListSFTP -> FetchSFTP? I believe
> ListSFTP has built-in support for tracking recent files, and it might
> satisfy your use case. If not, you can certainly filter the listed files by
Hello
The Apache NiFi team would like to announce the release of Apache NiFi 0.6.1.
Apache NiFi is an easy to use, powerful, and reliable system to
process and distribute data. Apache NiFi was made for dataflow. It
supports highly configurable directed graphs of data routing,
transformation, an
Hello Keith,
We do have a solid developer guide here [1] that goes into the key
concepts and processor development a bit. The next best thing is to
use the supplied maven archetype to lay down the fundamental pieces.
You can read a bit more about that here [2]. Finally something that
is also qui
> I also tried to pipe directly from ListSFTP -> FetchSFTP and used
> ${now():toNumber():minus(8640):format('mmdd')}-*.csv but then this
> doesn't match the remote file guessing because FetchSFTP doesn't do globing.
>
> Thanks,
> ___
here's a better way to filter. Can you help by giving me a
> pointer or two please?
>
> I also tried to pipe directly from ListSFTP -> FetchSFTP and used
> ${now():toNumber():minus(8640):format('yyyymmdd')}-*.csv but then this
> doesn't match the rem
Kumiko,
Not that I am aware of. If you do end up doing so and are interested
in contributing please let us know.
Thanks
Joe
On Thu, Apr 21, 2016 at 3:43 PM, Kumiko Yada wrote:
> Hello,
>
>
>
> Has anyone written the custom process for WebHDFS?
>
>
>
> Thanks
>
> Kumiko
Run the output through UpdateAttribute and put a property on that
processor with a name of 'filename' and a value of
'${filename}.yourextension'
Thanks
Joe
On Thu, Apr 21, 2016 at 5:24 PM, Igor Kravzov wrote:
> Thanks guys. I think it will work.
> One thing: merged file comes out without extensi
I agree Mark. We should have the user make a simple explicit
expression of intent to terminate data but we should not by default
silently do so. I can see how during early phases of building a brand
new flow or experimenting with NiFi one could feel like they'd rather
it just terminated data by d
Madhu,
I'm not aware of anyone doing so but as always we'd be happy to help
it be brought in as a contrib.
Thanks
Joe
On Mon, Apr 25, 2016 at 7:50 PM, Madhukar Thota
wrote:
> Friends,
>
> Just checking to see if anyone in the community using Nifi or custom Nifi
> processor to write the data int
content to
>>> GET/POST just let us know.
>>>
>>> [1] http://opentsdb.net/docs/build/html/api_http/index.html[2]
>>> https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.InvokeHTTP/index.html
>>>
>>>
>>> Joe
&g
Ralph,
Possibly related to https://issues.apache.org/jira/browse/NIFI-1827.
Clearly something to get sorted out promptly.
Thanks
Joe
On Fri, Apr 29, 2016 at 2:45 PM, Perko, Ralph J wrote:
> Hi
>
> We are using Kafka as our messaging backbone and having been using Nifi
> since 0.3.x – It has bee
Igor,
There is no automatic failover of the the node that is considered
primary. For the upcoming 1.x release though this has been addressed
https://issues.apache.org/jira/browse/NIFI-483
Thanks
Joe
On Sun, May 1, 2016 at 2:36 PM, Igor Kravzov wrote:
> Thanks Aldrin for the repose.
> What didn
Madhu,
My testing showed the jython script performance to be poor as well.
Couple of options to tackle this worth trying:
1) write the script such that it handles multiple flowfiles per
process session (basically batching). This works presuming the
slowness is the setup/teardown of the script exe
Conrad,
Inside the conf/nifi.properties file there is a property called
nifi.version=
You will need to change that to the version you've upgrade to if you
just carried forward the old config file. That value is what ends up
being displayed in the web-ui.
Now, having said this if you are runn
ve a number of flows that use convertAvroSchema processor but I just have
> the default locale of ‘default’ in there which would appear to be the
> problem. I’m running on Java 8 if that make a difference.
>
> Thanks
> Conrad
>
>
>
> On 06/05/2016, 12:22, "Joe
Igor,
MergeContent [1] has a property for this purpose called "Demarcator"
and you can set the "Delimiter Strategy" to "text" and put a value for
the demarcator of \n.
That should get you there I think.
[1]
https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.Me
Thad,
Is that line from a bulletin or the log file itself? I would assume there
is a much better statement in the log file.
One thing I notice from the screenshot is that the database driver url is
not set. Have you put oracle's jdbc driver in the classpath somewhere?
You'll need to point that
s you want.
Thanks
Joe
On Thu, May 12, 2016 at 3:49 PM, Igor Kravzov wrote:
> Joe, If I put \n or '\n' the processor adds at as a string. How do i add it
> as ASCII?
>
> On Thu, May 12, 2016 at 2:43 PM, Joe Witt wrote:
>>
>> Igor,
>>
>> MergeContent [1] ha
Matt
We def can do better. Though I think the first statement he showed is the
lifecycle timeout. There should have been another error we could capture
and shoe though.
Glad you are good to go now thad.
Joe
On May 12, 2016 6:42 PM, "Matt Burgess" wrote:
> We can probably do better with the e
Hello
What version of nifi are you using? This was a problem in previous
versions...not seeing it properly on the output claim
Thanks
Joe
On May 14, 2016 5:56 PM, "Hammad" wrote:
> Hi,
> I am getting tweets from GetTwitter and trying to add a customer attribute
> to it using UpdateAttribute. S
Madhu,
Absolutely. You can use MergeContent, for example, to pack together a
bunch of smaller files to create a larger bundle. I'd recommend if
you will bundle 10s of thousands or hundreds of thousands or more of
things that you use two MergeContent processors together where the
first one merges
Hello
While it is clearly a very poor error/log it appears that some
property was not set in the nifi.properties file. Can you share as
much of the properties file you can - specifically around cluster
configuration?
Thanks
Joe
On Thu, May 19, 2016 at 3:00 PM, Igor Kravzov wrote:
> NiFi 0.6.1
Definitely should not need to be on the same machine. Whole idea was
to help you drive data into HDFS clusters. So yeah just grab the
right config files and ensure the machine can get through and you
should be rockin'.
Thanks
Joe
On Thu, May 19, 2016 at 5:37 PM, Igor Kravzov wrote:
> If I want
I am very proud to be part of a community with threads like this!
On Fri, May 20, 2016 at 9:34 AM, Bryan Bende wrote:
> Hi Conrad,
>
> Sorry this has been so challenging to setup. After trying it out myself, I
> believe the problem you ran into when you didn't set the System properties
> is actua
Not bothering. This is good info we should document
On May 27, 2016 11:47 AM, "Igor Kravzov" wrote:
> Guys, I found the problem. It was my fault.
> Kafka broker configured as fully qualified domain name.
> What happens is when you call zookeper it returns FQDN but my hosts file
> was not up
Hello Shoping
I am not aware of any existing processors in nifi that deal with dbf
directly. You could certainly a custom processor in place or use the
ExecuteScript processors(s) to extend it for that. The pattern you
describe though is very doable.
Perhaps this library could be a good basis
h
501 - 600 of 1121 matches
Mail list logo
