I agree with you Matt, it sounds very similar to the issue reported in
NIFI-1752 "EvaluateXPath invalid when starting processor" (
https://issues.apache.org/jira/browse/NIFI-1752), but resolved by the
NarCloseable fix as part of NIFI-1697. I believe it is possible that
0.7.0-SNAPSHOT might have th
This is a differently the Microsoft SDK issue that the sample Java program is
hitting this error as well ☹
Thanks
Kumiko
From: Kumiko Yada [mailto:kumiko.y...@ds-iq.com]
Sent: Thursday, June 9, 2016 5:53 PM
To: users@nifi.apache.org
Subject: RE: Exception: java.lang.NoClassDefFoundError: retrofi
I found out that I didn’t have specify this dependency in pom file that it
would be packaged as part of below by finding the jar file in
…\nifi-azure-dlstore-nar\target\classes\META-INF\bundled-dependencies. I
verified that it is packaged with a new Nar, and I even copied this jar file in
…\ni
Ok. Got it. Thanks guys.
On Thu, Jun 9, 2016 at 7:37 PM James Wing wrote:
> The funnel merges multiple queues into a single queue. You then have one
> queue to configure prioritization, backpressure, etc. And one queue to
> monitor and administer. It can also be helpful visually if you really
Yes, it has to be available to your code otherwise you will continue to get
ClassNotFoundException
Oleg
On Jun 9, 2016, at 8:06 PM, Kumiko Yada
mailto:kumiko.y...@ds-iq.com>> wrote:
Does this mean that I have to include this dependency in nar pom file now?
Does this mean that I have to include this dependency in nar pom file now?
com.squareup.retrofit2
retrofit
2.0.4
Not to stir the pot but the only time I've seen that error was a Jira that was
fixed for 0.6.1, in fact I think I recommended such an upgrade for someone with
the same problem. I'm glad the issue went away but it's weird that it showed up
in 0.6.1...
> On Jun 9, 2016, at 7:41 PM, James Wing w
Thanks for reporting back, Keith. It sounds like a bug got fixed, and
that's always great news even if we don't exactly where :).
James
On Thu, Jun 9, 2016 at 4:10 PM, Keith Lim wrote:
> Thanks James, I built from the latest 0.x branch and the issue does not
> show up.
>
>
> Thanks,
> Keith
>
The funnel merges multiple queues into a single queue. You then have one
queue to configure prioritization, backpressure, etc. And one queue to
monitor and administer. It can also be helpful visually if you really have
a lot of input queues, as a self-describing way of asserting they go to one
c
Funnels are used to combine multiple connections into a single connection.
There are a couple reasons this could be desirable. Processors like
MergeContent can only operate on a single incoming connection.
From the documentation [1]:
Funnels are used to combine the data from many Connections
No, it just means that retrofit2.BaseUri is not in the NAR class path (see
class not found at the bottom of the trace). Is it packaged with your new Nar?
Sent from my iPhone
On Jun 9, 2016, at 19:01, Kumiko Yada
mailto:kumiko.y...@ds-iq.com>> wrote:
Hello,
My custom processor is throwing the
Thanks James, I built from the latest 0.x branch and the issue does not show
up.
Thanks,
Keith
From: James Wing
Sent: Wednesday, June 08, 2016 9:23:22 PM
To: users@nifi.apache.org
Subject: Re: Failure when running a workflow created from a template from
anot
Hello,
My custom processor is throwing the run-time exception, so I reverted the
changes that I made and I'm still getting this below error. Does this mean
that there is some changes in Microsoft Azure SDK? My custom processor nar
file which I compiled yesterday is working fine. Note: I'm
Guys, what is the actual role of funnel?
Here is the code:
https://github.com/kyada1/PutFileAzureDLStore/blob/master/nifi-azure-dlstore-bundle/nifi-azure-dlstore-processors/src/main/java/nifi/azure/dlstore/processors/PutFileAzureDLStore.java
The problems are :
Line 209 - SetupClients(creds);
Line 217 - CreateFile(_path + _filename, val
Hi Anuj,
This method supposes your XML input file is not too complex. Have a look on
this thread, this should answer your questions:
https://mail-archives.apache.org/mod_mbox/nifi-users/201606.mbox/%3CCALo_M1_erYWJkWB=D7kJ17gvpmnyeVGmYiQH9=mqqktb-nh...@mail.gmail.com%3E
Hope this helps.
2016-06-
Thanks James. That's exactly what I ended up with :)
On Thu, Jun 9, 2016 at 12:48 PM, James Wing wrote:
> Igor,
>
> One way would be to format both dates as strings (like "20160609" in your
> HDFS paths) first, then compare the two strings for equality. In a
&g
Hi ,
I am getting the below error of not a valid JSON content
a text file containing XML was sconverted to JSON.
2016-06-09 16:10:11,765 ERROR [Timer-Driven Process Thread-10]
o.a.n.p.standard.EvaluateJsonPath
EvaluateJsonPath[id=475d43ec-549b-4378-81d5-778041558781] FlowFile
StandardFlowFileRec
If there are multiple SDK calls that share the same problematic code (that is,
multiple SDK methods that would interact with each other in a non-thread-safe
way), then one must synchronize their calls to a shared lock object, which only
requires a couple more lines of code.
___
+1, was just responding with the same.
On Jun 9, 2016, at 3:11 PM, Matt Foley
mailto:mfo...@hortonworks.com>> wrote:
Kumiko, would it be sufficient to just wrap your call to the non-thread-safe MS
SDK routine, in a 'synchronized' method? You could then use the standard NiFi
thread management
Kumiko, would it be sufficient to just wrap your call to the non-thread-safe MS
SDK routine, in a 'synchronized' method? You could then use the standard NiFi
thread management and avoid a lot of complexity. And the result should be >=
efficiency of having a dedicated thread to manage the probl
Yes I think it ends up being the same thing.
If you create multiple threads that all use the
same DataLakeStoreFileSystemManagementClient,
or if you increase concurrent threads > 1 in the UI, both will potentially
run into the problem in the Microsoft SDK.
On Thu, Jun 9, 2016 at 2:49 PM, Kumiko Y
Hi Bryan,
Does this mean that even I create the multiple threads in onTriger, I will
still hit the Microsoft SDK issue where it's not a thread safe? Sounds like
basically what I am trying to do and creating the multiple threads via UI
might be the same thing.
Thanks
Kumiko
__
Kumiko,
In general you shouldn't have to create threads in your processors, with
the exception of some special cases.
The framework has a thread pool and it takes one of those threads and calls
the onTrigger method of your processor.
If you want multiple threads to call onTrigger, then each proce
Microsoft found this is an issue with the SDK, they are working on a fix, they
do not have the ETA for the fix. To workaround this issue, I’m trying to
create the multiple threads in using AbstractSessionFactoryProcessor and handle
the Create a file in a single thread. I’m having a problem th
Brian,
Thank you - that was the problem.
I updated my xml files from the cluster in question and all is working fine
now.
Michael
Igor,
One way would be to format both dates as strings (like "20160609" in your
HDFS paths) first, then compare the two strings for equality. In a
RouteOnAttribute expression:
${now():format("MMdd"):equals(${entryDate:format("MMdd")})}
If your goal is to
Hi,
In my workflow data is coming form Kafka Topic in JSON format and saved ot
HDFS directory by day.
HDFS directory path constructed as /mypath/${now():format("MMdd")}
JSON file contains attribute {... "adddate":"2016-06-07 17:06:17" }
I want to avoid over-spill of a previous date files int
28 matches
Mail list logo
