Re: PutParquet fails to convert avro logical decimal type.

Are you using Nifi 1.5.0? If not, try with it first. There are bugs in older versions related to Record/Avro. On Fri, 16 Feb 2018 at 02:46 wrote: > Hi all, > > > > I am using QueryDatabaseTable to extract records from mysql. I have set > Logical Data Type to true. I am using the PutParquet proce

Re: PutParquet fails to convert avro logical decimal type.

6 February 2018 12:12 > *To:* users@nifi.apache.org > *Subject:* RE: PutParquet fails to convert avro logical decimal type. > > > > Hi Juan, > > > > I’m using Nifi 1.4.0. > > > > > > *From:* Juan Pablo Gardella [mailto:gardellajuanpa...@gmail.com > ] &

Cannot convert to Record a valid Avro schema

Hello team, I filed an issue at https://issues.apache.org/jira/browse/NIFI-4893. I discovered using a complex Avro schema. I've isolated the issue and also did a patch. At least, this solve the issue but actually I don't know well the implications on that solution. Please let me know what do you

Re: Cannot convert to Record a valid Avro schema

I saw an issue in a test :(. I will continue looking into current approach. On Mon, 19 Feb 2018 at 22:23 Juan Pablo Gardella < gardellajuanpa...@gmail.com> wrote: > Hello team, > > I filed an issue at https://issues.apache.org/jira/browse/NIFI-4893. I > discovered using a c

Re: Cannot convert to Record a valid Avro schema

Hello team, I could not fix the issue. I did a patch but it's solves the issue, but I believe is not the correct solution. Anyone that knows Record Framework can help me on that? Thanks in advance, Juan On Mon, 19 Feb 2018 at 22:33 Juan Pablo Gardella < gardellajuanpa...@gmail.com>

Re: Cannot convert to Record a valid Avro schema

efaultValue to a new (empty) ArrayList. > I would think that maybe it should set defaultValue to > > new Integer[] {0}; > > But I am not certain of the semantics here. > > Thanks > -Mark > > > On Feb 27, 2018, at 7:30 AM, Juan Pablo Gardella < > gardellajuanpa...

Re: Cannot convert to Record a valid Avro schema

pty) ArrayList. >> I would think that maybe it should set defaultValue to >> >> new Integer[] {0}; >> >> But I am not certain of the semantics here. >> >> Thanks >> -Mark >> >> >> On Feb 27, 2018, at 7:30 AM, Juan Pablo Gardella < &

Re: Cannot convert to Record a valid Avro schema

ems": "int" }, "default": 0 >>> >>> > Then currently it throws an Exception because the default value is not an > array. But what you expect to happen > is for this case to be treated the same as if the schema had said: > > "type": {&quo

Add Max Rows Per Flow File into ExecuteSQL

Hello team, I would like to add "Max Rows Per Flow File" to ExecuteSQL processor. I can create a JIRA and spent some time into that. But before doing this, I would like to know if someone of the team see a problem with that or, if that is intentional. I found that option useful in some use cases.

QueryDatabaseAdapter does not work with Phoenix's TIMESTAMP columns

Hello team, I'm testing QueryDatabaseAdapter against Phoenix DB and it cannot convert TIMESTAMP. The error is described below: https://stackoverflow.com/questions/45989678/convert-varchar-to-timestamp-in-hbase Basically, it's required to use TO_TIMESTAMP(MAX_COLUMN) to make it work. Do you think

Re: QueryDatabaseAdapter does not work with Phoenix's TIMESTAMP columns

s, > Matt > > [1] https://issues.apache.org/jira/browse/NIFI-2323 > > > On Wed, Mar 14, 2018 at 2:43 PM, Juan Pablo Gardella > wrote: > > Hello team, > > > > I'm testing QueryDatabaseAdapter against Phoenix DB and it cannot convert > > TIMESTAMP. Th

Re: Unable to create HiveConnectionPool with kerberos.

See https://issues.apache.org/jira/browse/NIFI-2575, the driver does not suppor that. I've put some workarounds in the ticket. On Mon, 26 Mar 2018 at 13:03 wrote: > Hi, > > > > I am getting the following warning when I use HiveConnection pool with > Kerberos : > > > > HiveConnectionPool[id=6e602

Re: Unable to create HiveConnectionPool with kerberos.

Sorry, the issue happens when a HA configuration is used. On Mon, 26 Mar 2018 at 13:03 Juan Pablo Gardella < gardellajuanpa...@gmail.com> wrote: > See https://issues.apache.org/jira/browse/NIFI-2575, the driver does not > suppor that. I've put some workarounds in the ticket. &

Re: Attributes vs JOLTTransformJSON

The best docs are javadoc for Jolt. I suggest to checkout the code and read from there. It also has examples. On Wed, 18 Jul 2018 at 18:41 Jean-Sebastien Vachon wrote: > Hi all, > > > > I’m using a JOLT transformation at the very end of my flow to filter out > some attributes that I don’t want t

Re: Weird behavior with the latest rev of MySQL and NiFi 1.7.1

Did you check https://dev.mysql.com/doc/refman/8.0/en/identifier-case-sensitivity.html ? I have similar issue with postgres. Mysql is case sensitive. Try to use lower or upper case to test if that's the fix On Mon, 13 Aug 2018 at 13:26 Rick wrote: > Hi Everybody! > > I am seeing some really unus

Re: Simple CSV to Parquet without Hadoop

It's a warning. You can ignore that. On Tue, 14 Aug 2018 at 18:53 Bryan Bende wrote: > Scott, > > Sorry I did not realize the Hadoop client would be looking for this > winutils.exe when running on Windows. > > On linux and MacOS you don't need anything external installed outside > of NiFi so I w

Re: Strange behavior with PutSQL

Probably connection pool is exhausted. On Wed, 15 Aug 2018 at 11:44 Lone Pine Account wrote: > I have a simple flow that takes the output of a ReplaceText processor and > sends it to PutSQL. > > This has been working in the past with a "toy" configuration. Now that > I'm testing it on a larger

Re: Anyone using HashAttribute?

I vote to keep for backward compatibility. On Wed, 5 Sep 2018 at 13:33 Brandon DeVries wrote: > Mike, > > We don't use it with Elasticsearch. > > Fundamentally, it feels like the problem is that this change would break > backwards compatibility, which would require a major version bump. So, in

Nifi with docker and LDAP

Hi all, I'm using Nifi with docker and it's secure. I'm facing an issue when I bounce my LAPTOP (I'm running it locally). After bouncing my lap, I cannot access to it (the container is running). The only workaround it's restart the service. I suppose it's something related to the host name. Any t

Re: Nifi with docker and LDAP

How? On Mon, 24 Sep 2018 at 11:31 David Gallagher wrote: > Hi – not sure if it helps, but you can set a static hostname in your > docker-compose. > > > > Thanks, > > > Dave > > > > *From:* Juan Pablo Gardella > *Sent:* Sunday, September 23, 2018 3:43 P

Re: Nifi with docker and LDAP

I will check, thanks. But what about if I would like to run as a cluster? I cannot follow that approach right? On Mon, 24 Sep 2018 at 12:59 Mike Thomsen wrote: > hostname: nifi > > Under the nifi declaration > On Mon, Sep 24, 2018 at 11:07 AM Juan Pablo Gardella < > gardellaj

ReplaceText cannot consume messages if Regex does not match

Hi all, I'm seeing that ReplaceText is not able to consume messages that does not match regex. It keeps all the messages in the input queue instead of sending them to failure relationship. Is this the intended behavior or I have to file a ticket in order to be fixed? In that way, the processor is

Re: [EXT] ReplaceText cannot consume messages if Regex does not match

t; > > Thanks > > Shawn Weeks > > > > *From:* Juan Pablo Gardella > > *Sent:* Thursday, October 18, 2018 10:13 AM > > > *To:* users@nifi.apache.org > *Subject:* Re: [EXT] ReplaceText cannot consume messages if Regex does > not match > > > > Hi, th

Re: [EXT] ReplaceText cannot consume messages if Regex does not match

so may be > misunderstanding the problem because I don’t see any regular expressions > anywhere. Can you create a sample workflow showing your issue so I can take > a look at it. > > > > Thanks > > Shawn Weeks > > > > *From:* Juan Pablo Gardella > *Sent:* Thursday, Octo

Re: [EXT] ReplaceText cannot consume messages if Regex does not match

xpression. A template would also be > really helpful. > > > > Thanks > > Shawn Weeks > > > > *From:* Juan Pablo Gardella > > *Sent:* Thursday, October 18, 2018 10:45 AM > > > *To:* users@nifi.apache.org > *Subject:* Re: [EXT] ReplaceText cannot consume

Re: [EXT] ReplaceText cannot consume messages if Regex does not match

things that look like dates but aren’t valid. > > > > Thanks > > Shawn Weeks > > > > *From:* Juan Pablo Gardella > > *Sent:* Thursday, October 18, 2018 11:03 AM > > > *To:* users@nifi.apache.org > *Subject:* Re: [EXT] ReplaceText cannot consume messages

Re: Who uses NiFi Cluster in Docker ?

It would be great to expose properties as *NIFI_*. I see that approach at https://hub.docker.com/r/wurstmeister/kafka/ kafka docker image. On Fri, 19 Oct 2018 at 11:56 Robert R. Bruno wrote: > Been running nifi cluster in a on-prem kubernetes cluster with a lot of > success. We found using loca

Re: Who uses NiFi Cluster in Docker ?

It will be great! On Fri, 19 Oct 2018 at 16:13 Michael Moser wrote: > I have done exactly what Juan Pablo Gardella suggested in my own Docker > sandbox, and also a *ADDNIFI_* > function. It would take a lot of cleanup and documentation in order to > contribute, but if there is in

Re: Recommended NiFi Docker volume mappings?

I suggest to be careful when mount log directory. In one day fills some Gigabytes. If you want to mount logs, adjust the logging. On Thu, 25 Oct 2018 at 10:07 Stephen Greszczyszyn wrote: > > > On Thu, 25 Oct 2018 at 12:50, Peter Wilcsinszky < > peterwilcsins...@gmail.com> wrote: > > But even wit

Re: [EXT] ReplaceText cannot consume messages if Regex does not match

Patch available at https://issues.apache.org/jira/browse/NIFI-5761 <https://www.google.com/url?q=https://issues.apache.org/jira/browse/NIFI-5761&sa=D&source=hangouts&ust=1540669801593000&usg=AFQjCNHVVj1whk8fb1Z3Ic51w2TdwvrC1Q> On Thu, 18 Oct 2018 at 13:33 Juan Pablo Gar

Re: nifi 1.9.0 on dockerhub

Probably README [image: image.png] On Mon, 25 Feb 2019 at 10:45 Pierre Villard wrote: > Hi Harleen, > > What do you mean? > There is a 1.9.0 Docker image available here (it's the latest) - > https://hub.docker.com/r/apache/nifi/tags > > Pierre > > Le lun. 25 févr. 2019 à 13:02, harleen mann a

Re: LDAP, Groups and nifi users

Did you delete users.xml and authorizations.xml files? On Mon, 11 Mar 2019 at 09:16 DEHAY Aurelien wrote: > Hello. > > > > I’m struggling to configure a correct authorizes.xml to achieve the > following. I’m using nifi 1.8 and 1.9 (freshy install) in secure mode + > ldap auth. > > > > -

Re: [ANNOUNCE] Apache NiFi 1.9.1 release.

Hello, It seems docker image was built incorrectly: root@c7b796dde1a8:/opt/nifi/nifi-current# ls lib/*.nar|head lib/nifi-ambari-nar-1.9.0.nar lib/nifi-amqp-nar-1.9.0.nar lib/nifi-avro-nar-1.9.0.nar lib/nifi-aws-nar-1.9.0.nar lib/nifi-aws-service-api-nar-1.9.0.nar lib/nifi-azure-nar-1.9.0.nar lib/

Re: Weird behavior w/ HWX schema registry new builds

I had to rebuild it using a newer version of HWX client. On Mon, 15 Apr 2019 at 13:24, Mike Thomsen wrote: > We deployed 0.7.0 and started running into issues with it saying it could > not find a schema. Really weird since we can see the schema in the UI and > get the metadata about it with the

Re: Weird behavior w/ HWX schema registry new builds

On Mon, 15 Apr 2019 at 13:46, Michael Pearce wrote: > Sounds like a client compatibility issue, maybe raise a bug on HWX schema > registry, pretty bad to be breaking api calls. > > > > *From: *Juan Pablo Gardella > *Reply-To: *"users@nifi.apache.org" > *Date:

Re: NIFI - PUTSQL - sql.args.1.type

The values of the constants defined at https://docs.oracle.com/javase/8/docs/api/java/sql/Types.html On Mon, Sep 23, 2019, 8:10 PM Wesley C. Dias de Oliveira < wcdolive...@gmail.com> wrote: > Hi, KhajaAsmath. > > I've search it too but found nothing. > > I think it's more easy to observe the type

Re: ElasticSearchClientServiceImpl not working for secured ElasticSearch

Any ETA for Nifi 1.10 release? On Fri, 18 Oct 2019 at 13:39, Mike Thomsen wrote: > Peter, > > Are you configuring the service as a trust-only configuration? If so, > that's been addressed in the 1.10 which is due for release in the near(ish) > future. > > https://issues.apache.org/jira/browse/NI

Re: ElasticSearchClientServiceImpl not working for secured ElasticSearch

50MB. Juan On Fri, 18 Oct 2019 at 14:13, Joe Witt wrote: > is a daily effort at this point. i am close to pushing first rc. have > been watching for stability on bug fixes. > > On Fri, Oct 18, 2019 at 1:10 PM Juan Pablo Gardella < > gardellajuanpa...@gmail.com> wrote:

NPE at JMSConsumer processor

Hello all, I found the following NPE in Nifi 1.5.0 version: 2019-11-13 04:19:11,031 ERROR [Timer-Driven Process Thread-5] o.apache.nifi.jms.processors.ConsumeJMS ConsumeJMS - JMSConsumer[destination:null; pub-sub:true;] ConsumeJMS - JMSConsumer[destination:null; pub-sub:true;] failed to process s

is it possible to query if a processor is yield?

Hello all, Is it possible to determine if a processor was yield by UI or API? Thanks, Juan

Re: NIFI expression language

Check here: https://docs.oracle.com/javase/8/docs/api/java/util/regex/Pattern.html On Fri, 22 Nov 2019 at 16:08, KhajaAsmath Mohammed wrote: > Hi, > > I have existing flow where it replace value in the json document. I > understood what is does but i would like to know what does ?s .*? does and

Encrypting passwords - Nifi 1.10.0

Hello all, I am trying to protect plain text passwords. I am using the latest docker image (1.10.0), and edited manually nifi.sensitive.props.key as below sed -i -e "s|^nifi.sensitive.props.key=.*$|nifi.sensitive.props.key=${NIFI_SENSITIVE_PROPS_KEY}|" /opt/nifi/nifi-current/conf/nifi.properties

Re: Encrypting passwords - Nifi 1.10.0

move this line entirely > > > [1] https://github.com/apache/nifi/pull/3672 > [2] > https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#encrypted-provenance > > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98

Re: Encrypting passwords - Nifi 1.10.0

ntext value, that would cause > the exception to be thrown. > > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Dec 9, 2019, at 2:22 PM, Juan Pablo Gardella < > g

Re: NiFi ValidateRecord - unable to handle missing mandatory ARRAY ?

The bug https://issues.apache.org/jira/browse/NIFI-4893 was detected by myself. Do you have a reproducible flow to validate it? On Wed, 11 Dec 2019 at 12:54, Oliveira, Emanuel wrote: > Oh I see, makes, sense your analysis, but sorry I have done java 20 years > ago, nowadays im mostly data engine

Re: [ANNOUNCE] Apache NiFi 1.2.0 release

The release notes mention an official image docker. Do you know when it will be available? On Wed, 10 May 2017 at 12:01 Joseph Niemiec wrote: > Way to go team! > > On Wed, May 10, 2017 at 10:53 AM, Bryan Bende wrote: > >> Hello >> >> The Apache NiFi team would like to announce the release of Ap

ConsumerJMS throughput is degraded after running some hours

Hi all, I would like to know if someone has performance issues using ConsumerJMS (currently against Tibco). Using 16 cached sessions and 16 threads I saw that the performance is degraded after a while. I suppose it is something related to session.recover() call inside JMSConsumer. By using one th

Re: Application is no longer processing files

I had a similar issue but with ConsumerJMS. On Wed, 26 Jul 2017 at 10:04 Noel Alex Makumuli wrote: > Hello Mark, > Thanks for the prompt response. > Yes the folder has the data. > > /data/data_warehouse/data_sources/PCT/PCT_Backfile_non_Asian/nifi/sources$ > find -type f -iname wo\*.xml | wc -l

NPE at ConsumeKafka_0_10

Hi all, I was using ConsumerKafka_0_10 processor and yesterday I saw the following error, the gist is here for the log. The issue prevents consume data.

Re: NPE at ConsumeKafka_0_10

Sure: [image: image.png] On Tue, 29 Aug 2017 at 10:00 Pierre Villard wrote: > Hi Juan, > > Could you provide your processor configuration? > > Thanks! > > 2017-08-29 14:41 GMT+02:00 Juan Pablo Gardella < > gardellajuanpa...@gmail.com>: > >> Hi al

Re: NPE at ConsumeKafka_0_10

Kafka's JavaDocs do > imply that it is. I created a JIRA [1] to address this. > > Thanks > -Mark > > [1] https://issues.apache.org/jira/browse/NIFI-4330 > > > On Aug 29, 2017, at 9:04 AM, Juan Pablo Gardella < > gardellajuanpa...@gmail.com> wrote: > &

Re: ListSFTP/FetchSFTP not running after bad password

Check state managent : After performing a listing of files, the timestamp of the newest file is stored. This allows the Processor to list only files t

Re: Cannot convert to timestamp error using putsql processor NiFi 1.3.0

It is solved in Nifi 1.4.0, but you can use toDate().toNumber() and the timestamp will work. On Fri, 13 Oct 2017 at 08:57 rakesh wrote: > Greetings Community, > > > 1.I'm developing a nifi flow which reads mysql bin_log(Capture Change > Mysql) > form source db and executing the queries in dest

Re: Cannot convert to timestamp error using putsql processor NiFi 1.3.0

e approach to convert to timestamp before putting in DB. Juan On Fri, 13 Oct 2017 at 12:21 rakesh wrote: > Hi Juan Pablo Gardella, > > Thanks for your reply. > I tried with 1.4.0 as per your suggestion but still same issue.I'm not > getting any clue of your other suggstion I tried l

Re: Cannot convert to timestamp error using putsql processor NiFi 1.3.0

Adjust the date format properly. I see the value is different that the specified format. On Mon, 16 Oct 2017 at 08:50 rakesh wrote: > Hi Juan, > > As per your suggestion I tried your date format in update attribute > processor. > < > http://apache-nifi-users-list.2361937.n4.nabble.com/file/t310/

Re: putdatabaserecord

Could you check share the logs? Remember PostreSQL does not follow SQL standard : *"Quoting an identifier also makes it case-sensitive, whereas unquoted names are always folded to lower case. For exampl

Extract Record field to an attribute

Hello all, I'm working with Nifi records. Currently I have a json converted to Avro object using ConvertRecord processor. I would like to know if it is possible to use something similar to UpdateAttribute to add an attribute which evaluates a record expression. Something similar to: attribute1 ->

Re: Extract Record field to an attribute

l Details...' link at the > end of the first paragraph, it will provide quite a bit more documentation > with examples. Hopefully this all > makes sense, but if you have further questions, I am happy to elaborate if > there is something that's not clear. > > Thanks! >

Re: package org.apache.nifi.serialization

Check at https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-extension-utils/nifi-record-utils El sáb., 2 de dic. de 2017 18:46, Uwe Geercken escribió: > Hello, > > I wanted to update my processor. But I can't seem to find the maven > archetype which provides the serialization class

Re: ValidateRecord1.4.0 vs ConvertJsonToAvro1.4.0 regarding required field in nested object

Could you share a reproducible repo or files? El mié., 6 de dic. de 2017 07:00, Martin Mucha escribió: > Hi, > > I have JSON like: > > { > "a": { > "b": "1" > } > } > > and corresponding avro schema (written for the sake of this e-mail, need > not to be 100% accurate) > > { > "name": "

Re: Install of a Custom Processor

No, only put the processor at nifi/lib folder. Remember to add META-INF/service file On Tue, 19 Dec 2017 at 09:00 James McMahon wrote: > Good morning. I have a question about installation of a custom processor. > > Under my -bundle directory I have two subdirs. One is a -nar subdir, > within whi

Re: NULL String

Which Nifi version are you using? 1.3.0 and 1.4.0 have some bugs with null. Check NIFI-4069 and NIFI-4671. Juan On Tue, 19 Dec 2017 at 15:57 Bryan Bende wrote: > Hello, > > What does your schema look like? > > You would need the schema to indicate that the field is nullable like this: > > "type

Re: [EXTERNAL EMAIL]Re: Kerberos hive failure to renew tickets

Did you try disabling ticket cache usage? Client { com.sun.security.auth.module.Krb5LoginModule required useKeyTab=true keyTab="xxx"" principal="" storeKey=true * useTicketCache=false* serviceName="zookeeper"; }; On Wed, 10 Jan 2018 at 12:57 Schneider, Jonathan wrote: > For ref

Re: NiFi Invoke Http processor with oauth2

*removed dev list* Hi, I did a processor + a simple token service to do authentication based on token. Hope it helps to you. Probably you should adjust the token service to match the json that contains the token. Below the processors and the service. Notice I am using it in a standalone nifi. For

Re: FW: Execute SQL to MSFT SQLServer - getting error

According JDBC documentation driver , integratedSecurity is a boolean property, and to authenticate against SQLServer you have three options for integratedSecurity=true. Kerberos, NTLM or Nati

Re: How to block a flow until first file is finish

I think this common use cases are easily implemented with Pentaho Transformation and Pentaho Job constructors. Below a short summary how each type of construction works: 1) *Process Group (PG)*: Every processors inside the PG runs forever, that means always are triggered. 2) *Pentaho Transformatio

Re: ExecuteSQL not working

Did you try using mssql official jdbc driver? On Fri, 8 May 2020 at 01:34, Luis Carmona wrote: > Hi everyone, > > I am trying to execute a query to an MS SQL Server, through jTDS > driver, but can't figure why is it giving me error all the time. > > If I let the processor as it is, setting the c

Re: ExecuteSQL not working

reading, seems to be it is cause the SWL server is too old. > > And with jTDS I got the coneection, and was able to execute Database > list Tables. But the processor ExecuteSQL is not working. > > Regards, > > LC > > > > > On Fri, 2020-05-08 at 02:27 -0300,

Re: PutSQL and AutoCommit Mode Still Commits

Which driver? On Wed, 3 Jun 2020 at 17:20, Shawn Weeks wrote: > Per the JDBC Spec calling commit() on a connection in auto-commit should > raise a SQLException so what we’re doing is out of spec. > > > > https://docs.oracle.com/javase/7/docs/api/java/sql/Connection.html#commit() > > > > We shoul

Re: Custom service in NAR generation failure

I am facing a similar problem and the workaround I used was installing the dependency in local repository. On Fri, 19 Jun 2020 at 10:30, Etienne Jouvin wrote: > My parent pom has this as declaration : > > > org.apache.nifi > nifi-nar-bundles > 1.11.4 > > > When

Re: Custom service in NAR generation failure

I will try to reproduce it (I have a project where I can reproduce the problem) and then fill a JIRA. I hope I can reproduce it again :) Juan On Fri, 26 Jun 2020 at 09:19, Etienne Jouvin wrote: > Some update. > > I wanted to reproduce the error in a fresh new project. But no way to have > it ag

Re: NiFi-light for analysts

I actually do it manually in docker file: RUN mv /opt/nifi/nifi-current/lib/*.nar /opt/nifi/nifi-current/lib.original/ RUN cp /opt/nifi/nifi-current/lib.original/nifi-avro-nar-$NIFI_VER.nar /opt/nifi/nifi-current/lib RUN cp /opt/nifi/nifi-current/lib.original/nifi-update-attribute-nar-$NIFI_VER.na

Re: NiFi Registry Bundles - Integration into NiFi

Be aware that using auto-load works for adding only. If you remove it from that directory, it does not remove or update AFAIK, at least, on nifi 1.5.0 On Mon, 20 Jul 2020 at 16:10, Bryan Bende wrote: > Hello, > > The plan is to eventually build a seamless experience on the NiFi side > where it w

Re: Nested groups for LdapUserGroupProvider

Maybe that scenario is not supported, but you can start playing with that custom scenario. LDAP provider is configurable by XML *ldap-provider* org.apache.nifi.ldap.LdapProvider Juan On Fri, 24 Jul 2020 at 08:20, Moncef Abboud wrote: > Hello fellow NiFi Users, > > I am trying

Unable to rollback changes with Nifi Registry

Hi all, I am starting to play with Nifi Registry. I am using Nifi 1.12.1 and Nifi Registry 0.7.0 almost with all default configurations. No security on both. My flow has some custom processors and services which were generated by nifi-nar-maven-plugin/1.3.2. I was able to create a bucket in Nifi

Re: Unable to rollback changes with Nifi Registry

Hi all, Does anyone know about this issue? What does it mean? Thanks, Juan On Sun, 4 Oct 2020 at 11:25, Juan Pablo Gardella < gardellajuanpa...@gmail.com> wrote: > Hi all, > > I am starting to play with Nifi Registry. I am using Nifi 1.12.1 and Nifi > Registry 0.7.0 almos

Re: Unable to rollback changes with Nifi Registry

s name "com.foo.MyService", but the current > myprocessor-nar that you are running does not have that service in it. > > On Mon, Oct 5, 2020 at 3:00 PM Juan Pablo Gardella > wrote: > > > > Hi all, > > > > Does anyone know about this issue? What does it mean? >

Re: Unable to rollback changes with Nifi Registry

om.foo", > "artifact": "myprocessor-nar", > "version": "0.1.0-SNAPSHOT" > } > > So then NiFi goes to the NAR with that bundle coordinate and checks if > it contains that type, and in this case it doesn't, so it doesn't kn

Re: Unable to rollback changes with Nifi Registry

remove old services (although they was working fine) and add them again. That fix the Bundle value and I am able to rollback changes. Thanks, Juan On Mon, 5 Oct 2020 at 17:33, Juan Pablo Gardella < gardellajuanpa...@gmail.com> wrote: > These are my pom.xml files: > > *myprocess

Re: Need help for user authenrication

AFAIK is not possible. On Thu, 26 Nov 2020 at 07:51, 酷酷的诚 wrote: > Hi team! > As the docs described : NiFi does not perform user authentication > over HTTP. Using HTTP, all users will be granted all roles. > But sometimes, we want to use the user authenrication over Http. So if > I want

Re: [E] Re: NIFI show version changed *, but version control show no local changes

Any guide that explains how a process group can be graduated to upper environments? On Wed, 27 Jan 2021 at 12:33, Joe Witt wrote: > There is no requirement to use the registry. It simply gives you a way to > store versioned flows which you can reference/use from zero or more nifi > clusters/flo

Any known issue on SplitRecord?

Hi all, I am using latest nifi version and SplitRecord works only once and then hangs: [image: image.png] I cannot stop it also. Juan

Re: Any known issue on SplitRecord?

gt; > We will have a 1.13.2 out asap to fix this and the regression now has > tests to prevent it in the future. > > Thanks > Joe > > On Wed, Mar 17, 2021 at 8:44 PM Juan Pablo Gardella < > gardellajuanpa...@gmail.com> wrote: > >> Hi all, >> >> I

Re: Any known issue on SplitRecord?

t;> On Thu, 18 Mar 2021 at 00:47, Joe Witt wrote: >> >>> Juan >>> >>> We found a bug in 1.13.1 today as reported here >>> https://issues.apache.org/jira/browse/NIFI-8337 and >>> https://issues.apache.org/jira/browse/NIFI-8334. >>> >

Nifi DatabaseRecord has an issue at 1.13.2

Hi all, I just discovered a critical issue on PutDatabaseRecord. I just confirmed that if I roll back to Nifi 1.12.1 works as expected. Filed the problem at https://issues.apache.org/jira/browse/NIFI-8446. Juan

Re: Broken pipe write failed errors

Not related to Nifi, but I faced the same type of issue for endpoints behind a proxy which takes more than 30 seconds to answer. Fixed by replacing Apache Http client by OkHttp. I did not investigate further, just simply replaced one library by another and the error was fixed. Juan On Sat, 29 May

Re: Nifi Registry GitFlowPersistenceProvider

I use DatabaseFlowPersistenceProvider, it is the simpler one. I spent some time like you with the Git option but I gived up and chose the DB option. It works fine. As you already require a DB for metadata, I use only one DB for metadata and flow. Only one backup is required. Juan On Mon, 14 Jun 2

Nifi 1.14.0 - Using docker and Single User Credentials

Hello all, I am trying *Single User Credentials* with Docker but it does not work because it does not allow set up nifi.web.proxy.host[1] variable. The start script disallow setting the host: if [ -n "${SINGLE_USER_CREDENTIALS_USERNAME}" ] && [ -n " ${SINGLE_USER_CREDENTIALS_PASSWORD}" ]; then ${

Re: Nifi 1.14.0 - Using docker and Single User Credentials

Frazee wrote: > Yeah, this wasn’t being handled right anymore. I put up a PR for this on > Friday. > > https://github.com/apache/nifi/pull/5226 > > If you can give it a test that’d be a big help. > > Best, > > -joey > > On Jul 18, 2021, at 6:50 PM, Juan Pablo Gard

Re: Nifi 1.14.0 - Using docker and Single User Credentials

/scripts/scripts/secure.sh RUN chmod u+x /opt/nifi/scripts/start.sh /opt/nifi/scripts/secure.sh Juan On Wed, 21 Jul 2021 at 10:39, Juan Pablo Gardella < gardellajuanpa...@gmail.com> wrote: > Hi, > > I tried the patch by adjusting the image, and it seems it is not working > if it i

Re: NiFi Queue Monitoring

+1 On Tue, 27 Jul 2021 at 14:00, Joe Witt wrote: > Scott > > This sounds pretty darn cool. Any chance you'd be interested in > kicking out a blog on it? > > Thanks > > On Tue, Jul 27, 2021 at 9:58 AM scott wrote: > > > > Matt/all, > > I was able to solve my problem using the QueryNiFiReporting

Nifi cluster restart

Hi devs, Which mechanism are you using to restart the cluster? Apart from using ambari, any other suggestions? Thanks, Juan

Re: Nifi cluster restart

ith systemd, and have timed jobs that offset stop nodes -- > systemd then sees the failed job and spins it back up > > On Fri, Jul 30, 2021 at 7:54 AM Juan Pablo Gardella < > gardellajuanpa...@gmail.com> wrote: > >> Hi devs, >> >> Which mechanism are you usin

Re: NiFi 1.14.0 OpenJDK

AFAIK Nifi supports JDK 1.8, other JDK versions probably will not work. On Fri, 20 Aug 2021 at 09:24, wrote: > I've installed NiFi 1.14.0 on a Windows Server 2019 machine with OpenJDK > 16.0.2. > No changes to properties or anything, just unzipped these and set the PATH > and JAVA_HOME environme

Some JMS unit tests are failing since 1.14.0

Hi all, Just discovered yesterday that some tests are failing since 1.14.0, details at https://issues.apache.org/jira/browse/NIFI-9225. Be aware if you are using JMS be careful. It is required to review if failing tests are false positive or actually a bug was introduced at JMS processors. Juan

Re: Some JMS unit tests are failing since 1.14.0

Nifi 1.13.2 tests run fine. On Sat, 18 Sept 2021 at 12:05, Juan Pablo Gardella < gardellajuanpa...@gmail.com> wrote: > Hi all, > > Just discovered yesterday that some tests are failing since 1.14.0, > details at https://issues.apache.org/jira/browse/NIFI-9225. Be aware if >

Re: ConsumeJMS causing multiple BIND/UNBIND request

Which Nifi version are you using? On Thu, 13 Jan 2022 at 09:14, nayan sharma wrote: > Hi All, > > > > We are using consumeJMS to consume messages from the Solaxce system from > multiple queues but we are getting multiple bind/unbind requests. > > As we are getting alerts *SYSTEM_LOGGING_LOST_EVE

Re: ConsumeJMS causing multiple BIND/UNBIND request

> On Thu, Jan 13, 2022 at 8:29 AM nayan sharma > wrote: > >> NiFi 1.11 .0 >> >> On Thu, 13 Jan 2022 at 18:27, Juan Pablo Gardella < >> gardellajuanpa...@gmail.com> wrote: >> >>> Which Nifi version are you using? >>> >>> On Th

Re: nifi-app log rotation

Hi Emmanuel, That is not related to Nifi itself, I suggest to chek logback manual or, if the disk partition where are you storing logs are not full. Juan On Tue, 18 Jan 2022 at 06:54, QUEVILLON EMMANUEL - EXT-SAFRAN ENGINEERING SERVICES (SAFRAN) wrote: > Hi guys, > > > > I’m trying to configur

Re: InvokeHTTP vs invalid SSL certificates

You can set up a SSLManager to ignore all errors , but it is not safe. Other option maybe put a reverse proxy in the middle

  1   2   >