Re: HDF NIfi - Does Nifi writes provenance/data on HDP Node ?

are trying to accomplish? > > Thanks, > Koji > > On Mon, Jun 12, 2017 at 6:25 AM, Shashi Vishwakarma > <shashi.vish...@gmail.com> wrote: > > Hi > > > > I have HDF cluster with 3 Nifi instance which lunches jobs(Hive/Spark) on > > HDP cluster. U

HDF NIfi - Does Nifi writes provenance/data on HDP Node ?

Hi I have HDF cluster with 3 Nifi instance which lunches jobs(Hive/Spark) on HDP cluster. Usually nifi writes all information to different repositories available on local machine. My question is - Does nifi writes any data,provenance information or does spilling on HDP nodes (ex. data nodes in

Re: Keytab Configuration for Nifi processor

PutHDFS processor does not resolves hostname when I pass nifi/_HOST@REALM. Anyone way to configure it ? On Fri, Jun 9, 2017 at 10:52 AM, Shashi Vishwakarma < shashi.vish...@gmail.com> wrote: > Hi > > Above solution did not worked. In log I can see that Kerberos error as >

Re: Keytab Configuration for Nifi processor

ST@REALM > should resolve your problem. > > Hope this helps. > > > 2017-06-08 22:00 GMT+02:00 Shashi Vishwakarma <shashi.vish...@gmail.com>: > >> Hi >> >> I have Nifi 3 node cluster (Installed Via Hortonworks Data Flow - HDF ) >> in Kerborized en

Keytab Configuration for Nifi processor

Hi I have Nifi 3 node cluster (Installed Via Hortonworks Data Flow - HDF ) in Kerborized environment. As part of installation Ambari has created nifi service keytab . Can I use this nifi.service.keytab for configuring processors like PutHDFS who talks to Hadoop services ? The

Re: Spark Streaming with Nifi

me close. > > With this then once you would then have all provenance data in an external > system that you can query to understand the whole system. > > Thanks, > Andrew > > P.S. sorry if this is choppy or not well formed, on mobile. > > On Sun, Jun 4, 2017 at 17:46 Shashi Vish

Re: Spark Streaming with Nifi

t directly answer your question on how to make it work. > But, hopefully this helps provide an approach that will be a better long > term solution. There may be something I am missing in your initial > questions. > > Thanks, > Andrew > > > > On Sat, Jun 3, 2017 at 10:43

Spark Streaming with Nifi

Hi I am looking for way where I can make use of spark streaming in Nifi. I see couple of post where SiteToSite tcp connection is used for spark streaming application but I thinking it will be good If I can launch Spark streaming from Nifi custom processor. PublishKafka will publish message into

Unable to Start Nifi | Database nay be already in use : “Locked by another process”

Hi I am trying to start nifi but facing h2.jdbc.jdbcSqlException : Database my be already in used exception. 2017-02-20 16:09:04,189 INFO [main] /nifi-api No Spring WebApplicationInitializer types detected on classpath 2017-02-20 16:09:04,218 INFO [main] /nifi-api Initializing Spring root

Re: Nifi | Multiple nar dependency in pom

do not need to be in this NAR > dependency chain I'm describing. They can be bundled in a separate adjacent > NARs that share the same Controller Service API NAR dependency. > > Thanks > > Matt > > On Tue, Sep 6, 2016 at 6:27 AM, Shashi Vishwakarma < > shashi.vish...@

Re: Controller Service Implementation Help

[2] https://github.com/bbende/nifi-dependency-example > > > On Mon, Sep 5, 2016 at 3:03 AM, Shashi Vishwakarma < > shashi.vish...@gmail.com> wrote: > >> Hi Joe, >> >> Thanks for your reply. I have set >> .identifiesControllerService(MyService.class) >&g

Re: Controller Service Implementation Help

.name("ssl.context.service") > > .displayName("SSL Context Service") > > .description("Specifies the SSL Context Service to use") > > .required(false) > > .identifiesControllerService(SSLContextServ

Controller Service Implementation Help

Hi I need some help in my designing a controller service. I am developing a controller service which returns a object of a class and then that object can be referenced by multiple process.For Example Employee emp = new Employee(); emp.setName("Jack"); return emp; emp object will returned from

Re: NiFi | Contoller Service is not getting updated

e restarting to see if your changes are seen. > > On Sep 4, 2016 9:06 AM, "Shashi Vishwakarma" <shashi.vish...@gmail.com> > wrote: > >> Hi >> >> I created a sample controller service - 'MyControllerService' and >> packaged it into nar and pa

NiFi | Contoller Service is not getting updated

Hi I created a sample controller service - 'MyControllerService' and packaged it into nar and pasted into nifi lib directory. I restarted nifi service to see changes. I was able to see MyControllerService in Controller setting. After that i made small label change into controller service and

run.as option does not work other than Nifi user

Hi I want to run my NiFi application using ec2-user rather than default nifi user. I changed *run.as =ec2-user* in bootstrap.conf but it did not worked .It is not allowing me to start Nifi application getting following error while staring nifi service. 1. ./nifi.sh start