Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread vthiru2006
Hi Bryan, It throws back an error "Cannot Load Database Driver" ERROR : DBCPConnectionPool[id=909a0541-5abc-451b-ad5c-0f45b0bb6a9f] Failed to invoke @OnEnabled method due to org.apache.nifi.reporting.InitializationException: Can't load Database Driver The driver jar which we are using is :

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread Mark Payne
Yeah the issue appears to be that your JDBC driver has external dependencies. Generally, JDBC drivers are created as self-contained jars without any external dependencies. You may need to build a jar-with-dependencies in order to make sure that you are able to access the jar as a standalone

NIFI DBCP connection pool not working for hive

2015-09-18 Thread vthiru2006
Hi, I'm trying to make a hive connection pool via controller service - DBCP Connection Pool module. Database Connection URL -- jdbc:hive2://.com:11000/default;principal=hive/.c...@na.company.int Database Driver Class Name -- org.apache.hadoop.hive.jdbc.HiveDriver Database Drive Jar URL

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread vthiru2006
Hi Matt, I tried copying the jar in /lib and it still doesn't work :( It throws back the same error. Thanks, Thiru -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/NIFI-DBCP-connection-pool-not-working-for-hive-tp2863p2871.html Sent from the Apache NiFi

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread vthiru2006
Thank you for your response Bryan. I thought it just needs read access and the jar had read permission. Anyway, I tried copying the file to home directory where NIFI runs, gave it read-execute permission and it still throws me the same exception. Is there anything else I'm missing? Thanks, Thiru

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread Matt Gilman
Are there any additionally details in /logs/nifi-app.log? Hoping that the initialization exception (and it's cause) are being logged. Thanks. Matt On Fri, Sep 18, 2015 at 3:59 PM, vthiru2006 wrote: > Hi Matt, > > I tried copying the jar in /lib and it still doesn't work

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread vthiru2006
Hi Matt, Attached the log file for your reference. Thanks, Thiru errorLog.log -- View this message in context:

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread Mark Payne
I'm not 100% sure about this, but from some googling, it looks like the JDBC Driver class name that you have was the classname for Hive 1, but Hive 2 uses a different class name: org.apache.hive.jdbc.HiveDriver Given that your connection URL is jdbc:hive2:... you may want to give that a try.

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread QXU
Hi~ did you enable the pool ? Regards QXU On Fri, Sep 18, 2015 at 2:02 PM, vthiru2006 [via Apache NiFi Developer List] wrote: > Oh thank you Mark. I might have missed it. I remember that have already > tried this driver class as well. I get a different

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread vthiru2006
I guess HiveDriver is the class name even for hive2. Also, below is my NIFI config: Am I doing anything

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread vthiru2006
Thanks for your help QXU and Mark. I guess I'm using the right driver class. We use the same to access our hive metastore from java. -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/NIFI-DBCP-connection-pool-not-working-for-hive-tp2863p2877.html Sent

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread vthiru2006
:) Only when I try to enable the pool, it throws me that exception! -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/NIFI-DBCP-connection-pool-not-working-for-hive-tp2863p2882.html Sent from the Apache NiFi Developer List mailing list archive at

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread Matt Gilman
This is happening because something is loading that class (persumably through the HiveDriver). That class (org.apache.hadoop.conf.Configuration) has some initialization code (static variables and/or static initialization block). During this initialization (which happens when the class is loaded)

[RESULT][VOTE] Release Apache NiFi 0.3.0

2015-09-18 Thread Matt Gilman
Hello The release passes with 7 +1 (binding) votes 6 +1 (non-binding) votes 0 -1 (binding) votes Thanks to all who helped make this release possible. Here is the PMC vote thread: http://s.apache.org/Moe Matt

Re: NIFI DBCP connection pool not working for hive

2015-09-18 Thread Bryan Bende
Hello, Can you provide the error message you received? Is it about finding/loading the driver? or about actually creating the connection? Thanks, Bryan On Fri, Sep 18, 2015 at 2:11 PM, vthiru2006 wrote: > Hi, > > I'm trying to make a hive connection pool via controller

Email subscription request to Apache NIFI developer list

2015-09-18 Thread thiru malai
Hi, We are trying to work in NIFI and try to use the tool for our company. I'm trying to subscribe to the email list since yesterday and I didn't receive any emails for subscription. Can any of you please help me with this? Thanks, Thiru

hey guys :) how to let NiFi "pass and parse parameters" through "HandleHttpRequest" ?

2015-09-18 Thread QXU
I am a new user for this tools, right now I am creating a simple flow to access the database and do the select statement from the specific table. in the WHERE condition I want to use parameter do dynamic change. I know there is the a problem we cannot use ExecuteSQL processor directly use as