Re: ExecuteSQL Extract database tables multiple times.

2016-03-05 Thread Ralf Meier
Hi, thanks Matt for clarifying things. I got it at the processor is working just fine with mysql. Now I tried to use it with MS SQL. But here I get some issues and could not figure out why it is not working. My Configuration is: Nifi: 0.5.0 Java 8 MS SQL 2014 DBCPConnectionPool: Database Con

Re: ExecuteSQL Extract database tables multiple times.

2016-03-05 Thread Marcelo Valle Ávila
Hello Ralf, I'm suffering the same behaviour, taking data from Oracle DB failed to process due to org.apache.avro.SchemaParseException: Empty name With NiFi 0.4.1 ExecuteSQL processor works fine, it seems that in 0.5.0 and 0.5.1 there is some bug with Oracle databases. I test Nifi 0.5.1 process

Re: ExecuteSQL and NiFi 0.5.1 - Error org.apache.avro.SchemaParseException: Empty name

2016-03-05 Thread Marcelo Valle Ávila
Hello Juan, Thanks for the response, I deploy a NiFi 0.5.1 clean installation, and the behavior is still there. Reading other user mail of the mailing list, it seems that there is some incompatibility between NiFi 0.5.x and Oracle databases (maybe more). With DB2 databases works fine. Regards

Re: ExecuteSQL Extract database tables multiple times.

2016-03-05 Thread Marcelo Valle Ávila
Sorry, not see that you are using MS SQL Server. I deployed a host with MS SQL and the issue reproduces too. My enviroment: Nifi 0.5.1 Java 7 MS SQL Server 2008 With Oracle doesn't works too, but with DB2 works perfect. 2016-03-05 22:45 GMT+01:00 Marcelo Valle Ávila : > Hello Ralf, > > I'm su

Re: ExecuteSQL and NiFi 0.5.1 - Error org.apache.avro.SchemaParseException: Empty name

2016-03-05 Thread Bryan Bende
I think this a legitimate bug that was introduced in 0.5.0. I created this ticket: https://issues.apache.org/jira/browse/NIFI-1596 For those interested, I think the line of code causing the problem is this: https://github.com/apache/nifi/blob/0e926074661302c65c74ddee3af183ff49642da7/nifi-nar-bun

Re: PutMongo Processor

2016-03-05 Thread Bryan Bende
Uwe, Personally I don't have that much experience with MongoDB, but the additional functionality you described sounds like something we would want to support. Looking through JIRA I only see one ticket related to MongoDB to add SSL support [1] so I think it would be great to create a new JIRA to

Re: Advance usage documentation not displayed

2016-03-05 Thread Bryan Bende
Russell, Just want to confirm what you are seeing... so when you bring up the usage for your processor, you see the normal documentation, but you don't see an "Additional Details..." link at the top of the page? One example I know of is the PutSolrContentStream processor: https://nifi.apache.or

Re: ExecuteSQL and NiFi 0.5.1 - Error org.apache.avro.SchemaParseException: Empty name

2016-03-05 Thread Matt Burgess
That's on me, that commit went into 0.5.0 and looks like a negative logic error. I thought I had unit tested it but I guess not :( Sent from my iPhone > On Mar 5, 2016, at 6:57 PM, Bryan Bende wrote: > > I think this a legitimate bug that was introduced in 0.5.0. > > I created this ticket: h

Re: ExecuteSQL and NiFi 0.5.1 - Error org.apache.avro.SchemaParseException: Empty name

2016-03-05 Thread Matt Burgess
Actually on second thought it's not negative logic, it should be checking against tableNameFromMeta. Sent from my iPhone > On Mar 5, 2016, at 6:57 PM, Bryan Bende wrote: > > I think this a legitimate bug that was introduced in 0.5.0. > > I created this ticket: https://issues.apache.org/jira/

Mutiple dataflow jobs management(lots of jobs)

2016-03-05 Thread 刘岩
Hi All i39m trying to adapt Nifi to production but can not find an admin console which monitoring the dataflows The scenarios is simple, 1. we gather data from oracle database to hdfs and then to hive. 2. residules/incrementals are updated daily or monthly via Nifi.