Fwd: NIFI authorization problem

[rohit kumar tripathi]

HI Team,

I am trying to setup authorization for the LDAP user but during this i
facing some problem and description are below:-
1. Post authentication i am getting insufficient permission for the
particular user i.e.
cn=Gouru\, Suryadev Reddy,ou=Users,ou=AP Region,dc=exp,dc=com
attached reference image 1.

2. This particular user is fetched from LDAP and provided all the
policy details. i.e.
CN=Gouru\, Suryadev Reddy,OU=Users,OU=AP Region,DC=exp,DC=com
attached reference image 2.

3. Here my finding is that LDAP attribute are different in the part of case
sesitiveness and not able see any property to compare only values of these
attributes.
  *cn*=Gouru\, Suryadev Reddy,*ou*=Users,*ou*=AP Region,*dc*=exp,*dc*=com
  *CN*=Gouru\, Suryadev Reddy,*OU*=Users,*OU*=AP Region,*DC*=exp,*DC*=com

4. In my organisation LDAP is set up in the given format

dn: Gouru\, Suryadev Reddy ,OU=Users,OU=AP Region,DC=exp,DC=com
objectClass: top
objectClass: person
objectClass: organizationalPerson
objectClass: user
cn: Gouru\, Suryadev Reddy
sn: Gouru

Could you please help me out for the same attaching screenshot for the
reference.
Please let me know if any other info is required.


Regards,
Rohit Tripathi
8197345687

Re: "Method not supported" error facing GenerateTableFetch and QueryDatabaseTable processor

[Rohit]

Thanks Matt for reply...

So is there any other way to read data from have table into batches because
my table having millions of row and i am using NiFi 1.3

I tried with below processor:-

1. ExecuteHQL(Customer processor of Kylo) -- creating single file to
downstream.
2. SelectHiveQL - "Max Rows Per Flow File" property not supporting NiFi
1.3.0
3. GenerateTableFetch and QueryDatabaseTable



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: ExecuteHQL failed to reading table from Hive

[Rohit]

Hi Matt,

Issue got resolved after casting smallint to int, as avro not supported
smallint datatype.

Thanks.



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

"Method not supported" error facing GenerateTableFetch and QueryDatabaseTable processor

[Rohit]

Hi,

I trying to read hive table using QueryDatabaseTable processor and when i
executed my flow, i am getting below error.

""'
2018-03-20 00:42:20,717 ERROR [Timer-Driven Process Thread-5]
o.a.n.p.standard.GenerateTableFetch
GenerateTableFetch[id=3ddee0d9-0162-1000-7696-273b8816bcff] Unable to
execute SQL select query SELECT COUNT(*) FROM table2 due to
java.sql.SQLException: Method not supported: {}
java.sql.SQLException: Method not supported""'

and also tried with GenerateTableFetch but facing same error.

QueryDatabaseTable1.PNG

  
QueryDatabaseTable2.PNG

  
QueryDatabaseTable3.PNG

  

Thanks,
RohitC



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: Not able to add "Max Rows Per Flow File" property in SelectHiveQL

[Rohit]

Thanks..

Is it possible to change only source code in 1.3.0 and add 1.5.0 code.




--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: Not able to add "Max Rows Per Flow File" property in SelectHiveQL

[Rohit]

Thanks for the reply, but i don't have any knowledge to complile NAR object.


Is it possible to extract them of 1.5.0 and push it into NiFi 1.3.0
directly?



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Not able to add "Max Rows Per Flow File" property in SelectHiveQL

[Rohit]

Hi,

  I am using SelectHiveQL 1.3.0 processor to read data from hive table and i
am trying to add "Max Rows Per Flow File" property in  SelectHiveQL but its
giving error "Max Rows Per Flow File" is not a supported property. As per
Nifi notes this is valid property.

SelectHiveQL.png
<http://apache-nifi-developer-list.39713.n7.nabble.com/file/t927/SelectHiveQL.png>
  
SelectHiveQL1.PNG
<http://apache-nifi-developer-list.39713.n7.nabble.com/file/t927/SelectHiveQL1.PNG>
  

Thanks,
Rohit



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

ExecuteHQL failed to reading table from Hive

[Rohit]

Hi,

  I am trying read table from hive using ExecuteHQL  processor, but getting
"org.apache.avro.AvroRuntimeException: Unknown datum type java.lang.Short:
1" error.





--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: NiFi SplitAvro processor giving extra records

[Rohit]

Hi matt,

I changed the relationship set only Split relationship to downstream, its
working fine me.

Thanks



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Not able to create document_id using expression-language in PutCouchbaseKey

[Rohit]

Hi,
 
I am trying to create couchbase document_id (PutCouchbaseKey processor) as
json key "stud_id" using expression-language but i am getting below error.

due to uncaught
Exception:org.apache.nifi.attribute.expressac_noguage.exception.AttributeExpressionLanguageException:Subject
is empty.

Keys:-
{stud_id,first_name,last_name}

My Teamplate:- 

ExecuteHQL->SplitAvro->AvroToJson->PutCouch


nifi1.PNG
  



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: NiFi SplitAvro processor giving extra records

[Rohit]

Hi Mark,

after changing relationship, its working fine.

Thanks...



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

NiFi SplitAvro processor giving extra records

[Rohit]

Hi,

I am reading data from hive table using ExecuteHQL having 5 records in hive
table, its generating 1 avro file having total 5 records and using splitAvro
processor i am splitting separate records but SplitAvro processor generating
total 6 records which having 5 separate records and 6'th record having all 5
records.

My template:

ExecuteHQL -> SplitAvro -> AvroJson -> putCouch




--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

NiFi SplitAvro processor giving extra records

[Rohit]

Hi,

I am reading data from hive table using ExecuteHQL having 5 records in hive
table, its generating 1 avro file having total 5 records and using splitAvro
processor i am splitting separate records but SplitAvro processor generating
total 6 records which having 5 separate records and 6'th record having all 5
records.



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

NiFi SplitAvro processor giving extra records

[Rohit]

Hi,

I am reading data from hive table having 5 records and its generating 1 avro
file and using splitAvro processor  i am splitting data but splitAvro
generating 6 records which having  5 individual row and one row containing
all 5 row.

My Teamplate:-

ExecuteHQL->SplitAvro->AvroToJson->PutCouch



--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/