PutSQL Processor
Hi,
I am trying to insert some data in oracle table using PutSQL Processor. But
getting the below error.
2017-10-17 14:53:58,409 ERROR [Timer-Driven Process Thread-1]
o.apache.nifi.processors.standard.PutSQL
PutSQL[id=24b8613d-015f-1000-2f70-88d0c843300b]
org.apache.nifi.processors.standard.PutSQL$$Lambda$209/1062828301@1098de1
failed to process due to
org.apache.nifi.processor.exception.ProcessException: Failed to disable auto
commit due to java.sql.SQLFeatureNotSupportedException: Disabling
auto-commit mode not supported; rolling back session: {}
org.apache.nifi.processor.exception.ProcessException: Failed to disable auto
commit due to java.sql.SQLFeatureNotSupportedException: Disabling
auto-commit mode not supported
Regards,
Shankha
--
Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
Re: FuzzyHashContent/CompareFuzzyHash processor
Hi Andy, I am having multiple lines in the file. For example Col1 Col2 Col3 Col4 Col5 Test1Test2 Test3 Test4 Test5 Data1 Data2Data3Data4Data5 .. .. .. In the output file I want to write all the fields where there will be a fuzzy matching between Col2 and Col3. Regards, Shankha -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
Re: FuzzyHashContent/CompareFuzzyHash processor
Hi Andy, Thanks for the reply. But I am still not able to solve my use case. For example I have a data file in the below structure. Col1 Col2 Col3 Col4 Col5 Test1Test2 Test3 Test4 Test5 I want to do a fuzzy matching on Col2 and Col3 and generate an output file. I am using getFile and FuzzyHashContent processor but not able to design the flow. Need your help on this. Regards, Shankha -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
FuzzyHashContent/CompareFuzzyHash processor
Hi, I want to implement fuzzy logic on some fields in a data file using NiFi. I am trying to use FuzzyHashContent/CompareFuzzyHash processor but not sure how to implement the flow. Can you please provide me an example? Regards, Shankha -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/
Re: File Filter regular expression - GetFile
Hi, I have one more requirement. I have 5 files in a directory. 1. Test1.txt 2. Test12.txt 3. Test123.txt 4. Test1234.txt 5. Test12345.txt I want to get all the files by using Test in the File Filter Regex section of ListFile processor. I don't want give full file name. Please let me know how to resolve this. -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/File-Filter-regular-expression-GetFile-tp16279p16314.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Re: File Filter regular expression - GetFile
Thanks James, It's working fine. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/File-Filter-regular-expression-GetFile-tp16279p16291.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
File Filter regular expression - GetFile
Hi, I want to get the list of files from a directory where file name starts with a. I am using File Filter regular expression where default value is [^\.].*. But using this value I am getting all the files. Please let me know what I need to use in the File Filter regular expression section so that I can get the list of files where file name starts with a. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/File-Filter-regular-expression-GetFile-tp16279.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
PutElasticsearch Processor
Hi, I am able to load single json to Elasticsearch using NiFi PutElasticsearch Processor but while trying to load json array I am getting error. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/PutElasticsearch-Processor-tp15111.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
NiFi processor for Google Drive
Hi, I want to access the files from google drive using NiFi processor. I would like to use in build processor rather writing a Custom Processor. Is the any in build processor available for google drive? Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/NiFi-processor-for-Google-Drive-tp15043.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Re: NiFi PutElasticsearch Processor
Hi Mark, I have resolved json attribute issue by increasing the value of Maximum Capture Group Length in AttributesToJSON processor. I have one more question - For PutElasticsearch processor I am using elasticsearch2.2.0 version. Is it possible to use elasticsearch5 version for PutElasticsearch processor? Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/NiFi-PutElasticsearch-Processor-tp14733p14822.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Re: NiFi PutElasticsearch Processor
Thanks Mark, your solution has worked! I am facing one more issue. I am trying to put the entire content in a single json attribute using AttributesToJSON processor. It's working fine but that particular attribute is not able to capture the entire content, it's able to capture around first 7 lines of the entire content. Is there any limitation on that or how to to resolve this issue? Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/NiFi-PutElasticsearch-Processor-tp14733p14820.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Re: NiFi PutElasticsearch Processor
Hi,
I have added ExtractText processor and there added a new property called
myAttribute with value (.+). Then added AttributesToJSON processor with
Attributes List as myAttribute. As result I am getting the below json
structure.
{"myAttribute":"test elasticsearch"}
But it's not working for multiline content as the json attribute is taking
single line only. To resolve this I to keep the entire content in a single
line. So I have added ReplaceText processor before AttributesToJSON
processor. In the replace text processor I am trying to replace \n to empty
space so that entire content can come in a single line.
Can you please tell me how to make the entire content in a single line using
ReplaceText? I have used search value as \n and replacement value as ' '.
But this is not working properly.
Please provide some input on this.
Regards,
Shankha
--
View this message in context:
http://apache-nifi-developer-list.39713.n7.nabble.com/NiFi-PutElasticsearch-Processor-tp14733p14774.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
NiFi PutElasticsearch Processor
Hi, I am working on a use case where I need to load a PDF document to ElasticSearch. I have written a Custom NiFi processor using apache Tika which is basically extracting the content of the PDF. The NiFi flow is mentioned below. 1. NiFi GetFile processor is getting the PDF file from the source directory. 2. NiFi custom processor which is written using apache Tika is extracting the PDF file. 2. Using NiFi PutElasticsearch processor to load the data in ElasticSearch. But I am getting the below error. MapperParsingException[failed to parse]; nested: NotXContentException[Compressor detection can only be called on some xcontent bytes or compressed xcontent bytes]; Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/NiFi-PutElasticsearch-Processor-tp14733.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Re: NiFi Spark Processor
Hi joey, I am trying the POC in different way now. 1. GetFile processor which is getting the files from the local drive. 2. Connecting the processor to the NiFi Output Port. 3. Written a Spark streaming Job which is connecting to the NiFi Output Port to stream the data. The Spark Job is able to connect the NiFi Output Port successfully. But not able to get any data in spark though in the NiFi the data has been queued from GetFile processor. I have checked the NiFi Data Provenance of the NiFi Output Port but no data is showing there as well where as GetFile to Output Port connector is showing the data has been queued. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/NiFi-Spark-Processor-tp13899p13913.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
NiFi Spark Processor
Hi, I am trying to use custom Spark Nifi processor. I have downloaded the processor from https://github.com/qiansl127/nifi-spark-bundle and then executed the maven build. After the maven build I have copied nifi-spark-nar-0.3.0.nar inside NiFi lib folder and restarted the NiFi server which is not working. Please advice. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/NiFi-Spark-Processor-tp13899.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Re: Issue on creating Custom Processor - Salesforce
Hi Jeremy, There is one more issue. Actually I did the build inside D:\nifi-addons-master\Services\nifi-salesforce-service\nifi-salesforce-api-nar directory successfully. But ideally I should build inside D:\nifi-addons-master\Services directory which is failing. [ERROR] [ERROR] Some problems were encountered while processing the POMs: [ERROR] Child module D:\nifi-addons-master\Services\nifi-google-auth-service of D:\nifi-addons-master\Services\pom.xml does not exist @ @ I do not see nifi-google-auth-service as well in the D:\nifi-addons-master\Services directory. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Issue-on-creating-Custom-Processor-Salesforce-tp13603p13610.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Re: Issue on creating Custom Processor - Salesforce
Thanks Jeremy, now the build is successful. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Issue-on-creating-Custom-Processor-Salesforce-tp13603p13605.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
Issue on creating Custom Processor - Salesforce
Hi, I am trying to create the Custom Salesforce Processor for Nifi but getting the below error while doing the maven build. [ERROR] Failed to execute goal on project nifi-salesforce-processors: Could not resolve dependencies for project com.jeremydyer.nifi:nifi-salesforce-processors: jar:1.0.0: Could not find artifact com.jeremydyer.nifi:nifi-salesforce-api:jar:1 .0.0 in central (https://repo1.maven.org/maven2) -> [Help 1] The maven build for other Custom Processors are working fine. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Issue-on-creating-Custom-Processor-Salesforce-tp13603.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
