Re: [VOTE] Release Apache NiFi API 2.0.0 (RC1)

2024-09-20 Thread Dan S
+1 (non-binding) I ran through all the steps in the Release Candidate Verification for NiFi API document. In addition I checked the README, NOTICE, and LICENSE files. I did note a slight inconsistency though. In the README for the Maven minimum version it has '3.9' and not the value in the pom.xml

Re: [DISCUSS] Release Timing for NiFi 1.28.0

2024-09-18 Thread Dan S
I am also working on NIFI-13744 which is a bug in how ExcelReader handles dates, times and timestamps. I am also targeting for a fix by the end of the week. On Wed, Sep 18, 2024 at 4:31 PM Mike Thomsen wrote: > I found a serious bug in how copys

Re: facing issue in running the ExecuteStreamCommand

2024-08-09 Thread Dan S
Nutan, Just clarifying the obvious. In the documentation for property "Command Path" it says > Specifies the command to be executed; if just the name of an executable is > provided, it must be in the user's environment PATH. > *Supports Expression Language: true (will be evaluated using flow file

Re: Assistance Needed to Locate NiFi 1.27.0 Branch for QueryCassandra Processor Updates

2024-08-08 Thread Dan S
support/nifi-1.x On Thu, Aug 8, 2024 at 10:28 AM Rahul Sharma wrote: > Hi, > > I have recently fixed some issues related to the QueryCassandra Processor > for NiFi, and I am looking to push these changes into the NiFi 1.27.0 > release. However, I am unable to locate the corresponding branch for

Re: Cannot get build working

2024-07-30 Thread Dan S
bility. > > > On Mon, 29 Jul 2024, 23:15 Dan S, wrote: > > > I will take a crack at it. > > > > On Mon, Jul 29, 2024 at 6:12 PM Chris Sampson > > wrote: > > > > > As if Java 11 (I think), the String class has a repeat function, so it > > > cou

Re: Cannot get build working

2024-07-29 Thread Dan S
veged into their environments. > > > > > > > > I've created NIFI-13595, for someone to have a look at this test. > > Thanks > > > > for the suggestion about the alternate method, hopefully that will >

Re: Cannot get build working

2024-07-29 Thread Dan S
> > > > > > > On Mon, Jul 29, 2024 at 12:59 PM Paul Grey wrote: > > > >> Sure. I'm suggesting that to diagnose your situation. Depletion of > >> entropy may not be the problem. Here's another way to evaluate that: > >> > >> https://ma

Re: Cannot get build working

2024-07-29 Thread Dan S
th haveged > will help inform that decision. > > > On Mon, Jul 29, 2024 at 10:14 AM Dan S wrote: > > > Yes I have a VM on an EC2 instance in AWS. > > > > On Mon, Jul 29, 2024 at 10:10 AM Paul Grey wrote: > > > > > Is this by chance a virtual mac

Re: Cannot get build working

2024-07-29 Thread Dan S
; On Mon, Jul 29, 2024 at 9:29 AM Dan S wrote: > > > So I see the problem line is > > at > > > > > org.apache.nifi.processors.elasticsearch.PutElasticsearchJsonTest.testLargeInputStringHandling(PutElasticsearchJsonTest.java:471) > > and that l

Re: Cannot get build working

2024-07-29 Thread Dan S
umeric(1)); I am not sure though what is making the process hang. On Mon, Jul 29, 2024 at 9:11 AM Dan S wrote: > Thanks Joe for the tip. Here is what I have > for org.apache.maven.surefire.booter.ForkedBooter though I am not sure what > to make of it. > > "main" #1

Re: Cannot get build working

2024-07-29 Thread Dan S
hat may be quite informative. > > Thanks > > On Sun, Jul 28, 2024 at 2:27 PM Dan S wrote: > > > Maven home: /opt/apache-maven-3.9.6 Java version: 21.0.3, vendor: Red > Hat, > > Inc., runtime: /usr/lib/jvm/java-21-openjdk-21.0.3.0.9-1.el8.x86_64 > Default > >

Re: Cannot get build working

2024-07-28 Thread Dan S
t OS? > what error(s) are you seeing resulting in the failure? > > > Cheers, > > --- > Chris Sampson > IT Consultant > chris.samp...@naimuri.com > > > > On 26 Jul 2024, at 21:49, Dan S wrote: > > > > I am currently working on a feature branch for NI

Cannot get build working

2024-07-26 Thread Dan S
I am currently working on a feature branch for NIFI-12709 . I currently rebased from main where the latest commit was 2f73ced5a6dad469fb1942cfe9a6ac61031436a4 I consistently cannot build anymore as the build keeps on hanging when running org.apach

Re: org.apache.nifi.util.SchemaInferenceUtil getDataType does not seem to handle certain dates with dateTime MM/dd/yy

2024-07-17 Thread Dan S
I have created NIFI-13557 <https://issues.apache.org/jira/browse/NIFI-13557> to address this issue. On Wed, Jul 17, 2024 at 3:47 PM Dan S wrote: > After testing I see there is still an issue with single digit months e.g. > "Date Format" is 'M/d/yy' the following

Re: org.apache.nifi.util.SchemaInferenceUtil getDataType does not seem to handle certain dates with dateTime MM/dd/yy

2024-07-17 Thread Dan S
After testing I see there is still an issue with single digit months e.g. "Date Format" is 'M/d/yy' the following text '1/1/18' is being inferred as a STRING and not a DATE:M/d/yy but per DateTimeFormatter that is parseable as a date. On Wed, Jul 17, 2024 at 2:12 P

Re: org.apache.nifi.util.SchemaInferenceUtil getDataType does not seem to handle certain dates with dateTime MM/dd/yy

2024-07-17 Thread Dan S
the use of single letters allow for single digits without padding and double digits. On Mon, Jul 15, 2024 at 5:39 PM Dan S wrote: > I am noticing in a unit test when ExcelReader' "Date Format" property is > configured with MM/dd/yy and the schema access strategy is configured

org.apache.nifi.util.SchemaInferenceUtil getDataType does not seem to handle certain dates with dateTime MM/dd/yy

2024-07-15 Thread Dan S
I am noticing in a unit test when ExcelReader' "Date Format" property is configured with MM/dd/yy and the schema access strategy is configured with "Infer Schema" that a Excel spreadsheet which has a column of data which have dates without a leading 0 in the month (e.g 9/18/18) is being inferred as

Re: [VOTE] Release Apache NiFi 1.27.0 (RC2)

2024-07-03 Thread Dan S
+1 (non-binding) Ran through Release Candidate Verification Verified signatures and hashes Built with: Maven home: /opt/apache-maven-3.9.6 Java version: 1.8.0_412, vendor: Red Hat, Inc., runtime: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.412.b08-2.el8.x86_64/jre Default locale: en_US, platform encodin

Re: [VOTE] Release Apache NiFi 2.0.0-M4 (RC1)

2024-06-28 Thread Dan S
+1 (non-binding) Ran through Release Candidate Verification Verified signatures and hashes Built with: Maven home: /opt/apache-maven-3.9.6 Java version: 21.0.3, vendor: Red Hat, Inc., runtime: /usr/lib/jvm/java-21-openjdk-21.0.3.0.9-1.el8.x86_64 Default locale: en_US, platform encoding: UTF-8 OS n

Re: ...not the most recent version of this FlowFile within this session...

2024-05-23 Thread Dan S
NIFI-13288 <https://issues.apache.org/jira/browse/NIFI-13288> On Thu, May 23, 2024 at 12:46 PM Dan S wrote: > I will make a ticket for this. Thanks! > > On Thu, May 23, 2024 at 12:45 PM Mark Payne wrote: > >> Hey Dan, >> >> Yessir, it absolutely would! Prob

Re: ...not the most recent version of this FlowFile within this session...

2024-05-23 Thread Dan S
I will make a ticket for this. Thanks! On Thu, May 23, 2024 at 12:45 PM Mark Payne wrote: > Hey Dan, > > Yessir, it absolutely would! Probably would be good to clean those up. > > Thanks > -Mark > > > > On May 23, 2024, at 12:29 PM, Dan S wrote: > > &

Re: ...not the most recent version of this FlowFile within this session...

2024-05-23 Thread Dan S
Mark, In regards to your last comments > Not really related, but on the note of things you may not realize, with > that code snippet :) > If you have access to update the processor mentioned here, you should > avoid using session.putAttribute many times. > Under the hood, in order to maintain obj

Re: [VOTE] Release Apache NiFi 2.0.0-M3 (RC1)

2024-05-16 Thread Dan S
+1 (non-binding) - Verified hashes and signatures - Successfully built NiFi 2.0.0-M3 with contrib-check in the following environment: - Maven: 3.9.6 - Java 21.0.3 openjdk - Red Hat, Inc I did notice some non showstoppers such as discrepancies in the NOTICE file which should be addressed in

Re: [VOTE] Release Apache NiFi 1.26.0 (RC1)

2024-05-06 Thread Dan S
+1 (non-binding) Went through the helper guide and did a clean build Verified signatures and hashes Built on Linux 4.18.0-513.24.1.el8_9.x86_64 Java version: Java openjdk version 17.0.11 Apache Maven 3.9.6 Verified tickets [NIFI-12785] InvokeHTTP handler should not urlencode HTTP URL [NIFI-12842]

Re: [VOTE] Release Apache NiFi 1.26.0 (RC1)

2024-05-03 Thread Dan S
Thanks Matt! Upgrading to jdk 17 worked. On Fri, May 3, 2024 at 3:18 PM Matt Burgess wrote: > +1 (binding) > > Ran through release helper, verified various flows for fixes including > https://issues.apache.org/jira/browse/NIFI-13121 > > Thanks for RM'ing Pierre! > > On Fri, May 3, 2024 at 8:47 A

Re: [VOTE] Release Apache NiFi 1.26.0 (RC1)

2024-05-03 Thread Dan S
II am encountering the exception below when building with Java 8 My environment per maven -version Maven home: /opt/apache-maven-3.9.6 Java version: 1.8.0_412, vendor: Red Hat, Inc., runtime: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.412.b08-2.el8.x86_64/jre Default locale: en_US, platform encoding: U

Re: Build of 2.x failing on Centos 7

2024-04-19 Thread Dan S
ng NiFi 2.0. > > Regards, > David Handermann > > [1] https://lists.apache.org/thread/jdmw7dsjryyf8vbjgq84tl8kpv68pplr > [2] https://www.redhat.com/en/topics/linux/centos-linux-eol > > On Fri, Apr 19, 2024 at 10:51 AM Dan S wrote: > > > > I am trying to build the 2

Build of 2.x failing on Centos 7

2024-04-19 Thread Dan S
I am trying to build the 2.x branch for a PR I am trying to submit for NIFI-13069 and it is failing. Here are the messages I see from the build [INFO] git/NIFI-FORK/nifi-2.x/nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/target/frontend-working-directory/node/node:

Re: Is there a need for the ConvertAvroToJson processor in 2.x?

2024-04-18 Thread Dan S
ted+Components+and+Features > > But that is a great point. We generally want to drop any ConvertXtoY bits > we have that aren't well covered by Records. > > Thanks > > On Wed, Apr 10, 2024 at 1:07 PM Dan S wrote: > > > I guess I am wondering why it was not included

Re: How to unset a sensitive property

2024-04-17 Thread Dan S
change might look like. Thanks! On Tue, Apr 16, 2024 at 1:21 PM Dan S wrote: > I have created NIFI-13057 > <https://issues.apache.org/jira/browse/NIFI-13057> to address this. It > seems this is an issue when a property has both required and sensitive set > to true. > > On Mo

Re: How to unset a sensitive property

2024-04-16 Thread Dan S
I have created NIFI-13057 <https://issues.apache.org/jira/browse/NIFI-13057> to address this. It seems this is an issue when a property has both required and sensitive set to true. On Mon, Apr 15, 2024 at 5:32 PM Dan S wrote: > Although the UI does report the ExcelReader controller s

Re: How to unset a sensitive property

2024-04-15 Thread Dan S
Although the UI does report the ExcelReader controller service is invalid since the password does not have any characters. On Mon, Apr 15, 2024 at 5:31 PM Dan S wrote: > Mike, > That is not what is happening. I followed your instructions and after > pressing "OK" The &

Re: How to unset a sensitive property

2024-04-15 Thread Dan S
appears showing > the greyed-out "Sensitive value set" in the box, simply click anywhere in > the text box and "Sensitive value set" will disappear. Then click the "OK" > button and the value should be back to "No value set". > > -- Mike >

How to unset a sensitive property

2024-04-15 Thread Dan S
I am currently working on NIFI-12960 where I added a new property named password which allows a user to enter a password for reading a password protected Excel spreadsheet. I marked this new property as sensitive. While testing I entered a password

Re: Re: NiFi 1.24.1 or 1.25.0 release date? - NIFI-12513 bug

2024-04-11 Thread Dan S
Sorry that was the duplicated ticket. The fix was in NIFI-12785 <https://issues.apache.org/jira/browse/NIFI-12785> On Thu, Apr 11, 2024 at 2:02 PM Dan S wrote: > That is correct. This was fixed in NIFI-12842 > <https://issues.apache.org/jira/browse/NIFI-12842> > > O

Re: Re: NiFi 1.24.1 or 1.25.0 release date? - NIFI-12513 bug

2024-04-11 Thread Dan S
That is correct. This was fixed in NIFI-12842 On Thu, Apr 11, 2024 at 1:55 PM Martin Fong wrote: > We have installed 1.25.0 and there is no deprecated messages about this > bug but the URL-encoded does not work for this sample: > ${CKAN_URL}/api

Re: Is there a need for the ConvertAvroToJson processor in 2.x?

2024-04-10 Thread Dan S
I guess I am wondering why it was not included under NIFI-11172 <https://issues.apache.org/jira/browse/NIFI-11172>. On Wed, Apr 10, 2024 at 12:01 PM Mike Thomsen wrote: > IIRC, the plan was to remove those ConvertToX processors in 2.X > > On Wed, Apr 10, 2024 at 11:36 AM Dan S

Is there a need for the ConvertAvroToJson processor in 2.x?

2024-04-10 Thread Dan S
I noticed that the ConvertAvroToJson processor is not marked as deprecated in 2.x. Is there something it offers which cannot be done with the ConvertRecord processor configured with an AvroReader and JsonRecordSetWriter?

Re: Creating Avro Schema for ControllerServiceEntity

2024-03-08 Thread Dan S
I am getting the following when running Apache NIFI 1.25 On Fri, Mar 8, 2024 at 1:21 PM Dan S wrote: > I am trying to create a flow to stop the StandardJsonSchemaRegistry and to > update it with more JSON schemas using the NIFI Rest API. I figured I will > need to use the MergeRecord

Re: QueryRecord processor fails with use of CONTAINS_SUBSTR

2024-03-08 Thread Dan S
(‘fun=spark’ in the connect string). > > > I believe we only support the ones for Apache Calcite. This is probably > something we could/should improve. > > HTH, > Pierre > > > Le mer. 6 mars 2024 à 18:14, Dan S a écrit : > > > I am trying to use the QueryReco

Creating Avro Schema for ControllerServiceEntity

2024-03-08 Thread Dan S
I am trying to create a flow to stop the StandardJsonSchemaRegistry and to update it with more JSON schemas using the NIFI Rest API. I figured I will need to use the MergeRecord processor to merge the ControllerServiceEntity JSON (returned after stopping the StandardJsonSchemaRegistry controller se

QueryRecord processor fails with use of CONTAINS_SUBSTR

2024-03-06 Thread Dan S
I am trying to use the QueryRecord processor with a SQL statement similar to: SELECT mi FROM FLOWFILE WHERE CONTAIN_SUBSTR(somedetails, 'Fred') which fails with the following error message in the logs: Caused by org.apache.calcite.runtime.CalciteContextException: From column 31 to line 1, column

Re: Nifi Expression Language method toInstant works with a negative number

2024-02-23 Thread Dan S
So I think I answered why toInstant does not throw an exception when the subject is negative. The reason I believe this is because Java's java.time.Instant ofEpochMilli method takes negative numbers and will return Instant objects from before the epoch. On Fri, Feb 23, 2024 at 2:28 PM

Re: Nifi Expression Language method toInstant works with a negative number

2024-02-23 Thread Dan S
For decimal I think I figured that the long value of the decimal is used but I still have my question for a negative number. On Fri, Feb 23, 2024 at 1:44 PM Dan S wrote: > Similar question is with a decimal number e.g. 1403620278642.00 when > calling toInstant on it it evaluates to 2

Re: Nifi Expression Language method toInstant works with a negative number

2024-02-23 Thread Dan S
Similar question is with a decimal number e.g. 1403620278642.00 when calling toInstant on it it evaluates to 2014-06-24T14:31:18.642Z. Why does it not throw an exception? On Fri, Feb 23, 2024 at 12:48 PM Dan S wrote: > I am working on NIFI-12756 to better understand when NIFI expressions

Nifi Expression Language method toInstant works with a negative number

2024-02-23 Thread Dan S
I am working on NIFI-12756 to better understand when NIFI expressions can throw exceptions. I have an attribute which is a negative number and I thought calling toInstant would have thrown an org.apache.nifi.attribute.expression.language.exception.AttributeExpressionLanguageException but instead it

Re: [Discussion] JSON Schema support for Records

2024-02-14 Thread Dan S
Thanks for the write up Bence. With the latest release of 2.0 there is now the StandardJsonSchemaRegistry an in-

How to get files after a condition has been met

2024-02-05 Thread Dan S
I have a requirement to load Json Schemas into the StandardJsonSchemaRegistry from the file system for use in validating JSON with the ValidateJson processor. I am trying to use the NIFI Rest API to update the StandardJsonSchemaRegistry. I am able to stop the ValidateJson processor and disable the

UpdateAttribute Failure Relationship

2024-01-31 Thread Dan S
My team is requesting a failure relationship for UpdateAttribute as seen in NIFI-5448 and NIFI-6344 as we are experiencing the same problem where a NIFI Expression Language is throwing an exception.

Re: [VOTE] Release Apache NiFi 1.25.0 (RC1)

2024-01-29 Thread Dan S
+1 (non-binding) - Went through the Release Candidate Verification - Verified signatures and hashes - Built on CentOS Linux 7 - Java version Red Hat, Inc. 1.8.0_392 - Maven version 3.9.5 - NIFI

Re: [VOTE] Release Apache NiFi 1.25.0 (RC1)

2024-01-26 Thread Dan S
On Fri, Jan 26, 2024 at 10:50 AM Dan S wrote: > Pierre, > I am not sure if I am missing something or not, but I do not see a > release notes link for 1.25.0 on > https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.25.0 > > On Thu, Jan

Re: [VOTE] Release Apache NiFi 1.25.0 (RC1)

2024-01-26 Thread Dan S
Pierre, I am not sure if I am missing something or not, but I do not see a release notes link for 1.25.0 on https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.25.0 On Thu, Jan 25, 2024 at 1:53 PM Pierre Villard wrote: > Team, > > I am pleased to be calling this

Re: [CANCEL][VOTE] Release Apache NiFi 2.0.0-M2 (RC1)

2024-01-22 Thread Dan S
ssue, maybe this fix should also be > included in the next RC. > > BR, > Gabor > > On Mon, 22 Jan 2024 at 17:08, Dan S wrote: > > > Joe, > > I do not have any specific settings.xml. > > > > Chris, > > Before building I had wiped away my loc

Re: [CANCEL][VOTE] Release Apache NiFi 2.0.0-M2 (RC1)

2024-01-22 Thread Dan S
, so things will take longer. > > On the new UI front, should it be covered by the include-all profile in the > nifi-assembly (I don't think it is currently, but that's maybe intentional > and in the cards to change later one it's more stable)? > > On Mon, 22 Jan 2024,

Re: [CANCEL][VOTE] Release Apache NiFi 2.0.0-M2 (RC1)

2024-01-22 Thread Dan S
ild? > > Regards, > David Handermann > > On Mon, Jan 22, 2024 at 9:52 AM Dan S wrote: > > > > Sorry typo in my previous email > > would like to bring to your attention that I had a problem building as > > certain dependencies did seem to be present in M

Re: [CANCEL][VOTE] Release Apache NiFi 2.0.0-M2 (RC1)

2024-01-22 Thread Dan S
. On Mon, Jan 22, 2024 at 10:36 AM Dan S wrote: > David, > Despite cancelling RC1 I would like to bring to your attention that I had > a problem building as certain dependencies did seem to be present in Maven > repos. > I initially got > >> Could not resolve

Re: [CANCEL][VOTE] Release Apache NiFi 2.0.0-M2 (RC1)

2024-01-22 Thread Dan S
David, Despite cancelling RC1 I would like to bring to your attention that I had a problem building as certain dependencies did seem to be present in Maven repos. I initially got > Could not resolve dependencies for project > org.apache.nifi:nifi-stateless-nar:nar:2.0.0-M2: The following artifact

Re: Error in the expression-language-guide page.

2023-12-21 Thread Dan S
Can you please add a little more detail which examples you are referring to and what the errors are? On Wed, Dec 20, 2023 at 11:32 PM A S wrote: > Hi, > There are errors on the page in Table 13 14. Also, the tables are put > with same name 'PadLeft'. > > Thanks, > Ankura >

Re: Using Jira Issue Label backport-needed for Tracking

2023-11-29 Thread Dan S
David, What about tickets only applicable for 1.x the ticket like the one I just created NIFI-12428 ? What type of label should be used for it? On Wed, Nov 29, 2023 at 11:04 AM David Handermann < exceptionfact...@apache.org> wrote: > Team, > > F

Re: Cannot build in order to submit PR

2023-11-27 Thread Dan S
Matt, Is there a way I can skip that part of the build as my changes have nothing to do with the UI. On Mon, Nov 27, 2023 at 3:55 PM Dan S wrote: > Matt, > After running mvn clean install in > /home/dystieg/git/NIFI-FORK/nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi

Re: Cannot build in order to submit PR

2023-11-27 Thread Dan S
fi-web-frontend/target/frontend-working-directory/node/node: > /lib64/libc.so.6: version `GLIBC_2.25' not found (required by > /home/dystieg/git/NIFI-FORK/nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/target/frontend-working-directory/node/nod

Re: Cannot build in order to submit PR

2023-11-27 Thread Dan S
t; bit of time. > > Thanks > > On Mon, Nov 27, 2023 at 2:50 PM Dan S wrote: > > > Matt, > > I reran and this is the message I see before the reactor reports the > > summary > > [INFO] > > > > > /home/dystieg/git/NIFI-FORK/nifi/nifi-nar-bundles/

Re: Cannot build in order to submit PR

2023-11-27 Thread Dan S
d output. Can you > please check for those details and see if re-running the build helps? We'd > like to run down if there are any issues here so others don't run into them > too. > > Thanks > > Matt > > [1] https://github.com/apache/nifi/pull/8053 > > On

Cannot build in order to submit PR

2023-11-27 Thread Dan S
I pulled from the latest code and I cannot build in order to submit a PR. I am getting the following [ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:1.14.2:npm (npm-install) on project nifi-web-frontend: Failed to run task: 'npm run ci' failed. org.apache.commons.exec.Exec

Re: [VOTE] Release Apache NiFi 2.0.0-M1 (RC6)

2023-11-23 Thread Dan S
+1 (non-binding) - Verified binary hashes and signatures - Successfully built NiFi with contrib-check using: - Apache Maven 3.9.5 - Java 21 Oracle Corporation - Centos 7 Linux 3.10.0-1160.90.1.el7.x86_64 Exercised the following bug fixes and features NIFI-2964 Confirmed the ability to allow

Use of NIFI Registry to store Avro and Json schemas

2023-11-20 Thread Dan S
I recently have been working on NIFI-11627 which aims to add an in memory registry for JSON schemas. I see there are 4 implementations of Avro schema registries AmazonGlueSchemaRegistry

Re: [VOTE] Release Apache NiFi 1.24.0 (RC3)

2023-11-17 Thread Dan S
+1 (non-binding) - Went through the Release Candidate Verification - Verified signatures and hashes - Built on CentOS Linux 7 - Java version Oracle 17.0.7 - Maven version 3.9.5 - Executed simpl

Re: [CANCEL][VOTE] Release Apache NiFi 2.0.0-M1 (RC1)

2023-11-15 Thread Dan S
David, I would like to note one thing regarding the release notes. The following tickets are listed - [NIFI-10792 ] - ConvertExcelToCSVProcessor : Failed to convert file over 10MB - [NIFI-12100

Re: SplitContent identifier

2023-10-27 Thread Dan S
Based on the SplitContent processor source code, it seems the 'Byte Sequence' property does not support expression language. That property would need to be changed to support expression language so you could set an attribute. It looks like there is already a ticket that was submitted to address thi

Re: ASN.1 to text file

2023-09-20 Thread Dan S
Katarzyna, I apologize if this is a duplicate email but I did not see my first email show up in the archives. There is actually a controller service JASN1Reader which can read ASN.1. This can be used in the ConvertRecord processor with JsonRecordSetWriter (to write JSON), CSVRecordSetWriter (to wr

Re: ASN.1 to text file

2023-09-20 Thread Dan S
Katarzyna, There is actually a controller service JASN1Reader which can read ASN.1. This can be used in the ConvertRecord processor with JsonRecordSetWriter (to write JSON), CSVRecordSetWriter (to write CSV) or FreeFormTextRecordSetWriter (to write text). Per NIFI-6752

NIFI Jira ticket not updated with link to NIFI PR code in Github

2023-09-07 Thread Dan S
I recently submitted a PR for https://issues.apache.org/jira/browse/NIFI-11197 at https://github.com/apache/nifi/pull/7665 but the Jira ticket has not been updated with the link to the PR as it usually is. Please advise. Thanks!

Obtaining Process Group Version Number

2023-08-15 Thread Dan S
My team is trying to obtain the version numbers of all the process groups they have in a cluster. There are two REST endpoints which I thought could solve this issue but it turns out neither one does the entire job by itself. /flow/process-groups/{id}/status?recursive=true allows for obtaining all

Re: Nifi's advice

2023-06-22 Thread Dan S
Try GetFile On Thu, Jun 22, 2023 at 8:39 AM Marco Toti wrote: > Hi, > > I'm Marco and I'm the OctoStar's data scientist. > > I don't know if this is

Re: [discuss] nifi 2.0 and Java 17...

2023-06-20 Thread Dan S
With those changes, the Contributor Guide , will need to be updated specifically the 'Supported Versions' and the 'Minimum Required Versions' sections. In addition in the Apache NiFi Development Quickstart

Re: Help in creating a custom record reader

2023-05-11 Thread Dan S
Abhik Lodh, do you have specific questions? On Thu, May 11, 2023 at 10:29 AM Abhik Lodh wrote: > Hi, > I am writing this mail because I wanted to create a custom Record Reader > in NiFi that parses ASCII files (or any other currently unsupported file > format) but I’m having a very hard time cre

Re: ValidateXml Processor - validatexml.invalid.error = Validation failed (NiFi 1.19.1)

2023-02-09 Thread Dan S
is plaguing myself as > well. Please let me know what your ticket number is, and I will help in > whatever way is needed to get this fixed. > > /Adam > > On Wed, Feb 8, 2023 at 10:13 AM Dan S wrote: > > > Bilal, > > Please create a bug ticket for this. > > > &

Re: ValidateXml Processor - validatexml.invalid.error = Validation failed (NiFi 1.19.1)

2023-02-08 Thread Dan S
Bilal, Please create a bug ticket for this. On Wed, Feb 8, 2023 at 4:51 AM Bilal Bektaş wrote: > Hi Dev Team, > > NiFi environment was upgraded from 1.15.1 to 1.19.1. The following > situation has occurred with the ValidateXml processor: > > ValidateXml processor works correctly on 1.15.1 and >

Re: Line number to identify where CSVReader failed

2023-01-19 Thread Dan S
lpful. > > > > > > Perhaps best to file a JIRA. Someone else might have a better idea of > > what > > > you can do now. > > > > > > Thanks > > > > > > On Thu, Jan 19, 2023 at 1:39 PM Dan S wrote: > > > > > &g

Line number to identify where CSVReader failed

2023-01-19 Thread Dan S
For both QueryRecord and ValidateRecord when I use a CSVReader on a file which has different delimiters than the rest of the file, the error message logged does not include the line number where the parsing failed. When looking at the code, I did not see any hooks for getting that information. Is

ValidateCsv vs ValidateRecord

2023-01-18 Thread Dan S
I am trying to wrap my head around why there is a ValidateCsv processor when there is a ValidateRecord processor which can do I believe everything ValidateCsv can do and more. What is the community stance on this? Should only ValidateRecord be used or is there still a use case for using ValidateCsv

Re: c2-client-service unit test(s) failing

2022-10-24 Thread Dan S
Ferenc, Not sure if this will be helpful or not but I created a new branch off my fork and built it with tests successfully. On Mon, Oct 24, 2022 at 2:46 PM Dan S wrote: > Linux Centos 7 3.10.0-1160.59.1.el7.x86_64 > Maven 3.8.4 > I am trying to build the branch with my changes

Re: c2-client-service unit test(s) failing

2022-10-24 Thread Dan S
? > Also did you try to build the latest main branch, or are you trying to > build the branch with your changes in place? > > Thanks > Ferenc > > > On Mon, Oct 24, 2022 at 3:52 PM Dan S wrote: > > > Csaba, > > I am running with Java openjdk version 1.8.0

UpdateAttribute does not allow attribute value to be blank

2022-10-24 Thread Dan S
While testing my code for NIFI-10612 , in order to get an attribute which was empty, I tried using the UpdateAttribute processor with basic usage to add a dynamic property without any value. I was not able to do so. I realized the code does not allo

Re: c2-client-service unit test(s) failing

2022-10-24 Thread Dan S
> Thanks, > Csaba > > > On 2022. Oct 21., at 21:35, Dan S wrote: > > > > I have tried a few times to build the whole code base with unit tests > but I consistently am getting tripped up by > nifi/c2/c2-client-bundle/c2-client-servi

c2-client-service unit test(s) failing

2022-10-21 Thread Dan S
I have tried a few times to build the whole code base with unit tests but I consistently am getting tripped up by nifi/c2/c2-client-bundle/c2-client-service something which I have not even touched. The culprit is org.apache.nifi.c2.client.service.operation.DebugOperationHandlerTest Attached are the

Re: Possible typo in Apache NiFi Expression Language Guide

2022-10-14 Thread Dan S
Sorry in the subject line and in the actual email instead of type it should say typo Possible type -> Possible typo It seems there may be a type -> It seems there may be a typo Both have been corrected. On Fri, Oct 14, 2022 at 11:25 AM Dan S wrote: > It seems there may be a typo in

Possible type in Apache NiFi Expression Language Guide

2022-10-14 Thread Dan S
It seems there may be a type in the Data Types section. It says > > The Expression Language supports four different data types: and then guide lists five types String, Number, Decimal, Date and Boolean. So instead

Re: Suggestion for a new Expression Language method

2022-10-14 Thread Dan S
nse or is another category necessary? On Fri, Oct 7, 2022 at 4:12 PM Mike Thomsen wrote: > NP. I'd recommend riffing on something like isNull. Should be a pretty > easy ticket. Tag me in the review. > > On Fri, Oct 7, 2022 at 12:19 PM Dan S wrote: > > > > Mike, >

Controller Service which can not validate has spinning Validating and does not display Invalid until refreshed

2022-10-07 Thread Dan S
I am working on a Avro schema directory registry as detailed in NIFI-10428 . After configuring this service, validation fails as I see an icon with an error log message but the state column has "Validating" with a spinning icon. If I use the refresh

Re: Suggestion for a new Expression Language method

2022-10-07 Thread Dan S
com/fasterxml/jackson/databind/ObjectMapper.java#L81 > > Regards, > David Handermann > > On Fri, Oct 7, 2022 at 11:05 AM Dan S wrote: > > > Mike, > > I noticed you did similar work in NIFI-5271 > > <https://issues.apache.org/jira/browse/NIFI-5271>. Joe Witt comme

Re: Suggestion for a new Expression Language method

2022-10-07 Thread Dan S
t right, you want to use a tool like Jackson or Gson to do a > test parse after you've detected open and close statements that seem > to be JSON open and close statements. > > On Fri, Oct 7, 2022 at 11:38 AM Dan S wrote: > > > > Mike, > > What do you mean

Re: Suggestion for a new Expression Language method

2022-10-07 Thread Dan S
Mike, What do you mean by "this might be a somewhat heavy method so be careful." ?

Suggestion for a new Expression Language method

2022-10-07 Thread Dan S
My team has flow file attributes which we do not always know whether they are JSON or not. We would like to run JsonPath on them but when they are not JSON we get flow files yielding as detailed in NIFI-10396 . I understand the reasons given there

Maven Enforcer Plugin does not fail build with use of banDuplicatePomDependencyVersions rule when there are duplicates between top level parent pom and children poms

2022-09-30 Thread Dan S
Has anyone ever used Maven Enforcer Plugin with rule banDuplicatePomDependencyVersions? I identified duplicate dependencies and wrote ticket NIFI-10565 . I added the banDuplicatePomDependencyVersions to the list of Enforcer rules on a branch that s

Re: Duplicated dependencies

2022-09-30 Thread Dan S
tial removal of duplicate dependencies sounds good on its own. > Enforcing the rules might take a bit more evaluation, so having it as a > separate issue seems like the best way forward. > > Regards, > David Handermann > > On Thu, Sep 29, 2022 at 5:11 PM Dan S wrote: > > >

Re: Duplicated dependencies

2022-09-29 Thread Dan S
> David Handermann > > On Thu, Sep 29, 2022 at 4:21 PM Dan S wrote: > > > Sorry about that. I did not realize I could not include an image. Here > is a > > text version: > > > > Warning:(624, 10) Dependency is duplicated in file(s): > > nifi-zendesk-pro

Re: Duplicated dependencies

2022-09-29 Thread Dan S
; dependencies. These dependencies are applied to all modules by design, to > avoid unnecessary repetition in child modules. > > Regards, > David Handermann > > On Thu, Sep 29, 2022 at 4:06 PM Dan S wrote: > > > When looking in the top level pom.xml in IntelliJ I see >

Duplicated dependencies

2022-09-29 Thread Dan S
When looking in the top level pom.xml in IntelliJ I see [image: image.png] The duplicate dependencies are: org.junit.jupiter junit-jupiter-api test org.junit.jupiter junit-jupiter-engine test org.mockito mockito-core test org.slf4j slf4j-simple test

Re: Git questions for supplying a contribution

2022-09-29 Thread Dan S
r in there. You'd submit your code change > > in a branch to your fork/mirror. And from that you'd request/submit a > > pull request to NiFi. This is important because you wont be able to > > commit to the apache/nifi codebase for now (but if you become a > > c

  1   2   >