Re: [PR] Bump org.apache.santuario:xmlsec from 2.3.3 to 2.3.4 in /nifi-nar-bundles/nifi-framework-bundle [nifi]

2023-10-20 Thread via GitHub


exceptionfactory commented on PR #7917:
URL: https://github.com/apache/nifi/pull/7917#issuecomment-1773603953

   Closing in favor of #7916 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] Bump org.apache.santuario:xmlsec from 2.3.3 to 2.3.4 in /nifi-nar-bundles/nifi-framework-bundle [nifi]

2023-10-20 Thread via GitHub


dependabot[bot] commented on PR #7917:
URL: https://github.com/apache/nifi/pull/7917#issuecomment-1773603978

   OK, I won't notify you again about this release, but will get in touch when 
a new version is available. If you'd rather skip all updates until the next 
major or minor version, let me know by commenting `@dependabot ignore this 
major version` or `@dependabot ignore this minor version`.
   
   If you change your mind, just re-open this PR and I'll resolve any conflicts 
on it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] Bump org.apache.santuario:xmlsec from 2.3.3 to 2.3.4 in /nifi-nar-bundles/nifi-framework-bundle [nifi]

2023-10-20 Thread via GitHub


exceptionfactory closed pull request #7917: Bump org.apache.santuario:xmlsec 
from 2.3.3 to 2.3.4 in /nifi-nar-bundles/nifi-framework-bundle
URL: https://github.com/apache/nifi/pull/7917


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[PR] Bump org.apache.santuario:xmlsec from 2.3.3 to 2.3.4 in /nifi-nar-bundles/nifi-framework-bundle [nifi]

2023-10-20 Thread via GitHub


dependabot[bot] opened a new pull request, #7917:
URL: https://github.com/apache/nifi/pull/7917

   Bumps org.apache.santuario:xmlsec from 2.3.3 to 2.3.4.
   
   
   [![Dependabot compatibility 
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=org.apache.santuario:xmlsec=maven=2.3.3=2.3.4)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)
   
   Dependabot will resolve any conflicts with this PR as long as you don't 
alter it yourself. You can also trigger a rebase manually by commenting 
`@dependabot rebase`.
   
   [//]: # (dependabot-automerge-start)
   [//]: # (dependabot-automerge-end)
   
   ---
   
   
   Dependabot commands and options
   
   
   You can trigger Dependabot actions by commenting on this PR:
   - `@dependabot rebase` will rebase this PR
   - `@dependabot recreate` will recreate this PR, overwriting any edits that 
have been made to it
   - `@dependabot merge` will merge this PR after your CI passes on it
   - `@dependabot squash and merge` will squash and merge this PR after your CI 
passes on it
   - `@dependabot cancel merge` will cancel a previously requested merge and 
block automerging
   - `@dependabot reopen` will reopen this PR if it is closed
   - `@dependabot close` will close this PR and stop Dependabot recreating it. 
You can achieve the same result by closing it manually
   - `@dependabot show  ignore conditions` will show all of 
the ignore conditions of the specified dependency
   - `@dependabot ignore this major version` will close this PR and stop 
Dependabot creating any more for this major version (unless you reopen the PR 
or upgrade to it yourself)
   - `@dependabot ignore this minor version` will close this PR and stop 
Dependabot creating any more for this minor version (unless you reopen the PR 
or upgrade to it yourself)
   - `@dependabot ignore this dependency` will close this PR and stop 
Dependabot creating any more for this dependency (unless you reopen the PR or 
upgrade to it yourself)
   You can disable automated security fix PRs for this repo from the [Security 
Alerts page](https://github.com/apache/nifi/network/alerts).
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] MINIFICPP-2248 Refactor string::join_pack [nifi-minifi-cpp]

2023-10-20 Thread via GitHub


szaszm commented on code in PR #1680:
URL: https://github.com/apache/nifi-minifi-cpp/pull/1680#discussion_r1367522637


##
CPPLINT.cfg:
##
@@ -1,2 +1,2 @@
 set noparent
-filter=-runtime/reference,-runtime/string,-build/c++11,-build/include_subdir,-whitespace/forcolon,-build/namespaces_literals,-readability/check,-build/include_what_you_use,-readability/nolint
+filter=-runtime/reference,-runtime/string,-build/c++11,-build/include_subdir,-whitespace/forcolon,-build/namespaces_literals,-readability/check,-build/include_what_you_use,-readability/nolint,-readability/braces

Review Comment:
   To be honest, I have the feeling that we would be better off by dropping 
cpplint, and rely more on clang-tidy, especially as you recent changes in #1671 
get ready and do the google-specific checks.
   Too many false positives, and it looks outdated barely maintained. On the 
other hand, it runs much faster than clang-tidy.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] MINIFICPP-2248 Refactor string::join_pack [nifi-minifi-cpp]

2023-10-20 Thread via GitHub


szaszm commented on code in PR #1680:
URL: https://github.com/apache/nifi-minifi-cpp/pull/1680#discussion_r1367522637


##
CPPLINT.cfg:
##
@@ -1,2 +1,2 @@
 set noparent
-filter=-runtime/reference,-runtime/string,-build/c++11,-build/include_subdir,-whitespace/forcolon,-build/namespaces_literals,-readability/check,-build/include_what_you_use,-readability/nolint
+filter=-runtime/reference,-runtime/string,-build/c++11,-build/include_subdir,-whitespace/forcolon,-build/namespaces_literals,-readability/check,-build/include_what_you_use,-readability/nolint,-readability/braces

Review Comment:
   To be honest, I have the feeling that we would be better off by dropping 
cpplint, and rely more on clang-tidy, especially as you recent changes in #1671 
get ready and do the google-specific checks.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Comment Edited] (NIFI-11627) Add Dynamic Schema References to ValidateJSON Processor

2023-10-20 Thread Daniel Stieglitz (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1825#comment-1825
 ] 

Daniel Stieglitz edited comment on NIFI-11627 at 10/20/23 7:09 PM:
---

@[~markap14]  [~exceptionfactory] For the initial implementation for this 
Controller Interface, can 
{code:java}
org.apache.nifi.schemaregistry.services.SchemaRegistry{code}
be reused for this? Studying the code it seems AmazonGlueSchemaRegistry and 
ConfluentSchemaRegistry can be reused as they are not specific to any schema 
type but AvroSchemaRegistry cannot as it is specific to Avro. I assume in lieu 
of the AvroSchemaRegistry I would need to develop a JsonSchemaRegistry. If this 
is so where do I place this new ControllerService?

Please confirm. Thanks!


was (Author: JIRAUSER294662):
@[~markap14]  [~exceptionfactory] For the initial implementation for this 
Controller Interface, can 
{code:java}
org.apache.nifi.schemaregistry.services.SchemaRegistry{code}
be reused for this? Studying the code it seems AmazonGlueSchemaRegistry and 
ConfluentSchemaRegistry can be reused as they are not specific to any schema 
type but AvroSchemaRegistry cannot as it is specific to Avro. I assume in lieu 
of the AvroSchemaRegistry I would need to develop a JsonSchemaRegistry.

Please confirm. Thanks!

> Add Dynamic Schema References to ValidateJSON Processor
> ---
>
> Key: NIFI-11627
> URL: https://issues.apache.org/jira/browse/NIFI-11627
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Affects Versions: 1.19.1
>Reporter: Chuck Tilly
>Assignee: Daniel Stieglitz
>Priority: Major
>
> For the ValidateJSON processor, add support for flowfile attribute references 
> that will allow for a JSON schema located in the Parameter Contexts, to be 
> referenced dynamically based on a flowfile attribute. e.g. 
> {code:java}
> #{${schema.name}} {code}
>  
> The benefits of adding support for attribute references are significant.  
> Adding this capability will allow a single processor to be used for all JSON 
> schema validation.  Unfortunately, the current version of this processor 
> requires a dedicated processor for every schema, i.e. 12 schemas requires 12 
> ValidateJSON processors.  This is very laborious to construct and maintain, 
> and resource expensive.  
> ValidateJSON processor (https://issues.apache.org/jira/browse/NIFI-7392)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (NIFI-11627) Add Dynamic Schema References to ValidateJSON Processor

2023-10-20 Thread Daniel Stieglitz (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1825#comment-1825
 ] 

Daniel Stieglitz edited comment on NIFI-11627 at 10/20/23 7:08 PM:
---

@[~markap14]  [~exceptionfactory] For the initial implementation for this 
Controller Interface, can 
{code:java}
org.apache.nifi.schemaregistry.services.SchemaRegistry{code}
be reused for this? Studying the code it seems AmazonGlueSchemaRegistry and 
ConfluentSchemaRegistry can be reused as they are not specific to any schema 
type but AvroSchemaRegistry cannot as it is specific to Avro. I assume in lieu 
of the AvroSchemaRegistry I would need to develop a JsonSchemaRegistry.

Please confirm. Thanks!


was (Author: JIRAUSER294662):
@[~markap14]  [~exceptionfactory] For the initial implementation for this 
Controller Interface, can 
{code:java}
org.apache.nifi.schemaregistry.services.SchemaRegistry{code}
be reused for this?

> Add Dynamic Schema References to ValidateJSON Processor
> ---
>
> Key: NIFI-11627
> URL: https://issues.apache.org/jira/browse/NIFI-11627
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Affects Versions: 1.19.1
>Reporter: Chuck Tilly
>Assignee: Daniel Stieglitz
>Priority: Major
>
> For the ValidateJSON processor, add support for flowfile attribute references 
> that will allow for a JSON schema located in the Parameter Contexts, to be 
> referenced dynamically based on a flowfile attribute. e.g. 
> {code:java}
> #{${schema.name}} {code}
>  
> The benefits of adding support for attribute references are significant.  
> Adding this capability will allow a single processor to be used for all JSON 
> schema validation.  Unfortunately, the current version of this processor 
> requires a dedicated processor for every schema, i.e. 12 schemas requires 12 
> ValidateJSON processors.  This is very laborious to construct and maintain, 
> and resource expensive.  
> ValidateJSON processor (https://issues.apache.org/jira/browse/NIFI-7392)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (NIFI-11627) Add Dynamic Schema References to ValidateJSON Processor

2023-10-20 Thread Daniel Stieglitz (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1825#comment-1825
 ] 

Daniel Stieglitz edited comment on NIFI-11627 at 10/20/23 7:01 PM:
---

@[~markap14]  [~exceptionfactory] For the initial implementation for this 
Controller Interface, can 
{code:java}
org.apache.nifi.schemaregistry.services.SchemaRegistry{code}
be reused for this?


was (Author: JIRAUSER294662):
@[~markap14]  [~exceptionfactory] For the initial implementation for this 
Controller Interface, can 
{code:java}
org.apache.nifi.schemaregistry.services.SchemaRegistry{code}
be reused for this?

> Add Dynamic Schema References to ValidateJSON Processor
> ---
>
> Key: NIFI-11627
> URL: https://issues.apache.org/jira/browse/NIFI-11627
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Affects Versions: 1.19.1
>Reporter: Chuck Tilly
>Assignee: Daniel Stieglitz
>Priority: Major
>
> For the ValidateJSON processor, add support for flowfile attribute references 
> that will allow for a JSON schema located in the Parameter Contexts, to be 
> referenced dynamically based on a flowfile attribute. e.g. 
> {code:java}
> #{${schema.name}} {code}
>  
> The benefits of adding support for attribute references are significant.  
> Adding this capability will allow a single processor to be used for all JSON 
> schema validation.  Unfortunately, the current version of this processor 
> requires a dedicated processor for every schema, i.e. 12 schemas requires 12 
> ValidateJSON processors.  This is very laborious to construct and maintain, 
> and resource expensive.  
> ValidateJSON processor (https://issues.apache.org/jira/browse/NIFI-7392)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-11874) Reorganize UI presentation of Process Group configuration

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-11874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1911#comment-1911
 ] 

ASF subversion and git services commented on NIFI-11874:


Commit 0e806a19a18024c495516cd0f0f276a959fc328f in nifi's branch 
refs/heads/support/nifi-1.x from markobean
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=0e806a19a1 ]

NIFI-11874: update process group configuration dialog UI, specific to nifi-1.x 
line (#7844)

This closes #7844 

> Reorganize UI presentation of Process Group configuration
> -
>
> Key: NIFI-11874
> URL: https://issues.apache.org/jira/browse/NIFI-11874
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core UI
>Affects Versions: 1.23.0
>Reporter: Mark Bean
>Assignee: Mark Bean
>Priority: Major
>  Time Spent: 5.5h
>  Remaining Estimate: 0h
>
> When configuring a Process Group, the configuration options scroll off the 
> screen. Of course, this depends on the user's display resolution. However, on 
> many common display configurations, this results in the options scrolling off 
> a single screen view. 
> Recommend creating two columns of configuration settings so they are more 
> likely to fit on a single dialog window without needing to scroll - in 
> particular the "Apply" button.
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-11874: update process group configuration dialog UI, specific to nifi-1.x line [nifi]

2023-10-20 Thread via GitHub


mcgilman merged PR #7844:
URL: https://github.com/apache/nifi/pull/7844


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Updated] (NIFI-12260) UI - Remove leftover templates code from frontend

2023-10-20 Thread Shane Ardell (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shane Ardell updated NIFI-12260:

Description: NIFI-12006 ([https://github.com/apache/nifi/pull/7658]) 
removed templates from NiFi, but there is still some leftover code related to 
templates in the frontend code.  (was: NIFI-12006 
(https://github.com/apache/nifi/pull/7658) removed templates from NiFi, but 
there is still some leftover code related to templates in the frontend code.)

> UI - Remove leftover templates code from frontend
> -
>
> Key: NIFI-12260
> URL: https://issues.apache.org/jira/browse/NIFI-12260
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core UI
>Reporter: Shane Ardell
>Assignee: Shane Ardell
>Priority: Major
> Fix For: 2.0.0
>
>
> NIFI-12006 ([https://github.com/apache/nifi/pull/7658]) removed templates 
> from NiFi, but there is still some leftover code related to templates in the 
> frontend code.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (NIFI-12260) UI - Remove leftover templates code from frontend

2023-10-20 Thread Shane Ardell (Jira)
Shane Ardell created NIFI-12260:
---

 Summary: UI - Remove leftover templates code from frontend
 Key: NIFI-12260
 URL: https://issues.apache.org/jira/browse/NIFI-12260
 Project: Apache NiFi
  Issue Type: Improvement
  Components: Core UI
Reporter: Shane Ardell
Assignee: Shane Ardell
 Fix For: 2.0.0


NIFI-12006 (https://github.com/apache/nifi/pull/7658) removed templates from 
NiFi, but there is still some leftover code related to templates in the 
frontend code.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (NIFI-12246) Bump @babel/traverse version

2023-10-20 Thread Matt Gilman (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matt Gilman resolved NIFI-12246.

Resolution: Fixed

> Bump @babel/traverse version
> 
>
> Key: NIFI-12246
> URL: https://issues.apache.org/jira/browse/NIFI-12246
> Project: Apache NiFi
>  Issue Type: Task
>Reporter: Matt Gilman
>Priority: Major
> Fix For: 2.0.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> https://github.com/apache/nifi/pull/7897



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-12246 - Bump @babel/traverse from 7.21.2 to 7.23.2 in /nifi-registry/nifi-registry-core/nifi-registry-web-ui/src/main [nifi]

2023-10-20 Thread via GitHub


mcgilman merged PR #7897:
URL: https://github.com/apache/nifi/pull/7897


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11463 Allow IdentifyMimeType to use custom MIME types in addition to defaults [nifi]

2023-10-20 Thread via GitHub


NissimShiman commented on PR #7781:
URL: https://github.com/apache/nifi/pull/7781#issuecomment-1773201080

   Thank you @exceptionfactory for all the cycles spent to improve this PR and 
for pointing out the new `migrateProperties()` feature  This is really neat 
addition.
   
   Unfortunately I am running into some undesired behaviour when trying to 
implement.
   
   The code is:
   ```
@Override
   public void migrateProperties(PropertyConfiguration config) {
   if (!config.hasProperty(CONFIG_STRATEGY)) {
   if (config.isPropertySet(MIME_CONFIG_FILE) || 
config.isPropertySet(MIME_CONFIG_BODY)) {
   config.setProperty(CONFIG_STRATEGY, REPLACE.getValue());
   }
   }
   }
   ```
   
   For some reason, the first `if` is always evaluating as false, even when 
migrating from a 1.x flow.
   
   Still looking into this.
   
   (The first `if` needs to be there as `PRESET` can have `CONFIG_BODY` / 
`CONFIG_FILE`, set but they will be ignored.  Without the first `if`, these 
will become `REPLACE` on a nifi bounce.) 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Comment Edited] (NIFI-11627) Add Dynamic Schema References to ValidateJSON Processor

2023-10-20 Thread Daniel Stieglitz (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1825#comment-1825
 ] 

Daniel Stieglitz edited comment on NIFI-11627 at 10/20/23 6:06 PM:
---

@[~markap14]  [~exceptionfactory] For the initial implementation for this 
Controller Interface, can 
{code:java}
org.apache.nifi.schemaregistry.services.SchemaRegistry{code}
be reused for this?


was (Author: JIRAUSER294662):
@[~markap14]  [~exceptionfactory] For the initial implementation for this 
Controller Interface, would an in memory map similar to the AvroSchemaRegistry 
be okay?

Can 
{code:java}
org.apache.nifi.schemaregistry.services.SchemaRegistry{code}
be reused for this?

> Add Dynamic Schema References to ValidateJSON Processor
> ---
>
> Key: NIFI-11627
> URL: https://issues.apache.org/jira/browse/NIFI-11627
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Affects Versions: 1.19.1
>Reporter: Chuck Tilly
>Assignee: Daniel Stieglitz
>Priority: Major
>
> For the ValidateJSON processor, add support for flowfile attribute references 
> that will allow for a JSON schema located in the Parameter Contexts, to be 
> referenced dynamically based on a flowfile attribute. e.g. 
> {code:java}
> #{${schema.name}} {code}
>  
> The benefits of adding support for attribute references are significant.  
> Adding this capability will allow a single processor to be used for all JSON 
> schema validation.  Unfortunately, the current version of this processor 
> requires a dedicated processor for every schema, i.e. 12 schemas requires 12 
> ValidateJSON processors.  This is very laborious to construct and maintain, 
> and resource expensive.  
> ValidateJSON processor (https://issues.apache.org/jira/browse/NIFI-7392)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-11874: update process group configuration dialog UI, specific to nifi-1.x line [nifi]

2023-10-20 Thread via GitHub


mcgilman commented on PR #7844:
URL: https://github.com/apache/nifi/pull/7844#issuecomment-1773151007

   Reviewing...


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11874 update Process Group configuration layout in the UI [nifi]

2023-10-20 Thread via GitHub


markobean commented on code in PR #7591:
URL: https://github.com/apache/nifi/pull/7591#discussion_r1367330143


##
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/src/main/webapp/css/process-group-configuration.css:
##
@@ -87,7 +95,6 @@
 }
 
 #parameter-contexts-recursive-container {
-float: left;

Review Comment:
   Thanks @mcgilman !
   
   Would you mind taking a look/merging the PR for nifi-1.x as well so this can 
get into the 1.24.0 release?
   #7844 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11874 update Process Group configuration layout in the UI [nifi]

2023-10-20 Thread via GitHub


mcgilman commented on PR #7591:
URL: https://github.com/apache/nifi/pull/7591#issuecomment-1773149872

   @exceptionfactory CI was apparently not run because you had requested 
changes. I just manually triggered it. I plan to merge this one once CI 
completes unless you had any other concerns. Thanks! 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11874 update Process Group configuration layout in the UI [nifi]

2023-10-20 Thread via GitHub


mcgilman commented on code in PR #7591:
URL: https://github.com/apache/nifi/pull/7591#discussion_r1367328075


##
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/src/main/webapp/css/process-group-configuration.css:
##
@@ -87,7 +95,6 @@
 }
 
 #parameter-contexts-recursive-container {
-float: left;

Review Comment:
   I see. It is because the elements inside 
`parameter-contexts-recursive-container` are floated left. It would probably be 
clearer if the `div.clear` were the last element in that element but it's ok. 
I'll merge this one. Thanks again for the PR!



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11874 update Process Group configuration layout in the UI [nifi]

2023-10-20 Thread via GitHub


mcgilman commented on code in PR #7591:
URL: https://github.com/apache/nifi/pull/7591#discussion_r1367323039


##
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/src/main/webapp/css/process-group-configuration.css:
##
@@ -87,7 +95,6 @@
 }
 
 #parameter-contexts-recursive-container {
-float: left;

Review Comment:
   I'll take a look. But if nothing is floating (which should be the case now) 
then there should be no need to clear. But maybe I missed something else. 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Updated] (NIFI-12239) Print basic OS/Java details in bootstrap log file

2023-10-20 Thread David Handermann (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Handermann updated NIFI-12239:

Fix Version/s: 2.0.0
   1.24.0
   (was: 1.latest)
   (was: 2.latest)
   Resolution: Fixed
   Status: Resolved  (was: Patch Available)

> Print basic OS/Java details in bootstrap log file
> -
>
> Key: NIFI-12239
> URL: https://issues.apache.org/jira/browse/NIFI-12239
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core Framework
>Reporter: Pierre Villard
>Assignee: Pierre Villard
>Priority: Major
> Fix For: 2.0.0, 1.24.0
>
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> The goal here is to add a log line in the bootstrap.log file when NiFi starts 
> that is printing some basic OS/Java details. On busy clusters, nifi-app.log 
> may be rolling over quickly and/or contain huge amount of data. Adding this 
> data in the bootstrap log file makes it easy to retrieve.
> The associated PR will add a log line as below:
> {code:java}
> 2023-10-17 17:26:33,501 INFO [main] org.apache.nifi.bootstrap.RunNiFi 
> {"javaVersion":"21","cores":16,"totalPhysicalMemoryMB":16384,"maxOpenFileDescriptors":10240,"xms":"1g","xmx":"1g"}
>  {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-12239) Print basic OS/Java details in bootstrap log file

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1888#comment-1888
 ] 

ASF subversion and git services commented on NIFI-12239:


Commit 17738df3b06c4fb7933dfc59281857016fbccfe6 in nifi's branch 
refs/heads/support/nifi-1.x from Pierre Villard
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=17738df3b0 ]

NIFI-12239 Add OS and Java details at startup in bootstrap log

This closes #7891

Signed-off-by: David Handermann 

(cherry picked from commit e4e2336ebe022ee8f42cd29b52d6e210c9ceb24c)


> Print basic OS/Java details in bootstrap log file
> -
>
> Key: NIFI-12239
> URL: https://issues.apache.org/jira/browse/NIFI-12239
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core Framework
>Reporter: Pierre Villard
>Assignee: Pierre Villard
>Priority: Major
> Fix For: 1.latest, 2.latest
>
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> The goal here is to add a log line in the bootstrap.log file when NiFi starts 
> that is printing some basic OS/Java details. On busy clusters, nifi-app.log 
> may be rolling over quickly and/or contain huge amount of data. Adding this 
> data in the bootstrap log file makes it easy to retrieve.
> The associated PR will add a log line as below:
> {code:java}
> 2023-10-17 17:26:33,501 INFO [main] org.apache.nifi.bootstrap.RunNiFi 
> {"javaVersion":"21","cores":16,"totalPhysicalMemoryMB":16384,"maxOpenFileDescriptors":10240,"xms":"1g","xmx":"1g"}
>  {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-12239 - Add OS/Java details at startup in bootstrap log [nifi]

2023-10-20 Thread via GitHub


exceptionfactory closed pull request #7891: NIFI-12239 - Add OS/Java details at 
startup in bootstrap log
URL: https://github.com/apache/nifi/pull/7891


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Commented] (NIFI-12239) Print basic OS/Java details in bootstrap log file

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1885#comment-1885
 ] 

ASF subversion and git services commented on NIFI-12239:


Commit e4e2336ebe022ee8f42cd29b52d6e210c9ceb24c in nifi's branch 
refs/heads/main from Pierre Villard
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=e4e2336ebe ]

NIFI-12239 Add OS and Java details at startup in bootstrap log

This closes #7891

Signed-off-by: David Handermann 


> Print basic OS/Java details in bootstrap log file
> -
>
> Key: NIFI-12239
> URL: https://issues.apache.org/jira/browse/NIFI-12239
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core Framework
>Reporter: Pierre Villard
>Assignee: Pierre Villard
>Priority: Major
> Fix For: 1.latest, 2.latest
>
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> The goal here is to add a log line in the bootstrap.log file when NiFi starts 
> that is printing some basic OS/Java details. On busy clusters, nifi-app.log 
> may be rolling over quickly and/or contain huge amount of data. Adding this 
> data in the bootstrap log file makes it easy to retrieve.
> The associated PR will add a log line as below:
> {code:java}
> 2023-10-17 17:26:33,501 INFO [main] org.apache.nifi.bootstrap.RunNiFi 
> {"javaVersion":"21","cores":16,"totalPhysicalMemoryMB":16384,"maxOpenFileDescriptors":10240,"xms":"1g","xmx":"1g"}
>  {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NIFI-12259) Upgrade Santuario XML to 2.3.4

2023-10-20 Thread David Handermann (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Handermann updated NIFI-12259:

Status: Patch Available  (was: Open)

> Upgrade Santuario XML to 2.3.4
> --
>
> Key: NIFI-12259
> URL: https://issues.apache.org/jira/browse/NIFI-12259
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core Framework
>Reporter: David Handermann
>Assignee: David Handermann
>Priority: Major
>  Labels: dependency-upgrade
> Fix For: 2.0.0, 1.24.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Apache Santuario 2.3.4 includes a resolution for CVE-2023-44483, which 
> relates to logging sensitive private key information at the debug level. 
> Spring Security SAML2 has a dependency on Apache Santuario, which should be 
> upgraded.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[PR] NIFI-12259 Upgrade Apache Santuario from 2.3.3 to 2.3.4 [nifi]

2023-10-20 Thread via GitHub


exceptionfactory opened a new pull request, #7916:
URL: https://github.com/apache/nifi/pull/7916

   # Summary
   
   [NIFI-12259](https://issues.apache.org/jira/browse/NIFI-12259) Upgrades 
Apache Santuario XML Security from 2.3.3 to 2.3.4 to resolve CVE-2023-44483, 
related to sensitive information disclosure in debug log messages.
   
   This upgrade applies to both main and support branches.
   
   # Tracking
   
   Please complete the following tracking steps prior to pull request creation.
   
   ### Issue Tracking
   
   - [X] [Apache NiFi Jira](https://issues.apache.org/jira/browse/NIFI) issue 
created
   
   ### Pull Request Tracking
   
   - [X] Pull Request title starts with Apache NiFi Jira issue number, such as 
`NIFI-0`
   - [X] Pull Request commit message starts with Apache NiFi Jira issue number, 
as such `NIFI-0`
   
   ### Pull Request Formatting
   
   - [X] Pull Request based on current revision of the `main` branch
   - [X] Pull Request refers to a feature branch with one commit containing 
changes
   
   # Verification
   
   Please indicate the verification steps performed prior to pull request 
creation.
   
   ### Build
   
   - [X] Build completed using `mvn clean install -P contrib-check`
 - [X] JDK 21
   
   ### Licensing
   
   - [ ] New dependencies are compatible with the [Apache License 
2.0](https://apache.org/licenses/LICENSE-2.0) according to the [License 
Policy](https://www.apache.org/legal/resolved.html)
   - [ ] New dependencies are documented in applicable `LICENSE` and `NOTICE` 
files
   
   ### Documentation
   
   - [ ] Documentation formatting appears as expected in rendered files
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Created] (NIFI-12259) Upgrade Santuario XML to 2.3.4

2023-10-20 Thread David Handermann (Jira)
David Handermann created NIFI-12259:
---

 Summary: Upgrade Santuario XML to 2.3.4
 Key: NIFI-12259
 URL: https://issues.apache.org/jira/browse/NIFI-12259
 Project: Apache NiFi
  Issue Type: Improvement
  Components: Core Framework
Reporter: David Handermann
Assignee: David Handermann
 Fix For: 2.0.0, 1.24.0


Apache Santuario 2.3.4 includes a resolution for CVE-2023-44483, which relates 
to logging sensitive private key information at the debug level. Spring 
Security SAML2 has a dependency on Apache Santuario, which should be upgraded.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-8606 Added Stop & Configure button to the Controller Services De… [nifi]

2023-10-20 Thread via GitHub


mosermw commented on PR #7562:
URL: https://github.com/apache/nifi/pull/7562#issuecomment-1773061142

   I tested this on the support/nifi-1.x branch and this code works as expected 
there, too.
   
   I would still like another javascript dev to review this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11197 Initial check in for Yaml record reader [nifi]

2023-10-20 Thread via GitHub


exceptionfactory commented on code in PR #7665:
URL: https://github.com/apache/nifi/pull/7665#discussion_r1367234754


##
nifi-nar-bundles/nifi-extension-utils/nifi-record-utils/nifi-json-record-utils/src/main/java/org/apache/nifi/json/JsonParserFactory.java:
##
@@ -23,27 +23,20 @@
 
 import java.io.IOException;
 import java.io.InputStream;
+import java.util.Objects;
 
-public class JsonParserFactory implements TokenParserFactory{
-private static final JsonFactory JSON_FACTORY = new JsonFactory();
-private static final ObjectMapper JSON_MAPPER = new ObjectMapper();
-
+public class JsonParserFactory implements TokenParserFactory {
 @Override
-public JsonParser getJsonParser(InputStream in) throws IOException {
-JsonParser jsonParser = JSON_FACTORY.createParser(in);
-jsonParser.setCodec(JSON_MAPPER);
-
-return jsonParser;
-}
+public JsonParser getJsonParser(final InputStream in, final 
StreamReadConstraints streamReadConstraints, final boolean allowComments) 
throws IOException {
+Objects.requireNonNull(in, "Input Stream required");
+Objects.requireNonNull(streamReadConstraints, "Stream Read Constraints 
required");
 
-@Override
-public ObjectMapper createCodec(boolean allowComments, 
StreamReadConstraints streamReadConstraints) {
-ObjectMapper codec = new ObjectMapper();
-if(allowComments) {
-codec.enable(JsonParser.Feature.ALLOW_COMMENTS);
+final ObjectMapper objectMapper = new ObjectMapper();
+
objectMapper.getFactory().setStreamReadConstraints(streamReadConstraints);
+if (allowComments) {
+objectMapper.enable(JsonParser.Feature.ALLOW_COMMENTS);
 }
-codec.getFactory().setStreamReadConstraints(streamReadConstraints);
-
-return codec;
+final JsonFactory jsonFactory = objectMapper.getFactory();
+return jsonFactory.createParser(in);

Review Comment:
   Thanks for noting the previous approach. The line calling `setCodec()` was 
unchanged in the most recent updates for NIFI-12153, but it actually should 
have been removed as part of the changes to incorporate the constraint 
settings. So in this case, it is an opportunity to correct the implementation.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Commented] (NIFI-12258) Upgrade SSHD to 2.11.0

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1857#comment-1857
 ] 

ASF subversion and git services commented on NIFI-12258:


Commit f9615414bd750621977de7386eaa3a64019fa6a8 in nifi's branch 
refs/heads/main from David Handermann
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=f9615414bd ]

NIFI-12258 Upgraded MINA SSHD from 2.10.0 to 2.11.0

Signed-off-by: Pierre Villard 

This closes #7915.


> Upgrade SSHD to 2.11.0
> --
>
> Key: NIFI-12258
> URL: https://issues.apache.org/jira/browse/NIFI-12258
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: NiFi Registry
>Reporter: David Handermann
>Assignee: David Handermann
>Priority: Major
>  Labels: dependency-upgrade
> Fix For: 2.0.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Apache MINA SSHD dependencies should be upgraded to 2.11.0 on the main branch 
> to mitgate CVE-2023-35887. The vulnerability applies to SFTP server 
> implementations and is not directly applicable to transitive usage in NiFi 
> Registry, but upgrading mitigates version-based vulnerability findings.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NIFI-12258) Upgrade SSHD to 2.11.0

2023-10-20 Thread Pierre Villard (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pierre Villard updated NIFI-12258:
--
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> Upgrade SSHD to 2.11.0
> --
>
> Key: NIFI-12258
> URL: https://issues.apache.org/jira/browse/NIFI-12258
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: NiFi Registry
>Reporter: David Handermann
>Assignee: David Handermann
>Priority: Major
>  Labels: dependency-upgrade
> Fix For: 2.0.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Apache MINA SSHD dependencies should be upgraded to 2.11.0 on the main branch 
> to mitgate CVE-2023-35887. The vulnerability applies to SFTP server 
> implementations and is not directly applicable to transitive usage in NiFi 
> Registry, but upgrading mitigates version-based vulnerability findings.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-12258 Upgrade MINA SSHD from 2.10.0 to 2.11.0 for Main Branch [nifi]

2023-10-20 Thread via GitHub


asfgit closed pull request #7915: NIFI-12258 Upgrade MINA SSHD from 2.10.0 to 
2.11.0 for Main Branch
URL: https://github.com/apache/nifi/pull/7915


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] MINIFICPP-1891 Integrate google clang-tidy checks in CI [nifi-minifi-cpp]

2023-10-20 Thread via GitHub


fgerlits commented on code in PR #1671:
URL: https://github.com/apache/nifi-minifi-cpp/pull/1671#discussion_r1367165495


##
libminifi/src/core/ProcessSession.cpp:
##
@@ -175,7 +175,7 @@ std::shared_ptr 
ProcessSession::cloneDuringTransfer(const std::s
 }
 
 std::shared_ptr ProcessSession::clone(const 
std::shared_ptr , int64_t offset, int64_t size) {
-  if ((uint64_t) (offset + size) > parent->getSize()) {
+  if (static_cast(offset + size) > parent->getSize()) {

Review Comment:
   I would use `gsl::narrow` here, too



##
extensions/sftp/tests/PutSFTPTests.cpp:
##
@@ -201,7 +201,7 @@ class PutSFTPTestsFixture {
 
 namespace {
 std::size_t directoryContentCount(const std::filesystem::path& dir) {
-  return (std::size_t)std::distance(std::filesystem::directory_iterator{dir}, 
std::filesystem::directory_iterator{});
+  return 
static_cast(std::distance(std::filesystem::directory_iterator{dir},
 std::filesystem::directory_iterator{}));

Review Comment:
   `gsl::narrow` may be more appropriate here: if the distance is negative for 
some strange reason, it's better to crash than to return a huge number



##
libminifi/src/core/flow/StructuredConfiguration.cpp:
##
@@ -266,10 +266,10 @@ void StructuredConfiguration::parseProcessorNode(const 
Node& processors_node, co
   logger_->log_debug("setting scheduling strategy as {}", 
procCfg.schedulingStrategy);
 }
 
-int32_t maxConcurrentTasks;
+int32_t maxConcurrentTasks = 0;
 if (core::Property::StringToInt(procCfg.maxConcurrentTasks, 
maxConcurrentTasks)) {
   logger_->log_debug("parseProcessorNode: maxConcurrentTasks => [{}]", 
maxConcurrentTasks);
-  processor->setMaxConcurrentTasks((uint8_t) maxConcurrentTasks);
+  
processor->setMaxConcurrentTasks(static_cast(maxConcurrentTasks));
 }

Review Comment:
   would
   ```c++
   uint8_t maxConcurrentTasks;
   if (core::Property::StringToInt(procCfg.maxConcurrentTasks, 
maxConcurrentTasks)) {
 logger_->log_debug("parseProcessorNode: maxConcurrentTasks => [{}]", 
maxConcurrentTasks);
 processor->setMaxConcurrentTasks(maxConcurrentTasks);
   }
   ```
   work?  I think that would be better, if it works.



##
libminifi/src/provenance/Provenance.cpp:
##
@@ -249,17 +249,17 @@ bool ProvenanceEventRecord::deserialize(io::InputStream 
_stream) {
 }
   }
 
-  uint32_t eventType;
+  uint32_t eventType = 0;
   {
 const auto ret = input_stream.read(eventType);
 if (ret != 4) {
   return false;
 }
   }
 
-  this->_eventType = (ProvenanceEventRecord::ProvenanceEventType) eventType;
+  _eventType = 
static_cast(eventType);

Review Comment:
   we could check this:
   ```suggestion
 if (auto event_type_opt = 
magic_enum::enum_cast(eventType)) {
   _eventType = *event_type_opt;
 } else {
   return false;
 }
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11197 Initial check in for Yaml record reader [nifi]

2023-10-20 Thread via GitHub


dan-s1 commented on code in PR #7665:
URL: https://github.com/apache/nifi/pull/7665#discussion_r1367185418


##
nifi-nar-bundles/nifi-extension-utils/nifi-record-utils/nifi-json-record-utils/src/main/java/org/apache/nifi/json/JsonParserFactory.java:
##
@@ -23,27 +23,20 @@
 
 import java.io.IOException;
 import java.io.InputStream;
+import java.util.Objects;
 
-public class JsonParserFactory implements TokenParserFactory{
-private static final JsonFactory JSON_FACTORY = new JsonFactory();
-private static final ObjectMapper JSON_MAPPER = new ObjectMapper();
-
+public class JsonParserFactory implements TokenParserFactory {
 @Override
-public JsonParser getJsonParser(InputStream in) throws IOException {
-JsonParser jsonParser = JSON_FACTORY.createParser(in);
-jsonParser.setCodec(JSON_MAPPER);
-
-return jsonParser;
-}
+public JsonParser getJsonParser(final InputStream in, final 
StreamReadConstraints streamReadConstraints, final boolean allowComments) 
throws IOException {
+Objects.requireNonNull(in, "Input Stream required");
+Objects.requireNonNull(streamReadConstraints, "Stream Read Constraints 
required");
 
-@Override
-public ObjectMapper createCodec(boolean allowComments, 
StreamReadConstraints streamReadConstraints) {
-ObjectMapper codec = new ObjectMapper();
-if(allowComments) {
-codec.enable(JsonParser.Feature.ALLOW_COMMENTS);
+final ObjectMapper objectMapper = new ObjectMapper();
+
objectMapper.getFactory().setStreamReadConstraints(streamReadConstraints);
+if (allowComments) {
+objectMapper.enable(JsonParser.Feature.ALLOW_COMMENTS);
 }
-codec.getFactory().setStreamReadConstraints(streamReadConstraints);
-
-return codec;
+final JsonFactory jsonFactory = objectMapper.getFactory();
+return jsonFactory.createParser(in);

Review Comment:
   In the previous code also the `JsonFactory` was coming from the 
`ObjectMapper`and yet `setCodec` was still called. See the previous line 145:
`jsonParser = codec.getFactory().createParser(in);`
   
   



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11197 Initial check in for Yaml record reader [nifi]

2023-10-20 Thread via GitHub


exceptionfactory commented on code in PR #7665:
URL: https://github.com/apache/nifi/pull/7665#discussion_r1367180160


##
nifi-nar-bundles/nifi-extension-utils/nifi-record-utils/nifi-json-record-utils/src/main/java/org/apache/nifi/json/JsonRecordSource.java:
##
@@ -29,6 +30,11 @@
 
 public class JsonRecordSource implements RecordSource {
 private static final Logger logger = 
LoggerFactory.getLogger(JsonRecordSource.class);

Review Comment:
   There have been discussions in the past around casing for the `Logger` in 
particular. The general trend is having the `logger` lowercase, even when 
static, but of course actual constants should be uppercase.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11197 Initial check in for Yaml record reader [nifi]

2023-10-20 Thread via GitHub


exceptionfactory commented on code in PR #7665:
URL: https://github.com/apache/nifi/pull/7665#discussion_r1367179198


##
nifi-nar-bundles/nifi-extension-utils/nifi-record-utils/nifi-json-record-utils/src/main/java/org/apache/nifi/json/JsonParserFactory.java:
##
@@ -23,27 +23,20 @@
 
 import java.io.IOException;
 import java.io.InputStream;
+import java.util.Objects;
 
-public class JsonParserFactory implements TokenParserFactory{
-private static final JsonFactory JSON_FACTORY = new JsonFactory();
-private static final ObjectMapper JSON_MAPPER = new ObjectMapper();
-
+public class JsonParserFactory implements TokenParserFactory {
 @Override
-public JsonParser getJsonParser(InputStream in) throws IOException {
-JsonParser jsonParser = JSON_FACTORY.createParser(in);
-jsonParser.setCodec(JSON_MAPPER);
-
-return jsonParser;
-}
+public JsonParser getJsonParser(final InputStream in, final 
StreamReadConstraints streamReadConstraints, final boolean allowComments) 
throws IOException {
+Objects.requireNonNull(in, "Input Stream required");
+Objects.requireNonNull(streamReadConstraints, "Stream Read Constraints 
required");
 
-@Override
-public ObjectMapper createCodec(boolean allowComments, 
StreamReadConstraints streamReadConstraints) {
-ObjectMapper codec = new ObjectMapper();
-if(allowComments) {
-codec.enable(JsonParser.Feature.ALLOW_COMMENTS);
+final ObjectMapper objectMapper = new ObjectMapper();
+
objectMapper.getFactory().setStreamReadConstraints(streamReadConstraints);
+if (allowComments) {
+objectMapper.enable(JsonParser.Feature.ALLOW_COMMENTS);
 }
-codec.getFactory().setStreamReadConstraints(streamReadConstraints);
-
-return codec;
+final JsonFactory jsonFactory = objectMapper.getFactory();
+return jsonFactory.createParser(in);

Review Comment:
   Setting the codec is not necessary because the `JsonFactory` is coming from 
the `ObjectMapper`, as opposed to the other way around.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11197 Initial check in for Yaml record reader [nifi]

2023-10-20 Thread via GitHub


dan-s1 commented on code in PR #7665:
URL: https://github.com/apache/nifi/pull/7665#discussion_r1367170067


##
nifi-nar-bundles/nifi-extension-utils/nifi-record-utils/nifi-json-record-utils/src/main/java/org/apache/nifi/json/JsonRecordSource.java:
##
@@ -29,6 +30,11 @@
 
 public class JsonRecordSource implements RecordSource {
 private static final Logger logger = 
LoggerFactory.getLogger(JsonRecordSource.class);

Review Comment:
   If the added static final private variables below are uppercase, this should 
also be for consistency.



##
nifi-nar-bundles/nifi-extension-utils/nifi-record-utils/nifi-json-record-utils/src/main/java/org/apache/nifi/json/JsonParserFactory.java:
##
@@ -23,27 +23,20 @@
 
 import java.io.IOException;
 import java.io.InputStream;
+import java.util.Objects;
 
-public class JsonParserFactory implements TokenParserFactory{
-private static final JsonFactory JSON_FACTORY = new JsonFactory();
-private static final ObjectMapper JSON_MAPPER = new ObjectMapper();
-
+public class JsonParserFactory implements TokenParserFactory {
 @Override
-public JsonParser getJsonParser(InputStream in) throws IOException {
-JsonParser jsonParser = JSON_FACTORY.createParser(in);
-jsonParser.setCodec(JSON_MAPPER);
-
-return jsonParser;
-}
+public JsonParser getJsonParser(final InputStream in, final 
StreamReadConstraints streamReadConstraints, final boolean allowComments) 
throws IOException {
+Objects.requireNonNull(in, "Input Stream required");
+Objects.requireNonNull(streamReadConstraints, "Stream Read Constraints 
required");
 
-@Override
-public ObjectMapper createCodec(boolean allowComments, 
StreamReadConstraints streamReadConstraints) {
-ObjectMapper codec = new ObjectMapper();
-if(allowComments) {
-codec.enable(JsonParser.Feature.ALLOW_COMMENTS);
+final ObjectMapper objectMapper = new ObjectMapper();
+
objectMapper.getFactory().setStreamReadConstraints(streamReadConstraints);
+if (allowComments) {
+objectMapper.enable(JsonParser.Feature.ALLOW_COMMENTS);
 }
-codec.getFactory().setStreamReadConstraints(streamReadConstraints);
-
-return codec;
+final JsonFactory jsonFactory = objectMapper.getFactory();
+return jsonFactory.createParser(in);

Review Comment:
   The previous code in `AbstractJsonRowRecordReader.java` formally on line 146 
when creating the jsonParser also called `setCodec`.  Shouldn't you have 
something similar here?
   Instead of
   ` return jsonFactory.createParser(in);`
   
   change to
   ```
   final JsonParser jsonParser = jsonFactory.createParser(in);
   jsonParser.setCodec(objectMapper);
   return jsonParser;
   ```



##
nifi-nar-bundles/nifi-extension-utils/nifi-record-utils/nifi-json-record-utils/src/main/java/org/apache/nifi/json/TokenParserFactory.java:
##
@@ -18,13 +18,19 @@
 
 import com.fasterxml.jackson.core.JsonParser;
 import com.fasterxml.jackson.core.StreamReadConstraints;
-import com.fasterxml.jackson.databind.ObjectMapper;
 
 import java.io.IOException;
 import java.io.InputStream;
 
 public interface TokenParserFactory {
-JsonParser getJsonParser(InputStream in) throws IOException;
-
-ObjectMapper createCodec(boolean allowComments, StreamReadConstraints 
streamReadConstraints);
+/**
+ * Get JSON Parser implementation for provided Input Stream with 
configured settings
+ *
+ * @param in Input Stream to be parsed
+ * @param streamReadConstraints Stream Read Constraints applied
+ * @param allowComments Whether to allow comments when parsing
+ * @return JSON Parser
+ * @throws IOException Thrown on failures ot read the Input Stream

Review Comment:
   Instead of
   `@throws IOException Thrown on failures ot read the Input Stream`
   this should be
   `@throws IOException Thrown on failures to read the Input Stream`



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Updated] (NIFI-12257) Upgrade SSHD to 2.9.3

2023-10-20 Thread Pierre Villard (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pierre Villard updated NIFI-12257:
--
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> Upgrade SSHD to 2.9.3
> -
>
> Key: NIFI-12257
> URL: https://issues.apache.org/jira/browse/NIFI-12257
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: NiFi Registry
>Reporter: David Handermann
>Assignee: David Handermann
>Priority: Major
> Fix For: 1.24.0
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Apache MINA SSHD dependencies should be upgraded to 2.9.3 on the support 
> branch to mitgate CVE-2023-35887. The vulnerability applies to SFTP server 
> implementations and is not directly applicable to transitive usage in NiFi 
> Registry, but upgrading mitigates version-based vulnerability findings.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-12257) Upgrade SSHD to 2.9.3

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1843#comment-1843
 ] 

ASF subversion and git services commented on NIFI-12257:


Commit f4722f4d300c3f000aa172f7ac224274238b716b in nifi's branch 
refs/heads/support/nifi-1.x from David Handermann
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=f4722f4d30 ]

NIFI-12257 Upgraded MINA SSHD from 2.9.2 to 2.9.3

- SSHD 2.9.3 applies to JGit 5 for Java 8
- Upgraded SSHD from 2.10.0 to 2.11.0 for test components

Signed-off-by: Pierre Villard 

This closes #7914.


> Upgrade SSHD to 2.9.3
> -
>
> Key: NIFI-12257
> URL: https://issues.apache.org/jira/browse/NIFI-12257
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: NiFi Registry
>Reporter: David Handermann
>Assignee: David Handermann
>Priority: Major
> Fix For: 1.24.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Apache MINA SSHD dependencies should be upgraded to 2.9.3 on the support 
> branch to mitgate CVE-2023-35887. The vulnerability applies to SFTP server 
> implementations and is not directly applicable to transitive usage in NiFi 
> Registry, but upgrading mitigates version-based vulnerability findings.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-12257 Upgrade MINA SSHD from 2.9.2 to 2.9.3 for Support Branch [nifi]

2023-10-20 Thread via GitHub


pvillard31 commented on PR #7914:
URL: https://github.com/apache/nifi/pull/7914#issuecomment-1772966777

   Merged to support branch


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12257 Upgrade MINA SSHD from 2.9.2 to 2.9.3 for Support Branch [nifi]

2023-10-20 Thread via GitHub


pvillard31 closed pull request #7914: NIFI-12257 Upgrade MINA SSHD from 2.9.2 
to 2.9.3 for Support Branch
URL: https://github.com/apache/nifi/pull/7914


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Commented] (NIFI-12087) Remove all deprecated items in the nifi-api

2023-10-20 Thread Mark Payne (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1841#comment-1841
 ] 

Mark Payne commented on NIFI-12087:
---

The last of these should be addressed by NIFI-12245, which has a PR up now.

> Remove all deprecated items in the nifi-api
> ---
>
> Key: NIFI-12087
> URL: https://issues.apache.org/jira/browse/NIFI-12087
> Project: Apache NiFi
>  Issue Type: Improvement
>Reporter: Joe Witt
>Assignee: Joe Witt
>Priority: Major
> Fix For: 2.0.0
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NIFI-8981) Review TODO Comments and Deprecations

2023-10-20 Thread Mark Payne (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Payne updated NIFI-8981:
-
Fix Version/s: 2.latest
   (was: 2.0.0)

> Review TODO Comments and Deprecations
> -
>
> Key: NIFI-8981
> URL: https://issues.apache.org/jira/browse/NIFI-8981
> Project: Apache NiFi
>  Issue Type: Task
>Reporter: Andrew Atwood
>Priority: Minor
> Fix For: 2.latest
>
>
> Once NiFi 2.0 plans are stable, all of the TODOs in the project should be 
> evaluated (Hopefully assignee's IDE can show all TODOs).
>  For example, currently Java 11 requirement is being planned for NiFi 2.0 
> release, and I find lots of TODO comments saying to remove something when 
> minimum Java version is 11.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NIFI-11170) Support Migration for Upgrading Flows to 2.0.0

2023-10-20 Thread David Handermann (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Handermann updated NIFI-11170:

Priority: Major  (was: Critical)

> Support Migration for Upgrading Flows to 2.0.0
> --
>
> Key: NIFI-11170
> URL: https://issues.apache.org/jira/browse/NIFI-11170
> Project: Apache NiFi
>  Issue Type: Epic
>Reporter: David Handermann
>Priority: Major
> Fix For: 2.latest
>
>
> Migration tools and documentation should be created to streamline the process 
> of upgrading to 2.0.0.
> Supporting migration includes the following priorities outlined in the [NiFi 
> 2.0 Release 
> Goals|https://cwiki.apache.org/confluence/display/NIFI/NiFi+2.0+Release+Goals]:
>  * Implement automated migration where possible to remap properties and 
> features
>  * Implement migration tools for manual conversion of XML Templates to JSON 
> Flow Definitions
>  * Create documentation for manual steps necessary where programmatic 
> migration cannot be implemented
>  * NiFi 2.0 should be capable of starting with ghosted components for removed 
> Processors or Controller Services



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NIFI-11170) Support Migration for Upgrading Flows to 2.0.0

2023-10-20 Thread David Handermann (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Handermann updated NIFI-11170:

Fix Version/s: 2.latest
   (was: 2.0.0)

> Support Migration for Upgrading Flows to 2.0.0
> --
>
> Key: NIFI-11170
> URL: https://issues.apache.org/jira/browse/NIFI-11170
> Project: Apache NiFi
>  Issue Type: Epic
>Reporter: David Handermann
>Priority: Critical
> Fix For: 2.latest
>
>
> Migration tools and documentation should be created to streamline the process 
> of upgrading to 2.0.0.
> Supporting migration includes the following priorities outlined in the [NiFi 
> 2.0 Release 
> Goals|https://cwiki.apache.org/confluence/display/NIFI/NiFi+2.0+Release+Goals]:
>  * Implement automated migration where possible to remap properties and 
> features
>  * Implement migration tools for manual conversion of XML Templates to JSON 
> Flow Definitions
>  * Create documentation for manual steps necessary where programmatic 
> migration cannot be implemented
>  * NiFi 2.0 should be capable of starting with ghosted components for removed 
> Processors or Controller Services



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NIFI-12242) Allow ControlRate to optionally route to a new 'rate exceeded' relationship instead of just slowing things down

2023-10-20 Thread Michael W Moser (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael W Moser updated NIFI-12242:
---
Fix Version/s: 2.0.0
   (was: 2.latest)
   Resolution: Fixed
   Status: Resolved  (was: Patch Available)

> Allow ControlRate to optionally route to a new 'rate exceeded' relationship 
> instead of just slowing things down
> ---
>
> Key: NIFI-12242
> URL: https://issues.apache.org/jira/browse/NIFI-12242
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Reporter: Mark Payne
>Assignee: Mark Payne
>Priority: Major
> Fix For: 2.0.0
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> ControlRate provides the ability to slow down the rate of data through the 
> system. This is important in cases where we want to avoid overwhelming a 
> downstream system. However, there are times when we don't want to just slow 
> down the flow of data but instead reject it if the rate is too high.
> Take, for example, the typical case with an HTTP Server that responds with a 
> 429: Too Many Requests status code. ControlRate should give us the option of 
> rejecting FlowFiles when they exceed the limit, not just slow everything down.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-11170) Support Migration for Upgrading Flows to 2.0.0

2023-10-20 Thread Mark Payne (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1838#comment-1838
 ] 

Mark Payne commented on NIFI-11170:
---

The documentation for manual steps necessary can be found at: 
[https://cwiki.apache.org/confluence/display/NIFI/Migrating+Deprecated+Components+and+Features+for+2.0.0]

> Support Migration for Upgrading Flows to 2.0.0
> --
>
> Key: NIFI-11170
> URL: https://issues.apache.org/jira/browse/NIFI-11170
> Project: Apache NiFi
>  Issue Type: Epic
>Reporter: David Handermann
>Priority: Critical
> Fix For: 2.0.0
>
>
> Migration tools and documentation should be created to streamline the process 
> of upgrading to 2.0.0.
> Supporting migration includes the following priorities outlined in the [NiFi 
> 2.0 Release 
> Goals|https://cwiki.apache.org/confluence/display/NIFI/NiFi+2.0+Release+Goals]:
>  * Implement automated migration where possible to remap properties and 
> features
>  * Implement migration tools for manual conversion of XML Templates to JSON 
> Flow Definitions
>  * Create documentation for manual steps necessary where programmatic 
> migration cannot be implemented
>  * NiFi 2.0 should be capable of starting with ghosted components for removed 
> Processors or Controller Services



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-12242) Allow ControlRate to optionally route to a new 'rate exceeded' relationship instead of just slowing things down

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1839#comment-1839
 ] 

ASF subversion and git services commented on NIFI-12242:


Commit 40ac38dfe3b12376050fd09f8017cea52bcb7943 in nifi's branch 
refs/heads/main from Mark Payne
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=40ac38dfe3 ]

NIFI-12242: Added ability to route data that exceeds the configured threshold 
in ControlRate to be routed to  'rate exceeded' instead of just staying in the 
queue. Added Use Case documentation to ControlRate.

This closes #7895

Signed-off-by: Mike Moser 


> Allow ControlRate to optionally route to a new 'rate exceeded' relationship 
> instead of just slowing things down
> ---
>
> Key: NIFI-12242
> URL: https://issues.apache.org/jira/browse/NIFI-12242
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Reporter: Mark Payne
>Assignee: Mark Payne
>Priority: Major
> Fix For: 2.latest
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> ControlRate provides the ability to slow down the rate of data through the 
> system. This is important in cases where we want to avoid overwhelming a 
> downstream system. However, there are times when we don't want to just slow 
> down the flow of data but instead reject it if the rate is too high.
> Take, for example, the typical case with an HTTP Server that responds with a 
> 429: Too Many Requests status code. ControlRate should give us the option of 
> rejecting FlowFiles when they exceed the limit, not just slow everything down.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-12242: Added ability to route data that exceeds the configured t… [nifi]

2023-10-20 Thread via GitHub


asfgit closed pull request #7895: NIFI-12242: Added ability to route data that 
exceeds the configured t…
URL: https://github.com/apache/nifi/pull/7895


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12242: Added ability to route data that exceeds the configured t… [nifi]

2023-10-20 Thread via GitHub


mosermw commented on PR #7895:
URL: https://github.com/apache/nifi/pull/7895#issuecomment-1772932139

   +1 merging to main


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Comment Edited] (NIFI-11627) Add Dynamic Schema References to ValidateJSON Processor

2023-10-20 Thread Daniel Stieglitz (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1825#comment-1825
 ] 

Daniel Stieglitz edited comment on NIFI-11627 at 10/20/23 3:07 PM:
---

@[~markap14]  [~exceptionfactory] For the initial implementation for this 
Controller Interface, would an in memory map similar to the AvroSchemaRegistry 
be okay?

Can 
{code:java}
org.apache.nifi.schemaregistry.services.SchemaRegistry{code}
be reused for this?


was (Author: JIRAUSER294662):
@[~markap14]  [~exceptionfactory] For the initial implementation for this 
Controller Interface, would an in memory map similar to the AvroSchemaRegistry 
be okay?

> Add Dynamic Schema References to ValidateJSON Processor
> ---
>
> Key: NIFI-11627
> URL: https://issues.apache.org/jira/browse/NIFI-11627
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Affects Versions: 1.19.1
>Reporter: Chuck Tilly
>Assignee: Daniel Stieglitz
>Priority: Major
>
> For the ValidateJSON processor, add support for flowfile attribute references 
> that will allow for a JSON schema located in the Parameter Contexts, to be 
> referenced dynamically based on a flowfile attribute. e.g. 
> {code:java}
> #{${schema.name}} {code}
>  
> The benefits of adding support for attribute references are significant.  
> Adding this capability will allow a single processor to be used for all JSON 
> schema validation.  Unfortunately, the current version of this processor 
> requires a dedicated processor for every schema, i.e. 12 schemas requires 12 
> ValidateJSON processors.  This is very laborious to construct and maintain, 
> and resource expensive.  
> ValidateJSON processor (https://issues.apache.org/jira/browse/NIFI-7392)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (NIFI-11627) Add Dynamic Schema References to ValidateJSON Processor

2023-10-20 Thread Daniel Stieglitz (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1825#comment-1825
 ] 

Daniel Stieglitz edited comment on NIFI-11627 at 10/20/23 3:02 PM:
---

@[~markap14]  [~exceptionfactory] For the initial implementation for this 
Controller Interface, would an in memory map similar to the AvroSchemaRegistry 
be okay?


was (Author: JIRAUSER294662):
@[~markap14]  [~exceptionfactory] As for the initial implementation for this 
Controller Interface would an in memory map similar to the AvroSchemaRegistry 
be okay?

> Add Dynamic Schema References to ValidateJSON Processor
> ---
>
> Key: NIFI-11627
> URL: https://issues.apache.org/jira/browse/NIFI-11627
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Affects Versions: 1.19.1
>Reporter: Chuck Tilly
>Assignee: Daniel Stieglitz
>Priority: Major
>
> For the ValidateJSON processor, add support for flowfile attribute references 
> that will allow for a JSON schema located in the Parameter Contexts, to be 
> referenced dynamically based on a flowfile attribute. e.g. 
> {code:java}
> #{${schema.name}} {code}
>  
> The benefits of adding support for attribute references are significant.  
> Adding this capability will allow a single processor to be used for all JSON 
> schema validation.  Unfortunately, the current version of this processor 
> requires a dedicated processor for every schema, i.e. 12 schemas requires 12 
> ValidateJSON processors.  This is very laborious to construct and maintain, 
> and resource expensive.  
> ValidateJSON processor (https://issues.apache.org/jira/browse/NIFI-7392)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-11627) Add Dynamic Schema References to ValidateJSON Processor

2023-10-20 Thread Daniel Stieglitz (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1825#comment-1825
 ] 

Daniel Stieglitz commented on NIFI-11627:
-

@[~markap14]  [~exceptionfactory] As for the initial implementation for this 
Controller Interface would an in memory map similar to the AvroSchemaRegistry 
be okay?

> Add Dynamic Schema References to ValidateJSON Processor
> ---
>
> Key: NIFI-11627
> URL: https://issues.apache.org/jira/browse/NIFI-11627
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Affects Versions: 1.19.1
>Reporter: Chuck Tilly
>Assignee: Daniel Stieglitz
>Priority: Major
>
> For the ValidateJSON processor, add support for flowfile attribute references 
> that will allow for a JSON schema located in the Parameter Contexts, to be 
> referenced dynamically based on a flowfile attribute. e.g. 
> {code:java}
> #{${schema.name}} {code}
>  
> The benefits of adding support for attribute references are significant.  
> Adding this capability will allow a single processor to be used for all JSON 
> schema validation.  Unfortunately, the current version of this processor 
> requires a dedicated processor for every schema, i.e. 12 schemas requires 12 
> ValidateJSON processors.  This is very laborious to construct and maintain, 
> and resource expensive.  
> ValidateJSON processor (https://issues.apache.org/jira/browse/NIFI-7392)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NIFI-12198) Add API to import a VersionedReportingTaskSnapshot

2023-10-20 Thread Mark Payne (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Payne updated NIFI-12198:
--
Fix Version/s: 2.0.0
   Resolution: Fixed
   Status: Resolved  (was: Patch Available)

> Add API to import a VersionedReportingTaskSnapshot
> --
>
> Key: NIFI-12198
> URL: https://issues.apache.org/jira/browse/NIFI-12198
> Project: Apache NiFi
>  Issue Type: Improvement
>Reporter: Bryan Bende
>Assignee: Bryan Bende
>Priority: Major
> Fix For: 2.0.0
>
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> This is the corresponding import API to go along with the export API that was 
> added in NIFI-12186 . We should be able to POST a previously exported 
> VersionedReportingTaskSnapshot to a given NiFi instance to create any 
> reporting tasks and controller services provided in the snapshot. We should 
> also support uploading a file. The import process should be additive, we are 
> not trying to sync existing components, just create whatever is in the 
> snapshot.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-12198 Add API and CLI commands to import reporting task snapshots [nifi]

2023-10-20 Thread via GitHub


markap14 merged PR #7875:
URL: https://github.com/apache/nifi/pull/7875


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12198 Add API and CLI commands to import reporting task snapshots [nifi]

2023-10-20 Thread via GitHub


markap14 commented on PR #7875:
URL: https://github.com/apache/nifi/pull/7875#issuecomment-1772876906

   Great, thanks @bbende, merged to main


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Commented] (NIFI-12198) Add API to import a VersionedReportingTaskSnapshot

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1820#comment-1820
 ] 

ASF subversion and git services commented on NIFI-12198:


Commit fd2de5a1515458ccc73df3e9a85fed9d6c4c3ce1 in nifi's branch 
refs/heads/main from Bryan Bende
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=fd2de5a151 ]

NIFI-12198 Add API and CLI commands to import reporting task snapshots (#7875)

* NIFI-12198 Add API and CLI commands to import reporting task snapshots

> Add API to import a VersionedReportingTaskSnapshot
> --
>
> Key: NIFI-12198
> URL: https://issues.apache.org/jira/browse/NIFI-12198
> Project: Apache NiFi
>  Issue Type: Improvement
>Reporter: Bryan Bende
>Assignee: Bryan Bende
>Priority: Major
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> This is the corresponding import API to go along with the export API that was 
> added in NIFI-12186 . We should be able to POST a previously exported 
> VersionedReportingTaskSnapshot to a given NiFi instance to create any 
> reporting tasks and controller services provided in the snapshot. We should 
> also support uploading a file. The import process should be additive, we are 
> not trying to sync existing components, just create whatever is in the 
> snapshot.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-12198 Add API and CLI commands to import reporting task snapshots [nifi]

2023-10-20 Thread via GitHub


markap14 commented on code in PR #7875:
URL: https://github.com/apache/nifi/pull/7875#discussion_r1367075338


##
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-api/src/main/java/org/apache/nifi/web/api/ControllerResource.java:
##
@@ -449,6 +455,72 @@ public Response createReportingTask(
 );
 }
 
+/**
+ * Imports a reporting task snapshot.
+ */
+@POST
+@Consumes(MediaType.APPLICATION_JSON)
+@Produces(MediaType.APPLICATION_JSON)
+@Path("reporting-tasks/import")
+@ApiOperation(
+value = "Imports a reporting task snapshot",
+response = VersionedReportingTaskImportResponseEntity.class,
+authorizations = {
+@Authorization(value = "Write - /controller")
+}
+)
+@ApiResponses(
+value = {
+@ApiResponse(code = 400, message = "NiFi was unable to 
complete the request because it was invalid. The request should not be retried 
without modification."),
+@ApiResponse(code = 401, message = "Client could not be 
authenticated."),
+@ApiResponse(code = 403, message = "Client is not 
authorized to make this request."),
+@ApiResponse(code = 409, message = "The request was valid 
but NiFi was not in the appropriate state to process it. Retrying the same 
request later may be successful.")
+}
+)
+public Response importReportingTaskSnapshot(
+@Context final HttpServletRequest httpServletRequest,
+@ApiParam(
+value = "The import request containing the reporting task 
snapshot to import.",
+required = true
+) final VersionedReportingTaskImportRequestEntity 
importRequestEntity) {
+
+if (importRequestEntity == null || 
importRequestEntity.getReportingTaskSnapshot() == null) {
+throw new IllegalArgumentException("Reporting task snapshot is 
required");
+}
+
+final VersionedReportingTaskSnapshot requestSnapshot = 
importRequestEntity.getReportingTaskSnapshot();
+serviceFacade.discoverCompatibleBundles(requestSnapshot);
+serviceFacade.generateIdentifiersForImport(requestSnapshot, () -> 
generateUuid());
+
+if (isReplicateRequest()) {
+return replicate(HttpMethod.POST, importRequestEntity);
+} else if (isDisconnectedFromCluster()) {
+
verifyDisconnectedNodeModification(importRequestEntity.getDisconnectedNodeAcknowledged());
+}
+
+return withWriteLock(
+serviceFacade,
+importRequestEntity,
+lookup -> {
+authorizeController(RequestAction.WRITE);
+
+final Set restrictedComponents = 
FlowRegistryUtils.getRestrictedComponents(requestSnapshot, serviceFacade);
+restrictedComponents.forEach(restrictedComponent -> {
+final ComponentAuthorizable 
restrictedComponentAuthorizable = 
lookup.getConfigurableComponent(restrictedComponent);
+authorizeRestrictions(authorizer, 
restrictedComponentAuthorizable);
+});
+},
+() -> {
+// Nothing to verify
+},
+(importRequest) -> {
+final VersionedReportingTaskSnapshot snapshot = 
importRequestEntity.getReportingTaskSnapshot();

Review Comment:
   ```suggestion
   final VersionedReportingTaskSnapshot snapshot = 
importRequest.getReportingTaskSnapshot();
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12198 Add API and CLI commands to import reporting task snapshots [nifi]

2023-10-20 Thread via GitHub


bbende commented on PR #7875:
URL: https://github.com/apache/nifi/pull/7875#issuecomment-1772874845

   @markap14 yes that would be great! Really appreciate the review and testing


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12198 Add API and CLI commands to import reporting task snapshots [nifi]

2023-10-20 Thread via GitHub


markap14 commented on PR #7875:
URL: https://github.com/apache/nifi/pull/7875#issuecomment-1772871187

   Was able to test and all looks good. Given that the only I had was a trivial 
change, I can make that change and merge if you're good with that @bbende 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12245: Removed deprecations around flow registry clients [nifi]

2023-10-20 Thread via GitHub


markap14 commented on code in PR #7899:
URL: https://github.com/apache/nifi/pull/7899#discussion_r1367056503


##
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-components/src/main/java/org/apache/nifi/flow/synchronization/StandardVersionedComponentSynchronizer.java:
##
@@ -502,7 +502,7 @@ private String determineRegistryId(final 
VersionedFlowCoordinates coordinates) {
 }
 }
 
-final String location = coordinates.getStorageLocation() == null ? 
coordinates.getRegistryUrl() : coordinates.getStorageLocation();
+final String location = coordinates.getStorageLocation();
 if (location == null) {

Review Comment:
   Yeah, good point



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12245: Removed deprecations around flow registry clients [nifi]

2023-10-20 Thread via GitHub


simonbence commented on code in PR #7899:
URL: https://github.com/apache/nifi/pull/7899#discussion_r1367032604


##
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-components/src/main/java/org/apache/nifi/flow/synchronization/StandardVersionedComponentSynchronizer.java:
##
@@ -502,7 +502,7 @@ private String determineRegistryId(final 
VersionedFlowCoordinates coordinates) {
 }
 }
 
-final String location = coordinates.getStorageLocation() == null ? 
coordinates.getRegistryUrl() : coordinates.getStorageLocation();
+final String location = coordinates.getStorageLocation();
 if (location == null) {

Review Comment:
   I think the empty storage location is not valid (at least not with url 
removed)



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12220: Added ability to create Controller Services from migrateProperties. [nifi]

2023-10-20 Thread via GitHub


markap14 commented on code in PR #7874:
URL: https://github.com/apache/nifi/pull/7874#discussion_r1367042333


##
nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-core-api/src/main/java/org/apache/nifi/migration/ControllerServiceFactory.java:
##
@@ -0,0 +1,28 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.nifi.migration;
+
+import org.apache.nifi.controller.service.ControllerServiceNode;
+
+import java.util.Map;
+
+public interface ControllerServiceFactory {
+ControllerServiceCreationDetails creationDetails(String 
implementationClassName, Map propertyValues);

Review Comment:
   Nope - `getCreationDetails` is probably a better name. Will change.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12220: Added ability to create Controller Services from migrateProperties. [nifi]

2023-10-20 Thread via GitHub


markap14 commented on code in PR #7874:
URL: https://github.com/apache/nifi/pull/7874#discussion_r1367038991


##
nifi-nar-bundles/nifi-aws-bundle/nifi-aws-processors/src/test/java/org/apache/nifi/processors/aws/kinesis/stream/ITPutKinesisStreamWithEndpointOverride.java:
##
@@ -29,24 +31,24 @@
 
 // This integration test can be run against a mock Kenesis such as
 // https://github.com/mhart/kinesalite or 
https://github.com/localstack/localstack
+@Disabled("Required external service be running. Needs to be updated to make 
use of Localstack TestContainer")

Review Comment:
   Yeah, fair enough.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12220: Added ability to create Controller Services from migrateProperties. [nifi]

2023-10-20 Thread via GitHub


markap14 commented on code in PR #7874:
URL: https://github.com/apache/nifi/pull/7874#discussion_r1367035011


##
nifi-mock/src/main/java/org/apache/nifi/util/TestRunner.java:
##
@@ -1064,4 +1064,6 @@ void assertAttributes(
  * @param eventType Provenance event type
  */
  void assertProvenanceEvent(ProvenanceEventType eventType);
+

Review Comment:
   Good catch. Will do.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12220: Added ability to create Controller Services from migrateProperties. [nifi]

2023-10-20 Thread via GitHub


markap14 commented on code in PR #7874:
URL: https://github.com/apache/nifi/pull/7874#discussion_r1367034467


##
nifi-mock/src/main/java/org/apache/nifi/util/MockPropertyConfiguration.java:
##
@@ -0,0 +1,138 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.nifi.util;
+
+import org.apache.nifi.migration.PropertyConfiguration;
+
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.HashSet;
+import java.util.Map;
+import java.util.Optional;
+import java.util.Set;
+import java.util.UUID;
+
+public class MockPropertyConfiguration implements PropertyConfiguration {
+private final Map propertyRenames = new HashMap<>();
+private final Set propertiesRemoved = new HashSet<>();
+private final Set propertiesUpdated = new HashSet<>();
+private final Map rawProperties;
+private final Set createdControllerServices = 
new HashSet<>();
+
+
+public MockPropertyConfiguration(final Map propertyValues) 
{
+this.rawProperties = new HashMap<>(propertyValues);

Review Comment:
   There is, in general, no expectation of ordering of elements in the map. If 
there were, we would want to require a `SequencedMap` rather than a `Map`. In 
general, the List of Property Descriptors is ordered, so that we can provide a 
better user experience via the UI. However, the order in which elements are 
iterated over need not be maintained.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12165 Changed the properties "Custom Transformation Class Name" and "Custom Module Directory" to depend on the "Jolt Transformation DSL" property when its value is "Custom" [nifi]

2023-10-20 Thread via GitHub


dan-s1 commented on PR #7890:
URL: https://github.com/apache/nifi/pull/7890#issuecomment-1772819385

   @ChrisSamo632  @exceptionfactory 
   I understand the history from #7782 that there had to be two processors 
`JoltTransformJSON` and `JoltTransformRecord`.  But my question is why is there 
duplicate code between the two processors? This MR and NIFI-11959 are 
consequences of duplicate code. Is there something we can do here to refactor 
and extract the duplicate code to be shared with these two classes?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12220: Added ability to create Controller Services from migrateProperties. [nifi]

2023-10-20 Thread via GitHub


markap14 commented on code in PR #7874:
URL: https://github.com/apache/nifi/pull/7874#discussion_r1367031263


##
nifi-mock/src/main/java/org/apache/nifi/util/MockPropertyConfiguration.java:
##
@@ -0,0 +1,138 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.nifi.util;
+
+import org.apache.nifi.migration.PropertyConfiguration;
+
+import java.util.Collections;
+import java.util.HashMap;
+import java.util.HashSet;
+import java.util.Map;
+import java.util.Optional;
+import java.util.Set;
+import java.util.UUID;
+
+public class MockPropertyConfiguration implements PropertyConfiguration {
+private final Map propertyRenames = new HashMap<>();
+private final Set propertiesRemoved = new HashSet<>();
+private final Set propertiesUpdated = new HashSet<>();
+private final Map rawProperties;
+private final Set createdControllerServices = 
new HashSet<>();

Review Comment:
   I think I would disagree on this one. I believe that the order in which 
properties are removed, renamed, updated, etc. is not something that should be 
relied upon in a test. Tests should verify that "given this input, the expected 
output is produced." They should not attempt to assert the order in which the 
operations were performed in order to obtain that output - doing so would make 
the test very brittle.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12220: Added ability to create Controller Services from migrateProperties. [nifi]

2023-10-20 Thread via GitHub


markap14 commented on code in PR #7874:
URL: https://github.com/apache/nifi/pull/7874#discussion_r1367027814


##
nifi-api/src/main/java/org/apache/nifi/migration/PropertyConfiguration.java:
##
@@ -128,10 +128,83 @@ default Optional 
getPropertyValue(PropertyDescriptor descriptor) {
 return getPropertyValue(descriptor.getName());
 }
 
+/**
+ * Returns an optional value representing the "raw" value of the property 
with the given name. The "raw" value is
+ * the value before any parameters are substituted.
+ *
+ * @param propertyName the name of the property
+ * @return an empty optional if the value is null or unset, else an 
Optional representing the configured value
+ */
+Optional getRawPropertyValue(String propertyName);
+
+/**
+ * Returns an optional value representing the "raw" value of the property 
identified by the given descriptor. The "raw" value is
+ * the value before any parameters are substituted.
+ *
+ * @param descriptor the descriptor that identifies the property
+ * @return an empty optional if the value is null or unset, else an 
Optional representing the configured value
+ */
+default Optional getRawPropertyValue(PropertyDescriptor 
descriptor) {
+return getRawPropertyValue(descriptor.getName());
+}
+
 /**
  * Returns a map containing all of the configured properties
  * @return a Map containing the names and values of all configured 
properties
  */
 Map getProperties();
 
+/**
+ * Returns a map containing all of the raw property values
+ *
+ * @return a Map containing the names and values of all configured 
properties
+ */
+Map getRawProperties();
+
+/**
+ * 
+ * Creates a new Controller Service of the given type and configures it 
with the given property values. Note that if a Controller Service
+ * already exists within the same scope and with the same implementation 
and configuration, a new service may not be created and instead
+ * the existing service may be used.
+ * 
+ *
+ * 
+ * This allows for properties that were previously defined in the 
extension to be moved to a Controller Service. For example,
+ * consider a Processor that has "Username" and "Password" properties. In 
the next version of the Processor, we want to support
+ * multiple types of authentication, and we delegate the authentication to 
a Controller Service. Consider that the Controller Service
+ * implementation we wish to use has a classname of {@code 
org.apache.nifi.services.authentication.UsernamePassword}. We might then
+ * use this method as such:
+ * 
+ *
+ * 
+ * // Create a new Controller Service ofo type 
org.apache.nifi.services.authentication.UsernamePassword whose Username and 
Password
+ * // properties match those currently configured for this Processor.
+ * final MapString, String serviceProperties = 
Map.of("Username", propertyConfiguration.getRawPropertyValue("Username"),
+ *  "Password", 
propertyConfiguration.getRawPropertyValue("Password"));
+ * final String serviceId = 
propertyConfiguration.createControllerService("org.apache.nifi.services.authentication.UsernamePassword",
 serviceProperties);
+ *
+ * // Set our Authentication Service property to point to this new 
service.
+ * propertyConfiguration.setProperty(AUTHENTICATION_SERVICE, 
serviceId);
+ *
+ * // Remove the Username and Password properties from this Processor, 
since we are now going to use then Authentication Service.
+ * propertyConfiguration.removeProperty("Username");
+ * propertyConfiguration.removeProperty("Password");
+ * 
+ *
+ * 
+ * Note the use of {@link #getRawPropertyValue(String)} here instead of 
{@link #getPropertyValue(String)}. Because we want to set
+ * the new Controller Service's value to the same value as is currently 
configured for the Processor's "Username" and "Password" properties,
+ * we use {@link #getRawPropertyValue(String)}. This ensures that if the 
Processor is configured using Parameters, those Parameter
+ * references are still held by the Controller Service.
+ * 
+ *
+ * 
+ * Also note that this method expects the classname of the implementation, 
not the classname of the interface.
+ * 
+ *
+ * @param implementationClassName the fully qualified classname of the 
Controller Service implementation
+ * @param serviceProperties   the property values to configure the 
newly created Controller Service with
+ * @return an identifier for the Controller Service
+ */
+String createControllerService(String implementationClassName, Map serviceProperties);

Review Comment:
   Yeah, agreed. I don't love that it is needing to provide an explicit 
implementation of the service, but at the same time - the whole point is to 

Re: [PR] NIFI-12242: Added ability to route data that exceeds the configured t… [nifi]

2023-10-20 Thread via GitHub


markap14 commented on PR #7895:
URL: https://github.com/apache/nifi/pull/7895#issuecomment-1772804079

   Thanks @mosermw pushed a commit that addresses the above.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-12242: Added ability to route data that exceeds the configured t… [nifi]

2023-10-20 Thread via GitHub


markap14 commented on code in PR #7895:
URL: https://github.com/apache/nifi/pull/7895#discussion_r1367022418


##
nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/ControlRate.java:
##
@@ -66,6 +66,52 @@
 @CapabilityDescription("Controls the rate at which data is transferred to 
follow-on processors."
 + " If you configure a very small Time Duration, then the accuracy of 
the throttle gets worse."
 + " You can improve this accuracy by decreasing the Yield Duration, at 
the expense of more Tasks given to the processor.")
+@UseCase(description = "Limit the rate at which data is sent to a downstream 
system with little to no bursts",
+keywords = {"throttle", "limit", "slow down", "data rate"},
+configuration = """
+Set the "Rate Control Criteria" to `data rate`.
+Set the "Time Duration" property to `1 sec`.
+Configure the "Maximum Rate" property to specify how much data should 
be allowed through each second.
+
+For example, to allow through 8 MB per second, "Maximum Rate" to `8 
MB`.

Review Comment:
   Good catch @mosermw thanks



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Updated] (NIFI-12230) Add Configurable Log Level to GeoEnrichIP

2023-10-20 Thread David Handermann (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Handermann updated NIFI-12230:

Summary: Add Configurable Log Level to GeoEnrichIP  (was: GeoEnrichIP 
shouldn't produce a message when an IP is not found)

> Add Configurable Log Level to GeoEnrichIP
> -
>
> Key: NIFI-12230
> URL: https://issues.apache.org/jira/browse/NIFI-12230
> Project: Apache NiFi
>  Issue Type: Improvement
>Reporter: Didier B.
>Assignee: Pierre Villard
>Priority: Major
> Fix For: 2.0.0, 1.24.0
>
>
> GeoEnrichIP is a processor that convert an IP (found in the flowfile 
> attribute) to a geolocation information that it put in attributes. To do so 
> it requires a database file.
> In many environments, it's normal to have IP not found in the database 
> (internal IP, unknown IP, and so on). This is an information that concern the 
> rest of the workflow if needed.
> The problem here is that for every IP not found, GeoEnrichIP make a log warn 
> call which imply that a bulletin is emitted. This bulletin will trigger the 
> red box (upper right corner of the processor) up to the root flowgraph, 
> warning everyone working on the flowgraph that there is a problem, which is 
> not and will also emit a log that will flood the log system.
> *When an IP is not found, routing to failure is enough. No bulletin should be 
> emitted. Not finding an IP is normal and can happen several times per second.*



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NIFI-12253) GeoEnrichIPRecord does not route FF to not found

2023-10-20 Thread David Handermann (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Handermann updated NIFI-12253:

Fix Version/s: 2.0.0
   1.24.0
   (was: 1.latest)
   (was: 2.latest)
   Resolution: Fixed
   Status: Resolved  (was: Patch Available)

> GeoEnrichIPRecord does not route FF to not found
> 
>
> Key: NIFI-12253
> URL: https://issues.apache.org/jira/browse/NIFI-12253
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Extensions
>Reporter: Pierre Villard
>Assignee: Pierre Villard
>Priority: Major
> Fix For: 2.0.0, 1.24.0
>
> Attachments: Screenshot 2023-10-19 at 13.23.40.png
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> If the IP is not found, the flow file is rolled back instead of being routed 
> to the not found relationship.
> !Screenshot 2023-10-19 at 13.23.40.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NIFI-12230) GeoEnrichIP shouldn't produce a message when an IP is not found

2023-10-20 Thread David Handermann (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Handermann updated NIFI-12230:

Fix Version/s: 2.0.0
   1.24.0
   (was: 1.latest)
   (was: 2.latest)
   Resolution: Fixed
   Status: Resolved  (was: Patch Available)

> GeoEnrichIP shouldn't produce a message when an IP is not found
> ---
>
> Key: NIFI-12230
> URL: https://issues.apache.org/jira/browse/NIFI-12230
> Project: Apache NiFi
>  Issue Type: Improvement
>Reporter: Didier B.
>Assignee: Pierre Villard
>Priority: Major
> Fix For: 2.0.0, 1.24.0
>
>
> GeoEnrichIP is a processor that convert an IP (found in the flowfile 
> attribute) to a geolocation information that it put in attributes. To do so 
> it requires a database file.
> In many environments, it's normal to have IP not found in the database 
> (internal IP, unknown IP, and so on). This is an information that concern the 
> rest of the workflow if needed.
> The problem here is that for every IP not found, GeoEnrichIP make a log warn 
> call which imply that a bulletin is emitted. This bulletin will trigger the 
> red box (upper right corner of the processor) up to the root flowgraph, 
> warning everyone working on the flowgraph that there is a problem, which is 
> not and will also emit a log that will flood the log system.
> *When an IP is not found, routing to failure is enough. No bulletin should be 
> emitted. Not finding an IP is normal and can happen several times per second.*



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-12253) GeoEnrichIPRecord does not route FF to not found

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1793#comment-1793
 ] 

ASF subversion and git services commented on NIFI-12253:


Commit 3d607a7b6f37f1d24427e499df87362e45a3dfbb in nifi's branch 
refs/heads/support/nifi-1.x from Pierre Villard
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=3d607a7b6f ]

NIFI-12230 Add configurable Log Level for IP not found in GeoEnrichIP

NIFI-12253 Route to not found relationship instead of rolling back in 
GeoEnrichIPRecord

This closes #7909

Signed-off-by: David Handermann 
(cherry picked from commit 184757fede3e253ba47552ab8e6fe8bd75f8f49f)


> GeoEnrichIPRecord does not route FF to not found
> 
>
> Key: NIFI-12253
> URL: https://issues.apache.org/jira/browse/NIFI-12253
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Extensions
>Reporter: Pierre Villard
>Assignee: Pierre Villard
>Priority: Major
> Fix For: 1.latest, 2.latest
>
> Attachments: Screenshot 2023-10-19 at 13.23.40.png
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> If the IP is not found, the flow file is rolled back instead of being routed 
> to the not found relationship.
> !Screenshot 2023-10-19 at 13.23.40.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-12230) GeoEnrichIP shouldn't produce a message when an IP is not found

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1790#comment-1790
 ] 

ASF subversion and git services commented on NIFI-12230:


Commit 184757fede3e253ba47552ab8e6fe8bd75f8f49f in nifi's branch 
refs/heads/main from Pierre Villard
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=184757fede ]

NIFI-12230 Add configurable Log Level for IP not found in GeoEnrichIP

NIFI-12253 Route to not found relationship instead of rolling back in 
GeoEnrichIPRecord

This closes #7909

Signed-off-by: David Handermann 


> GeoEnrichIP shouldn't produce a message when an IP is not found
> ---
>
> Key: NIFI-12230
> URL: https://issues.apache.org/jira/browse/NIFI-12230
> Project: Apache NiFi
>  Issue Type: Improvement
>Reporter: Didier B.
>Assignee: Pierre Villard
>Priority: Major
> Fix For: 1.latest, 2.latest
>
>
> GeoEnrichIP is a processor that convert an IP (found in the flowfile 
> attribute) to a geolocation information that it put in attributes. To do so 
> it requires a database file.
> In many environments, it's normal to have IP not found in the database 
> (internal IP, unknown IP, and so on). This is an information that concern the 
> rest of the workflow if needed.
> The problem here is that for every IP not found, GeoEnrichIP make a log warn 
> call which imply that a bulletin is emitted. This bulletin will trigger the 
> red box (upper right corner of the processor) up to the root flowgraph, 
> warning everyone working on the flowgraph that there is a problem, which is 
> not and will also emit a log that will flood the log system.
> *When an IP is not found, routing to failure is enough. No bulletin should be 
> emitted. Not finding an IP is normal and can happen several times per second.*



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-12230) GeoEnrichIP shouldn't produce a message when an IP is not found

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1792#comment-1792
 ] 

ASF subversion and git services commented on NIFI-12230:


Commit 3d607a7b6f37f1d24427e499df87362e45a3dfbb in nifi's branch 
refs/heads/support/nifi-1.x from Pierre Villard
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=3d607a7b6f ]

NIFI-12230 Add configurable Log Level for IP not found in GeoEnrichIP

NIFI-12253 Route to not found relationship instead of rolling back in 
GeoEnrichIPRecord

This closes #7909

Signed-off-by: David Handermann 
(cherry picked from commit 184757fede3e253ba47552ab8e6fe8bd75f8f49f)


> GeoEnrichIP shouldn't produce a message when an IP is not found
> ---
>
> Key: NIFI-12230
> URL: https://issues.apache.org/jira/browse/NIFI-12230
> Project: Apache NiFi
>  Issue Type: Improvement
>Reporter: Didier B.
>Assignee: Pierre Villard
>Priority: Major
> Fix For: 1.latest, 2.latest
>
>
> GeoEnrichIP is a processor that convert an IP (found in the flowfile 
> attribute) to a geolocation information that it put in attributes. To do so 
> it requires a database file.
> In many environments, it's normal to have IP not found in the database 
> (internal IP, unknown IP, and so on). This is an information that concern the 
> rest of the workflow if needed.
> The problem here is that for every IP not found, GeoEnrichIP make a log warn 
> call which imply that a bulletin is emitted. This bulletin will trigger the 
> red box (upper right corner of the processor) up to the root flowgraph, 
> warning everyone working on the flowgraph that there is a problem, which is 
> not and will also emit a log that will flood the log system.
> *When an IP is not found, routing to failure is enough. No bulletin should be 
> emitted. Not finding an IP is normal and can happen several times per second.*



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-12253) GeoEnrichIPRecord does not route FF to not found

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1791#comment-1791
 ] 

ASF subversion and git services commented on NIFI-12253:


Commit 184757fede3e253ba47552ab8e6fe8bd75f8f49f in nifi's branch 
refs/heads/main from Pierre Villard
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=184757fede ]

NIFI-12230 Add configurable Log Level for IP not found in GeoEnrichIP

NIFI-12253 Route to not found relationship instead of rolling back in 
GeoEnrichIPRecord

This closes #7909

Signed-off-by: David Handermann 


> GeoEnrichIPRecord does not route FF to not found
> 
>
> Key: NIFI-12253
> URL: https://issues.apache.org/jira/browse/NIFI-12253
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Extensions
>Reporter: Pierre Villard
>Assignee: Pierre Villard
>Priority: Major
> Fix For: 1.latest, 2.latest
>
> Attachments: Screenshot 2023-10-19 at 13.23.40.png
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> If the IP is not found, the flow file is rolled back instead of being routed 
> to the not found relationship.
> !Screenshot 2023-10-19 at 13.23.40.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-12253 NIFI-12230 - Add configurable log level for IP not found and fix GeoEnrichIPRecord [nifi]

2023-10-20 Thread via GitHub


exceptionfactory closed pull request #7909: NIFI-12253 NIFI-12230 - Add 
configurable log level for IP not found and fix GeoEnrichIPRecord
URL: https://github.com/apache/nifi/pull/7909


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11197 Initial check in for Yaml record reader [nifi]

2023-10-20 Thread via GitHub


dan-s1 commented on PR #7665:
URL: https://github.com/apache/nifi/pull/7665#issuecomment-1772781514

   @exceptionfactory Any chance this can make 1.24?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Updated] (NIFI-12257) Upgrade SSHD to 2.9.3

2023-10-20 Thread David Handermann (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Handermann updated NIFI-12257:

Status: Patch Available  (was: Open)

> Upgrade SSHD to 2.9.3
> -
>
> Key: NIFI-12257
> URL: https://issues.apache.org/jira/browse/NIFI-12257
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: NiFi Registry
>Reporter: David Handermann
>Assignee: David Handermann
>Priority: Major
> Fix For: 1.24.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Apache MINA SSHD dependencies should be upgraded to 2.9.3 on the support 
> branch to mitgate CVE-2023-35887. The vulnerability applies to SFTP server 
> implementations and is not directly applicable to transitive usage in NiFi 
> Registry, but upgrading mitigates version-based vulnerability findings.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NIFI-12258) Upgrade SSHD to 2.11.0

2023-10-20 Thread David Handermann (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Handermann updated NIFI-12258:

Status: Patch Available  (was: Open)

> Upgrade SSHD to 2.11.0
> --
>
> Key: NIFI-12258
> URL: https://issues.apache.org/jira/browse/NIFI-12258
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: NiFi Registry
>Reporter: David Handermann
>Assignee: David Handermann
>Priority: Major
>  Labels: dependency-upgrade
> Fix For: 2.0.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Apache MINA SSHD dependencies should be upgraded to 2.11.0 on the main branch 
> to mitgate CVE-2023-35887. The vulnerability applies to SFTP server 
> implementations and is not directly applicable to transitive usage in NiFi 
> Registry, but upgrading mitigates version-based vulnerability findings.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[PR] NIFI-12258 Upgrade MINA SSHD from 2.10.0 to 2.11.0 for Main Branch [nifi]

2023-10-20 Thread via GitHub


exceptionfactory opened a new pull request, #7915:
URL: https://github.com/apache/nifi/pull/7915

   # Summary
   
   [NIFI-12258](https://issues.apache.org/jira/browse/NIFI-12258) Upgrades 
Apache MINA SSHD dependencies from 2.10.0 to 2.11.0 for the main branch.
   
   This upgrade mitigates CVE-2023-35887, which applies to SFTP server 
implementations and is not directly applicable to transitive usage in NiFi 
Registry.
   
   # Tracking
   
   Please complete the following tracking steps prior to pull request creation.
   
   ### Issue Tracking
   
   - [X] [Apache NiFi Jira](https://issues.apache.org/jira/browse/NIFI) issue 
created
   
   ### Pull Request Tracking
   
   - [X] Pull Request title starts with Apache NiFi Jira issue number, such as 
`NIFI-0`
   - [X] Pull Request commit message starts with Apache NiFi Jira issue number, 
as such `NIFI-0`
   
   ### Pull Request Formatting
   
   - [X] Pull Request based on current revision of the `main` branch
   - [X] Pull Request refers to a feature branch with one commit containing 
changes
   
   # Verification
   
   Please indicate the verification steps performed prior to pull request 
creation.
   
   ### Build
   
   - [X] Build completed using `mvn clean install -P contrib-check`
 - [X] JDK 21
   
   ### Licensing
   
   - [ ] New dependencies are compatible with the [Apache License 
2.0](https://apache.org/licenses/LICENSE-2.0) according to the [License 
Policy](https://www.apache.org/legal/resolved.html)
   - [ ] New dependencies are documented in applicable `LICENSE` and `NOTICE` 
files
   
   ### Documentation
   
   - [ ] Documentation formatting appears as expected in rendered files
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[PR] NIFI-12257 Upgrade MINA SSHD from 2.9.2 to 2.9.3 for Support Branch [nifi]

2023-10-20 Thread via GitHub


exceptionfactory opened a new pull request, #7914:
URL: https://github.com/apache/nifi/pull/7914

   # Summary
   
   [NIFI-12257](https://issues.apache.org/jira/browse/NIFI-12257) Upgrades 
runtime Apache MINA SSHD dependencies in NiFi Registry from 2.9.2 to 2.9.3, 
maintaining compatibility with JGit 5.
   
   Additional changes include upgrading MINA SSHD test dependencies for 
standard processors from 2.10.0 to 2.11.0.
   
   This upgrade mitigates CVE-2023-35887, which applies to SFTP server 
implementations and is not directly applicable to transitive usage in NiFi 
Registry.
   
   # Tracking
   
   Please complete the following tracking steps prior to pull request creation.
   
   ### Issue Tracking
   
   - [X] [Apache NiFi Jira](https://issues.apache.org/jira/browse/NIFI) issue 
created
   
   ### Pull Request Tracking
   
   - [X] Pull Request title starts with Apache NiFi Jira issue number, such as 
`NIFI-0`
   - [X] Pull Request commit message starts with Apache NiFi Jira issue number, 
as such `NIFI-0`
   
   ### Pull Request Formatting
   
   - [X] Pull Request based on current revision of the `main` branch
   - [X] Pull Request refers to a feature branch with one commit containing 
changes
   
   # Verification
   
   Please indicate the verification steps performed prior to pull request 
creation.
   
   ### Build
   
   - [ ] Build completed using `mvn clean install -P contrib-check`
 - [ ] JDK 21
   
   ### Licensing
   
   - [ ] New dependencies are compatible with the [Apache License 
2.0](https://apache.org/licenses/LICENSE-2.0) according to the [License 
Policy](https://www.apache.org/legal/resolved.html)
   - [ ] New dependencies are documented in applicable `LICENSE` and `NOTICE` 
files
   
   ### Documentation
   
   - [ ] Documentation formatting appears as expected in rendered files
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11874 update Process Group configuration layout in the UI [nifi]

2023-10-20 Thread via GitHub


markobean commented on PR #7591:
URL: https://github.com/apache/nifi/pull/7591#issuecomment-1772766720

   @mcgilman @mtien-apache @exceptionfactory 
   Hey all.. thank you for the time you've put into this PR so far. I'd like to 
get it over the line - and more importantly merge the corresponding nifi-1.x PR 
- before we get to the 1.24.0 release.
   
   https://github.com/apache/nifi/pull/7844
   
   Appreciate your time!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Created] (NIFI-12257) Upgrade SSHD to 2.9.3

2023-10-20 Thread David Handermann (Jira)
David Handermann created NIFI-12257:
---

 Summary: Upgrade SSHD to 2.9.3
 Key: NIFI-12257
 URL: https://issues.apache.org/jira/browse/NIFI-12257
 Project: Apache NiFi
  Issue Type: Improvement
  Components: NiFi Registry
Reporter: David Handermann
Assignee: David Handermann
 Fix For: 1.24.0


Apache MINA SSHD dependencies should be upgraded to 2.9.3 on the support branch 
to mitgate CVE-2023-35887. The vulnerability applies to SFTP server 
implementations and is not directly applicable to transitive usage in NiFi 
Registry, but upgrading mitigates version-based vulnerability findings.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (NIFI-12258) Upgrade SSHD to 2.11.0

2023-10-20 Thread David Handermann (Jira)
David Handermann created NIFI-12258:
---

 Summary: Upgrade SSHD to 2.11.0
 Key: NIFI-12258
 URL: https://issues.apache.org/jira/browse/NIFI-12258
 Project: Apache NiFi
  Issue Type: Improvement
  Components: NiFi Registry
Reporter: David Handermann
Assignee: David Handermann
 Fix For: 2.0.0


Apache MINA SSHD dependencies should be upgraded to 2.11.0 on the main branch 
to mitgate CVE-2023-35887. The vulnerability applies to SFTP server 
implementations and is not directly applicable to transitive usage in NiFi 
Registry, but upgrading mitigates version-based vulnerability findings.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2256) Un-singletonize LoggerConfiguration

2023-10-20 Thread Ferenc Gerlits (Jira)
Ferenc Gerlits created MINIFICPP-2256:
-

 Summary: Un-singletonize LoggerConfiguration
 Key: MINIFICPP-2256
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2256
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Ferenc Gerlits


1. {{LoggerConfiguration}} has a private constructor and a public 
{{newInstance}} method, which returns a pointer.  This means we can create new 
instances, but only on the heap, which makes no sense.  Remove 
{{newInstance()}}, make the constructor public, and update tests to create 
{{LoggerConfiguration}} objects on the stack.

2. If possible, we should also make the ownership of {{LoggerConfiguration}} 
clearer in the production use cases.  Currently, we use it as a singleton, via 
the {{getInstance}} method.  It would be better to have a clear (non-static) 
owner for it, and users got a reference or pointer to {{LoggerConfiguration}} 
from the owner.  Then we could remove {{getInstance}}, as well.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (MINIFICPP-2256) Un-singletonize LoggerConfiguration

2023-10-20 Thread Ferenc Gerlits (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ferenc Gerlits updated MINIFICPP-2256:
--
Description: 
1. {{LoggerConfiguration}} has a private constructor and a public 
{{newInstance}} method, which returns a pointer.  This means we can create new 
instances, but only on the heap, which makes no sense.  Remove {{newInstance}}, 
make the constructor public, and update tests to create {{LoggerConfiguration}} 
objects on the stack.

2. If possible, we should also make the ownership of {{LoggerConfiguration}} 
clearer in the production use cases.  Currently, we use it as a singleton, via 
the {{getInstance}} method.  It would be better to have a clear (non-static) 
owner for it, and users got a reference or pointer to {{LoggerConfiguration}} 
from the owner.  Then we could remove {{getInstance}}, as well.

  was:
1. {{LoggerConfiguration}} has a private constructor and a public 
{{newInstance}} method, which returns a pointer.  This means we can create new 
instances, but only on the heap, which makes no sense.  Remove 
{{newInstance()}}, make the constructor public, and update tests to create 
{{LoggerConfiguration}} objects on the stack.

2. If possible, we should also make the ownership of {{LoggerConfiguration}} 
clearer in the production use cases.  Currently, we use it as a singleton, via 
the {{getInstance}} method.  It would be better to have a clear (non-static) 
owner for it, and users got a reference or pointer to {{LoggerConfiguration}} 
from the owner.  Then we could remove {{getInstance}}, as well.


> Un-singletonize LoggerConfiguration
> ---
>
> Key: MINIFICPP-2256
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2256
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Ferenc Gerlits
>Priority: Minor
>
> 1. {{LoggerConfiguration}} has a private constructor and a public 
> {{newInstance}} method, which returns a pointer.  This means we can create 
> new instances, but only on the heap, which makes no sense.  Remove 
> {{newInstance}}, make the constructor public, and update tests to create 
> {{LoggerConfiguration}} objects on the stack.
> 2. If possible, we should also make the ownership of {{LoggerConfiguration}} 
> clearer in the production use cases.  Currently, we use it as a singleton, 
> via the {{getInstance}} method.  It would be better to have a clear 
> (non-static) owner for it, and users got a reference or pointer to 
> {{LoggerConfiguration}} from the owner.  Then we could remove 
> {{getInstance}}, as well.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-12239 - Add OS/Java details at startup in bootstrap log [nifi]

2023-10-20 Thread via GitHub


exceptionfactory commented on code in PR #7891:
URL: https://github.com/apache/nifi/pull/7891#discussion_r1366910027


##
nifi-bootstrap/src/main/java/org/apache/nifi/bootstrap/RunNiFi.java:
##
@@ -1165,13 +1168,22 @@ public void start(final boolean monitor) throws 
IOException {
 
 nifiPropsFilename = nifiPropsFilename.trim();
 
+String xmx = null;
+String xms = null;
+
 final List javaAdditionalArgs = new ArrayList<>();
 for (final Map.Entry entry : props.entrySet()) {
 final String key = entry.getKey();
 final String value = entry.getValue();
 
 if (key.startsWith("java.arg")) {
 javaAdditionalArgs.add(value);
+if(value.toLowerCase().startsWith("-xms")) {

Review Comment:
   Thanks!



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11958 Azure Data Explorer as sink [nifi]

2023-10-20 Thread via GitHub


exceptionfactory commented on code in PR #7624:
URL: https://github.com/apache/nifi/pull/7624#discussion_r1366908724


##
nifi-nar-bundles/nifi-azure-bundle/nifi-azure-services-api/src/main/java/org/apache/nifi/services/azure/data/explorer/KustoIngestService.java:
##
@@ -0,0 +1,28 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.services.azure.data.explorer;
+
+import org.apache.nifi.annotation.documentation.CapabilityDescription;
+import org.apache.nifi.annotation.documentation.Tags;
+
+import java.net.URISyntaxException;
+
+@Tags({"azure", "adx", "explorer", "kusto", "ingest"})
+@CapabilityDescription("Connection-Service for Azure ADX (Kusto) ingestion 
cluster to ingest data.")
+public interface KustoIngestService extends KustoQueryService {

Review Comment:
   Thanks for clarifying, that makes sense.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] MINIFICPP-2248 Refactor string::join_pack [nifi-minifi-cpp]

2023-10-20 Thread via GitHub


lordgamez commented on code in PR #1680:
URL: https://github.com/apache/nifi-minifi-cpp/pull/1680#discussion_r1366849293


##
CPPLINT.cfg:
##
@@ -1,2 +1,2 @@
 set noparent
-filter=-runtime/reference,-runtime/string,-build/c++11,-build/include_subdir,-whitespace/forcolon,-build/namespaces_literals,-readability/check,-build/include_what_you_use,-readability/nolint
+filter=-runtime/reference,-runtime/string,-build/c++11,-build/include_subdir,-whitespace/forcolon,-build/namespaces_literals,-readability/check,-build/include_what_you_use,-readability/nolint,-readability/braces

Review Comment:
   @martinzink has an open issue for this for a while now 
https://github.com/google/styleguide/issues/752



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Updated] (NIFI-12254) PutElasticsearchRecord documentation for Dynamic Properties isn't clear

2023-10-20 Thread Pierre Villard (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pierre Villard updated NIFI-12254:
--
Fix Version/s: 2.0.0
   1.24.0
   (was: 1.latest)
   (was: 2.latest)
   Resolution: Fixed
   Status: Resolved  (was: Patch Available)

> PutElasticsearchRecord documentation for Dynamic Properties isn't clear
> ---
>
> Key: NIFI-12254
> URL: https://issues.apache.org/jira/browse/NIFI-12254
> Project: Apache NiFi
>  Issue Type: Bug
>Affects Versions: 1.23.2
>Reporter: Chris Sampson
>Assignee: Chris Sampson
>Priority: Minor
> Fix For: 2.0.0, 1.24.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> The Dynamic Property documentation for {{PutElasticsearchRecord}} doesn't 
> indicate that the values of the properties are expected to be Record Path 
> expressions in order to obtain values from within the Records processed for 
> sending to Elasticsearch.
> This is very confusing for users.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-12254) PutElasticsearchRecord documentation for Dynamic Properties isn't clear

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1686#comment-1686
 ] 

ASF subversion and git services commented on NIFI-12254:


Commit 54030bfe11fecee83fc402b04274fe5a478d2c4d in nifi's branch 
refs/heads/support/nifi-1.x from Chris Sampson
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=54030bfe11 ]

NIFI-12254 clarify Bulk operation header documentation for 
PutElasticsearchRecord and PutElasticsearchJson processors

Signed-off-by: Pierre Villard 

This closes #7912.


> PutElasticsearchRecord documentation for Dynamic Properties isn't clear
> ---
>
> Key: NIFI-12254
> URL: https://issues.apache.org/jira/browse/NIFI-12254
> Project: Apache NiFi
>  Issue Type: Bug
>Affects Versions: 1.23.2
>Reporter: Chris Sampson
>Assignee: Chris Sampson
>Priority: Minor
> Fix For: 1.latest, 2.latest
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> The Dynamic Property documentation for {{PutElasticsearchRecord}} doesn't 
> indicate that the values of the properties are expected to be Record Path 
> expressions in order to obtain values from within the Records processed for 
> sending to Elasticsearch.
> This is very confusing for users.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NIFI-12254) PutElasticsearchRecord documentation for Dynamic Properties isn't clear

2023-10-20 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-12254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1682#comment-1682
 ] 

ASF subversion and git services commented on NIFI-12254:


Commit 6c7d02e22e95ea84cf8895231d01c9b60144c24d in nifi's branch 
refs/heads/main from Chris Sampson
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=6c7d02e22e ]

NIFI-12254 clarify Bulk operation header documentation for 
PutElasticsearchRecord and PutElasticsearchJson processors

Signed-off-by: Pierre Villard 

This closes #7912.


> PutElasticsearchRecord documentation for Dynamic Properties isn't clear
> ---
>
> Key: NIFI-12254
> URL: https://issues.apache.org/jira/browse/NIFI-12254
> Project: Apache NiFi
>  Issue Type: Bug
>Affects Versions: 1.23.2
>Reporter: Chris Sampson
>Assignee: Chris Sampson
>Priority: Minor
> Fix For: 1.latest, 2.latest
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The Dynamic Property documentation for {{PutElasticsearchRecord}} doesn't 
> indicate that the values of the properties are expected to be Record Path 
> expressions in order to obtain values from within the Records processed for 
> sending to Elasticsearch.
> This is very confusing for users.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [PR] NIFI-12254 clarify Bulk operation header documentation for PutElasticsearchRecord and PutElasticsearchJson processors [nifi]

2023-10-20 Thread via GitHub


asfgit closed pull request #7912: NIFI-12254 clarify Bulk operation header 
documentation for PutElasticsearchRecord and PutElasticsearchJson processors
URL: https://github.com/apache/nifi/pull/7912


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] NIFI-11958 Azure Data Explorer as sink [nifi]

2023-10-20 Thread via GitHub


tanmaya-panda1 commented on PR #7624:
URL: https://github.com/apache/nifi/pull/7624#issuecomment-1772420811

   @exceptionfactory : Thanks for the detailed review. I have addressed most of 
your comments, please feel free to review and comment if anything is missing. 
Thanks once again.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@nifi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[jira] [Updated] (NIFI-12256) Update documentation and screenshots

2023-10-20 Thread Pierre Villard (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-12256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pierre Villard updated NIFI-12256:
--
Component/s: Documentation & Website

> Update documentation and screenshots
> 
>
> Key: NIFI-12256
> URL: https://issues.apache.org/jira/browse/NIFI-12256
> Project: Apache NiFi
>  Issue Type: Sub-task
>  Components: Documentation  Website
>Reporter: Pierre Villard
>Priority: Major
> Fix For: 2.latest
>
>
> Following changes such as NIFI-12167 (and others), documentation should be 
> updated as well as the screenshots to take into account UI-related changes.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


  1   2   >