[jira] [Created] (MINIFICPP-2434) Use dynamic_cast for c2 update service

2024-07-31 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2434:
-

 Summary: Use dynamic_cast for c2 update service
 Key: MINIFICPP-2434
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2434
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2433) Add nifi.c2.rest.path.base to the minifi installer

2024-07-30 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2433:
-

 Summary: Add nifi.c2.rest.path.base to the minifi installer
 Key: MINIFICPP-2433
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2433
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2427) Create new flowfile content instead of providing a view into a shared resource

2024-07-16 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2427:
-

 Summary: Create new flowfile content instead of providing a view 
into a shared resource
 Key: MINIFICPP-2427
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2427
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Currently each flowfile implements a view into a possibly shared resource. When 
this resource is large this could result in a performance bottleneck since each 
rocksdb read must read the whole resource even if the view is only a few bytes. 
We should create brand new resources.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2403) Refactor c2 server urls

2024-06-14 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2403:
-

 Summary: Refactor c2 server urls
 Key: MINIFICPP-2403
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2403
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (MINIFICPP-2365) Change minifi_native extension

2024-05-08 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni updated MINIFICPP-2365:
--
Description: Python searches for minifi_native.so on non-windows systems, 
even on macOS, where the extension of shared libraries is dylib. We should name 
the extension of this symlink accordingly.

> Change minifi_native extension
> --
>
> Key: MINIFICPP-2365
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2365
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Python searches for minifi_native.so on non-windows systems, even on macOS, 
> where the extension of shared libraries is dylib. We should name the 
> extension of this symlink accordingly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2365) Change minifi_native extension

2024-05-08 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2365:
-

 Summary: Change minifi_native extension
 Key: MINIFICPP-2365
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2365
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2364) Add missing plist file

2024-05-08 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2364:
-

 Summary: Add missing plist file
 Key: MINIFICPP-2364
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2364
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-2243) ListenHTTP: avoid reading full input or output flow file contents into memory

2024-04-29 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-2243:
-

Assignee: Adam Debreceni

> ListenHTTP: avoid reading full input or output flow file contents into memory
> -
>
> Key: MINIFICPP-2243
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2243
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Marton Szasz
>Assignee: Adam Debreceni
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2347) Flow config structure errors should reference the invalid node

2024-04-29 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2347:
-

 Summary: Flow config structure errors should reference the invalid 
node
 Key: MINIFICPP-2347
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2347
 Project: Apache NiFi MiNiFi C++
  Issue Type: New Feature
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Currently some exceptions in json do not contain the path they occur (in yaml 
the exact line and offset is logged so this is not an issue). We should make 
sure that the path to the node is logged as well as the error.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2340) Upgrade WiX tool support

2024-04-23 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2340:
-

 Summary: Upgrade WiX tool support
 Key: MINIFICPP-2340
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2340
 Project: Apache NiFi MiNiFi C++
  Issue Type: New Feature
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2315) Send asset id hashes in c2 heartbeat

2024-03-11 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2315:
-

 Summary: Send asset id hashes in c2 heartbeat
 Key: MINIFICPP-2315
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2315
 Project: Apache NiFi MiNiFi C++
  Issue Type: New Feature
Reporter: Adam Debreceni


The agent should calculate the hash of all asset ids and send it in each 
heartbeat for the c2 agent to assess if a sync operation is needed.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2314) Introduce SYNC_ASSETS c2 command

2024-03-11 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2314:
-

 Summary: Introduce SYNC_ASSETS c2 command
 Key: MINIFICPP-2314
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2314
 Project: Apache NiFi MiNiFi C++
  Issue Type: New Feature
Reporter: Adam Debreceni
Assignee: Adam Debreceni


The c2 server sends a list of file paths, ids and download urls. The agent 
should calculate the diff and fetch files as needed.

 
{code:java}
{
  operation: heartbeat,
  requested_operations: [
{
  operationid: 13,
  operation: sync,
  operand: asset,
  args: [
{
  file: ,
  url: ,
  id: 
},
        {
  file: ,
  url: ,
          id:          }
  ]
}
  ]
}
{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (MINIFICPP-2301) Respect SQLITE_ROOT

2024-02-15 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni updated MINIFICPP-2301:
--
Description: soci uses the system sqlite even if SQLITE_ROOT is set on macos

> Respect SQLITE_ROOT 
> 
>
> Key: MINIFICPP-2301
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2301
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Minor
>
> soci uses the system sqlite even if SQLITE_ROOT is set on macos



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2301) Respect SQLITE_ROOT

2024-02-15 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2301:
-

 Summary: Respect SQLITE_ROOT 
 Key: MINIFICPP-2301
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2301
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-2299) SQL tests transiently fail on MacOS in CI

2024-02-14 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-2299:
-

Assignee: Adam Debreceni

> SQL tests transiently fail on MacOS in CI
> -
>
> Key: MINIFICPP-2299
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2299
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Gábor Gyimesi
>Assignee: Adam Debreceni
>Priority: Minor
>
> SQL tests often fail with the following issue on MacOS in github actions:
>  
> /Users/runner/work/nifi-minifi-cpp/nifi-minifi-cpp/extensions/sql/tests/QueryDatabaseTableTests.cpp:176:
>  FAILED:
> due to unexpected exception with message:
> Errorconnectingtodatabase: [iODBC][Driver Manager]dlopen(libsqlite3odbc.
> so,0x0006): tried: 'libsqlite3odbc.so' (nosuchfile), '/System/Volumes/
> Preboot/Cryptexes/OSlibsqlite3odbc.so' (no such file), '/Users/runner/work/
> nifi-minifi-cpp/nifi-minifi-cpp/build/bin/libsqlite3odbc.so' ( (SQL state
> 0)
>  
> The runner machines seem to be a bit different when the failure occurs, the 
> difference I found was that the installed SQLite version is 3.45.1 when the 
> tests fail and 3.44.2 when the tests succeed.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (MINIFICPP-2296) Install application as a service on macos with minifi.sh install command

2024-02-14 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni updated MINIFICPP-2296:
--
Summary: Install application as a service on macos with minifi.sh install 
command  (was: Install application as a service with minifi.sh install command)

> Install application as a service on macos with minifi.sh install command
> 
>
> Key: MINIFICPP-2296
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2296
> Project: Apache NiFi MiNiFi C++
>  Issue Type: New Feature
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Minor
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2296) Install application as a service with minifi.sh install command

2024-02-07 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2296:
-

 Summary: Install application as a service with minifi.sh install 
command
 Key: MINIFICPP-2296
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2296
 Project: Apache NiFi MiNiFi C++
  Issue Type: New Feature
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2267) Add openssl dylib to package on intel macos

2023-11-27 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2267:
-

 Summary: Add openssl dylib to package on intel macos
 Key: MINIFICPP-2267
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2267
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (MINIFICPP-2217) Create JoltTransform processor

2023-09-15 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni updated MINIFICPP-2217:
--
Priority: Minor  (was: Major)

> Create JoltTransform processor
> --
>
> Key: MINIFICPP-2217
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2217
> Project: Apache NiFi MiNiFi C++
>  Issue Type: New Feature
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Minor
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2217) Create JoltTransform processor

2023-09-15 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2217:
-

 Summary: Create JoltTransform processor
 Key: MINIFICPP-2217
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2217
 Project: Apache NiFi MiNiFi C++
  Issue Type: New Feature
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-2178) Move extension tests to the appropriate extension directories (from libminifi/test)

2023-09-11 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-2178:
-

Assignee: Adam Debreceni

> Move extension tests to the appropriate extension directories (from 
> libminifi/test)
> ---
>
> Key: MINIFICPP-2178
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2178
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Marton Szasz
>Assignee: Adam Debreceni
>Priority: Minor
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-2193) Add agent manifest to C2 debug package

2023-08-29 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-2193:
-

Assignee: Adam Debreceni

> Add agent manifest to C2 debug package
> --
>
> Key: MINIFICPP-2193
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2193
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Marton Szasz
>Assignee: Adam Debreceni
>Priority: Major
>
> The agent manifest contains a lot of useful information about the system, 
> which can be helpful in a situation where remote debugging of minifi agent 
> problems is required.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-1951) Parallel DefragmentTexts should not rewrite each other's content

2023-08-15 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-1951:
-

Assignee: Adam Debreceni

> Parallel DefragmentTexts should not rewrite each other's content
> 
>
> Key: MINIFICPP-1951
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1951
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Gábor Gyimesi
>Assignee: Adam Debreceni
>Priority: Minor
>
> DefragmentText processors append flow file contents, which can modify the 
> content repository. If multiple DefragmentText processors run and modify the 
> same flow file in parallel (in a situation when a processor's relationship is 
> connected to multiple DefragmentText processors), that should result in two 
> separate flow files forwarded to the rest of the flow. It should create 
> separate files in the content repository as well.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (MINIFICPP-2176) Add tests for ListSFTP minimum_reliable_timestamp

2023-08-03 Thread Adam Debreceni (Jira)


[ 
https://issues.apache.org/jira/browse/MINIFICPP-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750760#comment-17750760
 ] 

Adam Debreceni commented on MINIFICPP-2176:
---

the utility of rounding of the timestamp is questionable, e.g:

setting to minute precision, we query the files at 2:28, so the limit becomes 
1:28,
but we are rounding down to minute so 1:00, i.e. every file before 1:00 gets 
processed,
the rounding difference affects files modified between 1:00 and 1:28

> Add tests for ListSFTP minimum_reliable_timestamp
> -
>
> Key: MINIFICPP-2176
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2176
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Test
>Reporter: Adam Debreceni
>Priority: Minor
>
> https://github.com/apache/nifi-minifi-cpp/pull/1623#discussion_r1281760440



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2176) Add tests for ListSFTP minimum_reliable_timestamp

2023-08-02 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2176:
-

 Summary: Add tests for ListSFTP minimum_reliable_timestamp
 Key: MINIFICPP-2176
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2176
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2153) Change MergeContent default to Bin Packing

2023-06-28 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2153:
-

 Summary: Change MergeContent default to Bin Packing
 Key: MINIFICPP-2153
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2153
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-2143) CWEL JSON: add System/Security/UserId

2023-06-26 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-2143:
-

Assignee: Adam Debreceni

> CWEL JSON: add System/Security/UserId
> -
>
> Key: MINIFICPP-2143
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2143
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Marton Szasz
>Assignee: Adam Debreceni
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (MINIFICPP-2144) Allow windows service and standalone execution with different MINIFI_HOMEs

2023-06-26 Thread Adam Debreceni (Jira)


[ 
https://issues.apache.org/jira/browse/MINIFICPP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737027#comment-17737027
 ] 

Adam Debreceni edited comment on MINIFICPP-2144 at 6/26/23 7:42 AM:


turns out that this was caused by the semaphore usage which is removed as of 
[MINIFICPP-2121|https://issues.apache.org/jira/browse/MINIFICPP-2121]


was (Author: adebreceni):
turns out that this was caused by the semaphore usage which is removed as of 
[MINIFICPP-2020|https://issues.apache.org/jira/browse/MINIFICPP-2020]

> Allow windows service and standalone execution with different MINIFI_HOMEs
> --
>
> Key: MINIFICPP-2144
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2144
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>
> A minifi service on windows prevents any other minifi instance from running 
> even if their MINIFI_HOME is different.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-2144) Allow windows service and standalone execution with different MINIFI_HOMEs

2023-06-26 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-2144.
---
Resolution: Fixed

fixed in https://issues.apache.org/jira/browse/MINIFICPP-2121

> Allow windows service and standalone execution with different MINIFI_HOMEs
> --
>
> Key: MINIFICPP-2144
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2144
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>
> A minifi service on windows prevents any other minifi instance from running 
> even if their MINIFI_HOME is different.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (MINIFICPP-2144) Allow windows service and standalone execution with different MINIFI_HOMEs

2023-06-26 Thread Adam Debreceni (Jira)


[ 
https://issues.apache.org/jira/browse/MINIFICPP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737027#comment-17737027
 ] 

Adam Debreceni commented on MINIFICPP-2144:
---

turns out that this was caused by the semaphore usage which is removed as of 
[MINIFICPP-2020|https://issues.apache.org/jira/browse/MINIFICPP-2020]

> Allow windows service and standalone execution with different MINIFI_HOMEs
> --
>
> Key: MINIFICPP-2144
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2144
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>
> A minifi service on windows prevents any other minifi instance from running 
> even if their MINIFI_HOME is different.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2144) Allow windows service and standalone execution with different MINIFI_HOMEs

2023-06-22 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2144:
-

 Summary: Allow windows service and standalone execution with 
different MINIFI_HOMEs
 Key: MINIFICPP-2144
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2144
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni


A minifi service on windows prevents any other minifi instance from running 
even if their MINIFI_HOME is different.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-1755) Use std::span instead of gsl::span

2023-05-31 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-1755:
-

Assignee: Adam Debreceni

> Use std::span instead of gsl::span
> --
>
> Key: MINIFICPP-1755
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1755
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Marton Szasz
>Assignee: Adam Debreceni
>Priority: Major
>  Labels: MiNiFi-CPP-Hygiene
>
> The move is not trivial, because there is no .as_span member of std::span. 
>  There is `as_bytes()`, but we do (rarely) use `as_span` with types other 
> than `std::byte`, too.  We could write a free-standing utility function for 
> the non-byte case of `as_span` (and maybe some of those cases could use 
> `std::byte` instead).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2128) Verify test utility hash

2023-05-31 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2128:
-

 Summary: Verify test utility hash
 Key: MINIFICPP-2128
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2128
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Verify the hash of sqliteodbc driver on windows.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2121) Investigate if we need the semaphore for intraprocess signaling

2023-05-17 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2121:
-

 Summary: Investigate if we need the semaphore for intraprocess 
signaling
 Key: MINIFICPP-2121
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2121
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-2020) Fix the code which is supposed to stop two MiNiFi instances from interfering with each other

2023-05-15 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-2020:
-

Assignee: Adam Debreceni

> Fix the code which is supposed to stop two MiNiFi instances from interfering 
> with each other
> 
>
> Key: MINIFICPP-2020
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2020
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Ferenc Gerlits
>Assignee: Adam Debreceni
>Priority: Minor
>  Time Spent: 2h
>  Remaining Estimate: 0h
>
> On Windows,
>  * (x) if MiNiFi is already running as a service and you try to start another 
> instance from the console, then the second instance will exit with 
> %errorlevel% == -1, but without any message printed to either the console or 
> the log file, because GetTerminationEventHandle returns a null pointer;
>  * (/) if MiNiFi is not running as a service, you can start up two instances 
> with different MINIFI_HOMES from the console;
>  * (?) if you start up a MiNiFi instance from the console, then you start the 
> MiNiFi service, that works (assuming their MINIFI_HOMEs are different).
> On Linux,
>  * (/) you can start up two instances as long as their MINIFI_HOMEs are 
> different.
> On both,
>  * (?) if you try to start up two MiNiFi instances with the same MINIFI_HOME, 
> it will fail, as long as some repositories are RocksDB, because RocksDB can't 
> open the repo if another process has it open already.
>  
> In theory, the process semaphore should stop the last case before trying to 
> open the DBs, but it doesn't, because we open the semaphore in non-exclusive 
> mode.  Opening the process semaphore in exclusive mode (with no other 
> changes) would be a bad solution, because in the case of a crash or a kill 
> signal, the stale semaphore would stop the user from starting a new MiNiFi 
> instance and would have to be removed manually.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2111) Remove test-only stream yaml config parse method

2023-04-26 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2111:
-

 Summary: Remove test-only stream yaml config parse method
 Key: MINIFICPP-2111
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2111
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni


YamlConfiguration::getYamlRoot(std::istream&) method is only used in the yaml 
unit tests, we could remove it in favor of the getRootFromPayload method.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2109) Provide more helpful config parse error messages

2023-04-25 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2109:
-

 Summary: Provide more helpful config parse error messages
 Key: MINIFICPP-2109
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2109
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Currently a json parse failure is discarded and we try to parse it as yaml, but 
this could mask the json parse failure's valid error message.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2105) Throw on invalid output format in ConsumeWindowsEventLog

2023-04-17 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2105:
-

 Summary: Throw on invalid output format in ConsumeWindowsEventLog
 Key: MINIFICPP-2105
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2105
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-2081) CWEL saved logs support

2023-04-13 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-2081:
-

Assignee: Adam Debreceni

> CWEL saved logs support
> ---
>
> Key: MINIFICPP-2081
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2081
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Marton Szasz
>Assignee: Adam Debreceni
>Priority: Minor
>
> According to the EvtQuery docs, specifying a file path as Channel should 
> normally work, but for some reason, it doesn't. This may be an easy feature 
> addition if it only needs some small fix.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2086) Add extra accept header for c2 yaml flow download

2023-03-24 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2086:
-

 Summary: Add extra accept header for c2 yaml flow download
 Key: MINIFICPP-2086
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2086
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Specify the exact application-specific mime type for yaml flow download.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2085) Minifi is crashing on c2 heartbeat after flow update with the same processor id

2023-03-24 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2085:
-

 Summary: Minifi is crashing on c2 heartbeat after flow update with 
the same processor id
 Key: MINIFICPP-2085
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2085
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


We cache the ProcessorController for each processor id, after an update that 
cache is both ever-growing and not overwritten with the new processor 
referencing old destroyed processor pointers.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2071) Change default configuration class to yaml

2023-03-07 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2071:
-

 Summary: Change default configuration class to yaml
 Key: MINIFICPP-2071
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2071
 Project: Apache NiFi MiNiFi C++
  Issue Type: Task
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Change default configuration class to yaml.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2065) Allow disabling json support

2023-03-03 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2065:
-

 Summary: Allow disabling json support
 Key: MINIFICPP-2065
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2065
 Project: Apache NiFi MiNiFi C++
  Issue Type: New Feature
Reporter: Adam Debreceni
Assignee: Adam Debreceni


We should advertise the possible configuration formats the agent accepts 
through the c2 protocol based on the FlowConfiguration's capabilities.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2054) Periodically force rocksdb compaction

2023-02-24 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2054:
-

 Summary: Periodically force rocksdb compaction
 Key: MINIFICPP-2054
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2054
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Sometimes rocksdb sst files can get stuck even though all items have been 
deleted, running  a forced compaction on it clears them up.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2045) Enable synchronous flow file reloading, and orphan content cleanup

2023-02-08 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2045:
-

 Summary: Enable synchronous flow file reloading, and orphan 
content cleanup
 Key: MINIFICPP-2045
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2045
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Currently, reloading the flow files happens asynchronously which allows 
connections to exceed the backpressure threshold. We should also clean up 
contents without owner flow files.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (MINIFICPP-2043) Do not read stale checkpoint data

2023-02-08 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni updated MINIFICPP-2043:
--
Summary: Do not read stale checkpoint data  (was: Always delete checkpoint 
directory)

> Do not read stale checkpoint data
> -
>
> Key: MINIFICPP-2043
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2043
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>
> Steps to reproduce:
>  -  the agent starts up and creates a checkpoint directory of a non-empty 
> flowfilerepository 
>  -  allow the active flowfilerepository to be emptied out
>  - trigger a flow update, it will not delete the existing checkpoint 
> directory but use it regardless and reload stale flowfiles



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (MINIFICPP-2043) Always delete checkpoint directory

2023-02-08 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni updated MINIFICPP-2043:
--
Description: 
Steps to reproduce:
 -  the agent starts up and creates a checkpoint directory of a non-empty 
flowfilerepository 

 -  allow the active flowfilerepository to be emptied out

 - trigger a flow update, it will not delete the existing checkpoint directory 
but use it regardless and reload stale flowfiles

  was:
Steps to reproduce:
 -  the agent starts up and creates a checkpoint directory of a non-empty 
flowfilerepository 

 -  allow the active flowfilerepository to be emptied out

 - restart the agent, it will not delete the existing checkpoint directory but 
use it regardless and reload stale flowfiles


> Always delete checkpoint directory
> --
>
> Key: MINIFICPP-2043
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2043
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>
> Steps to reproduce:
>  -  the agent starts up and creates a checkpoint directory of a non-empty 
> flowfilerepository 
>  -  allow the active flowfilerepository to be emptied out
>  - trigger a flow update, it will not delete the existing checkpoint 
> directory but use it regardless and reload stale flowfiles



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2043) Always delete checkpoint directory

2023-02-08 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2043:
-

 Summary: Always delete checkpoint directory
 Key: MINIFICPP-2043
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2043
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Steps to reproduce:
 -  the agent starts up and creates a checkpoint directory of a non-empty 
flowfilerepository 

 -  allow the active flowfilerepository to be emptied out

 - restart the agent, it will not delete the existing checkpoint directory but 
use it regardless and reload stale flowfiles



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2040) Do not deserialize flow file just to be deleted

2023-02-02 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2040:
-

 Summary: Do not deserialize flow file just to be deleted
 Key: MINIFICPP-2040
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2040
 Project: Apache NiFi MiNiFi C++
  Issue Type: New Feature
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Currently FlowFileRepository deserializes each flow file just to be deleted, it 
makes the deletion of the content possible. We should elide the deserialization 
step.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-1372) Add batch cleanup for ContentRepository

2023-01-24 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-1372:
-

Assignee: Adam Debreceni

> Add batch cleanup for ContentRepository
> ---
>
> Key: MINIFICPP-1372
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1372
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Affects Versions: 0.9.0, 0.7.0
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Labels: selected-for-development
> Fix For: 0.14.0
>
>
> Currently all content is removed one-by-one whenever the refCount in the 
> ContentReposiroty::count_map_ goes to 0. For the rocksdb backed 
> DatabaseContentRepository this results in an unnecessary cost we could elide 
> if we batch-remove these resources. We could create a background gc thread 
> like in FlowFileRepository to handle the actual removal.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1976) Do not duplicate relationships for each transfer

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1976.
---
Resolution: Done

> Do not duplicate relationships for each transfer
> 
>
> Key: MINIFICPP-1976
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1976
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 2h 10m
>  Remaining Estimate: 0h
>
> Currently we store a copy of a Relationship object for each transferred flow 
> file, these objects add up. Investigate if we could make do without this 
> duplication.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1959) Fix VolatileFlowFileRepository leaving dangling ResourceClaims

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1959.
---
Resolution: Fixed

> Fix VolatileFlowFileRepository leaving dangling ResourceClaims
> --
>
> Key: MINIFICPP-1959
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1959
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> In `ProcessSession::commit` waiting for `MultiPut` to finish before calling 
> `increaseFlowFileRecordOwnedCount` could evict previously stored flowfiles 
> from the VolatileRepo causing their resource's ref_counter to go to 0 (as we 
> are yet to increase on behalf of the stored reference) causing dangling 
> ResourceClaims.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1984) Restart old flow if flow update fails

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1984.
---
Resolution: Fixed

> Restart old flow if flow update fails
> -
>
> Key: MINIFICPP-1984
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1984
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> We currently call a load with the previous flow, but we do not call start, 
> leaving processors unscheduled, and unable to get triggered.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-2012) Possible leak

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-2012.
---
Resolution: Fixed

LookupAccountSid overwrites the size of the buffer with the number of bytes 
actually written NOT including the null terminator.

> Possible leak
> -
>
> Key: MINIFICPP-2012
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2012
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-2017) Use std::string_view instead of std::string in ranges::join

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-2017.
---
Resolution: Done

> Use std::string_view instead of std::string in ranges::join
> ---
>
> Key: MINIFICPP-2017
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2017
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1227) Enable linting where applicable

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1227.
---
Resolution: Not A Problem

The linting has been greatly revised since then, this is no longer needed.

> Enable linting where applicable
> ---
>
> Key: MINIFICPP-1227
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1227
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Minor
>
> Some parts of the repository are excluded from the linting phase, notably 
> most of the extensions directory. Evaluate each part and enable their linting 
> if necessary.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2035) Support for nifi flow.json format

2023-01-19 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2035:
-

 Summary: Support for nifi flow.json format
 Key: MINIFICPP-2035
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2035
 Project: Apache NiFi MiNiFi C++
  Issue Type: New Feature
Reporter: Adam Debreceni
Assignee: Adam Debreceni


The agent should be able to handle a json flow config corresponding to a 
serialized VersionedDataflow object.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1386) Update includes and namespace for StreamCallbacks

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1386.
---
Resolution: Not A Problem

refactored in MINIFICPP-1717

> Update includes and namespace for StreamCallbacks
> -
>
> Key: MINIFICPP-1386
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1386
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>
> InputStreamCallback and OutputStreamCallback are about to be moved to their 
> own file from FlowFile.h. All files which access the class through transitive 
> includes should be updated moreover they should be moved to the `io` 
> namespace.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1407) Properly handle config deletion

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1407.
---
  Assignee: Adam Debreceni
Resolution: Fixed

> Properly handle config deletion
> ---
>
> Key: MINIFICPP-1407
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1407
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 2h 50m
>  Remaining Estimate: 0h
>
> Currently on c2 update we write the flow url only once (only if it is missing 
> from minifi.properties). This makes it impossible to refetch the correct flow 
> if the agent is restarted and the configuration file is deleted (by accident 
> or on purpose). We should correctly update the flow url on each c2 update, 
> and if no flow config is present, use that to instantiate a flow.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (MINIFICPP-1538) Investigate per process group column families

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni updated MINIFICPP-1538:
--
Issue Type: Task  (was: New Feature)

> Investigate per process group column families
> -
>
> Key: MINIFICPP-1538
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1538
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Task
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
> Attachments: Screenshot 2021-04-14 at 12.50.05.png, Screenshot 
> 2021-04-14 at 12.50.14.png
>
>
> *Edit*: See performance measurement in the comments of a previous 
> implementation. 
> Currently all operations in FlowFileRepository go through a single column 
> family (the default). We should investigate the performance benefit, if any, 
> of using different column families for different process groups (special care 
> must be taken for RPGs, the processors of which logically belong to their 
> parent groups).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1538) Investigate per process group column families

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1538.
---
Resolution: Done

> Investigate per process group column families
> -
>
> Key: MINIFICPP-1538
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1538
> Project: Apache NiFi MiNiFi C++
>  Issue Type: New Feature
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
> Attachments: Screenshot 2021-04-14 at 12.50.05.png, Screenshot 
> 2021-04-14 at 12.50.14.png
>
>
> *Edit*: See performance measurement in the comments of a previous 
> implementation. 
> Currently all operations in FlowFileRepository go through a single column 
> family (the default). We should investigate the performance benefit, if any, 
> of using different column families for different process groups (special care 
> must be taken for RPGs, the processors of which logically belong to their 
> parent groups).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Reopened] (MINIFICPP-1538) Investigate per process group column families

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reopened MINIFICPP-1538:
---

> Investigate per process group column families
> -
>
> Key: MINIFICPP-1538
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1538
> Project: Apache NiFi MiNiFi C++
>  Issue Type: New Feature
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
> Attachments: Screenshot 2021-04-14 at 12.50.05.png, Screenshot 
> 2021-04-14 at 12.50.14.png
>
>
> *Edit*: See performance measurement in the comments of a previous 
> implementation. 
> Currently all operations in FlowFileRepository go through a single column 
> family (the default). We should investigate the performance benefit, if any, 
> of using different column families for different process groups (special care 
> must be taken for RPGs, the processors of which logically belong to their 
> parent groups).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1538) Investigate per process group column families

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1538.
---
Resolution: Won't Do

> Investigate per process group column families
> -
>
> Key: MINIFICPP-1538
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1538
> Project: Apache NiFi MiNiFi C++
>  Issue Type: New Feature
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
> Attachments: Screenshot 2021-04-14 at 12.50.05.png, Screenshot 
> 2021-04-14 at 12.50.14.png
>
>
> *Edit*: See performance measurement in the comments of a previous 
> implementation. 
> Currently all operations in FlowFileRepository go through a single column 
> family (the default). We should investigate the performance benefit, if any, 
> of using different column families for different process groups (special care 
> must be taken for RPGs, the processors of which logically belong to their 
> parent groups).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1548) Investigate merging the three rocksdb databases

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1548.
---
  Assignee: Adam Debreceni
Resolution: Done

> Investigate merging the three rocksdb databases
> ---
>
> Key: MINIFICPP-1548
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1548
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 3h 50m
>  Remaining Estimate: 0h
>
> Currently we use three separate rocksdb databases: one for the 
> FlowFileRepository one for the ContentRepository and one for the 
> KeyValueStoreService. There is ad-hoc syncing between some of them (FFRepo 
> and ContentRepo) which a single rocksdb instance could provide out of the 
> box. We should investigate if utilizing a single database backend and 
> separate column families for these three, would be viable without large-scale 
> refactors.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1722) Missing artifact field from manifest

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1722.
---
Resolution: Fixed

> Missing artifact field from manifest
> 
>
> Key: MINIFICPP-1722
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1722
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> A property can specify what type of service it accepts (like InvokeHTTP's SSL 
> Context Service only accepts an SSLContextService type). The artifact field 
> describing this type disappeared from the manifest. Restore it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1903) Make utils::Regex handle std::string_view

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1903.
---
Resolution: Done

> Make utils::Regex handle std::string_view
> -
>
> Key: MINIFICPP-1903
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1903
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> Currently due to a bug we can't use std::regex on all platforms. The 
> interface of utils::regexSearch/utils::regexMatch (which aims to abstract 
> away this difference) does not allow working with std::string_view but forces 
> an std::string allocation even on platforms supporting std::regex.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1905) Extension loader directory traversal

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1905.
---
Resolution: Fixed

> Extension loader directory traversal
> 
>
> Key: MINIFICPP-1905
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1905
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> There is a bug in traversing the directory tree while finding the extensions 
> to load. The parent directory's path is used to determine if we descend into 
> a subdirectory, but the subdirectory's path should be used.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1918) Fix windows build

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1918.
---
Resolution: Fixed

> Fix windows build
> -
>
> Key: MINIFICPP-1918
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1918
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> `std::filesystem:: path` is not convertible to std::string



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1908) Fix python processor info in the manifest

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1908.
---
Resolution: Fixed

> Fix python processor info in the manifest
> -
>
> Key: MINIFICPP-1908
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1908
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> The description of python processors is malformed in the manifest.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1917) Generate JSON schema for flow config

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1917.
---
Resolution: Done

> Generate JSON schema for flow config
> 
>
> Key: MINIFICPP-1917
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1917
> Project: Apache NiFi MiNiFi C++
>  Issue Type: New Feature
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 3h
>  Remaining Estimate: 0h
>
> It is possible to provide edit-time feedback in some editors (Visual Studio 
> Code, possibly others) when editing the flow config json (upcoming feature). 
> We should generate such a schema by the minifi executable as we do it with 
> the docs/manifest.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1991) Remove unused features from ControllerServiceProvider

2023-01-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1991.
---
  Assignee: Adam Debreceni
Resolution: Done

> Remove unused features from ControllerServiceProvider
> -
>
> Key: MINIFICPP-1991
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1991
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> ControllerServiceProvider seems to contain unused methods, probably coming 
> from nifi. We should remove them and only readd them if need be.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2033) Check if we need runDurationNanos

2023-01-16 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2033:
-

 Summary: Check if we need runDurationNanos
 Key: MINIFICPP-2033
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2033
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni


Currently we can set the runDurationNanos but it is unused, investigate if we 
need it or it can be removed.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2017) Use std::string_view instead of std::string in ranges::join

2022-12-15 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2017:
-

 Summary: Use std::string_view instead of std::string in 
ranges::join
 Key: MINIFICPP-2017
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2017
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2013) Ensure localization-correctness in `OsUtils::userIdToUsername`

2022-12-13 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2013:
-

 Summary: Ensure localization-correctness in 
`OsUtils::userIdToUsername`
 Key: MINIFICPP-2013
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2013
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni


We currently do not take the necessary steps to ensure that user ids are mapped 
to usernames in an installation-language-conforming way. We should look into it 
if it is a problem.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2012) Possible leak

2022-12-12 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2012:
-

 Summary: Possible leak
 Key: MINIFICPP-2012
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2012
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2005) Fix compilation on clang 14.0.0 + libc++

2022-12-05 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2005:
-

 Summary: Fix compilation on clang 14.0.0 + libc++
 Key: MINIFICPP-2005
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2005
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


We are using the iterator constructor of std::span, which is not available due 
to a bug in clang 14.0.0 + libc++ configuration. We should go with gsl::span.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2002) Typecheck query arguments in SQL processors

2022-11-30 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2002:
-

 Summary: Typecheck query arguments in SQL processors
 Key: MINIFICPP-2002
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2002
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni


The used backend soci,odbc, do not seem to check the type of bound arguments in 
a prepared statement. We should investigate if it is feasible to fail such 
flowfiles or provide a "Check type" property to these sql processors.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-2001) In SQL processors fail flowfiles with more than required arguments

2022-11-30 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-2001:
-

 Summary: In SQL processors fail flowfiles with more than required 
arguments
 Key: MINIFICPP-2001
 URL: https://issues.apache.org/jira/browse/MINIFICPP-2001
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni


Currently the used libraries soci, odbc do not give feedback when more 
arguments are provided than required by the query, e.g. query = `INSERT INTO 
test VALUES (?);` args = ['1', '2'], we should give either a warning or fail 
such flowfiles.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-1994) Missing "failure", "retry" relationships for PutSql processor (and other processors)

2022-11-23 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-1994:
-

Assignee: Adam Debreceni  (was: Arpad Boda)

> Missing "failure", "retry" relationships for PutSql processor (and other 
> processors)
> 
>
> Key: MINIFICPP-1994
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1994
> Project: Apache NiFi MiNiFi C++
>  Issue Type: New Feature
>Reporter: Kondakov Artem
>Assignee: Adam Debreceni
>Priority: Major
>
> According to the manifest, sent by minifi, PutSql processors (and many 
> others) do not have a failure relationship, while in the apache / nifi 
> project similar processors have it.
> I think maintaining these relationships is important.
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1992) ControllerServiceNode should enable its dependencies

2022-11-22 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1992:
-

 Summary: ControllerServiceNode should enable its dependencies
 Key: MINIFICPP-1992
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1992
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni


Linked Services in a ControllerService should be enabled before being able to 
enable the service itself. Similarly disabling a service should first disable 
all its dependents.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1991) Remove unused features from ControllerServiceProvider

2022-11-22 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1991:
-

 Summary: Remove unused features from ControllerServiceProvider
 Key: MINIFICPP-1991
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1991
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni


ControllerServiceProvider seems to contain unused methods, probably coming from 
nifi. We should remove them and only readd them if need be.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1989) Circular reference in controllerservice

2022-11-16 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1989:
-

 Summary: Circular reference in controllerservice
 Key: MINIFICPP-1989
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1989
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


FlowController tried to clear its own controller_map_ but it is a 
ForwardingControllerServiceProvider.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1984) Restart old flow if flow update fails

2022-11-15 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1984:
-

 Summary: Restart old flow if flow update fails
 Key: MINIFICPP-1984
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1984
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


We currently call a load with the previous flow, but we do not call start, 
leaving processors unscheduled, and unable to get triggered.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1982) Fix documentation for BinFiles

2022-11-09 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1982:
-

 Summary: Fix documentation for BinFiles
 Key: MINIFICPP-1982
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1982
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni


BinFiles processor documentation is confusing, we should fix the meaning of 
"bin", "group", "entry" and the general principle/purpose of operation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1976) Do not duplicate relationships for each transfer

2022-11-04 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1976:
-

 Summary: Do not duplicate relationships for each transfer
 Key: MINIFICPP-1976
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1976
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Currently we store a copy of a Relationship object for each transferred flow 
file, these objects add up. Investigate if we could make do without this 
duplication.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1973) Refactor ResourceQueue

2022-11-02 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1973:
-

 Summary: Refactor ResourceQueue
 Key: MINIFICPP-1973
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1973
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni


Currently ResourceQueue::getResource does not guarantee that the returned 
cached object is in any way similar to the constructor function provided. It 
also does not guarantee that the modified object is "reset" before adding it 
back into the queue.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (MINIFICPP-1950) Disable in-memory-caching for FileSystemRepository

2022-10-24 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni resolved MINIFICPP-1950.
---
Resolution: Implemented

> Disable in-memory-caching for FileSystemRepository
> --
>
> Key: MINIFICPP-1950
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1950
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Bug
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> The DatabaseContentRepository's backend (rocksdb) does not support files 
> bigger than 4gb, so FileSystemRepository is a viable alternative for such 
> use-cases. Moreover, on memory-constrained systems storing large contents 
> in-memory is not acceptable. We should change the behavior of 
> FileSystemRepository to avoid such caches.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1959) Fix VolatileFlowFileRepository leaving dangling ResourceClaims

2022-10-12 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1959:
-

 Summary: Fix VolatileFlowFileRepository leaving dangling 
ResourceClaims
 Key: MINIFICPP-1959
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1959
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


In `ProcessSession::commit` waiting for `MultiPut` to finish before calling 
`increaseFlowFileRecordOwnedCount` could evict previously stored flowfiles from 
the VolatileRepo causing their resource's ref_counter to go to 0 (as we are yet 
to increase on behalf of the stored reference) causing dangling ResourceClaims.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1955) Revisit Stream::seek

2022-10-06 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1955:
-

 Summary: Revisit Stream::seek
 Key: MINIFICPP-1955
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1955
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni


Currently Stream::seek aims to set both the read and write offsets into the 
stream, we should talk this through, possibly mimic seekg/seekp (also 
BufferStream::seek is noop when writing)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1954) Implement ConcatInputStream

2022-10-05 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1954:
-

 Summary: Implement ConcatInputStream
 Key: MINIFICPP-1954
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1954
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni


We currently have no means to read back from a stream we have appended to when 
using BufferedContentSession, a ConcatInputStream could allow us to do just 
that.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1950) Disable in-memory-caching for FileSystemRepository

2022-10-05 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1950:
-

 Summary: Disable in-memory-caching for FileSystemRepository
 Key: MINIFICPP-1950
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1950
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


The DatabaseContentRepository's backend (rocksdb) does not support files bigger 
than 4gb, so FileSystemRepository is a viable alternative for such use-cases. 
Moreover, on memory-constrained systems storing large contents in-memory is not 
acceptable. We should change the behavior of FileSystemRepository to avoid such 
caches.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1937) High disk load when using MergeContent

2022-09-15 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1937:
-

 Summary: High disk load when using MergeContent
 Key: MINIFICPP-1937
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1937
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


The rocksdb content repository backend could exhibit unacceptable disk usage on 
some flows, e.g. GenerateFlowFile\{File Size: 2kB, period: 1 s, Batch Size: 
200} -> MergeContent\{Batch Size: 500, Bin Packing, Delimiter: ';'}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1936) Python link error in script extension

2022-09-12 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1936:
-

 Summary: Python link error in script extension
 Key: MINIFICPP-1936
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1936
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


libpython.so is expected to be opened into the global scope, moreover there was 
a collision on systems using a different openssl library as the bundled 
libressl's symbols polluted the global scope



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1918) Fix windows build

2022-08-23 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1918:
-

 Summary: Fix windows build
 Key: MINIFICPP-1918
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1918
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


`std::filesystem:: path` is not convertible to std::string



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1917) Generate JSON schema for config

2022-08-22 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1917:
-

 Summary: Generate JSON schema for config
 Key: MINIFICPP-1917
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1917
 Project: Apache NiFi MiNiFi C++
  Issue Type: New Feature
Reporter: Adam Debreceni
Assignee: Adam Debreceni


It is possible to provide edit-time feedback in some editors (Visual Studio 
Code, possibly others) when editing the flow config json (upcoming feature). We 
should generate such a schema by the minifi executable as we do it with the 
docs/manifest.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (MINIFICPP-1917) Generate JSON schema for flow config

2022-08-22 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni updated MINIFICPP-1917:
--
Summary: Generate JSON schema for flow config  (was: Generate JSON schema 
for config)

> Generate JSON schema for flow config
> 
>
> Key: MINIFICPP-1917
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1917
> Project: Apache NiFi MiNiFi C++
>  Issue Type: New Feature
>Reporter: Adam Debreceni
>Assignee: Adam Debreceni
>Priority: Major
>
> It is possible to provide edit-time feedback in some editors (Visual Studio 
> Code, possibly others) when editing the flow config json (upcoming feature). 
> We should generate such a schema by the minifi executable as we do it with 
> the docs/manifest.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1908) Fix python processor info in the manifest

2022-08-16 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1908:
-

 Summary: Fix python processor info in the manifest
 Key: MINIFICPP-1908
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1908
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


The description of python processors is malformed in the manifest.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1905) Extension loader directory traversal

2022-08-15 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1905:
-

 Summary: Extension loader directory traversal
 Key: MINIFICPP-1905
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1905
 Project: Apache NiFi MiNiFi C++
  Issue Type: Bug
Reporter: Adam Debreceni
Assignee: Adam Debreceni


There is a bug in traversing the directory tree while finding the extensions to 
load. The parent directory's path is used to determine if we descend into a 
subdirectory, but the subdirectory's path should be used.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (MINIFICPP-1903) Make utils::Regex handle std::string_view

2022-08-10 Thread Adam Debreceni (Jira)
Adam Debreceni created MINIFICPP-1903:
-

 Summary: Make utils::Regex handle std::string_view
 Key: MINIFICPP-1903
 URL: https://issues.apache.org/jira/browse/MINIFICPP-1903
 Project: Apache NiFi MiNiFi C++
  Issue Type: Improvement
Reporter: Adam Debreceni
Assignee: Adam Debreceni


Currently due to a bug we can't use std::regex on all platforms. The interface 
of utils::regexSearch/utils::regexMatch (which aims to abstract away this 
difference) does not allow working with std::string_view but forces an 
std::string allocation even on platforms supporting std::regex.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (MINIFICPP-1846) Add support for JSON flow configuration

2022-07-19 Thread Adam Debreceni (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Debreceni reassigned MINIFICPP-1846:
-

Assignee: Adam Debreceni

> Add support for JSON flow configuration
> ---
>
> Key: MINIFICPP-1846
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1846
> Project: Apache NiFi MiNiFi C++
>  Issue Type: New Feature
>Reporter: Marton Szasz
>Assignee: Adam Debreceni
>Priority: Major
>
> NiFi is starting to switch to flow JSONs. Check if MiNiFi C++ can adopt the 
> same or similar format, and add support for it.
> Check if we can do so in such a way that supports loading both a flow.json 
> and multiple parts from flow.json.d/*.json, and merge them during load time. 
> This would be a separate feature, but if it's easy to do, it could serve as a 
> basis for preinstalled partial flows, or it could allow the separation of 
> different process groups into different files.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


  1   2   3   4   >