[jira] [Created] (MINIFICPP-2434) Use dynamic_cast for c2 update service
Adam Debreceni created MINIFICPP-2434: - Summary: Use dynamic_cast for c2 update service Key: MINIFICPP-2434 URL: https://issues.apache.org/jira/browse/MINIFICPP-2434 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2433) Add nifi.c2.rest.path.base to the minifi installer
Adam Debreceni created MINIFICPP-2433: - Summary: Add nifi.c2.rest.path.base to the minifi installer Key: MINIFICPP-2433 URL: https://issues.apache.org/jira/browse/MINIFICPP-2433 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2427) Create new flowfile content instead of providing a view into a shared resource
Adam Debreceni created MINIFICPP-2427: - Summary: Create new flowfile content instead of providing a view into a shared resource Key: MINIFICPP-2427 URL: https://issues.apache.org/jira/browse/MINIFICPP-2427 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni Currently each flowfile implements a view into a possibly shared resource. When this resource is large this could result in a performance bottleneck since each rocksdb read must read the whole resource even if the view is only a few bytes. We should create brand new resources. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2403) Refactor c2 server urls
Adam Debreceni created MINIFICPP-2403: - Summary: Refactor c2 server urls Key: MINIFICPP-2403 URL: https://issues.apache.org/jira/browse/MINIFICPP-2403 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (MINIFICPP-2365) Change minifi_native extension
[ https://issues.apache.org/jira/browse/MINIFICPP-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni updated MINIFICPP-2365: -- Description: Python searches for minifi_native.so on non-windows systems, even on macOS, where the extension of shared libraries is dylib. We should name the extension of this symlink accordingly. > Change minifi_native extension > -- > > Key: MINIFICPP-2365 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2365 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Python searches for minifi_native.so on non-windows systems, even on macOS, > where the extension of shared libraries is dylib. We should name the > extension of this symlink accordingly. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2365) Change minifi_native extension
Adam Debreceni created MINIFICPP-2365: - Summary: Change minifi_native extension Key: MINIFICPP-2365 URL: https://issues.apache.org/jira/browse/MINIFICPP-2365 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2364) Add missing plist file
Adam Debreceni created MINIFICPP-2364: - Summary: Add missing plist file Key: MINIFICPP-2364 URL: https://issues.apache.org/jira/browse/MINIFICPP-2364 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-2243) ListenHTTP: avoid reading full input or output flow file contents into memory
[ https://issues.apache.org/jira/browse/MINIFICPP-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-2243: - Assignee: Adam Debreceni > ListenHTTP: avoid reading full input or output flow file contents into memory > - > > Key: MINIFICPP-2243 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2243 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Marton Szasz >Assignee: Adam Debreceni >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2347) Flow config structure errors should reference the invalid node
Adam Debreceni created MINIFICPP-2347: - Summary: Flow config structure errors should reference the invalid node Key: MINIFICPP-2347 URL: https://issues.apache.org/jira/browse/MINIFICPP-2347 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Adam Debreceni Assignee: Adam Debreceni Currently some exceptions in json do not contain the path they occur (in yaml the exact line and offset is logged so this is not an issue). We should make sure that the path to the node is logged as well as the error. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2340) Upgrade WiX tool support
Adam Debreceni created MINIFICPP-2340: - Summary: Upgrade WiX tool support Key: MINIFICPP-2340 URL: https://issues.apache.org/jira/browse/MINIFICPP-2340 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2315) Send asset id hashes in c2 heartbeat
Adam Debreceni created MINIFICPP-2315: - Summary: Send asset id hashes in c2 heartbeat Key: MINIFICPP-2315 URL: https://issues.apache.org/jira/browse/MINIFICPP-2315 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Adam Debreceni The agent should calculate the hash of all asset ids and send it in each heartbeat for the c2 agent to assess if a sync operation is needed. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2314) Introduce SYNC_ASSETS c2 command
Adam Debreceni created MINIFICPP-2314: - Summary: Introduce SYNC_ASSETS c2 command Key: MINIFICPP-2314 URL: https://issues.apache.org/jira/browse/MINIFICPP-2314 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Adam Debreceni Assignee: Adam Debreceni The c2 server sends a list of file paths, ids and download urls. The agent should calculate the diff and fetch files as needed. {code:java} { operation: heartbeat, requested_operations: [ { operationid: 13, operation: sync, operand: asset, args: [ { file: , url: , id: }, { file: , url: , id: } ] } ] } {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (MINIFICPP-2301) Respect SQLITE_ROOT
[ https://issues.apache.org/jira/browse/MINIFICPP-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni updated MINIFICPP-2301: -- Description: soci uses the system sqlite even if SQLITE_ROOT is set on macos > Respect SQLITE_ROOT > > > Key: MINIFICPP-2301 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2301 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Minor > > soci uses the system sqlite even if SQLITE_ROOT is set on macos -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2301) Respect SQLITE_ROOT
Adam Debreceni created MINIFICPP-2301: - Summary: Respect SQLITE_ROOT Key: MINIFICPP-2301 URL: https://issues.apache.org/jira/browse/MINIFICPP-2301 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-2299) SQL tests transiently fail on MacOS in CI
[ https://issues.apache.org/jira/browse/MINIFICPP-2299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-2299: - Assignee: Adam Debreceni > SQL tests transiently fail on MacOS in CI > - > > Key: MINIFICPP-2299 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2299 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gábor Gyimesi >Assignee: Adam Debreceni >Priority: Minor > > SQL tests often fail with the following issue on MacOS in github actions: > > /Users/runner/work/nifi-minifi-cpp/nifi-minifi-cpp/extensions/sql/tests/QueryDatabaseTableTests.cpp:176: > FAILED: > due to unexpected exception with message: > Errorconnectingtodatabase: [iODBC][Driver Manager]dlopen(libsqlite3odbc. > so,0x0006): tried: 'libsqlite3odbc.so' (nosuchfile), '/System/Volumes/ > Preboot/Cryptexes/OSlibsqlite3odbc.so' (no such file), '/Users/runner/work/ > nifi-minifi-cpp/nifi-minifi-cpp/build/bin/libsqlite3odbc.so' ( (SQL state > 0) > > The runner machines seem to be a bit different when the failure occurs, the > difference I found was that the installed SQLite version is 3.45.1 when the > tests fail and 3.44.2 when the tests succeed. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (MINIFICPP-2296) Install application as a service on macos with minifi.sh install command
[ https://issues.apache.org/jira/browse/MINIFICPP-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni updated MINIFICPP-2296: -- Summary: Install application as a service on macos with minifi.sh install command (was: Install application as a service with minifi.sh install command) > Install application as a service on macos with minifi.sh install command > > > Key: MINIFICPP-2296 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2296 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2296) Install application as a service with minifi.sh install command
Adam Debreceni created MINIFICPP-2296: - Summary: Install application as a service with minifi.sh install command Key: MINIFICPP-2296 URL: https://issues.apache.org/jira/browse/MINIFICPP-2296 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2267) Add openssl dylib to package on intel macos
Adam Debreceni created MINIFICPP-2267: - Summary: Add openssl dylib to package on intel macos Key: MINIFICPP-2267 URL: https://issues.apache.org/jira/browse/MINIFICPP-2267 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (MINIFICPP-2217) Create JoltTransform processor
[ https://issues.apache.org/jira/browse/MINIFICPP-2217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni updated MINIFICPP-2217: -- Priority: Minor (was: Major) > Create JoltTransform processor > -- > > Key: MINIFICPP-2217 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2217 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2217) Create JoltTransform processor
Adam Debreceni created MINIFICPP-2217: - Summary: Create JoltTransform processor Key: MINIFICPP-2217 URL: https://issues.apache.org/jira/browse/MINIFICPP-2217 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-2178) Move extension tests to the appropriate extension directories (from libminifi/test)
[ https://issues.apache.org/jira/browse/MINIFICPP-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-2178: - Assignee: Adam Debreceni > Move extension tests to the appropriate extension directories (from > libminifi/test) > --- > > Key: MINIFICPP-2178 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2178 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Marton Szasz >Assignee: Adam Debreceni >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-2193) Add agent manifest to C2 debug package
[ https://issues.apache.org/jira/browse/MINIFICPP-2193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-2193: - Assignee: Adam Debreceni > Add agent manifest to C2 debug package > -- > > Key: MINIFICPP-2193 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2193 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Marton Szasz >Assignee: Adam Debreceni >Priority: Major > > The agent manifest contains a lot of useful information about the system, > which can be helpful in a situation where remote debugging of minifi agent > problems is required. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-1951) Parallel DefragmentTexts should not rewrite each other's content
[ https://issues.apache.org/jira/browse/MINIFICPP-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-1951: - Assignee: Adam Debreceni > Parallel DefragmentTexts should not rewrite each other's content > > > Key: MINIFICPP-1951 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1951 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Gábor Gyimesi >Assignee: Adam Debreceni >Priority: Minor > > DefragmentText processors append flow file contents, which can modify the > content repository. If multiple DefragmentText processors run and modify the > same flow file in parallel (in a situation when a processor's relationship is > connected to multiple DefragmentText processors), that should result in two > separate flow files forwarded to the rest of the flow. It should create > separate files in the content repository as well. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (MINIFICPP-2176) Add tests for ListSFTP minimum_reliable_timestamp
[ https://issues.apache.org/jira/browse/MINIFICPP-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750760#comment-17750760 ] Adam Debreceni commented on MINIFICPP-2176: --- the utility of rounding of the timestamp is questionable, e.g: setting to minute precision, we query the files at 2:28, so the limit becomes 1:28, but we are rounding down to minute so 1:00, i.e. every file before 1:00 gets processed, the rounding difference affects files modified between 1:00 and 1:28 > Add tests for ListSFTP minimum_reliable_timestamp > - > > Key: MINIFICPP-2176 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2176 > Project: Apache NiFi MiNiFi C++ > Issue Type: Test >Reporter: Adam Debreceni >Priority: Minor > > https://github.com/apache/nifi-minifi-cpp/pull/1623#discussion_r1281760440 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2176) Add tests for ListSFTP minimum_reliable_timestamp
Adam Debreceni created MINIFICPP-2176: - Summary: Add tests for ListSFTP minimum_reliable_timestamp Key: MINIFICPP-2176 URL: https://issues.apache.org/jira/browse/MINIFICPP-2176 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2153) Change MergeContent default to Bin Packing
Adam Debreceni created MINIFICPP-2153: - Summary: Change MergeContent default to Bin Packing Key: MINIFICPP-2153 URL: https://issues.apache.org/jira/browse/MINIFICPP-2153 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-2143) CWEL JSON: add System/Security/UserId
[ https://issues.apache.org/jira/browse/MINIFICPP-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-2143: - Assignee: Adam Debreceni > CWEL JSON: add System/Security/UserId > - > > Key: MINIFICPP-2143 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2143 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Marton Szasz >Assignee: Adam Debreceni >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Comment Edited] (MINIFICPP-2144) Allow windows service and standalone execution with different MINIFI_HOMEs
[ https://issues.apache.org/jira/browse/MINIFICPP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737027#comment-17737027 ] Adam Debreceni edited comment on MINIFICPP-2144 at 6/26/23 7:42 AM: turns out that this was caused by the semaphore usage which is removed as of [MINIFICPP-2121|https://issues.apache.org/jira/browse/MINIFICPP-2121] was (Author: adebreceni): turns out that this was caused by the semaphore usage which is removed as of [MINIFICPP-2020|https://issues.apache.org/jira/browse/MINIFICPP-2020] > Allow windows service and standalone execution with different MINIFI_HOMEs > -- > > Key: MINIFICPP-2144 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2144 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > > A minifi service on windows prevents any other minifi instance from running > even if their MINIFI_HOME is different. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-2144) Allow windows service and standalone execution with different MINIFI_HOMEs
[ https://issues.apache.org/jira/browse/MINIFICPP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-2144. --- Resolution: Fixed fixed in https://issues.apache.org/jira/browse/MINIFICPP-2121 > Allow windows service and standalone execution with different MINIFI_HOMEs > -- > > Key: MINIFICPP-2144 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2144 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > > A minifi service on windows prevents any other minifi instance from running > even if their MINIFI_HOME is different. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (MINIFICPP-2144) Allow windows service and standalone execution with different MINIFI_HOMEs
[ https://issues.apache.org/jira/browse/MINIFICPP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737027#comment-17737027 ] Adam Debreceni commented on MINIFICPP-2144: --- turns out that this was caused by the semaphore usage which is removed as of [MINIFICPP-2020|https://issues.apache.org/jira/browse/MINIFICPP-2020] > Allow windows service and standalone execution with different MINIFI_HOMEs > -- > > Key: MINIFICPP-2144 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2144 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > > A minifi service on windows prevents any other minifi instance from running > even if their MINIFI_HOME is different. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2144) Allow windows service and standalone execution with different MINIFI_HOMEs
Adam Debreceni created MINIFICPP-2144: - Summary: Allow windows service and standalone execution with different MINIFI_HOMEs Key: MINIFICPP-2144 URL: https://issues.apache.org/jira/browse/MINIFICPP-2144 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni A minifi service on windows prevents any other minifi instance from running even if their MINIFI_HOME is different. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-1755) Use std::span instead of gsl::span
[ https://issues.apache.org/jira/browse/MINIFICPP-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-1755: - Assignee: Adam Debreceni > Use std::span instead of gsl::span > -- > > Key: MINIFICPP-1755 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1755 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Marton Szasz >Assignee: Adam Debreceni >Priority: Major > Labels: MiNiFi-CPP-Hygiene > > The move is not trivial, because there is no .as_span member of std::span. > There is `as_bytes()`, but we do (rarely) use `as_span` with types other > than `std::byte`, too. We could write a free-standing utility function for > the non-byte case of `as_span` (and maybe some of those cases could use > `std::byte` instead). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2128) Verify test utility hash
Adam Debreceni created MINIFICPP-2128: - Summary: Verify test utility hash Key: MINIFICPP-2128 URL: https://issues.apache.org/jira/browse/MINIFICPP-2128 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni Verify the hash of sqliteodbc driver on windows. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2121) Investigate if we need the semaphore for intraprocess signaling
Adam Debreceni created MINIFICPP-2121: - Summary: Investigate if we need the semaphore for intraprocess signaling Key: MINIFICPP-2121 URL: https://issues.apache.org/jira/browse/MINIFICPP-2121 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-2020) Fix the code which is supposed to stop two MiNiFi instances from interfering with each other
[ https://issues.apache.org/jira/browse/MINIFICPP-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-2020: - Assignee: Adam Debreceni > Fix the code which is supposed to stop two MiNiFi instances from interfering > with each other > > > Key: MINIFICPP-2020 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2020 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Ferenc Gerlits >Assignee: Adam Debreceni >Priority: Minor > Time Spent: 2h > Remaining Estimate: 0h > > On Windows, > * (x) if MiNiFi is already running as a service and you try to start another > instance from the console, then the second instance will exit with > %errorlevel% == -1, but without any message printed to either the console or > the log file, because GetTerminationEventHandle returns a null pointer; > * (/) if MiNiFi is not running as a service, you can start up two instances > with different MINIFI_HOMES from the console; > * (?) if you start up a MiNiFi instance from the console, then you start the > MiNiFi service, that works (assuming their MINIFI_HOMEs are different). > On Linux, > * (/) you can start up two instances as long as their MINIFI_HOMEs are > different. > On both, > * (?) if you try to start up two MiNiFi instances with the same MINIFI_HOME, > it will fail, as long as some repositories are RocksDB, because RocksDB can't > open the repo if another process has it open already. > > In theory, the process semaphore should stop the last case before trying to > open the DBs, but it doesn't, because we open the semaphore in non-exclusive > mode. Opening the process semaphore in exclusive mode (with no other > changes) would be a bad solution, because in the case of a crash or a kill > signal, the stale semaphore would stop the user from starting a new MiNiFi > instance and would have to be removed manually. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2111) Remove test-only stream yaml config parse method
Adam Debreceni created MINIFICPP-2111: - Summary: Remove test-only stream yaml config parse method Key: MINIFICPP-2111 URL: https://issues.apache.org/jira/browse/MINIFICPP-2111 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni YamlConfiguration::getYamlRoot(std::istream&) method is only used in the yaml unit tests, we could remove it in favor of the getRootFromPayload method. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2109) Provide more helpful config parse error messages
Adam Debreceni created MINIFICPP-2109: - Summary: Provide more helpful config parse error messages Key: MINIFICPP-2109 URL: https://issues.apache.org/jira/browse/MINIFICPP-2109 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni Currently a json parse failure is discarded and we try to parse it as yaml, but this could mask the json parse failure's valid error message. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2105) Throw on invalid output format in ConsumeWindowsEventLog
Adam Debreceni created MINIFICPP-2105: - Summary: Throw on invalid output format in ConsumeWindowsEventLog Key: MINIFICPP-2105 URL: https://issues.apache.org/jira/browse/MINIFICPP-2105 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-2081) CWEL saved logs support
[ https://issues.apache.org/jira/browse/MINIFICPP-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-2081: - Assignee: Adam Debreceni > CWEL saved logs support > --- > > Key: MINIFICPP-2081 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2081 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Marton Szasz >Assignee: Adam Debreceni >Priority: Minor > > According to the EvtQuery docs, specifying a file path as Channel should > normally work, but for some reason, it doesn't. This may be an easy feature > addition if it only needs some small fix. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2086) Add extra accept header for c2 yaml flow download
Adam Debreceni created MINIFICPP-2086: - Summary: Add extra accept header for c2 yaml flow download Key: MINIFICPP-2086 URL: https://issues.apache.org/jira/browse/MINIFICPP-2086 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni Specify the exact application-specific mime type for yaml flow download. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2085) Minifi is crashing on c2 heartbeat after flow update with the same processor id
Adam Debreceni created MINIFICPP-2085: - Summary: Minifi is crashing on c2 heartbeat after flow update with the same processor id Key: MINIFICPP-2085 URL: https://issues.apache.org/jira/browse/MINIFICPP-2085 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni We cache the ProcessorController for each processor id, after an update that cache is both ever-growing and not overwritten with the new processor referencing old destroyed processor pointers. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2071) Change default configuration class to yaml
Adam Debreceni created MINIFICPP-2071: - Summary: Change default configuration class to yaml Key: MINIFICPP-2071 URL: https://issues.apache.org/jira/browse/MINIFICPP-2071 Project: Apache NiFi MiNiFi C++ Issue Type: Task Reporter: Adam Debreceni Assignee: Adam Debreceni Change default configuration class to yaml. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2065) Allow disabling json support
Adam Debreceni created MINIFICPP-2065: - Summary: Allow disabling json support Key: MINIFICPP-2065 URL: https://issues.apache.org/jira/browse/MINIFICPP-2065 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Adam Debreceni Assignee: Adam Debreceni We should advertise the possible configuration formats the agent accepts through the c2 protocol based on the FlowConfiguration's capabilities. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2054) Periodically force rocksdb compaction
Adam Debreceni created MINIFICPP-2054: - Summary: Periodically force rocksdb compaction Key: MINIFICPP-2054 URL: https://issues.apache.org/jira/browse/MINIFICPP-2054 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni Sometimes rocksdb sst files can get stuck even though all items have been deleted, running a forced compaction on it clears them up. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2045) Enable synchronous flow file reloading, and orphan content cleanup
Adam Debreceni created MINIFICPP-2045: - Summary: Enable synchronous flow file reloading, and orphan content cleanup Key: MINIFICPP-2045 URL: https://issues.apache.org/jira/browse/MINIFICPP-2045 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni Currently, reloading the flow files happens asynchronously which allows connections to exceed the backpressure threshold. We should also clean up contents without owner flow files. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (MINIFICPP-2043) Do not read stale checkpoint data
[ https://issues.apache.org/jira/browse/MINIFICPP-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni updated MINIFICPP-2043: -- Summary: Do not read stale checkpoint data (was: Always delete checkpoint directory) > Do not read stale checkpoint data > - > > Key: MINIFICPP-2043 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2043 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > > Steps to reproduce: > - the agent starts up and creates a checkpoint directory of a non-empty > flowfilerepository > - allow the active flowfilerepository to be emptied out > - trigger a flow update, it will not delete the existing checkpoint > directory but use it regardless and reload stale flowfiles -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (MINIFICPP-2043) Always delete checkpoint directory
[ https://issues.apache.org/jira/browse/MINIFICPP-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni updated MINIFICPP-2043: -- Description: Steps to reproduce: - the agent starts up and creates a checkpoint directory of a non-empty flowfilerepository - allow the active flowfilerepository to be emptied out - trigger a flow update, it will not delete the existing checkpoint directory but use it regardless and reload stale flowfiles was: Steps to reproduce: - the agent starts up and creates a checkpoint directory of a non-empty flowfilerepository - allow the active flowfilerepository to be emptied out - restart the agent, it will not delete the existing checkpoint directory but use it regardless and reload stale flowfiles > Always delete checkpoint directory > -- > > Key: MINIFICPP-2043 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2043 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > > Steps to reproduce: > - the agent starts up and creates a checkpoint directory of a non-empty > flowfilerepository > - allow the active flowfilerepository to be emptied out > - trigger a flow update, it will not delete the existing checkpoint > directory but use it regardless and reload stale flowfiles -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2043) Always delete checkpoint directory
Adam Debreceni created MINIFICPP-2043: - Summary: Always delete checkpoint directory Key: MINIFICPP-2043 URL: https://issues.apache.org/jira/browse/MINIFICPP-2043 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni Steps to reproduce: - the agent starts up and creates a checkpoint directory of a non-empty flowfilerepository - allow the active flowfilerepository to be emptied out - restart the agent, it will not delete the existing checkpoint directory but use it regardless and reload stale flowfiles -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2040) Do not deserialize flow file just to be deleted
Adam Debreceni created MINIFICPP-2040: - Summary: Do not deserialize flow file just to be deleted Key: MINIFICPP-2040 URL: https://issues.apache.org/jira/browse/MINIFICPP-2040 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Adam Debreceni Assignee: Adam Debreceni Currently FlowFileRepository deserializes each flow file just to be deleted, it makes the deletion of the content possible. We should elide the deserialization step. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-1372) Add batch cleanup for ContentRepository
[ https://issues.apache.org/jira/browse/MINIFICPP-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-1372: - Assignee: Adam Debreceni > Add batch cleanup for ContentRepository > --- > > Key: MINIFICPP-1372 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1372 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Affects Versions: 0.9.0, 0.7.0 >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Labels: selected-for-development > Fix For: 0.14.0 > > > Currently all content is removed one-by-one whenever the refCount in the > ContentReposiroty::count_map_ goes to 0. For the rocksdb backed > DatabaseContentRepository this results in an unnecessary cost we could elide > if we batch-remove these resources. We could create a background gc thread > like in FlowFileRepository to handle the actual removal. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1976) Do not duplicate relationships for each transfer
[ https://issues.apache.org/jira/browse/MINIFICPP-1976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1976. --- Resolution: Done > Do not duplicate relationships for each transfer > > > Key: MINIFICPP-1976 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1976 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 2h 10m > Remaining Estimate: 0h > > Currently we store a copy of a Relationship object for each transferred flow > file, these objects add up. Investigate if we could make do without this > duplication. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1959) Fix VolatileFlowFileRepository leaving dangling ResourceClaims
[ https://issues.apache.org/jira/browse/MINIFICPP-1959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1959. --- Resolution: Fixed > Fix VolatileFlowFileRepository leaving dangling ResourceClaims > -- > > Key: MINIFICPP-1959 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1959 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 1.5h > Remaining Estimate: 0h > > In `ProcessSession::commit` waiting for `MultiPut` to finish before calling > `increaseFlowFileRecordOwnedCount` could evict previously stored flowfiles > from the VolatileRepo causing their resource's ref_counter to go to 0 (as we > are yet to increase on behalf of the stored reference) causing dangling > ResourceClaims. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1984) Restart old flow if flow update fails
[ https://issues.apache.org/jira/browse/MINIFICPP-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1984. --- Resolution: Fixed > Restart old flow if flow update fails > - > > Key: MINIFICPP-1984 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1984 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > We currently call a load with the previous flow, but we do not call start, > leaving processors unscheduled, and unable to get triggered. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-2012) Possible leak
[ https://issues.apache.org/jira/browse/MINIFICPP-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-2012. --- Resolution: Fixed LookupAccountSid overwrites the size of the buffer with the number of bytes actually written NOT including the null terminator. > Possible leak > - > > Key: MINIFICPP-2012 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2012 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-2017) Use std::string_view instead of std::string in ranges::join
[ https://issues.apache.org/jira/browse/MINIFICPP-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-2017. --- Resolution: Done > Use std::string_view instead of std::string in ranges::join > --- > > Key: MINIFICPP-2017 > URL: https://issues.apache.org/jira/browse/MINIFICPP-2017 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1227) Enable linting where applicable
[ https://issues.apache.org/jira/browse/MINIFICPP-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1227. --- Resolution: Not A Problem The linting has been greatly revised since then, this is no longer needed. > Enable linting where applicable > --- > > Key: MINIFICPP-1227 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1227 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Minor > > Some parts of the repository are excluded from the linting phase, notably > most of the extensions directory. Evaluate each part and enable their linting > if necessary. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2035) Support for nifi flow.json format
Adam Debreceni created MINIFICPP-2035: - Summary: Support for nifi flow.json format Key: MINIFICPP-2035 URL: https://issues.apache.org/jira/browse/MINIFICPP-2035 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Adam Debreceni Assignee: Adam Debreceni The agent should be able to handle a json flow config corresponding to a serialized VersionedDataflow object. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1386) Update includes and namespace for StreamCallbacks
[ https://issues.apache.org/jira/browse/MINIFICPP-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1386. --- Resolution: Not A Problem refactored in MINIFICPP-1717 > Update includes and namespace for StreamCallbacks > - > > Key: MINIFICPP-1386 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1386 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > > InputStreamCallback and OutputStreamCallback are about to be moved to their > own file from FlowFile.h. All files which access the class through transitive > includes should be updated moreover they should be moved to the `io` > namespace. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1407) Properly handle config deletion
[ https://issues.apache.org/jira/browse/MINIFICPP-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1407. --- Assignee: Adam Debreceni Resolution: Fixed > Properly handle config deletion > --- > > Key: MINIFICPP-1407 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1407 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 2h 50m > Remaining Estimate: 0h > > Currently on c2 update we write the flow url only once (only if it is missing > from minifi.properties). This makes it impossible to refetch the correct flow > if the agent is restarted and the configuration file is deleted (by accident > or on purpose). We should correctly update the flow url on each c2 update, > and if no flow config is present, use that to instantiate a flow. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (MINIFICPP-1538) Investigate per process group column families
[ https://issues.apache.org/jira/browse/MINIFICPP-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni updated MINIFICPP-1538: -- Issue Type: Task (was: New Feature) > Investigate per process group column families > - > > Key: MINIFICPP-1538 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1538 > Project: Apache NiFi MiNiFi C++ > Issue Type: Task >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Attachments: Screenshot 2021-04-14 at 12.50.05.png, Screenshot > 2021-04-14 at 12.50.14.png > > > *Edit*: See performance measurement in the comments of a previous > implementation. > Currently all operations in FlowFileRepository go through a single column > family (the default). We should investigate the performance benefit, if any, > of using different column families for different process groups (special care > must be taken for RPGs, the processors of which logically belong to their > parent groups). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1538) Investigate per process group column families
[ https://issues.apache.org/jira/browse/MINIFICPP-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1538. --- Resolution: Done > Investigate per process group column families > - > > Key: MINIFICPP-1538 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1538 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Attachments: Screenshot 2021-04-14 at 12.50.05.png, Screenshot > 2021-04-14 at 12.50.14.png > > > *Edit*: See performance measurement in the comments of a previous > implementation. > Currently all operations in FlowFileRepository go through a single column > family (the default). We should investigate the performance benefit, if any, > of using different column families for different process groups (special care > must be taken for RPGs, the processors of which logically belong to their > parent groups). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Reopened] (MINIFICPP-1538) Investigate per process group column families
[ https://issues.apache.org/jira/browse/MINIFICPP-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reopened MINIFICPP-1538: --- > Investigate per process group column families > - > > Key: MINIFICPP-1538 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1538 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Attachments: Screenshot 2021-04-14 at 12.50.05.png, Screenshot > 2021-04-14 at 12.50.14.png > > > *Edit*: See performance measurement in the comments of a previous > implementation. > Currently all operations in FlowFileRepository go through a single column > family (the default). We should investigate the performance benefit, if any, > of using different column families for different process groups (special care > must be taken for RPGs, the processors of which logically belong to their > parent groups). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1538) Investigate per process group column families
[ https://issues.apache.org/jira/browse/MINIFICPP-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1538. --- Resolution: Won't Do > Investigate per process group column families > - > > Key: MINIFICPP-1538 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1538 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Attachments: Screenshot 2021-04-14 at 12.50.05.png, Screenshot > 2021-04-14 at 12.50.14.png > > > *Edit*: See performance measurement in the comments of a previous > implementation. > Currently all operations in FlowFileRepository go through a single column > family (the default). We should investigate the performance benefit, if any, > of using different column families for different process groups (special care > must be taken for RPGs, the processors of which logically belong to their > parent groups). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1548) Investigate merging the three rocksdb databases
[ https://issues.apache.org/jira/browse/MINIFICPP-1548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1548. --- Assignee: Adam Debreceni Resolution: Done > Investigate merging the three rocksdb databases > --- > > Key: MINIFICPP-1548 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1548 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 3h 50m > Remaining Estimate: 0h > > Currently we use three separate rocksdb databases: one for the > FlowFileRepository one for the ContentRepository and one for the > KeyValueStoreService. There is ad-hoc syncing between some of them (FFRepo > and ContentRepo) which a single rocksdb instance could provide out of the > box. We should investigate if utilizing a single database backend and > separate column families for these three, would be viable without large-scale > refactors. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1722) Missing artifact field from manifest
[ https://issues.apache.org/jira/browse/MINIFICPP-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1722. --- Resolution: Fixed > Missing artifact field from manifest > > > Key: MINIFICPP-1722 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1722 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > > A property can specify what type of service it accepts (like InvokeHTTP's SSL > Context Service only accepts an SSLContextService type). The artifact field > describing this type disappeared from the manifest. Restore it. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1903) Make utils::Regex handle std::string_view
[ https://issues.apache.org/jira/browse/MINIFICPP-1903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1903. --- Resolution: Done > Make utils::Regex handle std::string_view > - > > Key: MINIFICPP-1903 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1903 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 1h 40m > Remaining Estimate: 0h > > Currently due to a bug we can't use std::regex on all platforms. The > interface of utils::regexSearch/utils::regexMatch (which aims to abstract > away this difference) does not allow working with std::string_view but forces > an std::string allocation even on platforms supporting std::regex. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1905) Extension loader directory traversal
[ https://issues.apache.org/jira/browse/MINIFICPP-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1905. --- Resolution: Fixed > Extension loader directory traversal > > > Key: MINIFICPP-1905 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1905 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > There is a bug in traversing the directory tree while finding the extensions > to load. The parent directory's path is used to determine if we descend into > a subdirectory, but the subdirectory's path should be used. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1918) Fix windows build
[ https://issues.apache.org/jira/browse/MINIFICPP-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1918. --- Resolution: Fixed > Fix windows build > - > > Key: MINIFICPP-1918 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1918 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 1h > Remaining Estimate: 0h > > `std::filesystem:: path` is not convertible to std::string -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1908) Fix python processor info in the manifest
[ https://issues.apache.org/jira/browse/MINIFICPP-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1908. --- Resolution: Fixed > Fix python processor info in the manifest > - > > Key: MINIFICPP-1908 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1908 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > > The description of python processors is malformed in the manifest. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1917) Generate JSON schema for flow config
[ https://issues.apache.org/jira/browse/MINIFICPP-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1917. --- Resolution: Done > Generate JSON schema for flow config > > > Key: MINIFICPP-1917 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1917 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 3h > Remaining Estimate: 0h > > It is possible to provide edit-time feedback in some editors (Visual Studio > Code, possibly others) when editing the flow config json (upcoming feature). > We should generate such a schema by the minifi executable as we do it with > the docs/manifest. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1991) Remove unused features from ControllerServiceProvider
[ https://issues.apache.org/jira/browse/MINIFICPP-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1991. --- Assignee: Adam Debreceni Resolution: Done > Remove unused features from ControllerServiceProvider > - > > Key: MINIFICPP-1991 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1991 > Project: Apache NiFi MiNiFi C++ > Issue Type: Improvement >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 1.5h > Remaining Estimate: 0h > > ControllerServiceProvider seems to contain unused methods, probably coming > from nifi. We should remove them and only readd them if need be. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2033) Check if we need runDurationNanos
Adam Debreceni created MINIFICPP-2033: - Summary: Check if we need runDurationNanos Key: MINIFICPP-2033 URL: https://issues.apache.org/jira/browse/MINIFICPP-2033 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Currently we can set the runDurationNanos but it is unused, investigate if we need it or it can be removed. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2017) Use std::string_view instead of std::string in ranges::join
Adam Debreceni created MINIFICPP-2017: - Summary: Use std::string_view instead of std::string in ranges::join Key: MINIFICPP-2017 URL: https://issues.apache.org/jira/browse/MINIFICPP-2017 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2013) Ensure localization-correctness in `OsUtils::userIdToUsername`
Adam Debreceni created MINIFICPP-2013: - Summary: Ensure localization-correctness in `OsUtils::userIdToUsername` Key: MINIFICPP-2013 URL: https://issues.apache.org/jira/browse/MINIFICPP-2013 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni We currently do not take the necessary steps to ensure that user ids are mapped to usernames in an installation-language-conforming way. We should look into it if it is a problem. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2012) Possible leak
Adam Debreceni created MINIFICPP-2012: - Summary: Possible leak Key: MINIFICPP-2012 URL: https://issues.apache.org/jira/browse/MINIFICPP-2012 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2005) Fix compilation on clang 14.0.0 + libc++
Adam Debreceni created MINIFICPP-2005: - Summary: Fix compilation on clang 14.0.0 + libc++ Key: MINIFICPP-2005 URL: https://issues.apache.org/jira/browse/MINIFICPP-2005 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni We are using the iterator constructor of std::span, which is not available due to a bug in clang 14.0.0 + libc++ configuration. We should go with gsl::span. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2002) Typecheck query arguments in SQL processors
Adam Debreceni created MINIFICPP-2002: - Summary: Typecheck query arguments in SQL processors Key: MINIFICPP-2002 URL: https://issues.apache.org/jira/browse/MINIFICPP-2002 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni The used backend soci,odbc, do not seem to check the type of bound arguments in a prepared statement. We should investigate if it is feasible to fail such flowfiles or provide a "Check type" property to these sql processors. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-2001) In SQL processors fail flowfiles with more than required arguments
Adam Debreceni created MINIFICPP-2001: - Summary: In SQL processors fail flowfiles with more than required arguments Key: MINIFICPP-2001 URL: https://issues.apache.org/jira/browse/MINIFICPP-2001 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Currently the used libraries soci, odbc do not give feedback when more arguments are provided than required by the query, e.g. query = `INSERT INTO test VALUES (?);` args = ['1', '2'], we should give either a warning or fail such flowfiles. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-1994) Missing "failure", "retry" relationships for PutSql processor (and other processors)
[ https://issues.apache.org/jira/browse/MINIFICPP-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-1994: - Assignee: Adam Debreceni (was: Arpad Boda) > Missing "failure", "retry" relationships for PutSql processor (and other > processors) > > > Key: MINIFICPP-1994 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1994 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Kondakov Artem >Assignee: Adam Debreceni >Priority: Major > > According to the manifest, sent by minifi, PutSql processors (and many > others) do not have a failure relationship, while in the apache / nifi > project similar processors have it. > I think maintaining these relationships is important. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1992) ControllerServiceNode should enable its dependencies
Adam Debreceni created MINIFICPP-1992: - Summary: ControllerServiceNode should enable its dependencies Key: MINIFICPP-1992 URL: https://issues.apache.org/jira/browse/MINIFICPP-1992 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Linked Services in a ControllerService should be enabled before being able to enable the service itself. Similarly disabling a service should first disable all its dependents. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1991) Remove unused features from ControllerServiceProvider
Adam Debreceni created MINIFICPP-1991: - Summary: Remove unused features from ControllerServiceProvider Key: MINIFICPP-1991 URL: https://issues.apache.org/jira/browse/MINIFICPP-1991 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni ControllerServiceProvider seems to contain unused methods, probably coming from nifi. We should remove them and only readd them if need be. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1989) Circular reference in controllerservice
Adam Debreceni created MINIFICPP-1989: - Summary: Circular reference in controllerservice Key: MINIFICPP-1989 URL: https://issues.apache.org/jira/browse/MINIFICPP-1989 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni FlowController tried to clear its own controller_map_ but it is a ForwardingControllerServiceProvider. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1984) Restart old flow if flow update fails
Adam Debreceni created MINIFICPP-1984: - Summary: Restart old flow if flow update fails Key: MINIFICPP-1984 URL: https://issues.apache.org/jira/browse/MINIFICPP-1984 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni We currently call a load with the previous flow, but we do not call start, leaving processors unscheduled, and unable to get triggered. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1982) Fix documentation for BinFiles
Adam Debreceni created MINIFICPP-1982: - Summary: Fix documentation for BinFiles Key: MINIFICPP-1982 URL: https://issues.apache.org/jira/browse/MINIFICPP-1982 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni BinFiles processor documentation is confusing, we should fix the meaning of "bin", "group", "entry" and the general principle/purpose of operation. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1976) Do not duplicate relationships for each transfer
Adam Debreceni created MINIFICPP-1976: - Summary: Do not duplicate relationships for each transfer Key: MINIFICPP-1976 URL: https://issues.apache.org/jira/browse/MINIFICPP-1976 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni Currently we store a copy of a Relationship object for each transferred flow file, these objects add up. Investigate if we could make do without this duplication. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1973) Refactor ResourceQueue
Adam Debreceni created MINIFICPP-1973: - Summary: Refactor ResourceQueue Key: MINIFICPP-1973 URL: https://issues.apache.org/jira/browse/MINIFICPP-1973 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Currently ResourceQueue::getResource does not guarantee that the returned cached object is in any way similar to the constructor function provided. It also does not guarantee that the modified object is "reset" before adding it back into the queue. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (MINIFICPP-1950) Disable in-memory-caching for FileSystemRepository
[ https://issues.apache.org/jira/browse/MINIFICPP-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni resolved MINIFICPP-1950. --- Resolution: Implemented > Disable in-memory-caching for FileSystemRepository > -- > > Key: MINIFICPP-1950 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1950 > Project: Apache NiFi MiNiFi C++ > Issue Type: Bug >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > Time Spent: 1.5h > Remaining Estimate: 0h > > The DatabaseContentRepository's backend (rocksdb) does not support files > bigger than 4gb, so FileSystemRepository is a viable alternative for such > use-cases. Moreover, on memory-constrained systems storing large contents > in-memory is not acceptable. We should change the behavior of > FileSystemRepository to avoid such caches. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1959) Fix VolatileFlowFileRepository leaving dangling ResourceClaims
Adam Debreceni created MINIFICPP-1959: - Summary: Fix VolatileFlowFileRepository leaving dangling ResourceClaims Key: MINIFICPP-1959 URL: https://issues.apache.org/jira/browse/MINIFICPP-1959 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni In `ProcessSession::commit` waiting for `MultiPut` to finish before calling `increaseFlowFileRecordOwnedCount` could evict previously stored flowfiles from the VolatileRepo causing their resource's ref_counter to go to 0 (as we are yet to increase on behalf of the stored reference) causing dangling ResourceClaims. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1955) Revisit Stream::seek
Adam Debreceni created MINIFICPP-1955: - Summary: Revisit Stream::seek Key: MINIFICPP-1955 URL: https://issues.apache.org/jira/browse/MINIFICPP-1955 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Currently Stream::seek aims to set both the read and write offsets into the stream, we should talk this through, possibly mimic seekg/seekp (also BufferStream::seek is noop when writing) -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1954) Implement ConcatInputStream
Adam Debreceni created MINIFICPP-1954: - Summary: Implement ConcatInputStream Key: MINIFICPP-1954 URL: https://issues.apache.org/jira/browse/MINIFICPP-1954 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni We currently have no means to read back from a stream we have appended to when using BufferedContentSession, a ConcatInputStream could allow us to do just that. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1950) Disable in-memory-caching for FileSystemRepository
Adam Debreceni created MINIFICPP-1950: - Summary: Disable in-memory-caching for FileSystemRepository Key: MINIFICPP-1950 URL: https://issues.apache.org/jira/browse/MINIFICPP-1950 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni The DatabaseContentRepository's backend (rocksdb) does not support files bigger than 4gb, so FileSystemRepository is a viable alternative for such use-cases. Moreover, on memory-constrained systems storing large contents in-memory is not acceptable. We should change the behavior of FileSystemRepository to avoid such caches. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1937) High disk load when using MergeContent
Adam Debreceni created MINIFICPP-1937: - Summary: High disk load when using MergeContent Key: MINIFICPP-1937 URL: https://issues.apache.org/jira/browse/MINIFICPP-1937 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni The rocksdb content repository backend could exhibit unacceptable disk usage on some flows, e.g. GenerateFlowFile\{File Size: 2kB, period: 1 s, Batch Size: 200} -> MergeContent\{Batch Size: 500, Bin Packing, Delimiter: ';'} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1936) Python link error in script extension
Adam Debreceni created MINIFICPP-1936: - Summary: Python link error in script extension Key: MINIFICPP-1936 URL: https://issues.apache.org/jira/browse/MINIFICPP-1936 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni libpython.so is expected to be opened into the global scope, moreover there was a collision on systems using a different openssl library as the bundled libressl's symbols polluted the global scope -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1918) Fix windows build
Adam Debreceni created MINIFICPP-1918: - Summary: Fix windows build Key: MINIFICPP-1918 URL: https://issues.apache.org/jira/browse/MINIFICPP-1918 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni `std::filesystem:: path` is not convertible to std::string -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1917) Generate JSON schema for config
Adam Debreceni created MINIFICPP-1917: - Summary: Generate JSON schema for config Key: MINIFICPP-1917 URL: https://issues.apache.org/jira/browse/MINIFICPP-1917 Project: Apache NiFi MiNiFi C++ Issue Type: New Feature Reporter: Adam Debreceni Assignee: Adam Debreceni It is possible to provide edit-time feedback in some editors (Visual Studio Code, possibly others) when editing the flow config json (upcoming feature). We should generate such a schema by the minifi executable as we do it with the docs/manifest. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (MINIFICPP-1917) Generate JSON schema for flow config
[ https://issues.apache.org/jira/browse/MINIFICPP-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni updated MINIFICPP-1917: -- Summary: Generate JSON schema for flow config (was: Generate JSON schema for config) > Generate JSON schema for flow config > > > Key: MINIFICPP-1917 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1917 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Adam Debreceni >Assignee: Adam Debreceni >Priority: Major > > It is possible to provide edit-time feedback in some editors (Visual Studio > Code, possibly others) when editing the flow config json (upcoming feature). > We should generate such a schema by the minifi executable as we do it with > the docs/manifest. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1908) Fix python processor info in the manifest
Adam Debreceni created MINIFICPP-1908: - Summary: Fix python processor info in the manifest Key: MINIFICPP-1908 URL: https://issues.apache.org/jira/browse/MINIFICPP-1908 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni The description of python processors is malformed in the manifest. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1905) Extension loader directory traversal
Adam Debreceni created MINIFICPP-1905: - Summary: Extension loader directory traversal Key: MINIFICPP-1905 URL: https://issues.apache.org/jira/browse/MINIFICPP-1905 Project: Apache NiFi MiNiFi C++ Issue Type: Bug Reporter: Adam Debreceni Assignee: Adam Debreceni There is a bug in traversing the directory tree while finding the extensions to load. The parent directory's path is used to determine if we descend into a subdirectory, but the subdirectory's path should be used. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (MINIFICPP-1903) Make utils::Regex handle std::string_view
Adam Debreceni created MINIFICPP-1903: - Summary: Make utils::Regex handle std::string_view Key: MINIFICPP-1903 URL: https://issues.apache.org/jira/browse/MINIFICPP-1903 Project: Apache NiFi MiNiFi C++ Issue Type: Improvement Reporter: Adam Debreceni Assignee: Adam Debreceni Currently due to a bug we can't use std::regex on all platforms. The interface of utils::regexSearch/utils::regexMatch (which aims to abstract away this difference) does not allow working with std::string_view but forces an std::string allocation even on platforms supporting std::regex. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (MINIFICPP-1846) Add support for JSON flow configuration
[ https://issues.apache.org/jira/browse/MINIFICPP-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Debreceni reassigned MINIFICPP-1846: - Assignee: Adam Debreceni > Add support for JSON flow configuration > --- > > Key: MINIFICPP-1846 > URL: https://issues.apache.org/jira/browse/MINIFICPP-1846 > Project: Apache NiFi MiNiFi C++ > Issue Type: New Feature >Reporter: Marton Szasz >Assignee: Adam Debreceni >Priority: Major > > NiFi is starting to switch to flow JSONs. Check if MiNiFi C++ can adopt the > same or similar format, and add support for it. > Check if we can do so in such a way that supports loading both a flow.json > and multiple parts from flow.json.d/*.json, and merge them during load time. > This would be a separate feature, but if it's easy to do, it could serve as a > basis for preinstalled partial flows, or it could allow the separation of > different process groups into different files. -- This message was sent by Atlassian Jira (v8.20.10#820010)