This is an automated email from the ASF dual-hosted git repository. lordgamez pushed a change to branch MINIFICPP-2137 in repository https://gitbox.apache.org/repos/asf/nifi-minifi-cpp.git
omit 0fef6eb9a Review update omit f10d6e00d Remove unnecessary rvalue parameter omit 22bf1accb Only support TLS v1.2 omit 0bd73ab25 Review update omit bccd4826f Review update omit 7a990c037 Review update omit e8027a154 Continue on socket errors omit f267e3e2b Fix clang-tidy issue omit d9f3f5527 Use read_some instead of asio::read to have the socket read equivalent omit ae3acae7b Rewrite ControllerSocket to use coroutines omit dadf9b3ae Remove unneeded size check when reading AsioStream omit 938e5082c Remove duplication omit 1434168b3 MINIFICPP-2137 Rewrite MiNiFi Controller to use asio add 266bb13ed MINIFICPP-2127 Add multipart upload support for PutS3Object processor add dc3239dbf MINIFICPP-2143 Resolve Security/UserID attribute add 034ff6cbf MINIFICPP-2165 Add logger max log entry length configuration property add bed452e70 MINIFICPP-2166 Remove unused properties and update documentation add 914289a5a MINIFICPP-2158 Show true|false as allowed values of boolean properties in PROCESSORS.md add 2cef282cf MINIFICPP-2183 fix MacOS CI failure add aea2c3ce5 MINIFICPP-2137 Rewrite MiNiFi Controller to use asio add cd258abe9 Remove duplication add f067335a0 Remove unneeded size check when reading AsioStream add 388b76b2d Rewrite ControllerSocket to use coroutines add 49eea5165 Use read_some instead of asio::read to have the socket read equivalent add d294344b6 Fix clang-tidy issue add b13c8cbfa Continue on socket errors add cb5a0afca Review update add d828490fa Review update add cf5d23598 Review update add 993c8b8da Only support TLS v1.2 add 382521834 Remove unnecessary rvalue parameter add 4830868e6 Review update This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (0fef6eb9a) \ N -- N -- N refs/heads/MINIFICPP-2137 (4830868e6) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .github/workflows/ci.yml | 12 +- C2.md | 26 +- CONFIGURE.md | 186 +++++++++- PROCESSORS.md | 237 ++++++------- cmake/BuildTests.cmake | 13 +- conf/minifi-log.properties | 3 + docker/conf/minifi-log.properties | 3 + .../test/integration/cluster/DockerTestCluster.py | 4 + .../cluster/DockerTestDirectoryBindings.py | 17 + .../integration/cluster/checkers/AwsChecker.py | 12 + .../features/MiNiFi_integration_test_driver.py | 9 + docker/test/integration/features/s3.feature | 41 +++ docker/test/integration/features/steps/steps.py | 10 + .../filesystem_validation/OutputEventHandler.py | 6 - extensions/aws/processors/PutS3Object.cpp | 94 ++++- extensions/aws/processors/PutS3Object.h | 111 +++--- extensions/aws/s3/MultipartUploadStateStorage.cpp | 135 ++++++++ extensions/aws/s3/MultipartUploadStateStorage.h | 76 ++++ extensions/aws/s3/S3ClientRequestSender.cpp | 87 +++++ extensions/aws/s3/S3ClientRequestSender.h | 25 ++ extensions/aws/s3/S3RequestSender.h | 49 ++- extensions/aws/s3/S3Wrapper.cpp | 261 ++++++++++---- extensions/aws/s3/S3Wrapper.h | 108 +++++- extensions/aws/tests/MockS3RequestSender.h | 108 ++++++ .../aws/tests/MultipartUploadStateStorageTest.cpp | 162 +++++++++ extensions/aws/tests/PutS3ObjectTests.cpp | 238 ++++++++++++- extensions/aws/tests/S3TestsFixture.h | 9 +- .../http-curl/tests/C2DescribeManifestTest.cpp | 4 +- extensions/lua/tests/CMakeLists.txt | 1 + .../TestExecuteScriptProcessorWithLuaScript.cpp | 3 +- extensions/python/tests/CMakeLists.txt | 19 +- .../python/tests/ExecutePythonProcessorTests.cpp | 3 +- .../TestExecuteScriptProcessorWithPythonScript.cpp | 3 +- .../standard-processors/processors/LogAttribute.h | 1 + .../tests/unit/ConfigurationTests.cpp | 2 +- .../tests/ConsumeWindowsEventLogTests.cpp | 4 +- .../tests/MetadataWalkerTests.cpp | 15 + .../tests/resources/invalidxml.xml | 2 +- .../tests/resources/multiplesids.xml | 2 +- .../tests/resources/nobodysid.xml | 2 +- .../windows-event-log/tests/resources/nodata.xml | 2 +- .../resources/{withsids.xml => resolveduserid.xml} | 4 +- .../tests/resources/unknownsid.xml | 2 +- .../tests/resources/{nobodysid.xml => userid.xml} | 4 +- .../windows-event-log/tests/resources/withsids.xml | 2 +- extensions/windows-event-log/wel/JSONUtils.cpp | 6 + .../windows-event-log/wel/MetadataWalker.cpp | 48 ++- extensions/windows-event-log/wel/MetadataWalker.h | 7 +- libminifi/include/FlowControlProtocol.h | 273 --------------- libminifi/include/FlowController.h | 2 - libminifi/include/core/ProcessContext.h | 4 + libminifi/include/core/logging/Logger.h | 15 +- .../include/core/logging/LoggerConfiguration.h | 3 + libminifi/include/properties/Configuration.h | 7 +- libminifi/include/utils/TimeUtil.h | 19 +- libminifi/src/Configuration.cpp | 7 +- libminifi/src/FlowControlProtocol.cpp | 383 --------------------- libminifi/src/FlowController.cpp | 3 - .../controllers/keyvalue/KeyValueStateManager.cpp | 4 +- libminifi/src/core/logging/Logger.cpp | 1 - libminifi/src/core/logging/LoggerConfiguration.cpp | 15 + .../integration/StateTransactionalityTests.cpp | 13 +- libminifi/test/unit/LoggerTests.cpp | 71 ++++ libminifi/test/unit/TimeUtilTests.cpp | 12 +- minifi_main/AgentDocs.cpp | 17 +- 65 files changed, 1983 insertions(+), 1044 deletions(-) create mode 100644 extensions/aws/s3/MultipartUploadStateStorage.cpp create mode 100644 extensions/aws/s3/MultipartUploadStateStorage.h create mode 100644 extensions/aws/tests/MultipartUploadStateStorageTest.cpp copy extensions/windows-event-log/tests/resources/{withsids.xml => resolveduserid.xml} (96%) copy extensions/windows-event-log/tests/resources/{nobodysid.xml => userid.xml} (96%) delete mode 100644 libminifi/include/FlowControlProtocol.h delete mode 100644 libminifi/src/FlowControlProtocol.cpp