[
https://issues.apache.org/jira/browse/MINIFICPP-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marton Szasz updated MINIFICPP-2287:
------------------------------------
Description:
It looks like nifi may have extended the protocol, and minifi c++ didn't follow
the development.
>From Thomas on the nifi slack:
>[https://apachenifi.slack.com/archives/CDF1VC1UZ/p1705327811015419]
{quote}Running minifi c++ v0.15, I am getting errors when transferring large
files (10gb) via site to site to a Nifi (v1.20) cluster. Per the logs,the
transfer is on going for a while (warning logs, inputPortName has been running
for xxxxx ms in \{connection ID}
then it looks like the transfer completes (info log, Site to Site transaction
... set flow 1 flow records with total size xxx-yyy-zzz ) ALSO, the large file
appears on the remote Nifi cluster
then it looks like the transfer failed (warning log, Site2Site transaction xxx
peer unknown respond code 14)
then another error, (warning log , ProcessSession rollback for inputPortName
executed )
the finally, (warning protocol transmission failed, yielding ( xxx-yyy-zzz )
This results in endless copies of the large files as presumably minifi retries
the file despite successfully transferring the file.
The logs show that other smaller files continue to be transferred while the
large files yield. (edited)
{quote}
was:
It looks like nifi may have extended the protocol, and minifi c++ didn't follow
the development.
>From Thomas on the nifi slack:
>[https://apachenifi.slack.com/archives/CDF1VC1UZ/p1705327811015419]
{quote}Running minifi c++ v0.15, I am getting errors when transferring large
files (10gb) via site to site to a Nifi (v1.20) cluster. Per the logs,the
transfer is on going for a while (warning logs, inputPortName has been running
for xxxxx ms in \{connection ID}
then it looks like the transfer completes (info log, Site to Site transaction
... set flow 1 flow records with total size xxx-yyy-zzz ) ALSO, the large file
appears on the remote Nifi cluster
then it looks like the transfer failed (warning log, Site2Site transaction xxx
peer unknown respond code 14)
then another error, (warning log , ProcessSession rollback for inputPortName
executed )
the finally, (warning protocol transmission failed, yielding ( xxx-yyy-zzz
)This results in endless copies of the large files as presumably minifi retries
the file despite successfully transferring the file.The logs show that other
smaller files continue to be transferred while the large files yield. (edited)
{quote}
> Site-to-site with large files: "Site2Site transaction xxx peer unknown
> respond code 14"
> ---------------------------------------------------------------------------------------
>
> Key: MINIFICPP-2287
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2287
> Project: Apache NiFi MiNiFi C++
> Issue Type: Bug
> Reporter: Marton Szasz
> Priority: Major
>
> It looks like nifi may have extended the protocol, and minifi c++ didn't
> follow the development.
>
> From Thomas on the nifi slack:
> [https://apachenifi.slack.com/archives/CDF1VC1UZ/p1705327811015419]
>
> {quote}Running minifi c++ v0.15, I am getting errors when transferring large
> files (10gb) via site to site to a Nifi (v1.20) cluster. Per the logs,the
> transfer is on going for a while (warning logs, inputPortName has been
> running for xxxxx ms in \{connection ID}
> then it looks like the transfer completes (info log, Site to Site transaction
> ... set flow 1 flow records with total size xxx-yyy-zzz ) ALSO, the large
> file appears on the remote Nifi cluster
> then it looks like the transfer failed (warning log, Site2Site transaction
> xxx peer unknown respond code 14)
> then another error, (warning log , ProcessSession rollback for inputPortName
> executed )
> the finally, (warning protocol transmission failed, yielding ( xxx-yyy-zzz )
> This results in endless copies of the large files as presumably minifi
> retries the file despite successfully transferring the file.
> The logs show that other smaller files continue to be transferred while the
> large files yield. (edited)
> {quote}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)