[ https://issues.apache.org/jira/browse/NIFI-10622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yiteng Zhang updated NIFI-10622: -------------------------------- Description: At first I found that: {code:java} org.apache.nifi.remote.protocol.http.TestHttpFlowFileServerProtocol.testTransferTwoFiles {code} This test can pass the maven-test. However, it shows non-deterministic behavior under [NonDex|[https://github.com/TestingResearchIllinois/NonDex]]'s test and thus failed. The test result is below: {code:java} [ERROR] Errors: [ERROR] TestHttpFlowFileServerProtocol.testTransferTwoFiles:411 » IO StandardHttpFlowFileServerProtocol[CommsID=testTransferTwoFiles] Sent data to peer Peer[url=http://peer-host:8080/] but calculated CRC32 Checksum as 2668300945 while peer calculated CRC32 Checksum as 3058746557; canceling transaction and rolling back session {code} It seems like two peers calculate a different checksum, therefore the transaction was rolled back, and thus the test failed. *Steps to reproduce the failure:* # install [NonDex|[https://github.com/TestingResearchIllinois/NonDex]] # run the following command in nifi {code:java} MODULE=nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-site-to-site TEST=org.apache.nifi.remote.protocol.http.TestHttpFlowFileServerProtocol#testTransferTwoFiles mvn install -pl $MODULE -am -DskipTests mvn -pl $MODULE edu.illinois:nondex-maven-plugin:1.1.2:nondex -Dtest=$TEST{code} 3. the result will be saved under the package folder in .nondex *Further Flaky Tests were Founded* {code:java} TestHttpClient.testSendLargeFileHTTP TestHttpClient.testSendLargeFileHTTPS TestHttpClient.testSendLargeFileHTTPSWithProxy TestHttpClient.testSendLargeFileHTTPSWithProxyAuth TestHttpClient.testSendLargeFileHTTPWithProxy TestHttpClient.testSendLargeFileHTTPWithProxyAuth TestHttpClient.testSendSlowClientSuccess TestHttpClient.testSendSuccessCompressed{code} These tests are also flaky due to the same checksum-related reason. was: At first I found that: {code:java} org.apache.nifi.remote.protocol.http.TestHttpFlowFileServerProtocol.testTransferTwoFiles {code} This test can pass the maven-test. However, it shows non-deterministic behavior under [NonDex|[https://github.com/TestingResearchIllinois/NonDex]]'s test and thus failed. The test result is below: {code:java} [ERROR] Errors: [ERROR] TestHttpFlowFileServerProtocol.testTransferTwoFiles:411 » IO StandardHttpFlowFileServerProtocol[CommsID=testTransferTwoFiles] Sent data to peer Peer[url=http://peer-host:8080/] but calculated CRC32 Checksum as 2668300945 while peer calculated CRC32 Checksum as 3058746557; canceling transaction and rolling back session {code} It seems like two peers calculate a different checksum, therefore the transaction was rolled back, and thus the test failed. *Steps to reproduce the failure:* # install [NonDex|[https://github.com/TestingResearchIllinois/NonDex]] # run the following command in nifi {code:java} MODULE=nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-site-to-site TEST=org.apache.nifi.remote.protocol.http.TestHttpFlowFileServerProtocol#testTransferTwoFiles mvn install -pl $MODULE -am -DskipTests mvn -pl $MODULE edu.illinois:nondex-maven-plugin:1.1.2:nondex -Dtest=$TEST{code} 3. the result will be saved under the package folder in .nondex *Further Flaky Tests were Founded* {code:java} TestHttpClient.testSendLargeFileHTTP TestHttpClient.testSendLargeFileHTTPS TestHttpClient.testSendLargeFileHTTPSWithProxy TestHttpClient.testSendLargeFileHTTPSWithProxyAuth TestHttpClient.testSendLargeFileHTTPWithProxy TestHttpClient.testSendLargeFileHTTPWithProxyAuth TestHttpClient.testSendSlowClientSuccess TestHttpClient.testSendSuccessCompressed{code} {*}{*}These tests are also flaky due to the same checksum-related reason. > A Bundle of Flaky Tests caused by a similar problem > --------------------------------------------------- > > Key: NIFI-10622 > URL: https://issues.apache.org/jira/browse/NIFI-10622 > Project: Apache NiFi > Issue Type: Bug > Components: NiFi Registry > Environment: Apache Maven 3.6.0; > openjdk version "1.8.0_342"; > OpenJDK Runtime Environment (build 1.8.0_342-8u342-b07-0ubuntu1~20.04-b07); > OpenJDK 64-Bit Server VM (build 25.342-b07, mixed mode); > Reporter: Yiteng Zhang > Priority: Trivial > Fix For: 1.18.0 > > Attachments: > org.apache.nifi.remote.protocol.http.TestHttpFlowFileServerProtocol.txt > > > At first I found that: > {code:java} > org.apache.nifi.remote.protocol.http.TestHttpFlowFileServerProtocol.testTransferTwoFiles > {code} > This test can pass the maven-test. However, it shows non-deterministic > behavior under [NonDex|[https://github.com/TestingResearchIllinois/NonDex]]'s > test and thus failed. > The test result is below: > {code:java} > [ERROR] Errors: [ERROR] > TestHttpFlowFileServerProtocol.testTransferTwoFiles:411 » IO > StandardHttpFlowFileServerProtocol[CommsID=testTransferTwoFiles] Sent data to > peer Peer[url=http://peer-host:8080/] but calculated CRC32 Checksum as > 2668300945 while peer calculated CRC32 Checksum as 3058746557; canceling > transaction and rolling back session {code} > It seems like two peers calculate a different checksum, therefore the > transaction was rolled back, and thus the test failed. > *Steps to reproduce the failure:* > # install [NonDex|[https://github.com/TestingResearchIllinois/NonDex]] > # run the following command in nifi > {code:java} > MODULE=nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-site-to-site > > TEST=org.apache.nifi.remote.protocol.http.TestHttpFlowFileServerProtocol#testTransferTwoFiles > mvn install -pl $MODULE -am -DskipTests > mvn -pl $MODULE edu.illinois:nondex-maven-plugin:1.1.2:nondex > -Dtest=$TEST{code} > 3. the result will be saved under the package folder in .nondex > *Further Flaky Tests were Founded* > {code:java} > TestHttpClient.testSendLargeFileHTTP > TestHttpClient.testSendLargeFileHTTPS > TestHttpClient.testSendLargeFileHTTPSWithProxy > TestHttpClient.testSendLargeFileHTTPSWithProxyAuth > TestHttpClient.testSendLargeFileHTTPWithProxy > TestHttpClient.testSendLargeFileHTTPWithProxyAuth > TestHttpClient.testSendSlowClientSuccess > TestHttpClient.testSendSuccessCompressed{code} > These tests are also flaky due to the same checksum-related reason. -- This message was sent by Atlassian Jira (v8.20.10#820010)