[jira] [Updated] (HDDS-12574) Speed up flaky-test-check workflow in CI

2025-03-13 Thread Attila Doroszlai (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Doroszlai updated HDDS-12574:

Fix Version/s: 2.0.0
   Resolution: Implemented
   Status: Resolved  (was: Patch Available)

> Speed up flaky-test-check workflow in CI
> 
>
> Key: HDDS-12574
> URL: https://issues.apache.org/jira/browse/HDDS-12574
> Project: Apache Ozone
>  Issue Type: Sub-task
>  Components: CI
>Reporter: Peter Lee
>Assignee: Peter Lee
>Priority: Major
>  Labels: pull-request-available
> Fix For: 2.0.0
>
>
> Since flaky-test-check workflow run with designated TestClass, so we can find 
> which package the TestClass belongs to then use -pl args to only build 
> necessary packages
>  
> I made a POC which shows great improvement in test running time:
> Test with TestDeadNodeHandler
>  * run with master CI file: 
> [https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
>  * run with speedup-flaky-test-check-in-ci POC branch: 
> [https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins
>  
> This POC also support duplicated class name across different packages, and 
> the wildcard matching
>  
> POC git diff: 
> [https://github.com/apache/ozone/compare/master...peterxcli:ozone:speedup-flaky-test-check-in-ci?expand=1]
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



[jira] [Updated] (HDDS-12574) Speed up flaky-test-check workflow in CI

2025-03-12 Thread Peter Lee (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Lee updated HDDS-12574:
-
Parent: HDDS-6496
Issue Type: Sub-task  (was: Improvement)

> Speed up flaky-test-check workflow in CI
> 
>
> Key: HDDS-12574
> URL: https://issues.apache.org/jira/browse/HDDS-12574
> Project: Apache Ozone
>  Issue Type: Sub-task
>  Components: CI
>Reporter: Peter Lee
>Assignee: Peter Lee
>Priority: Major
>  Labels: pull-request-available
>
> Since flaky-test-check workflow run with designated TestClass, so we can find 
> which package the TestClass belongs to then use -pl args to only build 
> necessary packages
>  
> I made a POC which shows great improvement in test running time:
> Test with TestDeadNodeHandler
>  * run with master CI file: 
> [https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
>  * run with speedup-flaky-test-check-in-ci POC branch: 
> [https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins
>  
> This POC also support duplicated class name across different packages, and 
> the wildcard matching
>  
> POC git diff: 
> [https://github.com/apache/ozone/compare/master...peterxcli:ozone:speedup-flaky-test-check-in-ci?expand=1]
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



[jira] [Updated] (HDDS-12574) Speed up flaky-test-check workflow in CI

2025-03-12 Thread Peter Lee (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Lee updated HDDS-12574:
-
Status: Patch Available  (was: Open)

https://github.com/apache/ozone/pull/8062

> Speed up flaky-test-check workflow in CI
> 
>
> Key: HDDS-12574
> URL: https://issues.apache.org/jira/browse/HDDS-12574
> Project: Apache Ozone
>  Issue Type: Improvement
>  Components: CI
>Reporter: Peter Lee
>Assignee: Peter Lee
>Priority: Major
>  Labels: pull-request-available
>
> Since flaky-test-check workflow run with designated TestClass, so we can find 
> which package the TestClass belongs to then use -pl args to only build 
> necessary packages
>  
> I made a POC which shows great improvement in test running time:
> Test with TestDeadNodeHandler
>  * run with master CI file: 
> [https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
>  * run with speedup-flaky-test-check-in-ci POC branch: 
> [https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins
>  
> This POC also support duplicated class name across different packages, and 
> the wildcard matching
>  
> POC git diff: 
> [https://github.com/apache/ozone/compare/master...peterxcli:ozone:speedup-flaky-test-check-in-ci?expand=1]
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



[jira] [Updated] (HDDS-12574) Speed up flaky-test-check workflow in CI

2025-03-12 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HDDS-12574:
--
Labels: pull-request-available  (was: )

> Speed up flaky-test-check workflow in CI
> 
>
> Key: HDDS-12574
> URL: https://issues.apache.org/jira/browse/HDDS-12574
> Project: Apache Ozone
>  Issue Type: Improvement
>  Components: CI
>Reporter: Peter Lee
>Assignee: Peter Lee
>Priority: Major
>  Labels: pull-request-available
>
> Since flaky-test-check workflow run with designated TestClass, so we can find 
> which package the TestClass belongs to then use -pl args to only build 
> necessary packages
>  
> I made a POC which shows great improvement in test running time:
> Test with TestDeadNodeHandler
>  * run with master CI file: 
> [https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
>  * run with speedup-flaky-test-check-in-ci POC branch: 
> [https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins
>  
> This POC also support duplicated class name across different packages, and 
> the wildcard matching
>  
> POC git diff: 
> [https://github.com/apache/ozone/compare/master...peterxcli:ozone:speedup-flaky-test-check-in-ci?expand=1]
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



[jira] [Updated] (HDDS-12574) Speed up flaky-test-check workflow in CI

2025-03-12 Thread Peter Lee (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Lee updated HDDS-12574:
-
Description: 
Since flaky-test-check workflow run with designated TestClass, so we can find 
which package the TestClass belongs to then use -pl args to only build 
necessary packages

 

I made a POC which shows great improvement in test running time:

Test with TestDeadNodeHandler
 * run with master CI file: 
[https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
 * run with speedup-flaky-test-check-in-ci POC branch: 
[https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins

 

This POC also support duplicated class name across different packages, and the 
wildcard matching

 

POC git diff: 
[https://github.com/apache/ozone/compare/master...peterxcli:ozone:speedup-flaky-test-check-in-ci?expand=1]
 

  was:
Since flaky-test-check workflow run with designated TestClass, so we can find 
which package the TestClass belongs to then use -pl args to only build 
necessary packages

 

I made a POC which shows great improvement in test running time:

Test with TestDeadNodeHandler
 * run with master CI file: 
[https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
 * run with speedup-flaky-test-check-in-ci POC branch: 
[https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins

 

This POC also support duplicated class name across different packages, and the 
wildcard matching

 

git diff: 
[https://github.com/apache/ozone/compare/master...peterxcli:ozone:speedup-flaky-test-check-in-ci?expand=1]
 


> Speed up flaky-test-check workflow in CI
> 
>
> Key: HDDS-12574
> URL: https://issues.apache.org/jira/browse/HDDS-12574
> Project: Apache Ozone
>  Issue Type: Improvement
>  Components: CI
>Reporter: Peter Lee
>Assignee: Peter Lee
>Priority: Major
>
> Since flaky-test-check workflow run with designated TestClass, so we can find 
> which package the TestClass belongs to then use -pl args to only build 
> necessary packages
>  
> I made a POC which shows great improvement in test running time:
> Test with TestDeadNodeHandler
>  * run with master CI file: 
> [https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
>  * run with speedup-flaky-test-check-in-ci POC branch: 
> [https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins
>  
> This POC also support duplicated class name across different packages, and 
> the wildcard matching
>  
> POC git diff: 
> [https://github.com/apache/ozone/compare/master...peterxcli:ozone:speedup-flaky-test-check-in-ci?expand=1]
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



[jira] [Updated] (HDDS-12574) Speed up flaky-test-check workflow in CI

2025-03-12 Thread Peter Lee (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Lee updated HDDS-12574:
-
Description: 
Since flaky-test-check workflow run with designated TestClass, so we can find 
which package the TestClass belongs to then use -pl args to only build 
necessary packages

 

I made a POC which shows great improvement in test running time:

Test with TestDeadNodeHandler
 * run with master CI file: 
[https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
 * run with speedup-flaky-test-check-in-ci POC branch: 
[https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins

 

This POC also support duplicated class name across different packages, and the 
wildcard matching

 

git diff: 
[https://github.com/apache/ozone/compare/master...peterxcli:ozone:speedup-flaky-test-check-in-ci?expand=1]
 

  was:
Since flaky-test-check workflow run with designated TestClass, so we can find 
which package the TestClass belongs to then use -pl args to only build 
necessary packages

 

I made a POC which shows great improvement in test running time:

Test with TestDeadNodeHandler
 * run with master CI file: 
[https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
 * run with speedup-flaky-test-check-in-ci POC branch: 
[https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins

 

This POC also support duplicated class name across different packages, and the 
wildcard matching


> Speed up flaky-test-check workflow in CI
> 
>
> Key: HDDS-12574
> URL: https://issues.apache.org/jira/browse/HDDS-12574
> Project: Apache Ozone
>  Issue Type: Improvement
>  Components: CI
>Reporter: Peter Lee
>Assignee: Peter Lee
>Priority: Major
>
> Since flaky-test-check workflow run with designated TestClass, so we can find 
> which package the TestClass belongs to then use -pl args to only build 
> necessary packages
>  
> I made a POC which shows great improvement in test running time:
> Test with TestDeadNodeHandler
>  * run with master CI file: 
> [https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
>  * run with speedup-flaky-test-check-in-ci POC branch: 
> [https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins
>  
> This POC also support duplicated class name across different packages, and 
> the wildcard matching
>  
> git diff: 
> [https://github.com/apache/ozone/compare/master...peterxcli:ozone:speedup-flaky-test-check-in-ci?expand=1]
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



[jira] [Updated] (HDDS-12574) Speed up flaky-test-check workflow in CI

2025-03-12 Thread Peter Lee (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Lee updated HDDS-12574:
-
Description: 
Since flaky-test-check workflow run with designated TestClass, so we can find 
which package the TestClass belongs to then use -pl args to only build 
necessary packages

 

I made a POC which shows great improvement in test running time:

Test with TestDeadNodeHandler
 * run with master CI file: 
[https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
 * run with speedup-flaky-test-check-in-ci POC branch: 
[https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins

 

This POC also support duplicated class name across different packages, and the 
wildcard matching

  was:
Since flaky-test-check workflow run with designated TestClass, so we can find 
which package the TestClass belongs to then use -pl args to only build 
necessary packages

 

I made a POC which shows great improvement in test running time:

Test with TestDeadNodeHandler
 * run with master CI file: 
[https://github.com/peterxcli/ozone/actions/runs/13817211733] (this take 19mins
 * run with speedup-flaky-test-check-in-ci POC branch: 
[https://github.com/peterxcli/ozone/actions/runs/13817907647] (This takes 8mins

 

This POC also support duplicated class name across different packages, and the 
wildcard matching


> Speed up flaky-test-check workflow in CI
> 
>
> Key: HDDS-12574
> URL: https://issues.apache.org/jira/browse/HDDS-12574
> Project: Apache Ozone
>  Issue Type: Improvement
>  Components: CI
>Reporter: Peter Lee
>Assignee: Peter Lee
>Priority: Major
>
> Since flaky-test-check workflow run with designated TestClass, so we can find 
> which package the TestClass belongs to then use -pl args to only build 
> necessary packages
>  
> I made a POC which shows great improvement in test running time:
> Test with TestDeadNodeHandler
>  * run with master CI file: 
> [https://github.com/peterxcli/ozone/actions/runs/13817211733] (takes 19mins
>  * run with speedup-flaky-test-check-in-ci POC branch: 
> [https://github.com/peterxcli/ozone/actions/runs/13817907647] (takes 8mins
>  
> This POC also support duplicated class name across different packages, and 
> the wildcard matching



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]