[jira] [Commented] (IGNITE-16072) Add configurable throttling for the spanshot process

2022-03-03 Thread Ignite TC Bot (Jira) 


[ 
https://issues.apache.org/jira/browse/IGNITE-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501184#comment-17501184
 ] 

Ignite TC Bot commented on IGNITE-16072:


{panel:title=Branch: [pull/9833/head] Base: [master] : No blockers 
found!|borderStyle=dashed|borderColor=#ccc|titleBGColor=#D6F7C1}{panel}
{panel:title=Branch: [pull/9833/head] Base: [master] : New Tests 
(30)|borderStyle=dashed|borderColor=#ccc|titleBGColor=#D6F7C1}
{color:#8b}PDS 2{color} [[tests 
30|https://ci.ignite.apache.org/viewLog.html?buildId=6444031]]
* {color:#013220}IgnitePdsTestSuite2: 
CdcSelfTest.testCdcSingleton[specificConsistentId=false,walMode=FSYNC,metricExporter=org.apache.ignite.cdc.CdcSelfTest$$Lambda$17/791412502@296e281a,pageSz=8,192]
 - PASSED{color}
* {color:#013220}IgnitePdsTestSuite2: 
CdcSelfTest.testMultiNodeConsumption[specificConsistentId=false,walMode=FSYNC,metricExporter=org.apache.ignite.cdc.CdcSelfTest$$Lambda$17/791412502@296e281a,pageSz=8,192]
 - PASSED{color}
* {color:#013220}IgnitePdsTestSuite2: 
CdcSelfTest.testMultiNodeConsumption[specificConsistentId=true,walMode=BACKGROUND,metricExporter=org.apache.ignite.cdc.CdcSelfTest$$Lambda$17/791412502@296e281a,pageSz=8,192]
 - PASSED{color}
* {color:#013220}IgnitePdsTestSuite2: 
CdcSelfTest.testReReadWhenStateWasNotStored[specificConsistentId=true,walMode=BACKGROUND,metricExporter=org.apache.ignite.cdc.CdcSelfTest$$Lambda$17/791412502@296e281a,pageSz=8,192]
 - PASSED{color}
* {color:#013220}IgnitePdsTestSuite2: 
CdcSelfTest.testReadBeforeGracefulShutdown[specificConsistentId=true,walMode=BACKGROUND,metricExporter=org.apache.ignite.cdc.CdcSelfTest$$Lambda$17/791412502@296e281a,pageSz=8,192]
 - PASSED{color}
* {color:#013220}IgnitePdsTestSuite2: 
CdcSelfTest.testReadAllKeys[specificConsistentId=true,walMode=BACKGROUND,metricExporter=org.apache.ignite.cdc.CdcSelfTest$$Lambda$17/791412502@296e281a,pageSz=8,192]
 - PASSED{color}
* {color:#013220}IgnitePdsTestSuite2: 
CdcSelfTest.testReReadWhenStateWasNotStored[specificConsistentId=false,walMode=BACKGROUND,metricExporter=org.apache.ignite.cdc.CdcSelfTest$$Lambda$17/791412502@296e281a,pageSz=8,192]
 - PASSED{color}
* {color:#013220}IgnitePdsTestSuite2: 
CdcSelfTest.testReadBeforeGracefulShutdown[specificConsistentId=false,walMode=BACKGROUND,metricExporter=org.apache.ignite.cdc.CdcSelfTest$$Lambda$17/791412502@296e281a,pageSz=8,192]
 - PASSED{color}
* {color:#013220}IgnitePdsTestSuite2: 
CdcSelfTest.testReadAllKeys[specificConsistentId=false,walMode=BACKGROUND,metricExporter=org.apache.ignite.cdc.CdcSelfTest$$Lambda$17/791412502@296e281a,pageSz=8,192]
 - PASSED{color}
* {color:#013220}IgnitePdsTestSuite2: 
CdcSelfTest.testCdcSingleton[specificConsistentId=true,walMode=BACKGROUND,metricExporter=org.apache.ignite.cdc.CdcSelfTest$$Lambda$17/791412502@296e281a,pageSz=8,192]
 - PASSED{color}
* {color:#013220}IgnitePdsTestSuite2: 
CdcSelfTest.testReadBeforeGracefulShutdown[specificConsistentId=true,walMode=LOG_ONLY,metricExporter=org.apache.ignite.cdc.CdcSelfTest$$Lambda$17/791412502@296e281a,pageSz=8,192]
 - PASSED{color}
... and 19 new tests

{panel}
[TeamCity *--> Run :: All* 
Results|https://ci.ignite.apache.org/viewLog.html?buildId=6444076&buildTypeId=IgniteTests24Java8_RunAll]

> Add configurable throttling for the spanshot process
> 
>
> Key: IGNITE-16072
> URL: https://issues.apache.org/jira/browse/IGNITE-16072
> Project: Ignite
>  Issue Type: Improvement
>Reporter: Maxim Muzafarov
>Assignee: Pavel Pereslegin
>Priority: Major
>  Labels: iep-43, ise
> Fix For: 2.13
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> We want to add configurable throttling to the number of threads that perform 
> a snapshot operation. The IGNITE-16014 have introduced the pool size 
> configuration property, however, it is still possible that a node can become 
> overloaded and unresponsive due to its attempts to copy data files on very 
> slow HDDs. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Commented] (IGNITE-16072) Add configurable throttling for the spanshot process

2022-03-03 Thread Pavel Pereslegin (Jira) 


[ 
https://issues.apache.org/jira/browse/IGNITE-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501175#comment-17501175
 ] 

Pavel Pereslegin commented on IGNITE-16072:
---

[~alex_pl], thanks for the review!

> Add configurable throttling for the spanshot process
> 
>
> Key: IGNITE-16072
> URL: https://issues.apache.org/jira/browse/IGNITE-16072
> Project: Ignite
>  Issue Type: Improvement
>Reporter: Maxim Muzafarov
>Assignee: Pavel Pereslegin
>Priority: Major
>  Labels: iep-43, ise
> Fix For: 2.13
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> We want to add configurable throttling to the number of threads that perform 
> a snapshot operation. The IGNITE-16014 have introduced the pool size 
> configuration property, however, it is still possible that a node can become 
> overloaded and unresponsive due to its attempts to copy data files on very 
> slow HDDs. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Commented] (IGNITE-16072) Add configurable throttling for the spanshot process

2022-03-03 Thread Aleksey Plekhanov (Jira) 


[ 
https://issues.apache.org/jira/browse/IGNITE-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500785#comment-17500785
 ] 

Aleksey Plekhanov commented on IGNITE-16072:


[~xtern], LGTM

> Add configurable throttling for the spanshot process
> 
>
> Key: IGNITE-16072
> URL: https://issues.apache.org/jira/browse/IGNITE-16072
> Project: Ignite
>  Issue Type: Improvement
>Reporter: Maxim Muzafarov
>Assignee: Pavel Pereslegin
>Priority: Major
>  Labels: iep-43, ise
> Fix For: 2.13
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> We want to add configurable throttling to the number of threads that perform 
> a snapshot operation. The IGNITE-16014 have introduced the pool size 
> configuration property, however, it is still possible that a node can become 
> overloaded and unresponsive due to its attempts to copy data files on very 
> slow HDDs. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Commented] (IGNITE-16072) Add configurable throttling for the spanshot process

2022-02-27 Thread Pavel Pereslegin (Jira) 


[ 
https://issues.apache.org/jira/browse/IGNITE-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17498742#comment-17498742
 ] 

Pavel Pereslegin commented on IGNITE-16072:
---

[~alex_pl],
could you take a look at the proposed changes?

> Add configurable throttling for the spanshot process
> 
>
> Key: IGNITE-16072
> URL: https://issues.apache.org/jira/browse/IGNITE-16072
> Project: Ignite
>  Issue Type: Improvement
>Reporter: Maxim Muzafarov
>Assignee: Pavel Pereslegin
>Priority: Major
>  Labels: iep-43, ise
> Fix For: 2.13
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> We want to add configurable throttling to the number of threads that perform 
> a snapshot operation. The IGNITE-16014 have introduced the pool size 
> configuration property, however, it is still possible that a node can become 
> overloaded and unresponsive due to its attempts to copy data files on very 
> slow HDDs. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Commented] (IGNITE-16072) Add configurable throttling for the spanshot process

2022-02-24 Thread Ignite TC Bot (Jira) 


[ 
https://issues.apache.org/jira/browse/IGNITE-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497699#comment-17497699
 ] 

Ignite TC Bot commented on IGNITE-16072:


{panel:title=Branch: [pull/9833/head] Base: [master] : No blockers 
found!|borderStyle=dashed|borderColor=#ccc|titleBGColor=#D6F7C1}{panel}
{panel:title=Branch: [pull/9833/head] Base: [master] : New Tests 
(28)|borderStyle=dashed|borderColor=#ccc|titleBGColor=#D6F7C1}
{color:#8b}Basic 1{color} [[tests 
24|https://ci.ignite.apache.org/viewLog.html?buildId=6432988]]
* {color:#013220}IgniteBasicTestSuite: 
LimitedWriteRateFileIOTest.testLimitedTransferFrom[rate=4,096, bufLen=65,536, 
checkOffset=false] - PASSED{color}
* {color:#013220}IgniteBasicTestSuite: 
LimitedWriteRateFileIOTest.testLimitedWrite[rate=4,096, bufLen=1, 
checkOffset=true] - PASSED{color}
* {color:#013220}IgniteBasicTestSuite: 
LimitedWriteRateFileIOTest.testLimitedBufferWrite[rate=4,096, bufLen=1, 
checkOffset=true] - PASSED{color}
* {color:#013220}IgniteBasicTestSuite: 
LimitedWriteRateFileIOTest.testLimitedTransferTo[rate=4,096, bufLen=1, 
checkOffset=true] - PASSED{color}
* {color:#013220}IgniteBasicTestSuite: 
LimitedWriteRateFileIOTest.testLimitedTransferFrom[rate=4,096, bufLen=65,536, 
checkOffset=true] - PASSED{color}
* {color:#013220}IgniteBasicTestSuite: 
LimitedWriteRateFileIOTest.testLimitedWrite[rate=4,096, bufLen=65,536, 
checkOffset=false] - PASSED{color}
* {color:#013220}IgniteBasicTestSuite: 
LimitedWriteRateFileIOTest.testLimitedBufferWrite[rate=4,096, bufLen=65,536, 
checkOffset=false] - PASSED{color}
* {color:#013220}IgniteBasicTestSuite: 
LimitedWriteRateFileIOTest.testLimitedTransferTo[rate=4,096, bufLen=65,536, 
checkOffset=false] - PASSED{color}
* {color:#013220}IgniteBasicTestSuite: 
LimitedWriteRateFileIOTest.testLimitedWrite[rate=4,096, bufLen=65,536, 
checkOffset=true] - PASSED{color}
* {color:#013220}IgniteBasicTestSuite: 
LimitedWriteRateFileIOTest.testLimitedBufferWrite[rate=4,096, bufLen=65,536, 
checkOffset=true] - PASSED{color}
* {color:#013220}IgniteBasicTestSuite: 
LimitedWriteRateFileIOTest.testLimitedTransferTo[rate=4,096, bufLen=65,536, 
checkOffset=true] - PASSED{color}
... and 13 new tests

{color:#8b}Control Utility{color} [[tests 
3|https://ci.ignite.apache.org/viewLog.html?buildId=6433020]]
* {color:#013220}IgniteControlUtilityTestSuite: 
GridCommandHandlerTest.testChangeSnapshotTransferRateInRuntime - PASSED{color}
* {color:#013220}IgniteControlUtilityTestSuite: 
GridCommandHandlerWithSSLTest.testChangeSnapshotTransferRateInRuntime - 
PASSED{color}
* {color:#013220}IgniteControlUtilityTestSuite: 
GridCommandHandlerPropertiesTest.testPropertySnapshotTransferRate - 
PASSED{color}

{color:#8b}Control Utility (Zookeeper){color} [[tests 
1|https://ci.ignite.apache.org/viewLog.html?buildId=6433019]]
* {color:#013220}ZookeeperIgniteControlUtilityTestSuite: 
GridCommandHandlerTest.testChangeSnapshotTransferRateInRuntime - PASSED{color}

{panel}
[TeamCity *--> Run :: All* 
Results|https://ci.ignite.apache.org/viewLog.html?buildId=6433092&buildTypeId=IgniteTests24Java8_RunAll]

> Add configurable throttling for the spanshot process
> 
>
> Key: IGNITE-16072
> URL: https://issues.apache.org/jira/browse/IGNITE-16072
> Project: Ignite
>  Issue Type: Improvement
>Reporter: Maxim Muzafarov
>Assignee: Pavel Pereslegin
>Priority: Major
>  Labels: iep-43, ise
> Fix For: 2.13
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> We want to add configurable throttling to the number of threads that perform 
> a snapshot operation. The IGNITE-16014 have introduced the pool size 
> configuration property, however, it is still possible that a node can become 
> overloaded and unresponsive due to its attempts to copy data files on very 
> slow HDDs. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)