[jira] [Commented] (IGNITE-11262) Compression on Discovery data bag
[ https://issues.apache.org/jira/browse/IGNITE-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780332#comment-16780332 ] Ivan Rakov commented on IGNITE-11262: - [~v.pyatkov], thanks for your contribution! Merged to master. > Compression on Discovery data bag > - > > Key: IGNITE-11262 > URL: https://issues.apache.org/jira/browse/IGNITE-11262 > Project: Ignite > Issue Type: Improvement >Reporter: Vladislav Pyatkov >Assignee: Vladislav Pyatkov >Priority: Major > Time Spent: 1h 50m > Remaining Estimate: 0h > > Size of GridComponetns data may increase significantly in large deployment. > Examples: > 1) In case of more then 3K caches with QueryEntry configured - size of > {{DiscoveryDataBag}}{{GridCacheProcessor}} data bag consume more then 20 Mb > 2) If cluster contain more then 13K objects - > {{GridMarshallerMappingProcessor}} size more then 1 Mb > 3) Cluster with more then 3К types in binary format - > {{CacheObjectBinaryProcessorImpl}} size can grow to 10Mb > The data in most cases contain duplicated structure and simple zip > compression can led to seriously reduce size. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-11262) Compression on Discovery data bag
[ https://issues.apache.org/jira/browse/IGNITE-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779636#comment-16779636 ] Vladislav Pyatkov commented on IGNITE-11262: [~ivan.glukos] Done. Waiting to TC re-run. > Compression on Discovery data bag > - > > Key: IGNITE-11262 > URL: https://issues.apache.org/jira/browse/IGNITE-11262 > Project: Ignite > Issue Type: Improvement >Reporter: Vladislav Pyatkov >Assignee: Vladislav Pyatkov >Priority: Major > Time Spent: 1h 50m > Remaining Estimate: 0h > > Size of GridComponetns data may increase significantly in large deployment. > Examples: > 1) In case of more then 3K caches with QueryEntry configured - size of > {{DiscoveryDataBag}}{{GridCacheProcessor}} data bag consume more then 20 Mb > 2) If cluster contain more then 13K objects - > {{GridMarshallerMappingProcessor}} size more then 1 Mb > 3) Cluster with more then 3К types in binary format - > {{CacheObjectBinaryProcessorImpl}} size can grow to 10Mb > The data in most cases contain duplicated structure and simple zip > compression can led to seriously reduce size. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-11262) Compression on Discovery data bag
[ https://issues.apache.org/jira/browse/IGNITE-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779496#comment-16779496 ] Ivan Rakov commented on IGNITE-11262: - [~v.pyatkov], please merge fresh master to PR branch. > Compression on Discovery data bag > - > > Key: IGNITE-11262 > URL: https://issues.apache.org/jira/browse/IGNITE-11262 > Project: Ignite > Issue Type: Improvement >Reporter: Vladislav Pyatkov >Assignee: Vladislav Pyatkov >Priority: Major > Time Spent: 1h 50m > Remaining Estimate: 0h > > Size of GridComponetns data may increase significantly in large deployment. > Examples: > 1) In case of more then 3K caches with QueryEntry configured - size of > {{DiscoveryDataBag}}{{GridCacheProcessor}} data bag consume more then 20 Mb > 2) If cluster contain more then 13K objects - > {{GridMarshallerMappingProcessor}} size more then 1 Mb > 3) Cluster with more then 3К types in binary format - > {{CacheObjectBinaryProcessorImpl}} size can grow to 10Mb > The data in most cases contain duplicated structure and simple zip > compression can led to seriously reduce size. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-11262) Compression on Discovery data bag
[ https://issues.apache.org/jira/browse/IGNITE-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774047#comment-16774047 ] Pavel Voronkin commented on IGNITE-11262: - Thanks [~v.pyatkov] changes looks good to me > Compression on Discovery data bag > - > > Key: IGNITE-11262 > URL: https://issues.apache.org/jira/browse/IGNITE-11262 > Project: Ignite > Issue Type: Improvement >Reporter: Vladislav Pyatkov >Assignee: Vladislav Pyatkov >Priority: Major > Time Spent: 1h 50m > Remaining Estimate: 0h > > Size of GridComponetns data may increase significantly in large deployment. > Examples: > 1) In case of more then 3K caches with QueryEntry configured - size of > {{DiscoveryDataBag}}{{GridCacheProcessor}} data bag consume more then 20 Mb > 2) If cluster contain more then 13K objects - > {{GridMarshallerMappingProcessor}} size more then 1 Mb > 3) Cluster with more then 3К types in binary format - > {{CacheObjectBinaryProcessorImpl}} size can grow to 10Mb > The data in most cases contain duplicated structure and simple zip > compression can led to seriously reduce size. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-11262) Compression on Discovery data bag
[ https://issues.apache.org/jira/browse/IGNITE-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773744#comment-16773744 ] Ignite TC Bot commented on IGNITE-11262: {panel:title=-- Run :: All: Possible Blockers|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1} {color:#d04437}MVCC Cache 6{color} [[tests 5|https://ci.ignite.apache.org/viewLog.html?buildId=3141524]] * IgniteCacheMvccTestSuite6: TxRollbackOnIncorrectParamsTest.testTimeoutSetRemoteGuarantee - 3,3% fails in last 215 master runs. * IgniteCacheMvccTestSuite6: TxRollbackOnIncorrectParamsTest.testTimeoutSetLocalGuarantee - 3,3% fails in last 215 master runs. * IgniteCacheMvccTestSuite6: TxRollbackOnIncorrectParamsTest.testRollbackInsideLocalListenerAfterRemoteFilter - 3,3% fails in last 215 master runs. * IgniteCacheMvccTestSuite6: TxRollbackOnIncorrectParamsTest.testLabelFilledLocalGuarantee - 3,3% fails in last 215 master runs. * IgniteCacheMvccTestSuite6: TxRollbackOnIncorrectParamsTest.testLabelFilledRemoteGuarantee - 3,3% fails in last 215 master runs. {panel} [TeamCity *-- Run :: All* Results|https://ci.ignite.apache.org/viewLog.html?buildId=3136056buildTypeId=IgniteTests24Java8_RunAll] > Compression on Discovery data bag > - > > Key: IGNITE-11262 > URL: https://issues.apache.org/jira/browse/IGNITE-11262 > Project: Ignite > Issue Type: Improvement >Reporter: Vladislav Pyatkov >Assignee: Vladislav Pyatkov >Priority: Major > Time Spent: 1h 40m > Remaining Estimate: 0h > > Size of GridComponetns data may increase significantly in large deployment. > Examples: > 1) In case of more then 3K caches with QueryEntry configured - size of > {{DiscoveryDataBag}}{{GridCacheProcessor}} data bag consume more then 20 Mb > 2) If cluster contain more then 13K objects - > {{GridMarshallerMappingProcessor}} size more then 1 Mb > 3) Cluster with more then 3К types in binary format - > {{CacheObjectBinaryProcessorImpl}} size can grow to 10Mb > The data in most cases contain duplicated structure and simple zip > compression can led to seriously reduce size. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-11262) Compression on Discovery data bag
[ https://issues.apache.org/jira/browse/IGNITE-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773746#comment-16773746 ] Vladislav Pyatkov commented on IGNITE-11262: Hi, [~voropava] thank for your review. I have added some change, following your advice, please look it again. > Compression on Discovery data bag > - > > Key: IGNITE-11262 > URL: https://issues.apache.org/jira/browse/IGNITE-11262 > Project: Ignite > Issue Type: Improvement >Reporter: Vladislav Pyatkov >Assignee: Vladislav Pyatkov >Priority: Major > Time Spent: 1h 40m > Remaining Estimate: 0h > > Size of GridComponetns data may increase significantly in large deployment. > Examples: > 1) In case of more then 3K caches with QueryEntry configured - size of > {{DiscoveryDataBag}}{{GridCacheProcessor}} data bag consume more then 20 Mb > 2) If cluster contain more then 13K objects - > {{GridMarshallerMappingProcessor}} size more then 1 Mb > 3) Cluster with more then 3К types in binary format - > {{CacheObjectBinaryProcessorImpl}} size can grow to 10Mb > The data in most cases contain duplicated structure and simple zip > compression can led to seriously reduce size. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-11262) Compression on Discovery data bag
[ https://issues.apache.org/jira/browse/IGNITE-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772987#comment-16772987 ] Pavel Voronkin commented on IGNITE-11262: - Hi, [~v.pyatkov] i've put comments, please have a look. > Compression on Discovery data bag > - > > Key: IGNITE-11262 > URL: https://issues.apache.org/jira/browse/IGNITE-11262 > Project: Ignite > Issue Type: Improvement >Reporter: Vladislav Pyatkov >Assignee: Vladislav Pyatkov >Priority: Major > Time Spent: 1h 40m > Remaining Estimate: 0h > > Size of GridComponetns data may increase significantly in large deployment. > Examples: > 1) In case of more then 3K caches with QueryEntry configured - size of > {{DiscoveryDataBag}}{{GridCacheProcessor}} data bag consume more then 20 Mb > 2) If cluster contain more then 13K objects - > {{GridMarshallerMappingProcessor}} size more then 1 Mb > 3) Cluster with more then 3К types in binary format - > {{CacheObjectBinaryProcessorImpl}} size can grow to 10Mb > The data in most cases contain duplicated structure and simple zip > compression can led to seriously reduce size. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-11262) Compression on Discovery data bag
[ https://issues.apache.org/jira/browse/IGNITE-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772702#comment-16772702 ] Ignite TC Bot commented on IGNITE-11262: {panel:title=-- Run :: All: Possible Blockers|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1} {color:#d04437}Cache 7{color} [[tests 1|https://ci.ignite.apache.org/viewLog.html?buildId=3127198]] * IgniteCacheTestSuite7: TxRollbackAsyncWithPersistenceTest.testSynchronousRollback - 0,0% fails in last 421 master runs. {panel} [TeamCity *-- Run :: All* Results|https://ci.ignite.apache.org/viewLog.html?buildId=3127244buildTypeId=IgniteTests24Java8_RunAll] > Compression on Discovery data bag > - > > Key: IGNITE-11262 > URL: https://issues.apache.org/jira/browse/IGNITE-11262 > Project: Ignite > Issue Type: Improvement >Reporter: Vladislav Pyatkov >Assignee: Vladislav Pyatkov >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Size of GridComponetns data may increase significantly in large deployment. > Examples: > 1) In case of more then 3K caches with QueryEntry configured - size of > {{DiscoveryDataBag}}{{GridCacheProcessor}} data bag consume more then 20 Mb > 2) If cluster contain more then 13K objects - > {{GridMarshallerMappingProcessor}} size more then 1 Mb > 3) Cluster with more then 3К types in binary format - > {{CacheObjectBinaryProcessorImpl}} size can grow to 10Mb > The data in most cases contain duplicated structure and simple zip > compression can led to seriously reduce size. -- This message was sent by Atlassian JIRA (v7.6.3#76005)