[
https://issues.apache.org/jira/browse/IGNITE-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16406314#comment-16406314
]
Vitaliy Biryukov commented on IGNITE-7986:
------------------------------------------
[~dpavlov],
As far as I understand, size of the GridPartitionStateMap depends on the
number of nodes in the cluster, the number of backups and the number of
partitions (except local map).
Results of my benchmark for nonlocal partition maps.
|backups|nodes|partitions|current (ns/op)|new (ns/op)|new better times|
|0|10|1024|7773.397|3095.733|2.5110036944|
|0|10|2048|16087.69|6144.741|2.6181233676|
|0|10|4096|34482.486|12345.651|2.7930877035|
|0|10|8000|72479.404|26650.82|2.7195937686|
|0|10|16000|146432.544|58102.809|2.5202317499|
|0|10|32000|296809.492|120724.04|2.458578192|
|0|10|64000|594322.515|242735.119|2.4484405777|
|0|100|1024|4729.686|336.3|14.0638893845|
|0|100|2048|9415.128|647.433|14.5422429811|
|0|100|4096|21148.614|1316.889|16.0595266571|
|0|100|8000|38834.411|2621.357|14.8146212057|
|0|100|16000|82633.151|5140.644|16.0744745211|
|0|100|32000|173895.173|10422.767|16.6841658266|
|0|100|64000|342516.513|23952.39|14.2998887794|
|0|1000|1024|2426.349|46.471|52.2121107788|
|0|1000|2048|8139.08|108.815|74.7974084455|
|0|1000|4096|14454.287|240.411|60.1232347937|
|0|1000|8000|34907.128|489.104|71.3695410383|
|0|1000|16000|73389.182|944.313|77.7170090849|
|0|1000|32000|160308.128|1984.28|80.7890660592|
|0|1000|64000|324560.687|4079.957|79.5500263851|
|0|2000|1024|3.008|2.537|1.1856523453|
|0|2000|2048|5946.673|90.027|66.054328146|
|0|2000|4096|17325.297|138.235|125.3322024089|
|0|2000|8000|33072.617|348.708|94.8432986912|
|0|2000|16000|64440.651|745.311|86.461424828|
|0|2000|32000|155238.657|1479.522|104.9248723574|
|0|2000|64000|321251.884|3167.658|101.4162147555|
|1|10|1024|11171.521|6119.496|1.8255622685|
|1|10|2048|24172.271|12665.634|1.9084927766|
|1|10|4096|53294.77|26685.115|1.9971722063|
|1|10|8000|109864.099|53980.026|2.0352731768|
|1|10|16000|221824.913|113037.367|1.9624033971|
|1|10|32000|436256.482|230921.664|1.8891968577|
|1|10|64000|881911.03|459193.654|1.9205644989|
|1|100|1024|5129.195|629.328|8.1502729896|
|1|100|2048|10859.603|1250.619|8.683382389|
|1|100|4096|21685.862|2539.37|8.5398590989|
|1|100|8000|42293.47|4960.049|8.5268250374|
|1|100|16000|90791.646|10598.697|8.5663026314|
|1|100|32000|180378.316|21288.594|8.4730027732|
|1|100|64000|367885.521|51335.901|7.1662426067|
|1|1000|1024|2905.899|90.916|31.9624598531|
|1|1000|2048|9262.415|186.65|49.6245111171|
|1|1000|4096|18267.382|360.739|50.6387776204|
|1|1000|8000|32897.705|729.977|45.066769227|
|1|1000|16000|76443.255|1409.925|54.217958402|
|1|1000|32000|164860.382|2946.506|55.9511441687|
|1|1000|64000|330178.483|5966.129|55.3421628999|
|1|2000|1024|2292.627|55.323|41.4407570088|
|1|2000|2048|8686.208|108.265|80.2309887775|
|1|2000|4096|14479.482|242.147|59.7962477338|
|1|2000|8000|35766.976|484.239|73.8622374489|
|1|2000|16000|74094.016|962.648|76.968960617|
|1|2000|32000|157008.208|1986.852|79.0236051805|
|1|2000|64000|328899.34|4067.667|80.8569973894|
|2|10|1024|13852.683|9270.305|1.4943071452|
|2|10|2048|32389.393|19186.303|1.688151855|
|2|10|4096|71480.692|40449.752|1.7671478431|
|2|10|8000|145103.259|83085.115|1.7464410924|
|2|10|16000|298201.673|168707.071|1.7675706847|
|2|10|32000|597223.744|338370.431|1.7649998028|
|2|10|64000|1181314.547|677498.149|1.7436424716|
|2|100|1024|5556.731|929.405|5.9788047191|
|2|100|2048|11336.611|1884.978|6.0141874335|
|2|100|4096|23191.629|3724.606|6.2265992698|
|2|100|8000|46321.575|7395.63|6.2633710718|
|2|100|16000|96597.642|15122.088|6.3878508047|
|2|100|32000|198318.107|33385.073|5.9403227005|
|2|100|64000|390379.128|77205.45|5.0563674974|
|2|1000|1024|4275.427|107.752|39.6784004009|
|2|1000|2048|9002.224|240.328|37.4580739656|
|2|1000|4096|17506.322|478.795|36.5632932675|
|2|1000|8000|36023.671|936.647|38.4602427595|
|2|1000|16000|77573.168|1900.365|40.8201413939|
|2|1000|32000|166096.53|3807.846|43.6195502654|
|2|1000|64000|333527.89|8057.699|41.39244839|
|2|2000|1024|4215.233|40.166|104.9453019967|
|2|2000|2048|7817.065|140.176|55.7660726515|
|2|2000|4096|16460.534|302.354|54.4412642135|
|2|2000|8000|34834.671|595.045|58.5412380576|
|2|2000|16000|71198.703|1198.658|59.3986800238|
|2|2000|32000|164602.702|2441.896|67.4077446378|
|2|2000|64000|326950.689|5018.504|65.149034254|
|3|10|1024|17563.189|12591.11|1.3948880599|
|3|10|2048|40323.233|26827.544|1.5030534662|
|3|10|4096|90634.301|55372.915|1.636798442|
|3|10|8000|180605.006|112340.016|1.607664058|
|3|10|16000|377485.446|220576.124|1.7113613167|
|3|10|32000|719862.747|444048.477|1.6211354937|
|3|10|64000|1448648.778|888291.277|1.6308263016|
|3|100|1024|5953.177|1282.051|4.6434790816|
|3|100|2048|11867.489|2475.663|4.7936609304|
|3|100|4096|23781.162|4956.259|4.798208084|
|3|100|8000|50154.639|9918.107|5.0568761761|
|3|100|16000|101415.351|20612.608|4.920064021|
|3|100|32000|206534.66|46958.461|4.3982416715|
|3|100|64000|410189.768|103604.349|3.9591944929|
|3|1000|1024|3768.713|155.013|24.3122383284|
|3|1000|2048|9290.828|287.702|32.2932339713|
|3|1000|4096|19068.872|591.37|32.2452474762|
|3|1000|8000|37386.302|1173.022|31.8717824559|
|3|1000|16000|80019.08|2349.26|34.0613980573|
|3|1000|32000|166979.318|4750.332|35.1510837558|
|3|1000|64000|334807.012|10051.151|33.3103156047|
|3|2000|1024|3576.936|84.307|42.427508985|
|3|2000|2048|8858.885|173.809|50.9690810027|
|3|2000|4096|18813.804|367.991|51.1257177485|
|3|2000|8000|36267.153|719.568|50.4012866053|
|3|2000|16000|76035.017|1424.328|53.3830810038|
|3|2000|32000|162745.176|2920.364|55.7277024371|
|3|2000|64000|335004.219|6027.053|55.5834201226|
|100000|10|1024|24655.507|18805.963|1.3110472992|
|100000|10|2048|49134.673|37556.271|1.3082947719|
|100000|10|4096|100383.767|75620.664|1.3274647655|
|100000|10|8000|196333.59|148143.947|1.3252893147|
|100000|10|16000|396826.572|295088.476|1.3447714983|
|100000|10|32000|774229.377|585011.168|1.3234437552|
|100000|10|64000|1642733.978|1172637.039|1.4008887007|
|100000|100|1024|24248.412|18683.511|1.2978509232|
|100000|100|2048|49970.744|37517.12|1.331945096|
|100000|100|4096|100074.021|75406.868|1.3271207737|
|100000|100|8000|195791.347|148426.795|1.3191105218|
|100000|100|16000|395203.808|297003.995|1.3306346536|
|100000|100|32000|823697.417|586171.038|1.4052168456|
|100000|100|64000|1524057.926|1174318.153|1.2978236963|
|100000|1000|1024|24154.441|18803.488|1.2845723623|
|100000|1000|2048|48891.924|37709.658|1.2965358636|
|100000|1000|4096|100209.496|75919.448|1.3199450028|
|100000|1000|8000|211969.73|149735.453|1.4156282013|
|100000|1000|16000|387639.866|294624.263|1.3157092429|
|100000|1000|32000|814015.381|587213.471|1.3862341741|
|100000|1000|64000|1513301.084|1168756.976|1.2947953382|
|100000|2000|1024|24372.348|18985.193|1.2837556089|
|100000|2000|2048|48993.623|37517.633|1.3058825699|
|100000|2000|4096|99118.157|76048.613|1.3033525937|
|100000|2000|8000|209490.528|148385.397|1.4118001652|
|100000|2000|16000|395739.167|302666.502|1.3075089724|
|100000|2000|32000|773626.685|585625.143|1.3210271011|
|100000|2000|64000|1536702.086|1192397.602|1.2887497286|
> GridPartitionStateMap.entrySet() optimization.
> ----------------------------------------------
>
> Key: IGNITE-7986
> URL: https://issues.apache.org/jira/browse/IGNITE-7986
> Project: Ignite
> Issue Type: Improvement
> Reporter: Vitaliy Biryukov
> Assignee: Vitaliy Biryukov
> Priority: Major
> Attachments: GridPartitionStateMapBench.java
>
>
> GridPartitionStateMap based on BitSet. And the size of a BitSet depends on
> the maximum key element, and not on the number of elements.
> Just using the "BitSet.nextSetBit" method, will improve the performance of
> the iterator for big clusters or caches with a large number of partitions.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
