Hi, exactly I want to have near cache only on client nodes. I will check your advice with dynamic cache. I have two server nodes which keep data and I want to get data from them via my client nodes. I am also curious what had happened with heap on server nodes.
pon., 23 mar 2020 o 23:13 Evgenii Zhuravlev <e.zhuravlev...@gmail.com> napisał(a): > Hi, > > Near Cache configuration in xml creates near caches for all nodes, > including server nodes. As far as I understand, you want to have them on > client side only, right? If so, I'd recommend to create them dynamically: > https://www.gridgain.com/docs/latest/developers-guide/near-cache#creating-near-cache-dynamically-on-client-nodes > > What kind of operations are you running? Are you trying to access data on > server from another server node? In any case, so many entries in Heap on > server nodes looks strange. > > Evgenii > > пн, 23 мар. 2020 г. в 07:08, Dominik Przybysz <alien11...@gmail.com>: > >> Hi, >> I am using Ignite 2.7.6 and I have 2 server nodes with one partitioned >> cache and configuration: >> >> <?xml version="1.0" encoding="UTF-8"?> >> <beans xmlns="http://www.springframework.org/schema/beans"; >> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; >> xsi:schemaLocation=" >> http://www.springframework.org/schema/beans >> http://www.springframework.org/schema/beans/spring-beans.xsd";> >> >> <bean id="grid.cfg" >> class="org.apache.ignite.configuration.IgniteConfiguration"> >> <property name="cacheConfiguration"> >> <bean >> class="org.apache.ignite.configuration.CacheConfiguration"> >> <property name="name" value="cache1"/> >> <property name="cacheMode" value="PARTITIONED"/> >> <property name="statisticsEnabled" value="true"/> >> <property name="backups" value="1"/> >> </bean> >> </property> >> >> <property name="communicationSpi"> >> <bean >> class="org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi"> >> <property name="localPort" value="47500"/> >> </bean> >> </property> >> >> <property name="discoverySpi"> >> <bean >> class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> >> <property name="localPort" value="47100"/> >> <property name="localPortRange" value="100"/> >> <property name="ipFinder"> >> <bean >> class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder"> >> <property name="addresses"> >> <list> >> <value>ignite1:47100..47200</value> >> <value>ignite2:47100..47200</value> >> </list> >> </property> >> </bean> >> </property> >> </bean> >> </property> >> >> <property name="clientConnectorConfiguration"> >> <bean >> class="org.apache.ignite.configuration.ClientConnectorConfiguration"> >> <property name="port" value="10800"/> >> </bean> >> </property> >> >> <property name="dataStorageConfiguration"> >> <bean >> class="org.apache.ignite.configuration.DataStorageConfiguration"> >> <property name="defaultDataRegionConfiguration"> >> <bean >> class="org.apache.ignite.configuration.DataRegionConfiguration"> >> <property name="persistenceEnabled" value="true"/> >> <property name="metricsEnabled" value="true"/> >> </bean> >> </property> >> <property name="metricsEnabled" value="true"/> >> </bean> >> </property> >> >> <property name="consistentId" value="{{hostname}}"/> >> >> <property name="systemThreadPoolSize" >> value="{{ignite_system_thread_pool_size}}"/> >> <property name="dataStreamerThreadPoolSize" >> value="{{ignite_cluster_data_streamer_thread_pool_size}}"/> >> </bean> >> </beans> >> >> I loaded 1,5mln entries into cluster via data streamer. >> I tested this topology without near cache and everything was fine, but >> when I tried to add near cache to my client nodes then server nodes started >> to keep data on heap and reads rps dramatically fell down (150k rps to 10k >> rps). >> >> My clients' configuration: >> >> <?xml version="1.0" encoding="UTF-8"?> >> <beans xmlns="http://www.springframework.org/schema/beans"; >> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; >> xsi:schemaLocation=" >> http://www.springframework.org/schema/beans >> http://www.springframework.org/schema/beans/spring-beans.xsd";> >> <bean id="grid.cfg" >> class="org.apache.ignite.configuration.IgniteConfiguration"> >> <property name="clientMode" value="true"/> >> <property name="discoverySpi"> >> <bean >> class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> >> <property name="ipFinder"> >> <bean >> class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder"> >> <property name="addresses"> >> <list> >> <value>ignite1:47100..47200</value> >> <value>ignite2:47100..47200</value> >> </list> >> </property> >> </bean> >> </property> >> </bean> >> </property> >> <property name="dataStreamerThreadPoolSize" value="8"/> >> <property name="systemThreadPoolSize" value="8"/> >> >> <property name="cacheConfiguration"> >> <bean >> class="org.apache.ignite.configuration.CacheConfiguration"> >> <!-- Cache configuration has to be the same as in server >> config --> >> <property name="name" value="cache1"/> >> <property name="cacheMode" value="PARTITIONED"/> >> <property name="statisticsEnabled" value="true"/> >> <property name="backups" value="1"/> >> >> <property name="nearConfiguration"> >> <bean >> class="org.apache.ignite.configuration.NearCacheConfiguration"> >> <property name="nearEvictionPolicyFactory"> >> <bean >> class="org.apache.ignite.cache.eviction.lru.LruEvictionPolicyFactory"> >> <property name="maxSize" value="100000"/> >> </bean> >> </property> >> </bean> >> </property> >> </bean> >> </property> >> </bean> >> </beans> >> >> On visor i see: >> >> Nodes for: cache1(@c0) >> >> +=================================================================================================================================+ >> | Node ID8(@), IP | CPUs | Heap Used | CPU Load | Up Time >> | Size (Primary / Backup) | Hi/Mi/Rd/Wr | >> >> +=================================================================================================================================+ >> | BCA8F378(@n2), 10.100.0.239 | 4 | 32.32 % | 2.17 % | >> 00:38:33.071 | Total: 55204 (55204 / 0) | Hi: 1671212 | >> | | | | | >> | Heap: 55204 (55204 / <n/a>) | Mi: 35034768 | >> | | | | | >> | Off-Heap: 0 (0 / 0) | Rd: 36705980 | >> | | | | | >> | Off-Heap Memory: 0 | Wr: 0 | >> >> +-----------------------------+------+-----------+----------+--------------+---------------------------------------+--------------+ >> | 905F83EE(@n3), 10.100.0.230 | 4 | 52.56 % | 6.67 % | >> 00:38:33.401 | Total: 54051 (54051 / 0) | Hi: 1766495 | >> | | | | | >> | Heap: 54051 (54051 / <n/a>) | Mi: 34283753 | >> | | | | | >> | Off-Heap: 0 (0 / 0) | Rd: 36050248 | >> | | | | | >> | Off-Heap Memory: 0 | Wr: 0 | >> >> +-----------------------------+------+-----------+----------+--------------+---------------------------------------+--------------+ >> | 793E1BC9(@n1), 10.100.0.206 | 4 | 99.33 % | 38.43 % | >> 00:51:11.877 | Total: 2999836 (2230060 / 769776) | Hi: 17323596 | >> | | | | | >> | Heap: 1499836 (1499836 / <n/a>) | Mi: 0 | >> | | | | | >> | Off-Heap: 1500000 (730224 / 769776) | Rd: 17323596 | >> | | | | | >> | Off-Heap Memory: <n/a> | Wr: 0 | >> >> +-----------------------------+------+-----------+----------+--------------+---------------------------------------+--------------+ >> | 0147FB02(@n0), 10.100.0.205 | 4 | 96.48 % | 40.33 % | >> 00:51:11.820 | Total: 2999814 (2269590 / 730224) | Hi: 17335702 | >> | | | | | >> | Heap: 1499814 (1499814 / <n/a>) | Mi: 0 | >> | | | | | >> | Off-Heap: 1500000 (769776 / 730224) | Rd: 17335702 | >> | | | | | >> | Off-Heap Memory: <n/a> | Wr: 0 | >> >> +---------------------------------------------------------------------------------------------------------------------------------+ >> >> 1st and 2nd entry is client node, 3rd and 4th is server node. >> >> What is wrong with my near cache configuration? >> Do I have to mirror all cache configuration on server node into client >> nodes configuration? (for example, when I miss backup parameter I received >> exception "Affinity key backups mismatch") >> >> -- >> Pozdrawiam / Regards, >> Dominik Przybysz >> > -- Pozdrawiam / Regards, Dominik Przybysz
