Re: 3rd party persistence with hive not updating hive with all records/entries in ignite
Hello! Nothing obvious is wrong here. Can you please enable DEBUG logging for org.apache.ignite.cache.store.jdbc re-run your case and share the logs? Regards, -- Ilya Kasnacheev пн, 21 янв. 2019 г. в 18:04, shivakumar : > Hi here is my cache store configuration > > > > > http://www.springframework.org/schema/beans; >xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; >xmlns:util="http://www.springframework.org/schema/util; >xsi:schemaLocation="http://www.springframework.org/schema/beans > > http://www.springframework.org/schema/beans/spring-beans.xsd >http://www.springframework.org/schema/util > > http://www.springframework.org/schema/util/spring-util.xsd;> > > > > class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer"> >value="SYSTEM_PROPERTIES_MODE_OVERRIDE" /> > > > > class="org.springframework.jdbc.datasource.DriverManagerDataSource" > lazy-init="true"> > value="org.apache.hive.jdbc.HiveDriver"/> > > > > > > > > > > class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> > > > > > > class="org.apache.ignite.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder"> > > > > y.y.y.y:47500..47509 > > > > > > > > > > > > > > > > class="org.apache.ignite.configuration.CacheConfiguration"> > > > > > > class="org.apache.ignite.cache.store.jdbc.CacheJdbcPojoStoreFactory"> > value="dsHive_DB"/> > > class="org.apache.ignite.cache.store.jdbc.dialect.BasicJdbcDialect"> > > > > > > class="org.apache.ignite.cache.store.jdbc.JdbcType"> > value="ApnDiameter5MinCache"/> > value="com.mycomp.ignite_user.model.ApnDiameter5MinKey"/> > value="com.mycomp.ignite_user.model.ApnDiameter5Min"/> > value="ignite_ps"/> > value="apn_diameter_5_min"/> > > > > > > > class="org.apache.ignite.cache.store.jdbc.JdbcTypeField"> > name="databaseFieldType"> > static-field="java.sql.Types.VARCHAR"/> > > name="databaseFieldName" value="id"/> > name="javaFieldType" value="java.lang.String"/> > name="javaFieldName" value="id"/> > > > class="org.apache.ignite.cache.store.jdbc.JdbcTypeField"> > name="databaseFieldType"> > static-field="java.sql.Types.TIMESTAMP"/> > > value="report_start_time"/> > value="java.sql.Timestamp"/> > value="reportStartTime"/> > > > class="org.apache.ignite.cache.store.jdbc.JdbcTypeField"> > name="databaseFieldType"> > static-field="java.sql.Types.TIMESTAMP"/> > > value="report_end_time"/> > value="java.sql.Timestamp"/> > value="reportEndTime"/> > > > class="org.apache.ignite.cache.store.jdbc.JdbcTypeField"> > name="databaseFieldType"> >
Re: 3rd party persistence with hive not updating hive with all records/entries in ignite
Hi here is my cache store configuration http://www.springframework.org/schema/beans; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; xmlns:util="http://www.springframework.org/schema/util; xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd http://www.springframework.org/schema/util http://www.springframework.org/schema/util/spring-util.xsd;> y.y.y.y:47500..47509
Re: 3rd party persistence with hive not updating hive with all records/entries in ignite
Hello! What Cache Store implementation are you using, and which are its settings? Regards, -- Ilya Kasnacheev ср, 16 янв. 2019 г. в 21:43, shivakumar : > Hi > i am trying to use hive as 3rd party persistence store and enabled write > behind and i set these cache configurations using spring xml > > > value="5000"/> > > > every 5000ms interval ignite updating only one recored/one row in hive, > even > i ingested around 2000 records of data to ignite. > why all 2000 records of data not going into hive when it hits 5000ms > Flushfrequency time interval ? > is there any other parameter which affect these persistence store update. > any suggestions are appreciated! > thanks > > > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >
