Hi ,
I am new to Ignite. i am able to load data from oracle into ignite using
Cache Pojo Store method ignite.cache.("cachename").loadcache(null) . But in
the documentation it was mentioned that Data Steamers will provide better
performance when loading data into ignite cache.
*Documentation Reference:*
https://apacheignite.readme.io/docs/data-streamers
Following is the example provided for Data Streamers in the documentation
// Get the data streamer reference and stream data.
try (IgniteDataStreamer<Integer, String> stmr =
ignite.dataStreamer("myStreamCache")) {
// Stream entries.
for (int i = 0; i < 100000; i++)
stmr.addData(i, Integer.toString(i));
}
I have following questions by taking this example as reference to stream
data from oracle table to ignite
cache.
1. Is an external streamer needed to stream data from oracle to ignite to
use data streaming technique
as mentioned in above example.
2. If an external streamer is not required, then do we need to loop through
the jdbc result set and add data to the cache.Please find below for the
pseudo code implementation of the same.
try (IgniteDataStreamer<Key, Obj> stmr = ignite.dataStreamer("CacheName")) {
// Stream entries.
while(rs.hasNext()){-->rs is JDBC result set
Key keyobj=new Key(rs.getString(1));
Value valueobj=new
Value(rs.getString(2),rs.getString(3),rs.getString(4));
stmr.addData(keyobj , valueobj);
}
}
When i tried to load data into ignite cache from oracle using this method
it is taking lot of time which is as expected as we are looping through each
and every record.Is this right method of implementing Data Streamers to load
data from Oracle to Ignite.If this is not right way,can anyone share sample
code to stream data from any RDBMS table to Ignite cache.
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
