RE: Effective way to pre-load data around 10 TB

2018-12-19 Thread Stanislav Lukyanov
. Anyway, I think that your best chance is to implement the same thing https://issues.apache.org/jira/browse/IGNITE-8873 does. E.g. you can try to backport the commit on top of 2.6. Stan From: Naveen Sent: 5 декабря 2018 г. 7:59 To: user@ignite.apache.org Subject: RE: Effective way to pre-load data

RE: Effective way to pre-load data around 10 TB

2018-12-04 Thread Naveen
Thanks Stan, this may take little longer time to implement, we are in hurry to build this functionality of preloading the data. Can someone correct me how to improve this pre-load process. This is how we are preloading. 1. Send an Async request for all the partitions with the below code, below

RE: Effective way to pre-load data around 10 TB

2018-11-29 Thread Stanislav Lukyanov
Hi, Currently the best option is IgniteCache::preloadPartition method added in https://issues.apache.org/jira/browse/IGNITE-8873. There is a JIRA ticket to allow pre-loading data before the node joins the cluster: https://issues.apache.org/jira/browse/IGNITE-10152. Stan From: Naveen Sent: 29 н