Re: read-though tutorial for a big table

2020-09-23 Thread vtchernyi
Hi Alex,I have some good news.>> experience and materials you mentioned in thisthreadMy tutorial is finally published: https://www.gridgain.com/resources/blog/how-fast-load-large-datasets-apache-ignite-using-key-value-apiHope that helpsVladimir12:52, 22 июня 2020 г., Alex Panchenko :Hello Vladimir,

Re: read-though tutorial for a big table

2020-08-07 Thread vtchernyi
Hi Alex,I do not feel myself like a guru about Ignite, there is much more experienced people in that chat. Summer happened, vacation and so forth.. Please wait some time until my blog will be ready.I hope you can read russian and my article [1] may be helpful meanwhile. It is as a result of half ye

Re: read-though tutorial for a big table

2020-08-07 Thread Denis Magda
Alex, Please share a bit more details on what you’re struggling with. It sounds like you are looking for a specific piece of advice rather than generic performance suggestions. Denis On Thursday, August 6, 2020, Alex Panchenko wrote: > Hello Vladimir, > > are there some key things you can shar

Re: read-though tutorial for a big table

2020-08-06 Thread Alex Panchenko
Hello Vladimir, are there some key things you can share with us? Some checklist with the most important configuration params or things we need to review/check? anything would be helpful I've been playing with Ignite for the last few months, performance still low. I have to decide whether to switc

Re: read-though tutorial for a big table

2020-06-23 Thread Kseniya Romanova
Hi Vladimir! I will be absolutely happy to help. Let's discuss in telegram. ср, 24 июн. 2020 г. в 02:31, Denis Magda : > Hello Vladimir, > > Sounds interesting, thanks for reaching out. Let me introduce you to @Kseniya > Romanova who can help with the publication > process. > > - > Denis > > > O

Re: read-though tutorial for a big table

2020-06-23 Thread Denis Magda
Hello Vladimir, Sounds interesting, thanks for reaching out. Let me introduce you to @Kseniya Romanova who can help with the publication process. - Denis On Sun, Jun 21, 2020 at 10:31 PM Vladimir Tchernyi wrote: > Hi Denis, > > Some progress had happened and I have some material to share wit

Re: read-though tutorial for a big table

2020-06-22 Thread vtchernyi
Hi Alex,There is an NDA covering my work, so direct sharing is not a variant. I see tutorial post of that kind will be actual, so I should start working. Please wait some time. Right now I do have nothing to share.About production - the first thing I faced with was turtle-slow inserting values in c

Re: read-though tutorial for a big table

2020-06-22 Thread Alex Panchenko
Hello Vladimir, I'm building the high-load service to handle intensive read-write operations using Apache Ignite. I need exactly the same - "loading big tables from rdbms (Postgres) and creating cache entries based on table info". Could you, please, share your experience and materials you mention

Re: read-though tutorial for a big table

2020-06-21 Thread Vladimir Tchernyi
Hi Denis, Some progress had happened and I have some material to share with the community. I think it will be interesting to newbies. It is about loading big tables from rdbms and creating cache entries based on table info. This approach was tested in production and showed good timing being paired

Re: read-though tutorial for a big table

2020-03-11 Thread vtchernyi
Hello Denis,That is possible, my writing activities should be continued. The only question is to get my local project to production, there is no sense in writing another model example. So I hope there will be a progress in the nearest futureVladimir2:25, 12 марта 2020 г., Denis Magda :Hello Vladimi

Re: read-though tutorial for a big table

2020-03-11 Thread Denis Magda
Hello Vladimir, Just to clarify, are you suggesting to create a tutorial for data loading scenarios when data resides in an external database? - Denis On Tue, Mar 10, 2020 at 11:41 PM wrote: > Andrei, Evgenii, thanks for answer. > > Aa far as I see, there is no ready to use tutorial. I manage

Re: read-though tutorial for a big table

2020-03-10 Thread vtchernyi
Andrei, Evgenii, thanks for answer.Aa far as I see, there is no ready to use tutorial. I managed to do multi-threaded cache load procedure, out-of-the-box loadCache method is extremely slow.I spent about a month studying write-through topics, and finally got the same as "capacity planning" says: 0.

Re: read-though tutorial for a big table

2020-03-10 Thread Evgenii Zhuravlev
When you're saying that the result was poor, do you mean that data preloading took too much time, or it's just about get operations? Evgenii вт, 10 мар. 2020 г. в 03:29, aealexsandrov : > Hi, > > You can read the documentation articles: > > https://apacheignite.readme.io/docs/3rd-party-store > >

Re: read-though tutorial for a big table

2020-03-10 Thread aealexsandrov
Hi, You can read the documentation articles: https://apacheignite.readme.io/docs/3rd-party-store In case if you are going to load the cache from 3-rd party store (RDBMS) then the default implementation of CacheJdbcPojoStore can take a lot of time for loading the data because it used JDBC connect

read-though tutorial for a big table

2020-03-09 Thread vtchernyi
Hi Igniters,My question is about well done tutorial. Recently on the devlist there was topic "Read load balancing, read-though, ttl and optimistic serializable transactions". It says ignite cache sitting on the top of RDBMS is the most often use case. I tried to implement read-though for a big tabl