Unsubscribe

2021-07-12 Thread Michael Cherkasov

Re: Error Codes

2021-01-04 Thread Michael Cherkasov
First of all, we need to decide what's > our target. Is it log, or is it API? > > Regards, > -- > Ilya Kasnacheev > > > пт, 1 янв. 2021 г. в 02:07, Michael Cherkasov >: > >> Hi folks, >> >> I was thinking how we can simplify Ignite clu

Error Codes

2020-12-31 Thread Michael Cherkasov
Hi folks, I was thinking how we can simplify Ignite clusters troubleshooting and the best of course if the cluster can do self-healing, like transaction cancellation if tx blocks exchange or note restart on OOM error. However, sometimes those mechanisms don't work well or user interaction is

Re: ClusterGroupEmptyException: Topology projection is empty.

2020-09-11 Thread Michael Cherkasov
visor, WebConsole or ControlCenter use the same mechanisms for cluster monitoring, so if you use any of it see such kind of errors, you can ignore them, they are harmless for your cluster. чт, 10 сент. 2020 г. в 06:42, kay : > Hello, > > I don't use Visor for cluster monitoring.. then Why that

Re: Ignite Segmentation Behaviour

2020-09-11 Thread Michael Cherkasov
BTW, you can try zookeeper discovery, I think it's the easier way to resolve split-brain problem: https://www.gridgain.com/docs/latest/developers-guide/clustering/zookeeper-discovery пт, 11 сент. 2020 г. в 14:13, Michael Cherkasov : > Make sure first you stop all nodes in one segment and o

Re: Ignite Segmentation Behaviour

2020-09-11 Thread Michael Cherkasov
Make sure first you stop all nodes in one segment and only then start them, rolling restart might not fix cluster segmentation. пт, 11 сент. 2020 г. в 09:08, Denis Magda : > Hi Samuel, > > With the current behavior, the segments will not rejoin automatically. > Once the network is recovered

Re: Ignite 2.8.1 ContinuousQuery: ClassNotFoundException on a client node

2020-09-10 Thread Michael Cherkasov
Hello Ivan, Right now CQ deployed remote filter on all nodes, even on client nodes that don't store any data and this doesn't make sense, I think Ignite should not deploy it at all on non-affinity nodes. I filed a ticket for this: https://issues.apache.org/jira/browse/IGNITE-13432 Regarding the

Re: Ignite Node shutdown..

2020-09-08 Thread Michael Cherkasov
Hi, you don't have enough off heap space for your data, so I wondering, what kind of tests do you try to do? Might be you can enable persistence? пн, 7 сент. 2020 г. в 23:26, kay : > Hello, I test if i use max heap size.. > > I got this error and node was shut down.. > > rmtAddr's client socket

Re: Increase the indexing speed while loading the cache from an RDBMS

2020-09-04 Thread Michael Cherkasov
>I've checked the RDBMS perf metrics. I do not see any spike in the CPU or memory usage. >Is there anything in particular that could cause a bottleneck from the DB perspective ? The DB in use is a Postgres DB. if you use cache store, each node will read the full table you want to load, but only

Re: Ignite's memory consumption

2020-08-27 Thread Michael Cherkasov
512M of heap, plus 512M of offheap, plus some space for java metaspace, if you don't set, it is unlimited, set to: -XX:MaxMetaspaceSize=256m so, in total it will consume up to 1.25GB. But even with what you described, I don't see any problem 760MB is less than limits you set to heap+off-heap.

Re: Ignite client node raises "Sequence was removed from cache" after Ignite Server node restarts

2020-08-27 Thread Michael Cherkasov
Hi, as I remember AtomicInteger uses the default data region as storage, so if you don't have persistence for it, then it will be lost after restart. Try to enable persistence and check it again. ср, 26 авг. 2020 г. в 18:08, xmw45688 : > *USE CASE *- use IgniteAtomicLong for table sequence

Re: ignite partition mode

2020-08-27 Thread Michael Cherkasov
I'm not sure how you defined that only one node store data, but if so, it means only one node in baseline: https://www.gridgain.com/docs/latest/developers-guide/baseline-topology#baseline-topology add the second node to baseline and it will store data too. чт, 27 авг. 2020 г. в 15:08, Denis Magda

Re: Increase the indexing speed while loading the cache from an RDBMS

2020-08-27 Thread Michael Cherkasov
Hi Srikanta, Have you tried to load data without indexto compare time? I think Wal disabling for data load can save some hours for you: https://www.gridgain.com/docs/latest/developers-guide/persistence/native-persistence#disabling-wal Thanks, Mike. On Wed, Aug 26, 2020, 8:47 AM Srikanta

Re: How to confirm that disk compression is in effect?

2020-08-27 Thread Michael Cherkasov
Could you please share your benchmark code? I believe compression might depend on data you write, if it full random, it's difficult to compress the data. On Wed, Aug 26, 2020, 8:26 PM 38797715 <38797...@qq.com> wrote: > Hi, > > We turn on disk compression to see the trend of execution time and

Re: Select clause is quite more slow than same Select on MySQL

2020-08-27 Thread Michael Cherkasov
Hi Manuel, Ignite is a grid solution, it is supposed to be scaled horizontally, so MySQL can be more efficient in some cases, but it can not scaled well. So ignite will win when you can not fit data on one machine and need to scale. So, load more data, use more machines and at some point Apache

Re: NullPointerException while cluster startup

2020-03-13 Thread Michael Cherkasov
Hi Sumit, Did you have a chance to very the build by the link I sent to you? Might be you can share a reproducer so I can verify it my own? Thanks, Mike. пн, 9 мар. 2020 г. в 09:26, Mikhail : > Hello, > > Looks like it was fixed in GridGain Community edition: >

Re: How much data is actually in RAM?

2019-06-14 Thread Michael Cherkasov
Hi John, if you have native persistence enabled that ignite will evict data to a disk if there's no space in RAM. BUT you have to specify maxSize for RAM! so Ignite really doesn't have a limit for space, it's just limited by your disk and you will get IgniteOOM at some point. So your current

Re: Toxiproxy

2019-05-30 Thread Michael Cherkasov
Hi Delian, I used it to test timeout for client nodes, I attached the example, I think it can be adapted for your purposes. >I've now set up Toxiproxy with a proxy (per node) for discovery, >communication, shared mem and timeserver as the config file for each node >allows me to explicitly set

Re: Binary Serialization of Enums By Name

2019-02-04 Thread Michael Cherkasov
Hi Stuart, I think you can use Binarylizable interface, you can implement your one serialization for your enum. Thanks, Mike. пн, 4 февр. 2019 г. в 15:12, Stuart Macdonald : > Igniters, > > I have some cache objects which contain enum fields, which when persisted > through Ignite binary

Re: Spring Cloud + Jdbc client driver

2019-02-04 Thread Michael Cherkasov
Hi, Could you please describe your question in more details? I think it's not clear what you are trying to ask. Thanks, Mike. пн, 4 февр. 2019 г. в 16:44, nikfuri : > Hi! Is there any availability to pass properties gained through config > server > to jdbc config file? > > > > -- > Sent from:

Re: Heap size

2018-10-11 Thread Michael Cherkasov
Hi Prasad, G1 is a good choice for big heaps, if you have big GC pauses you need to investigate this, might be GC tuning is required, might be you just need to increase heap size, it depends on your case and very specific. Also, please make sure that you use 31GB heap, or > 40 GB heap, numbers

Re: Batch insert into ignite

2018-07-25 Thread Michael Cherkasov
-25 7:02 GMT+03:00 Sriveena Mattaparthi < sriveena.mattapar...@ekaplus.com>: > Thanks for the clarification Michael..will try the streamer option. > > > > Regards, > > Sriveena > > > > *From:* Michael Cherkasov [mailto:michael.cherka...@gmail.com] &

Re: Batch insert into ignite

2018-07-24 Thread Michael Cherkasov
I can't say for sure which one should be better for sure, it must be benchmarked. But if you can use SqlFieldsQuery this means that you can use native Ignite API, right? So, in this case, IgniteDataStreamer would be the best choice. 2018-07-24

Re: @SpringApplicationContextResource / ApplicationContext / getBeansOfType()

2018-02-08 Thread Michael Cherkasov
Hi Navnet, Could you please share a reproducer for this issue? Some small mvn based project on github or as zip archive that will show the issue. Thanks, Mike. 2018-02-08 15:00 GMT-08:00 NK : > Hi, > > I have a Spring Boot app using Ignite 2.3.0. > > I am invoking

Re: slow query performance against berkley db

2018-02-05 Thread Michael Cherkasov
Rajesh, >Does that mean Ignite cannot scale well against Berkley dB Incase of single node? Could you please clarify, what your question means? Ignite can scale from a single node to hundreds(or even thousands, I have seen the only cluster of 300 nodes, but this definitely not a limit). It was

Re: Peer to peer class loading + deployment modes

2018-02-05 Thread Michael Cherkasov
Hi Luqman, you're right, peer class loading is exactly what you need, isolated or shared mode fit your case and will automatically deploy a new compute classes, but unfortunately, there's no way to enable peer class loading without cluster restart. So you need to plan a maintenance for your

Re: Failed to activate cluster - table already exists

2018-01-26 Thread Michael Cherkasov
Hi Thomas, Please share with us next time a reproducer with work folder. It's something that should be checked. Did you change your QueryEntities between cluster restart? Thanks, Mike. 2018-01-26 5:25 GMT-08:00 Thomas Isaksen : > Hi Mikhail, > > I don't know what

Re: Memory leak in GridCachePartitionExchangeManager?

2017-12-26 Thread Michael Cherkasov
Hi, I created a ticket for the issue you found: https://issues.apache.org/jira/browse/IGNITE-7319 Thanks, Mike. 2017-12-18 17:05 GMT+03:00 zbyszek : > > Dear all, > > I was wondering if this is a know issue which has a chance to be fixed in > future or (I hope) it is me who

Re: using JDBC with Ignite cluster, configured with persistent storage

2017-12-05 Thread Michael Cherkasov
Hi, I can not understand from your email what was wrong, could you please provide more details about your case? Maybe you can send me a demo app that will show the exception you have? Thanks, Mike. 2017-12-05 1:45 GMT+03:00 soroka21 : > Hi, > I'm trying to use JDBC

Re: Ignite poor performance

2017-12-05 Thread Michael Cherkasov
Hi Sasha, Did you have time to try my advice? Did it help you? Thanks, Mike. 2017-12-04 17:00 GMT+03:00 Sasha Haykin : > Hi, > > I Working on big POC for telecom industry solution > > > I have loaded to ignite 5,000,000 objects/rows (I loaded it in the client > side Please

Re: Ignite .NET - Delete statement

2017-12-04 Thread Michael Cherkasov
Hi Jérôme, Could you please send me a full reproducer? And could you please clarify which version of Ignite is used? Thanks, Mike. 2017-12-04 12:38 GMT+03:00 jerpic : > Hello, I try to delete some records according to the DELETE statement (see > below).

Re: Ignite poor performance

2017-12-04 Thread Michael Cherkasov
and choose the best for your case. Thanks, Mike. 2017-12-04 18:02 GMT+03:00 Michael Cherkasov <michael.cherka...@gmail.com>: > Hi Sasha, > > it's definitely can work faster: > 1. add index for DEST_NE_NAME: > https://apacheignite.readme.io/docs/cache-queries#section-

Re: Ignite poor performance

2017-12-04 Thread Michael Cherkasov
Hi Sasha, it's definitely can work faster: 1. add index for DEST_NE_NAME: https://apacheignite.readme.io/docs/cache-queries#section-query-configuration-by-annotations 2. enable query parallelism: https://apacheignite-sql.readme.io/docs/performance-and-debugging#query-parallelism Thanks, Mike.

Re: Trouble with v 2.3.0 on AIX

2017-11-29 Thread Michael Cherkasov
Hi Vladimir, Unfortunately I don't have AIX or any other big-endian machine at hand, so could you please assist me with fixing this bug. Could you please run the following unit test on your AIX box: org.apache.ignite.internal.direct.stream.v2.DirectByteBufferStreamImplV2ByteOrderSelfTest Could

Re: Initial query resent the data when client got reconnect

2017-11-22 Thread Michael Cherkasov
There's a ticket for this feature: https://issues.apache.org/jira/browse/IGNITE-5625 please vote for it and at some point, it will be implemented. 2017-11-21 13:52 GMT+03:00 gunman524 : > Mike, double checked Mongodb way, their ObjectID only provide a unique ID, > sorry for

Re: IgniteInterruptedException: Node is stopping

2017-11-22 Thread Michael Cherkasov
Hi Hyma, Could you please show a code snippet where it is hanged? Thanks, Mike. 2017-11-22 12:48 GMT+03:00 Hyma : > Thanks Mikhail. > > I suspected to increase the spark heartbeat/network timeout. But my > question > here is if an executor is lost, corresponding

Re: Logging query on server node sent from client node

2017-11-22 Thread Michael Cherkasov
Hi, I don't think that you run ignite with proper configuration, because the snippet that you sent won't work. EventType.EVTS_CACHE_QUERY is array and you should have the folllowin exception on logs: Caused by: org.springframework.beans.TypeMismatchException: Failed to convert property value of

Re: Ignite-cassandra module issue

2017-11-09 Thread Michael Cherkasov
Hi Dmitriy, I created a ticket for this: https://issues.apache.org/jira/browse/IGNITE-6853 it will be fixed in 2.4. Thanks, Mike. 2017-11-09 2:35 GMT+03:00 Dmitriy Setrakyan <dsetrak...@apache.org>: > Hi Michael, do you have any update for the issue? > > On Thu, Nov 2, 2017 at 5

Re: Ignite-cassandra module issue

2017-11-02 Thread Michael Cherkasov
Hi Tobias, Thank you for explaining how to reproduce it, I'll try your instruction. I spend several days trying to reproduce the issue, but I thought that the reason of this is too high load and I didn't stop client during testing. I'll check your instruction and try to fix the issue. Thanks,

Re: Cassandra failing to ReadThrough using Cache.get(key) without preloading

2017-09-29 Thread Michael Cherkasov
Hi Kenan, I set up exactly the same config as you have, and I wasn't able to read data back form cassandra too. Then I found an error in configuration in persitence-settings.xml you have 'table="testresponse"' while you put data to 'table="test_response"', so I added underscore and now it works

Re: Unable to access cache data in Dbeaver

2017-09-27 Thread Michael Cherkasov
Do you want to say that you didn't change anything in configuration? Can you see you data in )H2 console? ( https://apacheignite.readme.io/docs/sql-performance-and-debugging#using-h2-debug-console ) Thanks, Mike. 2017-09-27 12:10 GMT+03:00 devkumar : > @Mikhail, I updated the

Re: Unable to access cache data in Dbeaver

2017-09-27 Thread Michael Cherkasov
Hi, I've recently was able to run DBeaver for ignite and have no problem to query data with it. Could you please show how you configured indexing in ignite(QueryEntity? )? And how did you query data in DBeaver? Did DBeaver show any error message? Thanks, Mike. 2017-09-27 11:55 GMT+03:00

Re: Design question on the Ignite Web Session Clustering.

2017-09-08 Thread Michael Cherkasov
Hi, I answered in SO, I copy it here: """ if you have a local cache for sessions and sticky sessions why do you need to use ignite at all? However, It's better to go with ignite, your app will have HA, if some node is failed, the whole app still will work fine. I agree you should split app

Re: 2.1.4 visor console - activate/deactivate command?

2017-09-07 Thread Michael Cherkasov
Hi, there's no such version like 2.1.4, the latest one is 2.1. Thanks, Mike. 2017-09-07 19:00 GMT+03:00 mzingman : > I've downloaded latest ignite-fabric (2.1.4), and running ignitevisorcmd, > but > having trouble finding activate/deactivate grid command (promised in

Re: IGFS With HDFS Configuration

2017-08-21 Thread Michael Cherkasov
Hi Pradeep, https://issues.apache.org/jira/browse/ZEPPELIN-2674 is resolved, Zeppelin 0.8 will be issued with ignite 2.0 support. Thanks, Mikhail. 2017-08-04 19:09 GMT+03:00 Mikhail Cherkasov : > Hi Pradeep, > > I can't run it with 1.9 too, however, the same config

Re: how to append data to IGFS so that data gets saved to Hive partitioned table?

2017-08-07 Thread Michael Cherkasov
Ok, I'll try to reproduce this issue locally, will response tomorrow. 2017-08-05 13:50 GMT+03:00 csumi : > Yes if I create partition using hive, select works fine. Please see last > two > bullets of my previous comment. Copying here for your quick reference: > > - Now

Re: how to append data to IGFS so that data gets saved to Hive partitioned table?

2017-08-04 Thread Michael Cherkasov
Hi, Could you please clarify, if you run all actions using IGFS, but instaed of fs.appedn use Hive, like: insert into table stocks PARTITION (years=2004,months=12,days=3) values('AAPL',1501236980,120.34); Does select work this time? Thanks, Mikhail. 2017-08-04 12:56 GMT+03:00 csumi

Re: Best practise for setting Ignite.Active to true when using persistence layer in Ignite 2.1

2017-08-03 Thread Michael Cherkasov
>: > Michael, > > > > Is there a reference implementation in Ignite 2.1 for an agent that > listens to topology changes to decide when to set active to true? > > > > Thanks, > > Raymond. > > > > *From:* Michael Cherkasov [mailto:michael.cherka...@gmai

Re: Best practise for setting Ignite.Active to true when using persistence layer in Ignite 2.1

2017-08-03 Thread Michael Cherkasov
en to set active to true? > > > > Thanks, > > Raymond. > > > > *From:* Michael Cherkasov [mailto:michael.cherka...@gmail.com] > *Sent:* Thursday, August 3, 2017 1:25 AM > > *To:* user@ignite.apache.org > *Subject:* Re: Best practise for setting Ignite.Active to true when

Re: Best practise for setting Ignite.Active to true when using persistence layer in Ignite 2.1

2017-08-02 Thread Michael Cherkasov
ace and then activate it. 2017-08-02 16:22 GMT+03:00 Rohan Shetty <rohan.she...@gmail.com>: > Does this mean we have to listen to events of server nodes going up and > down and activate and deactivate the cluster? > > On Wed, Aug 2, 2017 at 3:18 PM, Michael Cherkasov < > michael

Re: Best practise for setting Ignite.Active to true when using persistence layer in Ignite 2.1

2017-08-02 Thread Michael Cherkasov
when all nodes are up, so in latest topology snapshot you can see servers count == servers count you run, then cluster can be activated. 2017-08-02 0:51 GMT+03:00 Raymond Wilson : > Hi Mikhail, > > > > Thanks for the clarifications. > > > > Yes, I knew setting active

Re: Is it possible to make use of SSD in a Ignite cluster?

2017-07-27 Thread Michael Cherkasov
Hi San Luo. >1.Is there a way to use SSD when my cluster memory is running out to cache the data? Ignite 2.1 can do this for you: https://apacheignite.readme.io/v2.1/docs/distributed-persistent-store it will be release this week. >2.Is there a parameter that control intermediate result storage

Re: Performance WordCount to Hadoop

2017-06-27 Thread Michael Cherkasov
Hi Mimmo, How many map tasks do you have? if you have a lot of map tasks with small amount of work you will spend almost all cpu time in setup method. Also if you have small amount of data, one network operation( cache.put("interno", 666); ) can be very expensive operation relative to the whole

Re: Hadoop and Ignite, Problem grid cache

2017-06-23 Thread Michael Cherkasov
Hi Mimmo, The map works in other process, so map creates a new instance of ignite, also it doesn't know about Ignition.setClientMode(true); that you setup in main method. Also you shouldn't create ignite in map method, use Mapper#setup instead: @Override protected void setup(Context context)

Re: Hadoop and Ignite, Problem grid cache

2017-06-23 Thread Michael Cherkasov
Hi Mimmo, Could you please run all nodes with -DIGNITE_QUIET=false flag and send logs from both, server and client nodes? Does it work for you if you run only 1 server node and 1 client node from the same host? I think it's better to check this simple configuration first, so to be sure that

Re: Ignite 2.0 off-heap memory

2017-06-09 Thread Michael Cherkasov
Hi Jessie, With your configuration Ignites 2.0 stores data in Off Heap memory, but visor shows wrong statistics, I created a ticket for this issue: https://issues.apache.org/jira/browse/IGNITE-5461 Thanks, Mikhail. 2017-06-09 1:48 GMT+03:00 waterg : > Hello, > >

Re: Ignite Cache returning Null value from Mapper

2017-06-08 Thread Michael Cherkasov
Hi Prashant, I was able to reproduce the issue. It happens because TestMapper knows all about hadoop and CreateCache doesn't. So I believe TestMapper has the following dependency: Do you have this dependency? : org.apache.ignite ignite-hadoop 2.0.0 Try to

Re: Ignite Cache returning Null value from Mapper

2017-06-07 Thread Michael Cherkasov
Hi Prashant, Could you please collect more logs, please add "-DIGNITE_QUIET=false" arg to Createcache and TestMapper runs? I even tried CentOS with the same version as you have, but it still works fine for me. I have a suggestion, usually there's separate account for Hadoop, and when you try to

Re: Ignite Cache returning Null value from Mapper

2017-06-06 Thread Michael Cherkasov
Hi Prashant, Could you please also send CreateCache's log ? Also please try to specify non loop-back ip instead of 127.0.0.1 ? what linux dist do you use? Thanks, Mikhail. 2017-06-06 16:36 GMT+03:00 Prashant312 : > Hi, > > We are first running the Createcache.java and then

Re: Ignite Cache returning Null value from Mapper

2017-06-06 Thread Michael Cherkasov
Hi Prashant, In Mapper you run Ignite in client mode, it requires server instance to be running. I can the same error: [15:18:56] Failed to connect to any address from IP finder (will retry to join topology every 2 secs): [/127.0.0.1:47500, /127.0.0.1:47500, / 127.0.0.1:47501, /127.0.0.1:47502,

Re: Ignite Cache returning Null value from Mapper

2017-06-05 Thread Michael Cherkasov
Hi Prashant, I've run your code and it works fine for me, I see "abc" in output. However I wan't able to run it as is, I changed it a little bit. First, I added TcpDiscoverySpi in CreateCache.java: TcpDiscoverySpi spi = new TcpDiscoverySpi(); TcpDiscoveryVmIpFinder ipFinder = new