Re[2]: Feature request: On demand thread dumps from Ignite

2020-12-28 Thread Zhenya Stanilovsky
I understand that you use C# of course, you can use  var process = new Process ( ) for it and furthet jstack -l PID call   >Hi Zhenya, >  >We use the IA C# client (deployed in a.Net Core implementation using >containers on AWS EKS) so this makes it hard for us to run Java closures from >th

Re: Ignite in-memory + other SQL store without fully loading all data into Ignite

2020-12-28 Thread Courtney Robinson
Hi Val, Thanks. You're not missing anything and we have been using Ignite persistence for years. Among the reasons we want to switch to in-memory only is how easily we seem to get corrupt nodes. I mentioned in the first email. We haven't had a situation where upgrading corrupts more than 1 of our 3

Re: Feature request: On demand thread dumps from Ignite

2020-12-28 Thread Raymond Wilson
Hi Zhenya, We use the IA C# client (deployed in a.Net Core implementation using containers on AWS EKS) so this makes it hard for us to run Java closures from the C# client, which is why a client interface capability would be useful! Thanks, Raymond. On Tue, Dec 29, 2020 at 8:38 PM Zhenya Stanil

Re: Feature request: On demand thread dumps from Ignite

2020-12-28 Thread Zhenya Stanilovsky
You can call it through compute api [1], i suppose.   [1]  https://ignite.apache.org/docs/latest/distributed-computing/distributed-computing   >Many of the discussion threads here will generate a request for the Jave >Ignite thread dump to help triage an issue. >  >This is not difficult to do w

Re: Questions related to check pointing

2020-12-28 Thread Raymond Wilson
Hi Zhenya, 1. We currently use AWS EFS for primary storage, with provisioned IOPS to provide sufficient IO. Our Ignite cluster currently tops out at ~10% usage (with at least 5 nodes writing to it, including WAL and WAL archive), so we are not saturating the EFS interface. We use the default page

Re: Is Model class OR a value object mandatory for inserting the data thru non SQL API

2020-12-28 Thread Pavel Tupitsyn
Hi, you can use BinaryObject API without defining any classes: ignite.binary().builder("ANY_STRING_HERE"); builder.setField("id", 1); builder.setField("name", "John"); On Tue, Dec 29, 2020 at 9:56 AM Naveen wrote: > HI > > We dont need a model / pojo class or value object defined for a table wh

Is Model class OR a value object mandatory for inserting the data thru non SQL API

2020-12-28 Thread Naveen
HI We dont need a model / pojo class or value object defined for a table while creating a table and we can still insert data thru SQL and read the data thru SQL API as well as Java KV or binary objects However, if we want to insert data thru Java API by using binary object or KV (put cache), we do

Re: Enabling cache statistics does not seems to work cache created thru SQL with a cache template

2020-12-28 Thread Naveen
Yeah, it works {"successStatus":0,"affinityNodeId":null,"error":null,"sessionToken":"F4BBC58F2EDE4343BB3022DAA8EDB0FB","response":{"reads":0,"writes":30,"hits":0,"misses":0}} But the reads count is not changed, though I read the cache thru scanquery, SQL and java getCache API thru BinaryObject, a

Re: Questions related to check pointing

2020-12-28 Thread Zhenya Stanilovsky
* Additionally to Ilya reply you can check vendors page for additional info, all in this page are applicable for ignite too [1]. Increasing threads number leads to concurrent io usage, thus if your have something like nvme — it`s up to you but in case of sas possibly better would be to reduce

Feature request: On demand thread dumps from Ignite

2020-12-28 Thread Raymond Wilson
Many of the discussion threads here will generate a request for the Jave Ignite thread dump to help triage an issue. This is not difficult to do with command line Java tooling if you can easily access the server running the node. However, access to those nodes may not be simple (especially in prod

Re: Questions related to check pointing

2020-12-28 Thread Raymond Wilson
As another detail, we have the WriteThrottlingEnabled property left at its default value of 'false', so I would not ordinarily expect throttling, correct? On Tue, Dec 29, 2020 at 10:04 AM Raymond Wilson wrote: > Hi Ilya, > > Regarding the throttling question, I have not yet looked at thread dump

Re: Ignite in-memory + other SQL store without fully loading all data into Ignite

2020-12-28 Thread Valentin Kulichenko
Hi Courtney, Thanks for your feedback! To cut the story short, Ignite implements page memory architecture. All data is split into fixed-sized pages and any page can reside either both in memory and on disk or on disk only. Since the in-memory layer and persistence layer are natively integrated -

Re: Questions related to check pointing

2020-12-28 Thread Raymond Wilson
Hi Ilya, Regarding the throttling question, I have not yet looked at thread dumps - the observed behaviour has been seen in production metrics and logging. What would you expect a thread dump to show in this case? Given my description of the sizes of the data regions and the numbers of pages bein

Re: Ignite in-memory + other SQL store without fully loading all data into Ignite

2020-12-28 Thread Courtney Robinson
I know this was over the holiday so bumping. Can anyone provide any pointers on where to start looking or anything else mentioned in the previous email? Thanks On Sat, Dec 26, 2020 at 8:39 PM Courtney Robinson wrote: > We've been using Ignite in production for almost 3 years and we love the > pl

Re: Populate table created by JDBC

2020-12-28 Thread Surkov.Aleksandr
Great! It works. Thank you! -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Populate table created by JDBC

2020-12-28 Thread Surkov.Aleksandr
Hi igniters! I have created a table using JDBC. And I would like to fill it with data using data streamer. But after that I can't execute sql query and get data. After some experimentation, it turned out that SQL select does not return the data put in the table using the cache API. @Test public v

Re: Cluster hangs at times when making calls with Ignite thin client Java, but works thru SQLLine console

2020-12-28 Thread Ilya Kasnacheev
Hello! Maybe it is related to https://issues.apache.org/jira/browse/IGNITE-13863? If it is not, please provide thread dumps from nodes in the cluster. Regards, -- Ilya Kasnacheev чт, 24 дек. 2020 г. в 14:36, Naveen : > HI > > We do use Ignite 2.8.1 and use Java thin client for all Ignite ope

Re: Enabling cache statistics does not seems to work cache created thru SQL with a cache template

2020-12-28 Thread Ilya Kasnacheev
Hello! I have just checked the example, and I can definitely see something: ~/Downloads/apache-ignite-slim-2.9.0-bin% curl -q ' http://localhost:8080/ignite?cmd=cache&cacheName=TEST_STATS1' {"successStatus":0,"affinityNodeId":null,"sessionToken":null,"error":null,"response":{"reads":1,"writes":1,"

Re: Populate table created by JDBC

2020-12-28 Thread Ilya Kasnacheev
Hello! Have you also tried adding wrap_value=false parameter to your DDL statement? OtherwiseIgnite will assume you have a one-field POJO as a value. Regards, -- Ilya Kasnacheev пн, 28 дек. 2020 г. в 14:16, Surkov.Aleksandr : > Hi igniters! > > I have created a table using JDBC. And I would l

Re: DataBricks Spark/Scala Opportunity

2020-12-28 Thread Ilya Kasnacheev
Hello! Please avoid discussion of topics unrelated to Apache Ignite usage. This is not a general-purpose bulletin board. Thanks, -- Ilya Kasnacheev вт, 22 дек. 2020 г. в 21:21, sri hari kali charan Tummala < kali.tumm...@gmail.com>: > Hi Apache Ignite Community, >>> >>> Note:- (This is a full

Re: Questions related to check pointing

2020-12-28 Thread Ilya Kasnacheev
Hello! 1. If we knew the specific circumstances in which a specific setting value will yield the most benefit, we would've already set it to that value. A setting means that you may tune it and get better results, or not. But in general we can't promise you anything. I did see improvements from in

Re: configuring DBEaver to connect to Ignite cluster with SSL enabled

2020-12-28 Thread Ilya Kasnacheev
Hello! I believe I told you what to do specifically. You can also just append all of your SSL-related settings to JDBC connection string, like you will do with sqlline tool. Regards, -- Ilya Kasnacheev пн, 28 дек. 2020 г. в 10:41, Naveen : > HI Ilya > > Almost there, but still not completely