Re: Regarding ignite query result set limit

2021-06-08 Thread Vladimir Pligin
Hi, It's possible that you are looking for the lazy SQL flag. More details: https://ignite.apache.org/docs/latest/perf-and-troubleshooting/sql-tuning#lazy-loading It can also be set on the JDBC level. https://ignite.apache.org/docs/latest/SQL/JDBC/jdbc-driver#parameters -- Sent from: http://apa

Re: Maximising online ml performance

2021-04-21 Thread Vladimir Pligin
latency for realtime machine learning, and can the apache igniteinfrastructure be modified to achieve this? --Sent from: http://apache-ignite-users.70518.x6.nabble.com/  -- Warm Regards, Vladimir Pligin 

[Webinar] What’s new in Apache Ignite 2.10

2021-04-19 Thread Vladimir Pligin
Hi Igniters, Tomorrow I'm going to present new features of Apache Ignite 2.10. It'll be a webinar with a demo session. I'll show how to leverage new functionality. Please join us tomorrow, it's scheduled for the 20th April at 10:00 AM PDT. More details: https://www.gridgain.com/resources/webinars

Re: Query on CVE-2020-5421

2020-11-19 Thread Vladimir Pligin
This issue is definitely web-oriented. It's about the 'Content-Disposition' custom HTTP header which raised a big deal of concerns about security itself over time. As far as I currently understand it affects only web part(s) of Spring, more particularly spring-webmvc. It's not being used by Ignite.

Re: Inserting date into ignite with spark jdbc

2020-11-12 Thread Vladimir Pligin
Hi, It seems that a dataset internally uses built-in org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider instead of org.apache.ignite.spark.impl.IgniteRelationProvider in case you force it to use JDBC. The provider from spark obviously doesn't tolerate Ignite custom properties. To

Re: ReadFromBackup, Primary_SYNC, Backups

2020-11-06 Thread Vladimir Pligin
Manesh, >> When running a large SELECT from a thick client node, could data be >> fetched from the backup instead of primary partitions? readFromBackup=true affects only cache operations, it doesn't work with SQL queries. >> in a two server system, if readFromBackup = False for a cache, and if

Re: Ignite JDBC connection pooling mechanism

2020-11-06 Thread Vladimir Pligin
In general it should be ok to use connection pooling with Ignite. Is your network ok? It look like a connection is being closed because of network issues. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite Client Node OOM Issue

2020-11-06 Thread Vladimir Pligin
What load profile do you have? Do you use SQL queries? Is it possible to share your client node configuration? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Limit ignite-rest-http threads

2020-11-06 Thread Vladimir Pligin
Hi Ashish, Yes, it works that way because Ignite launches Jetty server under the hood to handle HTTP requests. Could you please clarify what concerns you exactly? In general a number of threads doesn't indicate anything "bad" or "good". -- Sent from: http://apache-ignite-users.70518.x6.nabble.

Re: Ignite JDBC connection pooling mechanism

2020-11-03 Thread Vladimir Pligin
I wasn't able to reproduce that hurriedly. What Hikari settings do you have? Maybe you have a reproducer? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite JDBC connection pooling mechanism

2020-11-02 Thread Vladimir Pligin
Hi, What java version do you use? What about Hikari & Ignite versions? Do you have SSL enabled? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Occasional duplicate ID with IgniteAtomicSequence in a cluster

2020-10-05 Thread Vladimir Pligin
Do you have a reproducer of such behavior? It would be really helpful. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: 2.8.1 : MutableEntry.getValue().toBuilder throws NullPointerException

2020-10-01 Thread Vladimir Pligin
Do you get it on every cache or with some subset of caches? Do you have assertions enabled? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Purging a partition

2020-10-01 Thread Vladimir Pligin
To be honest it doesn't look trivial. I'm not sure at the moment why one could need that. Could you please describe your use-case? It will definitely help us to design a solution somehow. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Binary memory restoration

2020-09-29 Thread Vladimir Pligin
It's possible that it happens because of https://issues.apache.org/jira/browse/IGNITE-13068. We need to scan the entire SQL primary index during startup in case you have at least on query entity configured. As far as I can see it's going to be a part of the Ignite 2.9 release. -- Sent from: http

Re: Map 10 caches to 10 different ignite nodes

2020-09-11 Thread Vladimir Pligin
Yes, it's possible to achieve that with a node filter. You should change your cache configurations. Here's the javadoc . After that yo

Re: Preload all indexes to memory

2020-09-10 Thread Vladimir Pligin
As far as know there's no such functionality at the moment. The only way that comes to my mind is to try making a SQL query that scans it. For example if you created a index like that: CREATE INDEX indexName ON tableName (field1, field2); Then you can try to execute: SELECT field1, field2 FROM ta

Re: Ignite Queue (Documentation or Code defect)?

2020-09-02 Thread Vladimir Pligin
Hi guys, That has been done. https://issues.apache.org/jira/browse/IGNITE-13396 -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: can web session filter be configured to create session on demand

2020-07-27 Thread Vladimir Pligin
Hi Cameron, I suppose the correct way of achieving the desired behavior is to modify WebSessionFilter from the Ignite. For example it's possible to introduce a new context param with a list of urls that shouldn't be affected by the filter. And pass a request to a chain in the doFilter method if th

Re: Ignite 2.7.6: Memory Leak with Direct buffers in TCPCommunication SPI

2020-02-26 Thread Vladimir Pligin
By the way it would be great if you share a couple of heap histograms between restarts. Something like jmap -histo > histo. Is it possible? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite 2.7.6: Memory Leak with Direct buffers in TCPCommunication SPI

2020-02-26 Thread Vladimir Pligin
Hi Manesh, Thanks for sharing your case. We'll try to reproduce it. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Long running query

2020-02-25 Thread Vladimir Pligin
Hi, The most useful information here is the plan that the RDBMS uses. Is it possible to share it? I suppose that using of either the IDX_ORG_MEDP_DRUG index or the IDX_DRUG_ID index is not absolutely correct. My bet is an index on (DRUG_ID, ORG_ID) could help here but it's to be checked. And it'

Re: How to failover/scale cluster in Apache Ignite

2020-02-13 Thread Vladimir Pligin
Hi, I'll try to do my best to help you. >> Is kill -9 the right way to kill a node? No, I don't think this is the right way. >> How about re-adding new nodes that were previously killed? You should clean a node's work directory before re-adding. >> How long does it take for the nodes to sync

Re: Failed to clean IP finder up.

2019-10-02 Thread Vladimir Pligin
Hi, Yeah, it seems to be that bug. As far as can see it's resolved and marked to be released as a part of 2.8. I haven't managed to find that commit in other branches unfortunately. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite 2.7.0 : thick client has all system threads busy indefinitely

2019-07-22 Thread Vladimir Pligin
Hi, could you please share your configurations of both server and client? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Log4j2 problem

2019-07-18 Thread Vladimir Pligin
Hi, Could you please share your logging configurations? I'll make a try to reproduce. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: CacheEntryProcessor causes cluster node to stop

2019-07-17 Thread Vladimir Pligin
Hi, It seems that the root cause of the issue happens on node with id=fb70df1c-0311-48b4-bb33-88cdf85438ce. That node becomes unresponsive. Could you please share logs from that node, it could help? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Web Agent connected to Cluster but console doesn't show

2019-07-10 Thread Vladimir Pligin
Yes, I suppose it could be. Have you finally managed to put it all together? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Web Agent connected to Cluster but console doesn't show

2019-07-09 Thread Vladimir Pligin
And do you use the corresponding versions of WC and agent (2.0) or you're trying a newer versions? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Web Agent connected to Cluster but console doesn't show

2019-07-08 Thread Vladimir Pligin
What version do you use? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Distributed Cluster Deployment

2019-07-04 Thread Vladimir Pligin
Hi, Spring here is just a convenient way of configuration building. Ignite is not tightly bound to it. You're able to construct everything programmatically. For example here https://apacheignite.readme.io/docs/tcpip-discovery you can switch example from "XML" to "Java". And Spring xml configuratio

Re: Ignite statistics in the logs

2019-05-08 Thread Vladimir Pligin
Hi, As far as I know this information should be shown in Ignite logs with default setup. The only thing you need to do is to run ignite.sh with -v option or set system property IGNITE_QUIET to false if you run a node without ignite.sh. In my setup it looks like [18:47:30,425][INFO][grid-timeout-w

Re: Error installing Ignite on K8s

2019-05-08 Thread Vladimir Pligin
Hi, As far as can see you're facing an issue related to k8s service configuration. It's quite difficult to say whether you have issues with Ignite pods at this stage. So let's try to figure it out step by step. I suppose that the error is related to load balancing. As far as I know AWS provides mu

Re: Ignite with Hibernate 5.3

2019-05-08 Thread Vladimir Pligin
Hi Tomasz, It seems like Hibernate 5.3 support has been already added to Ignite in the master branch. I suppose this feature will be delivered as a part of upcoming Ignite release. Here is the corresponding ticket https://issues.apache.org/jira/browse/IGNITE-9893, fix version is 2.8. -- Sent fr

Re: When to use REPLICATED vs PARTITIONED?

2019-03-27 Thread Vladimir Pligin
Hi again! I'm sorry for being absent for so long. Maybe the reason here that you data is collocated somehow using id of a city. Replicated cache suits well if you need to join to some static dictionary and it's impossible or difficult to distribute other data in manner corresponding to that dicti

Re: When to use REPLICATED vs PARTITIONED?

2019-03-19 Thread Vladimir Pligin
Hi David, As far as I know your understanding is correct in general. Let's try to figure out what's happening in this particular case. Could you please share execution plans of the query with both partitioned and replicated templates. And it also would be great if you share execution time for both