connecting to Zookeeper cluster using SSL/TLS Connection

Hi All, I am trying to use Zookeeper for node discovery with Apache Ignite. I have configured Zookeeper to only accept SSL/TLS connections. How do I provide Zookeeper keystore detail to Apache Ignite ZookeeperDiscoverySpi? I have checked the documentation and source code of

IgniteSparkSession exception:Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance? [name=null]

I use IgniteSparkSession to excute spark sql but get an exception:org.apache.ignite.IgniteIllegalStateException: Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance? [name=null] My test case runs well when I run spark in local mode,but it

Setting performance expectations

Hello, I am trying out Ignite for the first time. I have some interesting performance metrics that are unexpected. I'm looking to see if my understanding of what Ignite is meant to do is correct. I have 400K records from a database that I am loading into a cache with the primary key mapped

Re: Is ID generator split brain compliant?

I think you need to also look at the processes that are using the id in case of a split brain scenario. A unique identifier is always some centralistic approach either it is done by one central service or a central rule that is enforced in a distributed fashion. For instance, in your case you

Is ID generator split brain compliant?

Hi, I have a requirement to create a distributed cluster-unique ID generator microservice. I have done a PoC on it using Apache Ignite ID Generator. I created a 2 node cluster with two instances of microservices running on each node. Nodes are in the same datacenter (in fact in the same

Re: Query 3x slower with index

Hi Ilya, I created 4 indexs on the table: 1) ga_pKey: on customer_id, dt, category_id (that's our primary key columns) 2) ga_customer_and_category_id: on customer_id and category_id 2) ga_customer_id: on customer_id 4) ga_category_id: on category_id For the first query (category in ()), the

Re: Number of threads in computations

Perfect. Thanks, F.D. On Wed, Sep 19, 2018 at 11:23 AM Evgenii Zhuravlev wrote: > Hi, > > You can use set FifoCollisionSpi.parallelJobsNum: > https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/spi/collision/fifoqueue/FifoQueueCollisionSpi.html > > Evgenii > > ср, 19 сент.

Re: .net decimal being stored as Other in ignite.

Hello! I have tried that, and indeed: DBeaver shows the column type is OTHER even while the type of column is correctly mapped to java.math.BigDecimal. I have filed a ticket: https://issues.apache.org/jira/browse/IGNITE-9650 Note that SQL on that column since to work correctly, it's only

Re: Is there a way to use Ignite optimization and Spark optimization together when using Spark Dataframe API?

Ray, Per my understanding, pushdown filters are propagated to Ignite either way, it's not related to the "optimization". Optimization affects joins, gropings, aggregations, etc. So, unless I'm missing something, the behavior you're looking for is achieved by setting

Re: Problems are enabling Ignite Persistence

Hello, Could you also set correct path for IGNITE_HOME or set work directory in Ignite configuration to exclude chances for your /tmp directory to be wiped. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Problems are enabling Ignite Persistence

Hello, There are no issues with starting nodes with enabled persistence, your DataStorageConfiguration is fine, are there any other preconditions to be met to face same issue? Could you try to send minimalistic reproducer that shows issue on clean setup? Regards, -- Sent from:

Re: Is there a way to use Ignite optimization and Spark optimization together when using Spark Dataframe API?

Hi, I am not sure that it will work but you can try next: SparkSession spark = SparkSession .builder() .appName("SomeAppName") .master("spark://10.0.75.1:7077") .config(OPTION_DISABLE_SPARK_SQL_OPTIMIZATION, "false") //or true

Re: Recommended HW on AWS EC2 - vertical vs horizontal scaling

Hi, Left the list with some useful articles links here http://apache-ignite-users.70518.x6.nabble.com/Slow-SQL-query-uses-only-a-single-CPU-td23553.html BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: ttl-cleanup-worker got "Critical system error detected"

Hello, Would you mind sharing complete log for your nodes? Looks like SQL indexes got corrupted or operation was interrupted. Could you also point out exact version of Ignite that you are using? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Slow SQL query uses only a single CPU

Hi, I think you can try to investigate the articles from the next wiki: https://cwiki.apache.org/confluence/display/IGNITE/Design+Documents Next blog contains the interesting information (possible some will be out of date): http://gridgain.blogspot.com It contains a lot of information about

***UNCHECKED*** Re: new CacheConfiguration always returns same instance

Hello, Why would you expect them to be different in your test? This is not a violation of hashcode general contract. They are calculated using MutableConfiguration .hashCode() from JSR

Re: How does lazy load work internally in Ignite?

Hello! The default batch size is 1000 rows so it seems (org.apache.ignite.internal.processors.cache.query.GridCacheTwoStepQuery#DFLT_PAGE_SIZE). Regards, -- Ilya Kasnacheev ср, 19 сент. 2018 г. в 15:09, Ray : > Hi Ilya, thanks for the reply. > > So is it like cursor on the server side? > >

Re: How to write Trigger Script

I have found this instruction on SO: https://stackoverflow.com/a/45235510/36498 Please try it and see if there are any Ignite specifics. Regards, -- Ilya Kasnacheev ср, 19 сент. 2018 г. в 15:01, Malashree : > How to write Trigger Script in a DBeaver Tool Using Apache Ignite Database. > > >

Re: How does lazy load work internally in Ignite?

Hi Ilya, thanks for the reply. So is it like cursor on the server side? Let's say user ran a query "select * from tableA" where tablaA has a million records. When the lazy loading flag is on Ignite server will send the first batch of records to the user. When user's client asks for second batch

Ignite Cache metrics on K8s

Hi, I am trying to fetch some cache metrics from Ignite 2.5 running on k8s. Enabled the cache level metrics by setting the below property in ignite config xml for specific cache. But both "ignite_org_apache_ignite_internal_processors_cache_cacheclustermetricsmxbeanimpl_cacheputs" and

Unable to get the ignite cache metrics

Hi I brought ignite server on k8s cluster. Set the below property for a cache i wanted to check the metrics Then i started the client and tried to push the data into ignite cache. I am able to see the data in the cache. But the values for the following metrics i am getting as 0. Can some one

Inconsistent data.

Hi, I am using Ignite 2.6.0 on top of google kubernetes engine v1.10.6-gke.2. I am using native persistent and example configuration as follows.

Re: Number of threads in computations

Hi, You can use set FifoCollisionSpi.parallelJobsNum: https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/spi/collision/fifoqueue/FifoQueueCollisionSpi.html Evgenii ср, 19 сент. 2018 г. в 11:22, F.D. : > Hi, > > I'd like to know if is it possible to limit the number of threads,

Re: .net decimal being stored as Other in ignite.

anybody have any clue as to how Ignite is not mapping .Net decimal to Java.math.Bigdecimal? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Number of threads in computations

Hi, I'd like to know if is it possible to limit the number of threads, launched when a distubuted closure arrive to the server? thanks, F.D.

Re: ScanQuery throwing Exception for java Thin client while peerclassloading is enabled

Hi Ilya, Thanks for your response, yes I had tried with withKeepBinary() option. If I call with withKeepBinary() option then there no deserialization related exception is coming but the returned entries are being wrapped to 'BinaryObjectImpl' and hence getting ClassCastException. Is there any

***UNCHECKED*** new CacheConfiguration always returns same instance

here is a simple test code CacheConfiguration cacheCfg = new CacheConfiguration<>(IG_P); cacheCfg.setBackups(1); cacheCfg.setWriteSynchronizationMode(CacheWriteSynchronizationMode.PRIMARY_SYNC); logger.info("instance {}", cacheCfg.hashCode()); cacheCfg = new