Re: SQL query on nested objects?

Yes, check the documentation here. https://apacheignite-sql.readme.io/docs/schema-and-indexes#annotation-based-configuration -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

LoadCaches example fails

I created a cluster and imported a postgres database to the cluster. I created two ignite instances using that cluster config (from the maven project made available via download though the web-console). I even started a client instance (by running the ClientNodeCodeStartup file). The server as

Re: Prevent automatic Ignite server node start for Spring Boot

Did you rebuild your project? Or update your maven dependencies? Should not happen if you removed the dependency of ignite. It also should only start a node if you have in your spring configuration something (bean) of ignite. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Ignite Inter node Communication security

Hello, Does Ignite version 2.7 support inter-node communication security? I have a 3 node cluster and want to secure the cluster, so that no new node can be added to the cluster without proper credentials. If yes, please let me know where to find the relevant documentation. -- Sent from:

Prevent automatic Ignite server node start for Spring Boot

I have the following problem. I'm developing a Spring Boot application, this application uses Ignite, but via creation of some client nodes (when it is necessary). The following is the part of pom.xml for the project: The problem is when the application is started, I get the following log: But

PySpark: Failed to find data source: ignite

Hi, I'm trying to put parquet in to Ignite table, but getting the below error. java.lang.ClassNotFoundException: Failed to find data source: ignite. Please find packages at http://spark.apache.org/third-party-projects.html Spark: 2.3.1 Trying with PySpark I have copied the ignite-spark from

Re: DatasetFactory.createSimpleDataset with a cache

Yes. Yuri. Got it. We will wait for 2.8 release. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

SQL query on nested objects?

Does Ignite support SQL queries on nested objects? If so, what typeName should I specify for the QueryField? If it does work, does it work at arbitrary depth? The goal is to write a SQL query such as "foo.bar = ? and baz.bal.sum = ?" Thanks -- Sent from:

Introducing Typescript for the Node.js Client

https://github.com/thavlik/ignite/tree/master/modules/platforms/nodejs https://issues.apache.org/jira/browse/IGNITE-11032 Please let me know if you have any issues with it. I've only put a couple hours of work into this, but it already functions as a drop-in replacement. Tom Mid Continent

Eviction policy is not working for default and new data region

I have one ignite node with native persistence turn off. I have set eviction policy for both Default_Region and a new data region I created. However, none of them seem to be working. Here is the default-config.xml file for Ignite Configuration:

Re: Ignite with Spring cache

I have a Spring application with Ignite cache configured according to samples - https://apacheignite-mix.readme.io/docs/spring-caching *My configured Spring bean:* -- /@Bean public SpringCacheManager springCacheManager() {

Re: NPE when start

I will try to reproduce the excepiton. I am worried about it will happen as the cache remote listener rmtFilter @IgniteAsyncSupported public UUID remoteListen(@Nullable IgniteBiPredicate locLsnr, @Nullable IgnitePredicate rmtFilter, @Nullable int... types)

Re: ignite zk: Possible starvation in striped pool

Thank you！ I see that this is communication spi not discovery spi. But in other nodes there are many zk session timeout message or zk reconnect fail message. And the starvation message only print in the node which have the zk server(not cluster,just three zk node in one machine) in the same

Re: cache.removeAll cache operation is slow

The data I am removing from cache is colocated on the same node. So I think exchange will happen only for updating the backup copies. Please correct me if I am wrong. I believe that remove all operation first acquires the lock on all input keys and then removes the data. If I go for single

Re: 3rd party persistence with hive not updating hive with all records/entries in ignite

Hello! Nothing obvious is wrong here. Can you please enable DEBUG logging for org.apache.ignite.cache.store.jdbc re-run your case and share the logs? Regards, -- Ilya Kasnacheev пн, 21 янв. 2019 г. в 18:04, shivakumar : > Hi here is my cache store configuration > > > > >

Re: DatasetFactory.createSimpleDataset with a cache

Mahesh, Unfortunately no. We start to support model training over caches with binary objects from Ignite 2.8. This support was added by ticket https://issues.apache.org/jira/browse/IGNITE-10700 So, for now, this option is available only for builds from the master branch. Best regards, Yuriy

Re: cache.removeAll cache operation is slow

Prasad, When you run a transaction, that involves many entries, the whole key set is sent between nodes multiple times. It also generates a lot of garbage, which cannot be released until the transaction is committed. It's better to remove values in small batches. So, try changing the batch size.

cache.removeAll cache operation is slow

Hi, I am removing around 2 million entries from cache using cache.removeAll api. I removing entries in a batch of 100k. To remove 2 million entries ignite takes around 218 seconds. This cache is transactiona and write synchronization mode is full sync. Is there any way to improve the

Re: ignite zk: Possible starvation in striped pool

This message is printed, when a thread in striped pool doesn't have any progress for some time. As far as I can see from the thread dump, a TCP connection with another node cannot be established for some reason. It's probably caused by network problems or long GC on one of the nodes. This is about

Re: Apache Ignite: not able to cache Dataframe using Python thin client

Thanks a lot Stephan. I will explore more on Ignite sql, just that I have to get the data from Ignite cache , dont want to share and maintain same Spark context. I think I will get more clarification, If I go through the docs. Thanks again. Regards, Bala -- Sent from:

Re: Ignite with Spring cache

It is not completely clear what exactly you are trying to achieve. Could you describe your case in depth, share a piece of code or pseudo code? If you want to iterate through all cache entries, you can use Ignite cache API for that: org.apache.ignite.Ignite#getOrCreateCache(java.lang.String).

ignite zk: Possible starvation in striped pool

10:38:31.577 [grid-timeout-worker-#55%DAEMON-NODE-10-153-106-16-8991%] WARN o.a.ignite.internal.util.typedef.G - >>> Possible starvation in striped pool. Thread name: sys-stripe-9-#10%DAEMON-NODE-10-153-106-16-8991% Queue: [] Deadlock: false Completed: 17156 Thread

Re: Is there Ignite Eviction low water mark

In 2.x page eviction removes entries from cache from all nodes, and EVT_CACHE_ENTRY_EVICTED events are not triggered, when it happens. Please file a JIRA issue, if you rely on this event: https://issues.apache.org/jira/ > The implementation of eviction from 1.x to 2.x is a different, new one?

Re: Apache Ignite: not able to cache Dataframe using Python thin client

Write to Ignite using the Ignite-Spark integration: input = spark.read.parquet(HDFS_ACCOUNT) input.write.format("ignite") .option("table","sfdc_account_parquet") .option("primaryKeyFields”,”key1,key2") .option("config",configFile) .save() At that

Re: When the IgniteCache. clear () method is being executed, if SELECT COUNT (*) FROM CACHE is executed, the whole cluster will collapse.

Hello! Do you have a reproducer project? Regards, -- Ilya Kasnacheev вт, 22 янв. 2019 г. в 13:31, 李玉珏@163 <18624049...@163.com>: > Hi, > > If so, is this a bug? > > >

Re: read from igniteRDD and write to igniteRDD

i have wrote a piece of code for reading data from ignite cache table but i encounter following error. /usr/lib/jvm/java-8-oracle/bin/java -javaagent:/snap/intellij-idea-community/113/lib/idea_rt.jar=46131:/snap/intellij-idea-community/113/bin -Dfile.encoding=UTF-8 -classpath

When the IgniteCache. clear () method is being executed, if SELECT COUNT (*) FROM CACHE is executed, the whole cluster will collapse.

Hi, If so, is this a bug?

Re: Ignite 2.7 REST API returning escape characters

Hello! > What is the best practice way to do this in Ignite? Creating your own ConnectorMessageInterceptor implementation. Regards, -- Ilya Kasnacheev пн, 21 янв. 2019 г. в 21:05, EMCox : > Ilya, > > Thanks for helping me. > > I am trying to store the JSON as a string using the REST API

Re: Apache Ignite: not able to cache Dataframe using Python thin client

I’m not sure I fully understand what you’re trying to do. It looks like you’re trying to put an entire DataFrame (a collection of records) into a single value in Ignite? Even if there’s only a single record, you probably want to put the row into Ignite rather than the whole DF. But I think

Re: Apache Ignite: not able to cache Dataframe using Python thin client

Hi Stephan,Here is the codeaccountDF = spark.read.parquet(HDFS_ACCOUNT)self._igCache.put('sfdc_account_parquet', accountDF, value_hint=BinaryObject)I tried with many object types in value_hint, also tried leaving it as empty, nothing worked.*Error: without value_hint*TypeError: object of type