Re: Write behind and eventual consistency

Any updates on the two use cases mentioned above? On Apr 27, 2017 10:53 AM, "Gaurav Bajaj" wrote: > Hi Val, > > Our use case : > > 1. Read records from file > 2. Do computations on each record > 3. Put them in the cache and persistence using write behind. > 4. When all

Re: New Blog Post- Apache Ignite: Build Cloud Ready Applications Today!

Tom, Thank you for the feedback and including post on Apache Ignite's blog list. I will be sure to add my blog feed to https://www.imcplanet.org/ as well. Best, Turik -- View this message in context:

Re: Lots of cache creation become slow

Cédric, Can you clarify why not create 1 continuous query and listen to all the changes for all the keys? D. On Thu, Apr 13, 2017 at 8:00 AM, ctranxuan wrote: > Well, actually we were interesting in having continuous queries listening > multi-tenant caches. > >

@London May 10 Meetup: "Apache Flink meets Apache Ignite"

Hello London-based Igniters,On May 10, Akmal B. Chaudhri will present a talk about Apache Ignite at the Apache Flink Meetup . He'll talk about its main capabilities and how it can add value to your pipelines.Apache Flink is an

Query search performance and scalability

I have a program that issues SQLQuery on colA, colA has a single column index. The cache has about 360K entries, and 298K unique values in colA. I ran the query 1M times with different values. If the cache only has cache key, here's the results I ran with three senario With 1 server node:

Upcoming Apache Ignite Events

Igniters, Let me share with you a list of upcoming Apache Ignite events. Don’t hesitate and join, especially, if you live not that far. * Webinar, May 10th, Apache Ignite and Apache Spark for IoT:

Re: Ignite TLS with TrustStore

Does ignite looks for Truststore from any other default location or Is SSL/TLS keystore/trust store location varies for VMs? I tried enabled logging to capture the error, but don't seem to find any reason for this error- Failed to initialize connection (missing SSL configuration on remote

Re: HDP, Hive + Ignite

WRT item 2. : cannot reproduce the issue yet. Each time I get correct data: OK 2017-03-15 36564815 2017-03-16 36872463 2017-03-17 36900812 2017-03-18 36904198 2017-03-19 3630 2017-03-20 37029921 Time taken: 69.603 seconds, Fetched: 6 row(s) -- View this

Re: Grid is in invalid state to perform this operation

Want to go to the cluster case as you suggested. As of now I am running only single node. After awake application (JBOSS) revive, but cache grid seems to be stopped. Thanks, -Sam -- View this message in context:

Re: New Blog Post- Apache Ignite: Build Cloud Ready Applications Today!

Great post, Turik! You are welcome to add your blog feed to the In-Memory Computing Planet website, https://www.imcplanet.org/ IMCPlanet.org presents blog posts and events about in-memory from around the world. I invite everyone to submit your RSS feed or post your upcoming events and help

Re: CacheStore's Performance Drops Dramatically - Why?

I thought flushsize could be set as several times higher than the batch size is that in a cluster, data nodes would flush in parallel. For example there's a cluster with 10 nodes, and flushSize is 10240, thread count = 2, batch size = 512. Then each node would flush out in 2 thread, and each

Re: HDP, Hive + Ignite

Hi, Alena, 1. E.g. can you explicitly specify igfs:// as the table data location, like create table .. stored as orc location 'igfs://./path/test_ignite'; ? 2. Ok, thanks, will try to reproduce this using the provided data. 3. Here is something very strange. Are these logs full and do

Re: HDP, Hive + Ignite

1. How can I explicitly load the Hive table into the IFGS don't using Java API? (I don't know Java) I use DUAL_SYNC. Here is my config. default-config.xml 2. I attache sample data (test_ignite.rar). These are ORC

Re: Ignite SQL Indexing Performance problems

Yes, you have to go with JOIN and create better index for your query. Sergi 2017-05-03 16:27 GMT+03:00 kmandalas : > @Andrey: there is reason that I have selected REPLICATED over PARTITIONED > cache due to my business case. Custom Affinity is under

Re: Ignite SQL Indexing Performance problems

@Andrey: there is reason that I have selected REPLICATED over PARTITIONED cache due to my business case. Custom Affinity is under investigation, however seems over complicated for my scenario for starters. Now, even if PARTITIONED is used and things get done in parallel, the Network I/O is

Re: Ignite SQL Indexing Performance problems

Sergi, AFAIK, you suggest to make query run on replicated cache in similar way as on partitioned. Do you mean that query will run on one node in single thread as it works now? On Wed, May 3, 2017 at 3:39 PM, Sergi Vladykin wrote: > Andrey, > > In 2.0 queries over

Re: Ignite SQL Indexing Performance problems

Andrey, In 2.0 queries over replicated cache still work in a single thread. Kyriakos, I see that only index on TYPE is used which is not the most selective obviously. I suggest to create a group index on (TYPE, CATEGORYID, GEOCHANNELID, WEEK) and make sure it is used in query plan. Sergi

Re: Write-behind Flush Size

Hi Ricky, WriteBehindFlushSize is number of entries that queue can accumulate before it will be flushed. Are you update a entry with same key or different entries? Entry in writeBehind queue can be overwritten before it will be persisted. You can use time-based flushing or queue-sized flushing

Re: Continuous Query remote listener misses some events or respond really late

1) How you use ContinuousQuery: with initialQuery or without? : with initial query having same predicate 2) Did some nodes disconnect when you loose updates? no 3) Did you log entries in CQ.localListener? Just to be sure that error in CQ logic, not in your service logic. : No log entries in

Re: Ignite SQL Indexing Performance problems

Hi, As you use REPLICATED cache, the query will run on one node in single thread. This should be fixed in 2.0 The only workaround for now is to convert cache to PARTITIONED, to make the query to be run on several nodes, that will significantly increase performance. Also, you can try to add more

Re: IGFS - Python and R clients

As far as I understand, https://wiki.apache.org/hadoop/LibHDFS is generic enough, and should work with any org.apache.hadoop.fs.FileSystem implementation (IGFS , HDFS, or another). May it be an option for you? On Wed, May 3, 2017 at 12:51 PM, dkarachentsev wrote: >

Re: Continuous Query remote listener misses some events or respond really late

1) How you use ContinuousQuery: with initialQuery or without? 2) Did some nodes disconnect when you loose updates? 3) Did you log entries in CQ.localListener? Just to be sure that error in CQ logic, not in your service logic. 4) Can someone update old entries? Maybe they just get into CQ again

New Blog Post- Apache Ignite: Build Cloud Ready Applications Today!

Hello Ignite community, Here is an introduction to building 'cloud ready' applications with Apache Ignite: Blog Post: http://www.techbysample.com/2017/05/02/apache-ignite-build-cloud-ready-applications-today/ Best, Turik -- View this message in context:

Re: Continuous Query remote listener misses some events or respond really late

Hi Thanks for looking into this. Its not easily reproduce-able. I only see it some times. Here is my cache and service configuration Cache configuration: readThrough="true" writeThrough="true" writeBehindEnabled="true" writeBehindFlushThreadCount="5" backups="1" readFromBackup="true" service

Re: IGFS - Python and R clients

Hi Sergey, To use IGFS from non-JVM languages you may configure it as FS for Hadoop in IgfsMode.PRIMARY mode. After that you can configure connectivity from any supported language to Hadoop and it's file system. Thanks! -Dmitry -- View this message in context:

Re: BinaryObject

Anil, This seems to be fixed at https://issues.apache.org/jira/browse/IGNITE-4891, please check. On Wed, May 3, 2017 at 12:08 PM, Anil wrote: > HI Team, > > Did you get a chance to look into it ? thanks. > > Thanks > > On 2 May 2017 at 11:19, Anil

Re: Grid is in invalid state to perform this operation

Hi Sam, Was local node connected to remote cluster? Probably it was kicked off the cluster, because of closed connection. Thanks! -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Grid-is-in-invalid-state-to-perform-this-operation-tp12360p12379.html Sent

Re: BinaryObject

HI Team, Did you get a chance to look into it ? thanks. Thanks On 2 May 2017 at 11:19, Anil wrote: > Hi, > > java.lang.ClassCastException: > org.apache.ignite.internal.binary.BinaryObjectImpl > cannot be cast to org.apache.ignite.cache.affinity.Affinity exception >

Re: Serializer

Hi, You may use your custom collections as is - they will be deserialized in correct type. If you want to implement Binarylizable with additional serialization logic, you can use something like follows (but this approach will need intermediate object): private static class CustomList extends

Re: Where can I find example-ignite.xml for ignite sink connector?

Hi, You can find it in ignite-kafka module in src/test/resources folder. 2017-05-03 9:14 GMT+03:00 blasteralfred : > seen it here also https://apacheignite-mix.readme.io/v1.9/docs/kafka- > streamer > > > > -- > View this message in context: http://apache-ignite-users. >

Re: Continuous Query remote listener misses some events or respond really late

Hi, I'm trying to reproduce it in one host (with 6 ignite server node) but all work fine for me. Can you share ignite configuration, cache configuration, logs or some reproducer? 2017-05-02 15:48 GMT+07:00 begineer : > Hi, > I am currently facing intermittent issue with

Re: CacheStore's Performance Drops Dramatically - Why?

In fact, I don't see why you would need both batchSize and flushSize. If I got it right, only the min of them would be used by Ignite to know when to flush, why do we have both in the first place? In case they're both necessary for a reason I'm not seeing, I still wonder if the default values

Re: Volatile Kubernetes Node Discovery

Denis Magda-2 wrote >> Inside my service I'm using a IgniteCache in /Replicated/ mode from >> Ignite >> 1.9. >> Some replicas of this service run inside Kubernetes in form of Pods (1 >> Container/Pod). >> I'm using the >>

Re: CacheStore's Performance Drops Dramatically - Why?

I'm writing to confirm I managed to fix my problem by fine tuning the config params for the write behind cache until the performance was fine. I still see single element inserts from time to time, but just a few of them every now and then not like before. You should definitely avoid synchronous

Re: Where can I find example-ignite.xml for ignite sink connector?

seen it here also https://apacheignite-mix.readme.io/v1.9/docs/kafka-streamer -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Where-can-I-find-example-ignite-xml-for-ignite-sink-connector-tp12370p12371.html Sent from the Apache Ignite Users mailing list archive

Where can I find example-ignite.xml for ignite sink connector?

Hi, I am trying to fetch data from my Kafka topic, and insert it to Ignite cache. I followed tutorial here https://github.com/apache/ignite/tree/master/modules/kafka . At the end of instructions, for ignite xml reference, it is written that "For a simple cache configuration file example, see