Re: ignite questions

2019-01-02 Thread Clay Teahouse
Thanks Naveen. -- Cache Groups: When would I start considering cache groups, if my system is growing, and sooner or later I will have to add to my caches and I need to know 1) should I starting grouping now (I'd think yes), 2) if no, when, what number of caches? -- Capacity Planning: So, there is

Re: ignite questions

2019-01-01 Thread Naveen
Hello Couple of things I would like to with my experience 1. Cache Groups : Around 100 caches, I do not think we need to go for Cache groups, as you mentioned cache groups will have impact on you read/writes. However, changing the partition count to 128 from default 1024 would improve your

Re: ignite questions

2019-01-01 Thread Clay Teahouse
I'd have at least 80-90 caches, assuming each cache corresponds to a table. Any feedback regarding other questions? thanks, Clay On Mon, Dec 31, 2018 at 9:58 AM Mikael wrote: > Hi! > > You have to try, if you just have a few caches (<10) you may not need to > go for any cach

Re: ignite questions

2018-12-31 Thread Mikael
ups. Mikael Den 2018-12-31 kl. 14:01, skrev Clay Teahouse: Hello All, I am new to ignite and have several general questions. I'd appreciate your feedback. 1) Cache groups: according to the ignite documentation, cache groups help with scaling and performance but might hurt reads. Where is the bala

ignite questions

2018-12-31 Thread Clay Teahouse
Hello All, I am new to ignite and have several general questions. I'd appreciate your feedback. 1) Cache groups: according to the ignite documentation, cache groups help with scaling and performance but might hurt reads. Where is the balance? 2) Capacity planning: If I reading the docs correctly

RE: 2 questions about eviction and transactions

2018-10-11 Thread wt
this is brilliant. thanks for this information. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: 2 questions about eviction and transactions

2018-10-11 Thread Stanislav Lukyanov
Hi, // Sidenote: better not to ask two unrelated questions in a single email. It complicates things if the threads grow. Roughly speaking, REPLICATED cache is the same as PARTITIONED with an infinite number of backups. The behavior is supposed to always be the same. Some components cut corners

2 questions about eviction and transactions

2018-10-11 Thread wt
hi I can't find additional information on evictions and transactions that i need to document. 1) does the eviction policies apply at a node level or cluster level. I understand with replicated it probably is a node level but for a partitioned cache how does it work 2) if i have 4 tables and 1

Re: Questions about how Ignite SQL Works

2018-07-30 Thread Lijun Cao
-30 kl. 09:30, skrev Lijun Cao: >> Hi: >> >> I have referenced How Ignite SQL Works document but I still have got 2 >> questions. >> >> The first question is, when I load data to Ignite cluster(3 nodes) in first >> time, the data is stored both on RAM a

Re: Questions about how Ignite SQL Works

2018-07-30 Thread Mikael
the query point of view it's no difference if you have (native) persistence enabled or not, it works the same way. Mikael Den 2018-07-30 kl. 09:30, skrev Lijun Cao: Hi: I have referenced *How Ignite SQL Works *document but I still have got 2 questions. The first question is,  when I

Re: Questions about how Ignite SQL Works

2018-07-30 Thread Lijun Cao
1:00 PM Lijun Cao <641507...@qq.com > <mailto:641507...@qq.com>> wrote: > Hi: > > I have referenced How Ignite SQL Works document but I still have got 2 > questions. > > The first question is, when I load data to Ignite cluster(3 nodes) in first > time, the data

Re: Questions about how Ignite SQL Works

2018-07-30 Thread Prem Prakash Sharma
Don't know about the first question but if you have persistence enabled ignite will load the data on startup Regards, Prem On Mon, Jul 30, 2018, 1:00 PM Lijun Cao <641507...@qq.com> wrote: > Hi: > > I have referenced *How Ignite SQL Works *document but I still have go

Questions about how Ignite SQL Works

2018-07-30 Thread Lijun Cao
Hi: I have referenced How Ignite SQL Works document but I still have got 2 questions. The first question is, when I load data to Ignite cluster(3 nodes) in first time, the data is stored both on RAM and disk(I enabled local persistence), so which area does Ignite query on in this situation

Re: Questions on IgniteDataStreamer

2018-07-04 Thread vbm
Hi, Can anyone provide some info on this ? Regards, Vishwas -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Questions on setting up firewall for multicast cluster discovery.

2018-07-02 Thread Jon Tricker
Message- From: vkulichenko [mailto:valentin.kuliche...@gmail.com] Sent: 29 June 2018 15:05 To: user@ignite.apache.org Subject: Re: Questions on setting up firewall for multicast cluster discovery. Hi Jon, First of all, you don't have to use multicast for discovery. Using static IP configuration

Re: Questions on setting up firewall for multicast cluster discovery.

2018-06-29 Thread vkulichenko
Hi Jon, First of all, you don't have to use multicast for discovery. Using static IP configuration or one other shared IP finder might simplify the setup: https://apacheignite.readme.io/docs/tcpip-discovery Second of all, I'm not sure I fully understand what you're trying to achieve. Are both

Questions on setting up firewall for multicast cluster discovery.

2018-06-29 Thread Jon Tricker
Am trying to set up a couple of 2.5.0 nodes on CentOS boxes. I have opened the recommended ports: firewall-cmd --add-port=47500-47502/tcp firewall-cmd --add-port=47100-47200/tcp firewall-cmd --add-port=47400/udp I see an initial UDP packet, to the ignite multicast group address, received

Re: Igfs - questions and optimal configuration settings

2018-06-27 Thread matt
Thanks Denis! That helps a lot. I'll dig into those settings and see if I get my head around it all. I did notice that the default/max memory settings are based off of system settings/resources, so I'll try the defaults too and see what happens. - Matt -- Sent from:

Re: Igfs - questions and optimal configuration settings

2018-06-26 Thread Denis Mekhanikov
ccessfully sent, it is then deleted from Ignite -- this all seems to > work, > however, is there a better way? > > If this approach is a good one, I have questions on how to configure. I had > to look around quite a bit to get a working configuration (version 2.3) and > even now, I'

Igfs - questions and optimal configuration settings

2018-06-26 Thread matt
is all seems to work, however, is there a better way? If this approach is a good one, I have questions on how to configure. I had to look around quite a bit to get a working configuration (version 2.3) and even now, I'm not clear as to what is needed in order to get a good configuration setup,

Re: Quick questions on Evictions

2018-06-21 Thread Andrey Mashenkov
Yes, you are right. On Wed, Jun 20, 2018 at 4:13 PM the_palakkaran wrote: > So to conclude, if I have enabled on heap storage for cache(using > cache.setOnHeapEnabled(true), > then : > 1. Still data will be stored off heap, but will be loaded to heap. To > escape > out of memory error, I have

Re: Quick questions on Evictions

2018-06-20 Thread the_palakkaran
So to conclude, if I have enabled on heap storage for cache(using cache.setOnHeapEnabled(true), then : 1. Still data will be stored off heap, but will be loaded to heap. To escape out of memory error, I have to set eviction policies. 2. Off heap entries will be written to disk based on data page

Re: Quick questions on Evictions

2018-06-20 Thread Andrey Mashenkov
DataRegionConfiguration.setMaxSize() should be used to limit offheap memory usage. On Tue, Jun 19, 2018 at 2:35 PM the_palakkaran wrote: > So how do I limit cache size if ignite native persistence is enabled using > dataRegionCfg.setPersistenceEnabled(true)? I don't want it to keep a lot of >

Re: Quick questions on Evictions

2018-06-19 Thread the_palakkaran
So how do I limit cache size if ignite native persistence is enabled using dataRegionCfg.setPersistenceEnabled(true)? I don't want it to keep a lot of data in memory and others may be kept on disk. That is the requirement. Also, I do have on heap cache enabled. But I read in many threads that

Re: Quick questions on Evictions

2018-06-19 Thread Andrey Mashenkov
Hi, DataPageEvictionMode is about algorithm of choosing page to be replaced. EvictionPolicy is what you are looking for. E.g. FifoEvictionPolicy or LruEvictionPolicy. It looks like EvictionPolicies can't be used with persistence as all of them uses non-persistent structures to track cache

Re: Quick questions on Evictions

2018-06-18 Thread the_palakkaran
Hi, DataPageEvictionMode is deprecated now, right? What should I do to evict my off heap entries? Also, can I limit off heap memory usage? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Primary and Backups caches questions.

2018-04-12 Thread vkulichenko
Hi Mauricio, 1. This is correct. 2. Queries return the actual data, therefore you see every entry only once. The fact that there are backups is internal and is not related to query results. And actually, I don't think the check you're doing is valid because different queries are not in sync with

Primary and Backups caches questions.

2018-04-12 Thread Mauricio
Hi All. I have the following scenario. My cluster has 12 nodes. I have one PARTITIONED cache named Documents and the type is <UUID, Documents> also the number of backups of this cache is 1. My questions are the following: 1. Having my number of backups equals to 1, this means that any

Re: Questions about SQL interface

2018-01-23 Thread slava.koptilin
Hello Wolfram, After some reflection, it doesn't clear to me that this behavior is a bug. SQL engine always works with binary objects. When some operation (insert, update etc) is executed via SQL api, you can think about it as using something like the following: cache.withKeepBinary().query(...)

Re: Questions about SQL interface

2018-01-22 Thread Wolfram Huesken
Hello Slava, the workaround totally works for me, I already have an Interceptor for certain caches anyway. Thanks a lot for looking into this. Will you take care of the jira ticket, too? Cheers Wolfram On 23/01/2018 06:19, slava.koptilin wrote: Hello, Here is the SQL statement and the

Re: Questions about SQL interface

2018-01-22 Thread slava.koptilin
Hello, > Here is the SQL statement and the exception from the logs: > https://gist.github.com/wolframite/d0b28d8b7ce483f82b9fd145adb68abe I tried this use-case with cache configuration you provided and I was able to reproduce the issue. When insert/update operation is executed via SQL api, the

Re: Questions about SQL interface

2018-01-19 Thread Wolfram Huesken
Hello Slava, On 19/01/2018 19:48, slava.koptilin wrote: Hello Wolfram, 1. Duplication of table entries in sqlline (!tables) This is a known issue https://issues.apache.org/jira/browse/IGNITE-7277 This bug has been resolved in master branch and will be available in Apache Ignite 2.4. I

Re: Questions about SQL interface

2018-01-19 Thread slava.koptilin
Hello Wolfram, > 1. Duplication of table entries in sqlline (!tables) This is a known issue https://issues.apache.org/jira/browse/IGNITE-7277 This bug has been resolved in master branch and will be available in Apache Ignite 2.4. 3. Updating / Inserting via SQL fails Could you please provide

Re: Questions regarding Ignite as hdfs cache

2018-01-16 Thread Evgenii Zhuravlev
s 1500 rows > part 200 rows > partsupp 800 rows > region 5 rows > supplier 10 rows > > and using standard TPCH queries > > *Querying from hive shell with below properties:* > set fs.default.name=igfs://igfs@node1:10500/; > > > > I have now following q

Re: How to do 'stream processing' and more questions of a Ignite newbie

2017-12-25 Thread Alexey Kukushkin
Cache#invoke(key, entryProcessor) executes the "entryProcessor" on a node where the "key" is stored. This is called "colocated processing" that allows you to offload processing from client to server nodes and avoid transferring the "key" and result over the network (although now we have to

Re: How to do 'stream processing' and more questions of a Ignite newbie

2017-12-22 Thread svonn
Hi, Thanks alot! I managed to finally get my interpolation up an running. Most of my questions were caused by confusing due to weird peer class loading errors. The errors I encountered while having peer class loading enabled apparently were caused by classes not getting redeployed on the ignite

Re: How to do 'stream processing' and more questions of a Ignite newbie

2017-12-14 Thread Alexey Kukushkin
1. To reduce operating costs in real enterprise environments, have a single application-agnostic Ignite cluster and multiple business function-centric applications configuring themselves in the cluster upon startup. You will have a single Ignite server configuration file including generic settings

Re: How to do 'stream processing' and more questions of a Ignite newbie

2017-12-11 Thread svonn
Hi, Thanks a lot for the insight! I got a few questions left: 1. Currently, I'm developing in my local IDEA IDE, starting ignite in client mode - How would is deployment supposed to work for live environment? Do you still start a client node with 'instructions' for the cluster? 2. I've been

Re: How to do 'stream processing' and more questions of a Ignite newbie

2017-12-11 Thread svonn
Hi, Thanks alot for the insight! I got a few questions left: 1. Currently I'm developing in my local IDEA IDE, starting ignite in client mode - How would is deployment supposed to work for live environment? Do you still start a client node with 'instructions' for the cluster? 2. I've been

Re: How to do 'stream processing' and more questions of a Ignite newbie

2017-12-06 Thread Alexey Kukushkin
Hi, What you described sounds like an Event Processing architecture, which includes never-ending stream of input data, limited time window, analysis of data within the time window and taking an action if necessary. Ignite supports Event Processing architecture with the following components:

How to do 'stream processing' and more questions of a Ignite newbie

2017-12-05 Thread svonn
Hello! I've finally overcome the hurdle of getting Kafka Connect to work with Apache Ignite. For people reading this, that have issues with it: At the end of the mail I'm posting my currently used Converter and Extractor. Connecting multiple topics to Ignite was possible after setting different

Re: Student Blog about Apache Ignite & Questions how to efficiently handle data

2017-12-05 Thread Nikolai Tikhonov
Hello Sven! Glad hear that you solved the problem by yourself! Any way, if you are able to share code snippet that shows how you use kafka streamer then community can provide some additional suggest. On Tue, Dec 5, 2017 at 2:45 PM, svonn wrote: > I solved the key issue with

Re: Student Blog about Apache Ignite & Questions how to efficiently handle data

2017-12-05 Thread svonn
I solved the key issue with a singleTupleExtractor - For both GpsPoints and AccelerationPoints I'm simply adding a hashvalue over the Object. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Student Blog about Apache Ignite & Questions how to efficiently handle data

2017-12-04 Thread svonn
Apparently I messed up the Blog link, here's the proper one: https://streambench.wordpress.com/category/apache-ignite/ Best Regards Sven -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Student Blog about Apache Ignite & Questions how to efficiently handle data

2017-12-04 Thread svonn
Hello! I noticed that this community is pretty active, so there might be some people that are interested in this: For a university project, we're trying to compare different stream processing engines. I decided to use Apache Ignite. Since our professorship hasn't really worked with most of those

Re: Issues with multiple kafka connectors, questions regarding ignite caches

2017-12-04 Thread svonn
I think I figured it out now: Using the same worker for three different topics might be nonsense either way, at least in my case - All three topics require different converters, therefor I'll need three different connectors. To start multiple instances of connect-standalone, I need to specify the

Re: Issues with multiple kafka connectors, questions regarding ignite caches

2017-11-29 Thread Alexey Kukushkin
Hi, I opened a ticket for this issue: https://issues.apache.org/jira/browse/IGNITE-7065. If no one pick it up by next week then I might find time to fix it next week (although I cannot promise). I am not sure when community is going to release 2.4 but I (or anyone who fixes it) could share a

Re: Issues with multiple kafka connectors, questions regarding ignite caches

2017-11-27 Thread svonn
Hi, Apparently the very same bug also affects the standalone kafka connect: When I add multiple connectors it will start the last one given, shut that one down (resulting in another 'Data streamer has been closed' exception) and then start the next one - So there's always only a single one

Re: Issues with multiple kafka connectors, questions regarding ignite caches

2017-11-27 Thread svengoly
Hi! Thanks for your answer, great insights. It would be great if you could open a Bug for that. I'll have to go with the standalone version for now either way. I will try to implement a Kafka converter for that as you suggested. Let's see if I can get it running! Best Regards Svonn Am

Re: Issues with multiple kafka connectors, questions regarding ignite caches

2017-11-21 Thread Alexey Kukushkin
Hi, 1. IgniteSinkTask source code shows that Ignite Kafka Connector has this "feature" that stopping any task

Issues with multiple kafka connectors, questions regarding ignite caches

2017-11-20 Thread svonn
. Now, let's start with the questions and issues: 1. After starting up the docker-compose I can access the Kafka Control-Center (confluent) and it shows both topics being filled. With the REST-call: {"name": "test-connector-one", "config&qu

Re: Benchmark results questions

2017-11-09 Thread dkarachentsev
Hi Ray, I've finally got results of query benchmarks: 4s1c 80725.80 80725.80 4s2c 78797.90 157595.80 4s4c 54029.70 216118.80 8s1c 64185.60 64185.60 8s2c 61058.10 122116.20 8s4c 34792.70 139170.80 First column - cluster configuration (in 8 server variant 2 nodes per machine), second - average

Re: Benchmark results questions

2017-11-02 Thread Ray
Hi Dmitry, Thanks for you results. I'll try to increase the number of clients as well to see if the throughput can increase. Can you also test the sql query throughput? In my result, it seems with more servers the sql query throughput goes down dramatically. Is there a valid explanation for this

Re: Benchmark results questions

2017-11-02 Thread dkarachentsev
Hi Ray, I wasn't able to run benchmarks quickly, but I've got following results for atomic put throughput (numbers are a bit lower that could be, because of profiling): Throughput Cluster 264930 1c4s 513775 2c4s 968475 4c4s 281425 1c8s 530597

Questions regarding Ignite as hdfs cache

2017-11-02 Thread shailesh prajapati
properties:* set fs.default.name=igfs://igfs@node1:10500/; I have now following questions: 1) My queries are running fine with the above configurations. I want to see whether the data is caching and coming from cache or not. How should i check this? I used Ignite visor to see if the data is available

Re: Benchmark results questions

2017-11-01 Thread Ray
Hi Dmitry, It's been a while now, did you check out what happens? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Quick questions on replication and write synchronization mode

2017-10-31 Thread Andrey Mashenkov
Hi, Read requests by default goes to PRIMARY node until readFromBackup is true that allow to read local backup data. Write requests always applies on PRIMARY node first then primary node send request to backup nodes. The main difference between FULL and PRIMARY sync modes is that with second

Re: Quick questions on replication and write synchronization mode

2017-10-31 Thread slava.koptilin
Hello, > 1. Assume I write data item X with a FULL_ASYNC write synchronization > mode, what happens if I immediately attempt to read X? > Will I read an old value or do I wait till the previous writes are > completed? It depends on the fact whether the write operation is executed on the primary

Quick questions on replication and write synchronization mode

2017-10-30 Thread John Wilson
Hi, 1. Assume I write data item X with a FULL_ASYNC write synchronization mode, what happens if I immediately attempt to read X? Will I read an old value or do I wait till the previous writes are completed? 2. If the write mode is PRIMARY_ASYNC, will the immediate read operations on X get

Re: Benchmark results questions

2017-10-24 Thread dkarachentsev
Hi Ray, I've got the same results on my environment and checking what happens. Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Benchmark results questions

2017-10-18 Thread Ray
Hi Dmitry, The dstat and gc log for 4 and 12 are in the attachment. dstat.zip -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Benchmark results questions

2017-10-16 Thread Ray
Already tried tuning a few parameters, here's some quick update. Increasing 128 threads to 256 threads in yardstick configuration for 8 node setup, the result is still the same. Increasing warm up seconds from 60s to 120s in yardstick configuration for 8 node setup, the result is still the same.

Re: Benchmark results questions

2017-10-15 Thread Ray
Please see the attachment for yardstick configuration/parameters and cluster nodes configuration I used. Yes, I run the standard classes without modification, I run benchmark for these three classes IgnitePutBenchmark.java IgnitePutGetBenchmark.java IgniteSqlQueryBenchmark.java. config.zip

Re: Benchmark results questions

2017-10-13 Thread Denis Magda
Ray, Please share yardstick configuration/parameters and cluster nodes configuration you used. We might need to tune them. Another question is did you run standard benchmarking classes w/o modifications? Please list the names. — Denis > On Oct 13, 2017, at 1:58 AM, Ray

Re: Some questions regard Cache Query and performance

2017-10-13 Thread Alexey Kukushkin
Aaron, let me forward this to DEV: Ignite DEV community, I tried to confirm setLocal(true) semantics for ContinuousQuery and I have got not what I expected. I found that executing a ContinuousQuery with setLocal(true): - Still executes initial query remotely - Listens for modifications

Some questions regard Cache Query and performance

2017-10-13 Thread aa...@tophold.com
hi All, Regards ContinuousQuery, I notice there is a #setLocal will this meaning CQ only query against local cache? while this query only have #setRemoteFilterFactory method. So the question is will my CQ's local listener only receive event updates from local cache or entire cluster?

Benchmark results questions

2017-10-13 Thread Ray
We use Yardstick to do some benchmark of Ignite in our lab. The Ignite cluster size scale from one node with 16GB memory to 12 node with 64GB memory. We evaluated Atomic Put, Atomic PUT/GET and SQL Query. Please see the results in the attachment. My question is that the performance for Atomic Put

Re: Ignite SQL function questions

2017-10-11 Thread Denis Magda
There is always one copy stored in Ignite. The key-value store keeps data and Ignite indexes it using B+trees. H2 calls Ignite’s trees when prepares execution plans. This is partially mentioned here [1] and there [2] you can read more about the memory architecture. [1]

Re: BackupFilter for the RendezvousAffinityFunction Questions

2017-10-11 Thread Andrey Mashenkov
D cache) > across 16 Nodes (8 per AZ) > Then I will have 4 copies of the data – with 2 copies on each AZ. > > This way I can lose an entire AZ – for maintenance or whatever – and be > able > to withstand it. > > My questions: > > 1) By messing with the RendezvousAffinityFuncti

Ignite SQL function questions

2017-10-11 Thread Ray
I've been reading Ignite official document and going through Ignite source code for a few while now. >From the source code I see that Ignite can be a key/value store and the data is stored in a ConcurrentHashMap for every partition. So this is one copy of data in memory. For Ignite SQL function,

Ignite SQL function questions

2017-10-11 Thread Ray Liu (rayliu)
I've been reading Ignite official document and going through Ignite source code for a few while now. From the source code, I see that Ignite can be a key/value store and the data is stored in a ConcurrentHashMap for every partition. So, this is one copy of data in memory. For Ignite SQL

BackupFilter for the RendezvousAffinityFunction Questions

2017-10-09 Thread Chris Berry
per AZ) Then I will have 4 copies of the data – with 2 copies on each AZ. This way I can lose an entire AZ – for maintenance or whatever – and be able to withstand it. My questions: 1) By messing with the RendezvousAffinityFunction, am I messing with the Cache Affinity?? (I believe not?) We

Re: Quick questions on Evictions

2017-09-05 Thread Dmitry Karachentsev
the nice explanation. I got a few more questions: 1. For the case where on-heap caching and persistent are both disabled, why does Ignite throw out out-dated pages from off-heap? Why not throw OOM error since the out-dated pages are not backed by persistent store and throwing away

Re: Quick questions on Evictions

2017-09-04 Thread John Wilson
I appreciate the nice explanation. I got a few more questions: 1. For the case where on-heap caching and persistent are both disabled, why does Ignite throw out out-dated pages from off-heap? Why not throw OOM error since the out-dated pages are not backed by persistent store

Re: Quick questions on Evictions

2017-09-04 Thread Dmitry Karachentsev
: Hi, I have been reading through Ignite doc and I still have these questions. I appreciate your answer. Assume my Ignite native persistence is *not *enabled: 1. if on-heap cache is also not enabled, then there are no entry-based evictions, right? 2. if on-heap cache is now enabled, does

Quick questions on Evictions

2017-09-01 Thread John Wilson
Hi, I have been reading through Ignite doc and I still have these questions. I appreciate your answer. Assume my Ignite native persistence is *not *enabled: 1. if on-heap cache is also not enabled, then there are no entry-based evictions, right? 2. if on-heap cache is now enabled

Re: CacheMode - REPLICATED related questions

2017-08-28 Thread agura
Answers for all your questions (except of 4th) here depend on cache write synchronization mode. In case of FULL_SYNC mode the exception will be thrown on the client and you will be able to catch and process it. For PRIMARY_SYNC and FULL_ASYNC modes the client will get successful result and it's

Re: CacheMode - REPLICATED related questions

2017-08-28 Thread userx
replicated. Do we have any unit tests available to cater to such scenarios on a local node ? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/CacheMode-REPLICATED-related-questions-tp16423p16451.html Sent from the Apache Ignite Users mailing list archive

Re: CacheMode - REPLICATED related questions

2017-08-28 Thread agura
; am going with 1G, is there a documentation which helps me w.r.t > recommended settings on Xmx of 1g ? It depends on your use cases and there are no any "silver bullet" like advice. It would be great to test your application ander load before production. -- View this messa

CacheMode - REPLICATED related questions

2017-08-26 Thread userx
Hi, Consider the following situation Machine M1-> Data Grid Server S1 Machine M2-> Data Grid Server S2 Machine M3-> Data Grid Server S3 I intend to use REPLICATED mode because data loss is something which my application can't take. QUESTIONS QUESTION 1: Is there a way, we can ident

Re: Questions about "ignite-indexing"

2017-08-22 Thread slava.koptilin
used locally and per partition, but again, it > will check all entries. > > 3. If you set withKeepBinary(), then you'll be working with BinaryObject > and it's not require any specific config. > > Thanks! > -Dmitry. -- View this message in context: http://apache-igni

Re: Quick questions on Virtual Memory and Cache Memory Modes

2017-08-03 Thread vkulichenko
mory pages, but the data format is the same. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Quick-questions-on-Virtual-Memory-and-Cache-Memory-Modes-tp15971p15974.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Quick questions on Virtual Memory and Cache Memory Modes

2017-08-03 Thread John Wilson
A few quick questions: 1. Are the cache memory modes: OFFHEAP_TIERED, OFFHEAP_VALUES, and ONHEAP_TIERED, deprecated in Ignite 2.1? 2. In version 2.1, if I don't enable persistence store, do all data and indexes get stored on heap, possibly causing OME errors? 3. Is the virtual

Re: Off-Heap and Eviction policy questions

2017-08-03 Thread Yasser
ignite.apache.org/releases/2.1.0/javadoc/index.html > > Thanks. > > > > -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/Off-Heap-and-Eviction-policy-questions- > tp15869p15948.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. >

Re: Off-Heap and Eviction policy questions

2017-08-03 Thread slava.koptilin
nodes (default value is 0). [1] https://ignite.apache.org/releases/2.1.0/javadoc/index.html Thanks. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Off-Heap-and-Eviction-policy-questions-tp15869p15948.html Sent from the Apache Ignite Users mailing list archive

Re: Off-Heap and Eviction policy questions

2017-08-02 Thread slava.koptilin
Hi Yasser, 2) Could you please provide full Ignite and Cache configurations? It would be nice to see JVM options (Xms, Xmx etc) that you are using as well. Thanks. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Off-Heap-and-Eviction-policy-questions

Re: Off-Heap and Eviction policy questions

2017-08-02 Thread slava.koptilin
Hi Yasser, 1) There is a known issue https://issues.apache.org/jira/browse/IGNITE-5490 that is the reason of incorrect calculation "off heap" metrics. Thanks. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Off-Heap-and-Eviction-policy-questions-tp1

Off-Heap and Eviction policy questions

2017-08-01 Thread Yasser
I am developing a datagrid using Ignite 2.1 to store a large size table (~25G). I will be using 8 nodes with 12G RAM. I am currently developing in my local machine and trying to understand the cache load mechanism, printed metrics and eviction policy. Based on the below metrics, the heap size

Re: Compute Grid Questions

2017-07-18 Thread Matt
t; > -Val > > > > -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/Compute-Grid-Questions-tp14980p15091.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. >

Re: Compute Grid Questions

2017-07-18 Thread vkulichenko
Matt, undeployTask method is about task deployment [1], it's unrelated to the discussion. [1] https://apacheignite.readme.io/docs/deployment-spi -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Compute-Grid-Questions-tp14980p15091.html Sent from

Re: Compute Grid Questions

2017-07-18 Thread Matt
ruptedException e) { > isInterrupted = true; > } > > System.out.println("isInterrupted: " + isInterrupted); > } > } > } > > Thanks, > Slava. > > > > -- > View this message in context: http://ap

Re: Compute Grid Questions

2017-07-18 Thread slava.koptilin
om/Compute-Grid-Questions-tp14980p15055.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Compute Grid Questions

2017-07-17 Thread Matt
t; -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/Compute-Grid-Questions-tp14980p15015.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. >

Re: Compute Grid Questions

2017-07-17 Thread vkulichenko
and then cancel it. But again, it's all local - this state is not shared across nodes. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Compute-Grid-Questions-tp14980p15015.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Compute Grid Questions

2017-07-16 Thread Matt
Hi all, I want to run some code on a node based on an affinity key, for that I'm using ignite.compute().affinityRunAsync(...) but I have a few questions about this. *1.* Is it possible to give every closure a name (kind of an id), so that when I start a new client, I can somehow get the list

Re: Few questions

2017-05-22 Thread Ivan Veselovsky
course, you can add a CacheStore to the IGFS caches, but the question arises, would an underlying secondary file system be better and cheaper persistent layer? p.s. HDFS is not read-only, it is read-write file system. -- View this message in context: http://apache-ignite-users.70518.x6.nabb

Re: Few questions

2017-05-19 Thread Pranay Tonpay
should > appear eventually. In DUAL_SYNC mode the changes should appear immediately > upon operation completion. > > > > -- > View this message in context: http://apache-ignite-users.705 > 18.x6.nabble.com/Few-questions-tp13004p13027.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. > > >

Re: Few questions

2017-05-19 Thread Ivan V.
lly. In DUAL_SYNC mode the changes should appear immediately > upon operation completion. > > > > -- > View this message in context: http://apache-ignite-users.705 > 18.x6.nabble.com/Few-questions-tp13004p13027.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. > > >

Re: Few questions

2017-05-19 Thread Pranay Tonpay
DUAL_ASYNC mode it is possible that changes made to IGFS appear in underlying file system with some delays, but they should appear eventually. In DUAL_SYNC mode the changes should appear immediately upon operation completion. -- View this message in context: http://apache-ignite-users. 70518.x6.nabble.c

Re: Few questions

2017-05-19 Thread Ivan Veselovsky
delays, but they should appear eventually. In DUAL_SYNC mode the changes should appear immediately upon operation completion. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Few-questions-tp13004p13027.html Sent from the Apache Ignite Users mailing list archive

<    1   2   3   >