Re: Cache Memory Behavior \ GridDhtLocalPartition

Hi No, currently I add items much slower than add them, there is no accumulation of items in the queue, i clear the queue once in 30 seconds removing all items from the queue, the data in the queue is different from the data in the EventsCache. can entities from events cache end up in this

Re: AtomicSequence not performing well with 2 nodes cluster set up

Thanks for the quick reply. If I will use range, then it wont be anymore a sequence in cluster-wide.If the range is 1000,then calling AtomicSequence.increamentAndGet() twice may give 1 & 1001.But I want it should give 1 & 2 respectively in any situation. Again Is it the same thing using AtomicLong

Re: Package jar file path for sql Query Entity

I have added warehouse.java containing class warehouse to package schema. Thats why I wrote schema.warehouse. Query I am executing is SELECT * from warehouse w WHERE w.w_id = 1 and entry corresponding to w_id = 1 is present in warehouse cache. schema.jar

Re: MapReduce Job stuck when using ignite hadoop accelerator

I can find the WARN in logs. The stuck should be caused by a long running cache operations. How to locate what cause the long running cache operations. My map-reduce job can run successfully without ignite hadoop accelerator. [GridCachePartitionExchangeManager] Found long running cache

Re: Failed to perform request when running MR job with ignite hadoop accelerator

I use the following configuration to avoid this problem. However, I after doing this, I encounter an another problem which makes my job stuck. The issue is described in another message: MapReduce Job stuck when using ignite hadoop accelerator

Re: Security in Ignite

Ignite does not provide security capabilities out of the box, you need to implement a plugin for this. Here is a good blog about this that you can use as an example: http://smartkey.co.uk/development/securing-an-apache-ignite-cluster/ GridGain provides their own implementation of this plugin as a

Re: Secondary Key for ignite cache?

I'm confused. Why does the key contains these additional fields? Shouldn't it be just object ID? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Secondary-Key-for-ignite-cache-tp9242p9248.html Sent from the Apache Ignite Users mailing list archive at

Re: Cluster hung after a node killed

Hi Sam, If there is an explicit lock that you acquired and not released properly, there is not much we can do. Explicit locks must be released explicitly, doing this by timeout even more error-prone in my view. BTW, only stopping the node that acquired the lock should've helped as well, because

Re: Secondary Key for ignite cache?

The cache maps from a key that contains (the object id, the fields being returned, json/atom/rss format) and maps it to the formatted string for that object in the specified format. So when we're searching the cache for the object, we're querying using all the formatting information, but we want

Security in Ignite

Hello, I’ve been looking for information on how data security is handled in Ignite. The only mention I’ve seen is this: https://apacheignite.readme.io/discuss/55006040cfeeea17004717b0 Can anybody point me to additional docs?

Re: Secondary Key for ignite cache?

Hi, I'm not sure I understood the use case, can you please give more detail? What exactly you mean by 'invalidate'? Can you give an example of a key-value pair and describe the behavior you want to achieve? -Val -- View this message in context:

Re: Cluster hung after a node killed

Ideally cluster should recover seamlessly. Is there any locktimeout which I can configure? or any other configuration which will make sure locks taken by crashing node gets released and cluster still serves all requests? Is this a bug? -Sam -- View this message in context:

Secondary Key for ignite cache?

Is there a way to set and use a secondary key in ignite cache? Our use case is that we cache string representations of objects using a complex key that provides additional information about formatting, but we want to invalidate using just the object ID. There are many combinations of formatting

Re: Ignite user architecture question - Node Roles

P.S. There is no much difference between loading from one data sources or three data sources. Just create a cache per data source and point them to different databases. -Val -- View this message in context:

Re: Ignite user architecture question - Node Roles

Hi Russ, Please refer to [1] for information about data loading. Basically, there are two different approaches for this: using IgniteDataStreamer on client node or CacheStore on server side (in the latter case all nodes will load all the data and will filter out rows that should be stored

Re: Performance question

Alisher, This line does not look correct to me: int[] partitions = this.ignite.affinity("test.cache").primaryPartitions(this.ignite.cluster().node()); cluster().node() returns a random node from the group, it should be localNode() instead if I understand your approach correctly. I would also

Re: Problem about "[GridDirectParser] Failed to read message"

I would recommend you to switch off the shared memory first as it can be unstable in some cases, and check if this helps. To do this add the following in the configuration: -Val -- View this message in context:

Re: AtomicSequence not performing well with 2 nodes cluster set up

Hi, First of all, if you don't need ranges, you should use IgniteAtomicLong instead of the sequence. But you should keep in mind that updating the atomic long is actually the same as updating the same cache entry, so you acquire an exclusive write lock each time you do this. That's why sequence

Re: Behaviour of Apache Ignite instances in case of network isolation

Hi, Ignite detects segmentation internally, but you will end up with two separate clusters working independently. You will have to manually resolve this by stopping one of them. For smarter segmentation resolution you should use GridGain. -Val -- View this message in context:

Re: Job scheduling in apache ignite for single node system

Hi, Please properly subscribe to the mailing list so that the community can receive email notifications for your messages. To subscribe, send empty email to user-subscr...@ignite.apache.org and follow simple instructions in the reply. pra527vin wrote > We have a system to crawl a data from 400

Re: Failed to perform request when running MR job with ignite hadoop accelerator

Hi, It looks like a connectivity problem. Can you try to telnet to port 11211 and check if it works? Can there be a firewall in between? -Val -- View this message in context:

Re: Swap space

Can you give a link to the thread? If it's a different issue, let's discuss there. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Swap-space-tp8156p9231.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Disabling client notifications

Sorry i missed this response. The problem was actually that I was not setting null correctly in binary objects so the schema kept updating in all the nodes over and over. woops -- View this message in context:

Re: Performance question

I found only one way to parallelize read via ScanQuery int[] partitions = this.ignite.affinity("test.cache").primaryPartitions(this.ignite.cluster().node()); startTime = System.currentTimeMillis(); Arrays.stream(partitions) .parallel() .forEach(partition -> {

Re: Package jar file path for sql Query Entity

Hi, Is it correct class name? If you want to save several different classes to the cache, you must set some matched "QueryEntry" 's. Could you please provide the jar file? On Mon, Nov 28, 2016 at 2:17 PM, rishi007bansod wrote: > I have written following query

Re: Cache transformations

And take attention: "DataStreamer" and "Ignite Compute" use one thred pool (public thread pool). Hence you should execute work with streamer asynchronously (other side you risk to get a thread starvation). -- View this message in context:

Re: Cache transformations

Hi, Now one node of Ignite execute the operation at only a one thread. You should use one thread by partition, those. scan query[1] with method "setPartition" (instance of local entries). Using affinity[2] for determine partition by nodes and run your task by each. You can slightly increase

Re: Performance question

Hi Alisher, As Nicolae suggested, try parallelizing your scan using per-partition iterator. This should give you almost linear performance growth up to the number of available CPUs. Also make sure to set CacheConfiguration#copyOnRead flag to false. --AG 2016-11-28 19:31 GMT+03:00 Marasoiu

Re: Cassandra basic setup

If you are using ignite.sh it should be fine. Igor On Nov 28, 2016 8:29 AM, "Riccardo Iacomini" wrote: > I will try. Yes I am using the ignite.sh command. Any drawbacks? > > Il 28 nov 2016 5:26 PM, "Igor Rudyak" ha scritto: > > Try to check

Re: Performance question

?Regarding CPU load, a single thread of execution exists in the program so (at most) one core is used. So if you have 8 cores, it means that it is 8 to 16 times slower than a program able to use all the cores & CPU redundancy of the machine. In my tests, indeed, a core looks fully utilized. To

Re: Cassandra basic setup

Try to check your classpath. Find ignite process usig something like ps -es | grep Ignite and check java command used to launch ignite. By the way, how you launching Ignite? Do you use ignite.sh script for this? Igor On Nov 28, 2016 8:05 AM, "Riccardo Iacomini"

Re: Cassandra basic setup

Hi Igor, I tried your suggestion, but it does find the class. I've also read from the README files that optional modules must be copied into the libs folder: same outcome. I've tried also the docker image, adding my configuration xml files to it, and running the image as specified here

Cache transformations

Hello! My current goal is to transform initial cache to different types of caches. For example, I have IgniteCache initCache ( BinaryObject value consists of *4* fields) and i want to create IgniteCache secondCache (BinaryObject value consists of *2*

Performance question

Hello! I have write and run a simple performance test to check IgniteCache#localEntries and found that current method is not enough fast. Ignite ignite = Ignition.start(); CacheConfiguration cacheConfiguration = new CacheConfiguration<>(); cacheConfiguration.setBackups(0);

Package jar file path for sql Query Entity

I have written following query entity for my database up1.xml For this query entity I have created jar file of package schema, which contains warehouse class. I kept this jar file in libs folder in apache ignite installation

MapReduce Job stuck when using ignite hadoop accelerator

Hi, Recently, I did some experiments to test the map-reduce job's performance with ignite hadoop accelerator. It really make sense to accelerate a map-reduce job. In my previous experiment, I store a 10GB file into IGFS. I design a I/O intensive job whose duty is only to read the 10GB file.

Re: How to config timeout configuration?

I use the following configuration to avoid this problem. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-config-timeout-configuration-tp9206p9215.html Sent from the Apache

Re: Why ignite hadoop accelerator can't improve performance with cluster mode?

Maybe it is caused by the configuration. And the first load is always slow. I tuned the configuration and the job goes well on my cluster. -- View this message in context:

Re: Behaviour of Apache Ignite instances in case of network isolation

TYPO all I need to know Is there any Network Segmentation Protection support is there in free -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Behaviour-of-Apache-Ignite-instances-in-case-of-network-isolation-tp9205p9213.html Sent from the Apache Ignite Users

Re: CacheConfiguration. AffinityFunction or node filter

Hi Alisher, Of course, you should use the filter assembly (CacheConfiguration # setNodeFilter), it provides an easy way to deploy a cache on a particular node. Affinity function takes care of the balance of these sections between nodes. Implementation of the functions may not be so easy. On