Re: Limit the number of results query

HI Val, thanks for response. OOO is on server. Does server have separate memory blocks for each query results ? how does that work when number of number of queries executed in parallel ? Thanks On 16 November 2016 at 02:31, vkulichenko wrote: > Do you mean OOM

Unable to create cluster of Apache Ignite Server Containers running on individual VMs

Hi, I am trying to create a cluster of apache ignite server containers but unable to bring it up. *Setup:* To start, I have created two VMs on two separate host machines and trying to launch one Apache Ignite server container (Docker) on each VMs . The VMs are accessible using floating IP

`Unable to create cluster of server containers running on individual VMs

Hi,I am trying to create an apache ignite server cluster but unable to bring it up.I have two VM running on two separate host machines and the apache ignite server container (Docker) in running on those VMs . The VMs are accessible using floating IPs (e.g., VM1-172.26.116.67 and

Re: Fetching large number of records

Thanks Val Unfortunately, I have created centralized ignite cache cluster and use ignite jdbc connection to get fetch cache entries. i could not find any method which uses query parser in jdbc connection. Can we access query parser using jdbc connection ? Thanks On 30 November 2016 at 00:02,

Re: Blogging about new .NET features

Cos, This sounds interesting. Did it help to promote BigTop somehow? As I understand the blogging engine lacks of advanced text and code formatting capabilities. Is it so? This will be an issue for those posts that contains code snippets as a part of the content. However, in any case we

Re: Secondary Key for ignite cache?

As I said, you can use SQL queries [1]. However, you will need to have the object ID as a separate field, it will not be possible if you store the whole string. Actually, I'm sure how you intend to do this without parsing the string. And if you have to parse it anyway, why not store the parsed

Re: Cassandra basic setup

Ok, thanks for the info. Igor On Tue, Nov 29, 2016 at 12:56 PM, Denis Magda wrote: > Igor, > > The documentation has been moved to the new integrations related site > https://apacheignite-mix.readme.io/docs/ignite-with-apache-cassandra > > You’re free to update it there. > >

Re: Cassandra basic setup

Igor, The documentation has been moved to the new integrations related site https://apacheignite-mix.readme.io/docs/ignite-with-apache-cassandra You’re free to update it there. — Denis > On Nov 29, 2016, at 11:49 AM, Denis

Re: Cassandra basic setup

Igor, Please hold on for a while. I’ve just started moving all the integrations related documentation to a new domain. I’ll let you know when it’s safe to update the doc. — Denis > On Nov 29, 2016, at 10:46 AM, Igor Rudyak wrote: > > Hi Riccardo, > > Thanks for noticing

Re: Secondary Key for ignite cache?

We can cache it as the full object, but that means we have to use the processing power to marshal and unmarshal the object again, which is part of what we're using the cache to avoid. We've seen significant CPU usage improvements using this cache system so far against production simulated

Re: Blocked get operation problem

Are you scaling the computation across nodes? If so, you can make this cache replicated, in this case reads will always happen locally and therefore will be striped. -Val -- View this message in context:

Re: Data in cache per node

Hi, Please properly subscribe to the mailing list so that the community can receive email notifications for your messages. To subscribe, send empty email to user-subscr...@ignite.apache.org and follow simple instructions in the reply. Andrew Dzyuba wrote > Hi! > I have data from 5 million

Re: AtomicSequence not performing well with 2 nodes cluster set up

To my knowledge, AtomicSequence should throw an exception in this case. But if it works, then it will be the same. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/AtomicSequence-not-performing-well-with-2-nodes-cluster-set-up-tp9208p9276.html Sent from the

Re: Secondary Key for ignite cache?

Can you parse the object and save it not as a string? In this case you can use SQL to select all objects with the same ID. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Secondary-Key-for-ignite-cache-tp9242p9275.html Sent from the Apache Ignite Users

Re: Cassandra basic setup

Hi Riccardo, Thanks for noticing this. There were number of refactorings done and it looks like we need to update the documentation. I'll update the documentation for the module. Igor On Tue, Nov 29, 2016 at 9:26 AM, Denis Magda wrote: > Igor, > > Would you mind looking

Re: Performance question

Alisher, Since you're scanning the cache, time will always depend on number of entries and amount of CPU resources, so it's really hard to tell whether your result is good or bad. Having said that, the only effective way to improve this is to scale. If you add more nodes with the same dataset,

Re: Fetching large number of records

Hi Anil, While you iterate through the QueryCursor, the results will be fetched in pages and you will have only one page at a time in local client memory. The page size can be controlled via Query.setPageSize() method. -Val -- View this message in context:

Re: Secondary Key for ignite cache?

The object we're mapping to in the cache isn't the complete object - it's basically the tostring of an object after it's been formatted for the user. So if you had an object called foo with fields id, bar1, bar2, and bar3, and the user requested that object with just the id and bar2 field, in

Re: Cassandra basic setup

Igor, Would you mind looking through the documentation and updating it whenever is needed? — Denis > On Nov 29, 2016, at 1:58 AM, Riccardo Iacomini > wrote: > > Hi Igor, > I finally discovered what was causing the issue. The example provided >

Re: Lock and Failed to unlock keys exception

Just want to let you know that Ignite already provide a highly performant and stable implementation of a distributed ID generator https://apacheignite.readme.io/docs/id-generator — Denis > On Nov 23, 2016, at 11:11 PM, Shawn Du

Re: Blocked get operation problem

We use ignite mostly as a data cache and that fits and satisfy our needs. On the other hand we store some metadata in a seperate cache, we can maybe call as "global static metadata" which have around ~100 keys on it. So every time before reaching a data cache each thread access "global static

replace storm with ignite

Hi experts, After days trying with ignite, I am impressed by its powerful capability. Now in our architecture, ignite works with storm and act as cache/persist layer. I am considering replace storm with ignite at all. The reasons are : #1 In essential, we are recovering a stateful

Re: How IGFS keep sync with HDFS?

If IGFS can't hold more input data, will it flush data to HDFS? How IGFS flush data to HDFS? Async or sync? If it a async mode, when IGFS can't hold more data, it will using cache expire policy. And if the data which is expired is not persisted to HDFS timely, the data will be lost. Is is

Re: Performance question

In according to your suggestions I try to rewrite benchmark tests using jmh, here is link benchmark: https://github.com/aysheka/ignite-benchmarks/blob/master/test/src/test/java/com/example/ignite/IgniteCacheLocalReadTest.java Warmup partially

Re: Cassandra basic setup

Hi Igor, I finally discovered what was causing the issue. The example provided in the Ignite documentation page has a subtle difference in the package structure of several classes, for example:

How IGFS keep sync with HDFS?

I am using ignite hadoop accelerate to improve my map-reduce job. I am always encountered "java heap size" problem, though I have offer more than 80GB to ignite. The map-reduce job will write more than 150GB data to IGFS. When IGFS will sync data to HDFS? When processing a map-reduce job, do I

Re: Performance question

I think it is a bad idea to set number of threads greater than CPU count given you do not block on any IO operations However, benchmark itself seems totally incorrect to me. The most important issues are 1. total time is too low. try to put it to a loop body and measure each iterations. you can

Re: Performance question

Hi Alisher, It look doubt for me. You parallelize the job, but got a performance decrease. I recommend to use a java profiler and try to separate long time methods. How are you get a list of local partition (can it contain excess numbers)? And please check, has forckjoin pool enough size: