Question on BinaryObject

2023-01-17 Thread Peter
Hello, Do I understand correctly, that each BinaryObject that is returned by IgniteCache.get() and IgniteCache.getAll() method calls on a local node contains an internal on-heap byte array, and object unmarshalling occurs from that array, and not from off-heap memory?

unsubscribe

2021-01-21 Thread Peter Halverson
> On Jan 21, 2021, at 5:17 PM, akorensh wrote: > > Hi, > Can you actually see what the data distribution of itemid is. > > AffinityKey will direct Ignite to use that specific column (itemid) for > partition mapping. > If the data in itemid is in a narrow range, then all data will be put

There is no property called StartSize in CacheConfiguration

2018-12-08 Thread Peter Sham
I am reading performance tips on Ignite.Net (https://apacheignite-net.readme.io/docs/performance-tips#section-tune-cache-start-size) and upon "Tune Cache Start Size", there should be a property called "StartSize" in CacheConfiguration. But there is no such property. What should the configuration

Re: Fair queue polling policy?

2018-12-05 Thread Peter
t’s probably due to that the first value (when the queue is empty) always has the same key Shouldn't the implementation prefer polling clients that are local to the "put" if the queue is empty? Regards Peter Am 04.12.18 um 19:07 schrieb Peter: > Hello Stan, > > Thanks for your detaile

Re: Fair queue polling policy?

2018-12-04 Thread Peter
be several times slower like I currently observe in my test environment? Regards Peter Am 03.12.18 um 19:02 schrieb Stanislav Lukyanov: > > I think what you’re talking about isn’t fairness, it’s round-robinness. > > You can’t distribute a single piece of work among multiple nodes >

Re: Fair queue polling policy?

2018-11-30 Thread Peter
nments and/or environments with many clients this could make problems. I have created an issue about it here: https://issues.apache.org/jira/browse/IGNITE-10496 Kind Regards Peter Am 30.11.18 um 01:44 schrieb Peter: > > Hello, > > My aim is a queue for load balancing

Fair queue polling policy?

2018-11-29 Thread Peter
e? Or is it required to do queue.take() inside a Runnable submitted via ignite.compute().something? I also played with CollectionConfiguration.setCacheMode but the problem persists. Any pointers are appreciated. Kind Regards Peter

Re: Speed Expectations for Ignite Queue

2018-11-29 Thread Peter
To answer my own question: the speed seems to be expected and lays in the same range like e.g. redis+redisson Peter Am 26.11.18 um 16:32 schrieb Peter: > > Hello, > > I'm currently trying Apache Ignite and love the concept. > > I have created a simple example of what I'm

Speed Expectations for Ignite Queue

2018-11-26 Thread Peter
arm up everything before measuring the speed. I also tried various different JVM settings <https://apacheignite.readme.io/docs/jvm-and-system-tuning> without success. Kind Regards Peter PS: I cross-posted this a few days ago on SO: https://stackoverflow.com/q/53454232/194609

Re: Get Field Names In Select Query

2018-11-21 Thread Peter Sham
If you don't do GetAll() and just do Query(new SqlFieldsQuery...), the FieldsQueryCursor returned will have the column count and name of your result set. Hope this help. On Tuesday, November 20, 2018, 8:43:22 PM EST, siva wrote: Hi, How to get the field names in select query? I am

Re: Ignite.Net - Defining SQL Schema without using QuerySqlField custom attribute

2018-11-21 Thread Peter Sham
); This way SQL-compatible format is enforced, and non-UTC values will cause an exception.[1]  https://apacheignite-net.readme.io/docs/platform-interoperability#section-type-compatibility   On Tue, Nov 20, 2018 at 12:06 AM Peter Sham wrote: Sure. Hope this won't get too long and will still

Re: How to get the column names(or fieldsNames) of existing ignite sql table

2018-11-20 Thread Peter Sham
From what I understand, the first cache created by getOrCreate, where you will be using to run the SQLFieldsQuery to create your table, is just a dummy.  So name it as anything other than "Persons".  Yes.  It may sound counter intuitive. I'm still learning so may learn the reason behind it

Re: Ignite.Net - Defining SQL Schema without using QuerySqlField custom attribute

2018-11-19 Thread Peter Sham
Sure. Hope this won't get too long and will still be readable from e-mail, and thank you for helping.  Really appreciate it. using System;using System.Collections.Generic;using System.Linq;using System.Text;using System.Threading.Tasks;using Apache.Ignite.Core;using

Re: How to get the column names(or fieldsNames) of existing ignite sql table

2018-11-17 Thread Peter Sham
you will have Fields which are the columns. And for question 2, I think, yes, from my learning, SQL Create Table always create another cache with default naming like SQL_PUBLIC_. But according to manual, you can override the name by supplying options after "with". Happy Coding!

Re: Ignite.Net - Defining SQL Schema without using QuerySqlField custom attribute

2018-11-16 Thread Peter Sham
Additional findings. Actually the SQL schema defined by running sql create table works fine except for the date field. So I suspect the error message "BinaryInvalidTypeException: Unknown pair [platformId=0, typeId=-1854586790]" would probably mean the framework cannot find a mapping between Java

Ignite.Net - Defining SQL Schema without using QuerySqlField custom attribute

2018-11-15 Thread Peter Sham
Hello, I’m trying to learn Ignite.Net and has been following examples bundled with source or binary distribution.  However, when I try to define SQL Schema that will match an object either by sql create table statement or using QueryEntity in cache configuration, without resorting to

Re: Ignite RPM Package Installation error: Failed dependencies: java-1.8.0 is needed by apache-ignite-2.4.0-1.noarch

2018-06-14 Thread Peter Ivanov
Bhaskar, ignitevisorcmd.sh currently resides in /usr/share/docs/apache-ignite/bin directory (as an example). Not sure how to correctly run it - I guess it should be either copied to /usr/share/apache-ignite/bin or run with defined IGNITE_HOME env variable. On Fri, 15 Jun 2018 at 01:24, bhaskar

Re: Ignite RPM Package Installation error: Failed dependencies: java-1.8.0 is needed by apache-ignite-2.4.0-1.noarch

2018-06-12 Thread Peter Ivanov
Which Linux do you have? Currently packages are designed to be compatible with CentOS and RHEL. To satisfy dependencies, any rpm package that provides “java-1.8.0” should be installed as well (java-1.8.0-openjdk for instance). On Wed, 13 Jun 2018 at 01:42, bhaskar wrote: > I am trying to

Re: Agent not able to connect

2018-05-30 Thread Peter Ivanov
Humphrey, AFAIK, Web Console Standalone is deliberately designed to have self-contained Web Agent. Can you try separate Web Console docker image from experimental nightly build? [1] [1]

Re: hasOffHeapPointer

2017-03-16 Thread Peter Schmitt
regards, Peter 2017-03-08 14:08 GMT+01:00 Andrey Mashenkov <andrey.mashen...@gmail.com>: > Hi Peter, > > I think the message is not relevant. > It means, Entry had been load from Offhead earlier was evicted to Offheap > back (as AccessedEvictionPolicy is configured

Re: hasOffHeapPointer

2017-03-04 Thread Peter Schmitt
Hi Andrey, see https://github.com/ps4os/ignite_offheap_test/blob/master/src/main/java/demo/RunIgniteTester.java#L83 Kind regards, Peter 2017-03-03 13:35 GMT+01:00 Andrey Mashenkov <andrey.mashen...@gmail.com>: > Hi Peter, > > It looks like offheap entry was evicted from cac

hasOffHeapPointer

2017-03-02 Thread Peter Schmitt
have "soft references" between caches. In our case cache-entries don't have references to entries in other caches via a reference-variable pointing to those entries. Instead we store the key (in most cases a string) of the other cache-entry and do a lookup (once needed). Any hint is appreciated, Peter

Re: Whole cache-entries in log-files found

2017-03-02 Thread Peter Schmitt
Hi Val, thank you for the answer! Kind Regards, Peter 2017-03-02 23:31 GMT+01:00 vkulichenko <valentin.kuliche...@gmail.com>: > Hi Peter, > > Starting with 1.9 (which is about to be released) it will be possible to > avoid key-value printout by setting th

Whole cache-entries in log-files found

2017-03-02 Thread Peter Schmitt
oes Ignite create such log-entries which consist of the cache-entry-content and some Ignite-Metadata? How can I disable it? Any hint is appreciated, Peter

Re: OFFHEAP_TIERED and memory fragmentation

2017-02-07 Thread Peter Schmitt
Hi Alexey, I see. That sounds reasonable on that level (and is something different). What is your plan to limit the overhead/impact of detecting and moving around such small chunks? Kind regards, Peter 2017-02-03 14:52 GMT+01:00 Alexey Goncharuk <alexey.goncha...@gmail.com>: &

Re: OFFHEAP_TIERED and memory fragmentation

2017-01-26 Thread Peter Schmitt
ach causes a significant impact for applications which need to keep huge caches. Kind regards, Peter 2017-01-26 15:57 GMT+01:00 Alexey Goncharuk <alexey.goncha...@gmail.com>: > Hi Peter, > > Leaving defragmentation to Ignite is one of the reasons we are trying > PageMemory approach. In

Re: OFFHEAP_TIERED and memory fragmentation

2017-01-25 Thread Peter Schmitt
t debugged it, but the instances are created per cache. Furthermore, I'm not sure about the memory-page concept, because you would get pages on top of pages (used by a modern OS). Sounds like even more fragmentation and in this case Ignite would need to do the defragmentation. Kind regards, Peter 2017-01-2

Re: OFFHEAP_TIERED and memory fragmentation

2017-01-24 Thread Peter Schmitt
Hi Val, that means it depends a lot on the OS and if/how it handles virtual memory-pages. So why do you plan to change that? Thanks, Peter 2017-01-25 0:14 GMT+01:00 vkulichenko <valentin.kuliche...@gmail.com>: > Random means anywhere in empty memory space. When you create an entry

OFFHEAP_TIERED and memory fragmentation

2017-01-24 Thread Peter Schmitt
However, I would like to avoid that cache-fragmentation hits the application out of the blue and therefore I try to get an impression about those internals. Any hint is appreciated, Peter

Re: Reusing Ignite-Marshaller leads to a Memory-Leak

2017-01-22 Thread Peter Schmitt
Hi Denis, I think I've found the issue. Ignite skips references to Ignite-Caches. Moving away from the Ignite-Cache, but using the Ignite-Marshaller caused the issue. So it isn't an issue Ignite can prevent. Removing those references did it. Thanks for listening, Peter 2017-01-22 6:15 GMT+01

Reusing Ignite-Marshaller leads to a Memory-Leak

2017-01-21 Thread Peter Schmitt
eap grows once those 2000 instances get processed. (A manually triggered GC can just release few mb.) I even tried to re-use the marshaller, but nothing changed. At runtime BinaryMarshaller is used which wraps GridBinaryMarshaller. Any hint to get rid of the leak is appreciated, Peter

Re: Ignite Thread count

2016-09-09 Thread Peter Schmitt
Hi Val, thank you for your hint! I just found out that reducing public-thread-pool-size results in a lower write-performance. At least I could reproduce it. Are there any other information out there besides https://apacheignite.readme.io/docs/performance-tips ? Kind regards, Peter 2016-09-09

Ignite Thread count

2016-09-09 Thread Peter Schmitt
) grid-time-coordinator d) grid-time-server-reader e) ignite-clock f) nio-acceptor g) pub-* h) session-timeout-worker i) tcp-disco-msg-worker j) tcp-disco-srvr Any hint is appreciated, Peter

Re: Off-heap issue

2016-07-18 Thread Peter Schmitt
line in the run-method leads to a broken (see LOG.info) run or a working (createProprietaryLogger().info) run. I couldn't believe my eyes, however, I can reproduce it over and over again just by changing this one line. Kind regards, Peter 2016-07-18 22:50 GMT+02:00 vkulichenko <valentin.kulich

Re: Off-heap issue

2016-07-16 Thread Peter Schmitt
to a local-variable (the rest of the call is the same), the side-effect disappears as well (but I tested that constellation just twice). Kind regards, Peter 2016-07-16 2:04 GMT+02:00 vkulichenko <valentin.kuliche...@gmail.com>: > Hi Peter, > > It seems to me that either key and value

Re: Non-cluster mode

2016-07-05 Thread Peter Schmitt
Thank you Denis for the hint! Kind regards Peter 2016-07-05 14:35 GMT+02:00 Denis Magda <dma...@gridgain.com>: > Peter, > > Measure it basing under your load. Sometimes it’s enough to have Java > heaps 8 GB in size to work under significant load with off-heap data in > hu

Re: Non-cluster mode

2016-07-05 Thread Peter Schmitt
Hi Denis, we are trying to store a huge amount of data off-heap (more than 50 GB). Therefore, we need to know the heap-size which is needed by Ignite to handle such a huge off-heap cache (which we only need to keep the heap-size as low as possible due to the GC overhead). Kind regards Peter

Re: Non-cluster mode

2016-06-29 Thread Peter Schmitt
and comments which document the goals and observed issues. Kind regards Peter 2016-06-29 3:28 GMT+02:00 vkulichenko <valentin.kuliche...@gmail.com>: > Peter, > > This doesn't make much sense to me. With OFFHEAP_TIERED eviction policy > should not change anything at all, so it sounds lik

Re: Non-cluster mode

2016-06-28 Thread Peter Schmitt
, maybe it's a kind of index which needs heap-space. In that case it would be great to know how much heap-space is safe if the off-heap size should be ~50 GB. Kind regards Peter 2016-06-28 21:14 GMT+02:00 vkulichenko <valentin.kuliche...@gmail.com>: > Peter, > > The only configurati

Re: Non-cluster mode

2016-06-28 Thread Peter Schmitt
, CustomEntry> stream = ignite.dataStreamer(cache.getName())) { stream.allowOverwrite(true); //use stream#addData } I hope that config makes sense and can't lead to the effect I described initially. Kind regards Peter 2016-06-28 19:23 GMT+02:00 vkulichenko <valentin.k

Non-cluster mode

2016-06-28 Thread Peter Schmitt
des, but I couldn't find the information I'm looking for (which works as expected). Any hint is appreciated, Peter

Reproducing the benchmark numbers

2016-02-25 Thread Peter Veentjer
We (Hazelcast) would like to reproduce the benchmark numbers: https://ignite.apache.org/benchmarks/ignite-vs-hazelcast.html We have set up 3 separate environments, to reduce the change of configuration errors, according to the exact specifications on the website, but have failed to reproduced