RE: Ignite opens/close 5000 sockets in every 5mins after NODE_FAILED event

2018-06-13 Thread dkarachentsev
Hi, This thread dump is absolutely fine, you confused socket state and java thread state. These two things are absolutely unrelated. There should not be so many socket connections (TIME_WAIT means that socket already closed and waiting for last packages) for three nodes. Could you please share you

RE: Ignite Node failure - Node out of topology (SEGMENTED)

2018-06-13 Thread dkarachentsev
Hi Naresh, Recommendation will be the same: increase failureDetectionTimeout unless nodes stop segmenting or use gdb (or remove "live" option from jmap command to skip full GC). Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: And again... Failed to get page IO instance (page content is corrupted)

2018-06-13 Thread dkarachentsev
It would be better to upgrade to 2.5, where it is fixed. But if you want to overcome this issue in your's version, you need to add ignite-indexing dependency to your classpath and configure SQL indexes. For example [1], just modify it to work with Spring in XML:

Re: Local peek from client on a server node in a cluster

2018-06-13 Thread dkarachentsev
Hi, localPeek must be called on local node. I fyou want to do that from client, you have to execute a task [1] targeting on server node. But to list all entries ScanQuery is designed for [2]. You may run it via compute task from client with setLocal() flag set to true. [1] https://apacheignite.re

Re: Node pause for no obvious reason

2018-06-14 Thread dkarachentsev
Hi, Check system logs for that time, maybe there was some system freeze and add more information in GC logs, for example safepoints: -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCApplicationConcurrentTime. Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: "WAL segment tail is reached", Is it a problem ?

2018-06-15 Thread dkarachentsev
Hi Mikael! Don't worry about this message and you may just ignore it. It's absolutely OK and means that WAL was read fully. The question is why it's WARNING... In future releases it would be changed to INFO and message content to avoid such confusing. Thanks! -Dmitry -- Sent from: http://apach

Re: Text Query via SQL or REST API?

2018-06-15 Thread dkarachentsev
Hi, REST API does not have such option, but you can write your own compute task (that uses Java API) and call it from REST [1]. It's not possible to use Lucene search from SQL interfaces. To use full text search you need to annotate fields with @QueryTextField [2] and add to indexed types [3]. Ig

Re: Off-heap eviction configuration

2018-06-15 Thread dkarachentsev
Hi, I see you used your data region as default and set name for it. Try to set it to DataStorageConfiguration.setDataRegionConfigurations(). Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Text Query via SQL or REST API?

2018-06-15 Thread dkarachentsev
Jose, Unfortunately there is no other tools at the moment. But you still can contribute to Apache Ignite and implement that ticket which will persist Lucene indexes. It would be a great help! Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Off-heap eviction configuration

2018-06-15 Thread dkarachentsev
Check your configuration. This code works perfectly well for me. If set page eviction mode to disabled - IOOME will be thrown: IgniteConfiguration igniteConfiguration = new IgniteConfiguration(); DataStorageConfiguration dataStorageConfig = new DataStorageConfiguration(); long of

Re: Distributed Database as best choice for persistence

2018-06-18 Thread dkarachentsev
Hi, Probably the best choice would be Cassandra as Ignite has out of the box integration with it [1]. [1] https://apacheignite-mix.readme.io/v2.5/docs/ignite-with-apache-cassandra Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Deleting a ticket from https://issues.apache.org/jira/projects/IGNITE/issues

2018-06-18 Thread dkarachentsev
Hi, Not sure if it's possible to remove the ticket. Just close it with won't fix status, it would be enough. Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: monitoring function of web console

2018-06-18 Thread dkarachentsev
Hi, AFAIK, you cannot download plugin separately, it's commercial product. You can use it for free from here [1] or purchase a payed version for internal use. [1] http://console.gridgain.com/ Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite docker container not able to join in cluster

2018-06-18 Thread dkarachentsev
Hi, You configured external public EC interface address (34.241...), but it should be internal: 172... Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: No writes to WAL files for the whole day?

2018-06-20 Thread dkarachentsev
Hi, What is your configuration? Check WAL mode and path to persistence. Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: "Connect timed out" errors during cluster restart

2018-06-20 Thread dkarachentsev
Hi Oleksandr, It's OK for discovery, and this message is printed only in debug mode: if (log.isDebugEnabled()) log.error("Exception on direct send: " + e.getMessage(), e); Just turn off debug logging for discovery package: org.apache.ignite.spi.discovery.tcp. Thanks! -Dmitry

Re: Distributed Database as best choice for persistence

2018-06-20 Thread dkarachentsev
Hi, Just because: 1) not all users build their apps from scratch, they might have some legacy code built over Cassandra DB; 2) native persistence featured much later than Cassandra module, and there is no point to remove it now; 3) it's always better to offer more choices to user. Anyway, Ignite

Re: No writes to WAL files for the whole day?

2018-06-20 Thread dkarachentsev
I suppose that is issue with updating timestamps, rather with WAL writes. Try to make a load test and compare hash sum of files before load test and after. Also check if WAL history grow. Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Ignite Node failure - Node out of topology (SEGMENTED)

2018-06-26 Thread dkarachentsev
Hi Naresh, Actually any JVM process hang could lead to segmentation. If some node is not responsive for longer than failureDetectionTimeout, it will be kicked off from the cluster to prevent all over grid performance degradation. It works on following scenario. Let's say we have 3 nodes in a ring

Re: Ignite Cluster getting stuck when new node Join or release

2018-06-26 Thread dkarachentsev
Hi, Thread dumps look healthy. Please share full logs at that time when you took that thread dumps or take a new ones (thread dumps + logs). Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Different versions in ignite remote and local nodes.

2018-06-26 Thread dkarachentsev
Hi, Where did you get that images? In logs of all your instances do you see 2.5.0 version? Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Ignite Node failure - Node out of topology (SEGMENTED)

2018-06-27 Thread dkarachentsev
Naresh, GC logs show not only GC pause, but system pause as well. Try these parameters: -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Cache size in offheap mem in bytes

2018-06-27 Thread dkarachentsev
Hi, It will be incorrect, because entries are not stored sequentially, there are a lot of infrastructure that requires additional space. For example, memory is divided into pages and each page has header, each entry has key and value, version and other service information. For quick access to entr

Re: Scaling with SQL query

2018-06-27 Thread dkarachentsev
Hi, Slight degradation is expected in some cases. Let me explain how it works. 1) Client sends request to each node (if you have query parallelism > 1 than number of requests multiplied by that num). 2) Each node runs that query against it's local dataset. 3) Each node responses with 100 entries.

Re: Cache size in offheap mem in bytes

2018-06-27 Thread dkarachentsev
1) This applicable to Ignite. As it grown from GridGain sometimes it may appear in docs, because missed fro removal. 2) Yes, and I would say overhead could be even bigger. But anyway I cannot say definitely how much, because Ignite doesn't store data sequentially, there a lot of nuances. 3) Ignite

Re: Scaling with SQL query

2018-06-27 Thread dkarachentsev
Hi Jose, 1. Yep, I would say, you'll get more profit in persistence. Because if you split between real machines, each may keep more hot data in memory and each has separate hard drive. The more data you can fit into RAM and more hard drive could work in parallel, the better performance you get. 2

Re: Best practice for class versioning: marshaller error

2018-06-27 Thread dkarachentsev
Hi Calvin, BinaryMarshaller can solve that issue with involving a few more. First of all, you will need to disable compact footer to let each BinaryObject has it's schema in footer. If you need just put/get POJOs everything will be fine. But you need to enlist your POJO in BinaryConfiguration [1

Re: Scaling with SQL query

2018-06-27 Thread dkarachentsev
Hi, Reduce will be done on node to which JDBC or thin client connected, it could be either client or server node. Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Best practice for class versioning: marshaller error

2018-06-27 Thread dkarachentsev
Hi Calvin, 1. Enlist I mean that if you want, for example, to get to see what fields present in BinaryObject. In other words, if you want to work with BinaryObject directly. For POJO serialization/deserialization this should not be and issue at all. 2-3. In your case, you have and java.time.Ser i

Re: errors when building from source,?

2016-11-11 Thread dkarachentsev
Hi! It seems that dependency is broken. Try remove it from maven repository and rebuild. For more information please refer http://stackoverflow.com/questions/13846357/can-maven-3-redownload-broken-files-instead-of-failing-the-build -- View this message in context: http://apache-ignite-users.70

Re: Problem with v for listening updates

2016-11-16 Thread dkarachentsev
Hi Andry! Continuous query for performance reasons tries to avoid deserialization of binary values and reads cached data. Each time when you invoke CacheEntryEvent.getOldValue() you read just the same instance that was last deserialized, and it's actually returned by get() operation. So why it w

Re: Memory consumption in apache ignite

2016-11-18 Thread dkarachentsev
Please describe how data are stored on disk that you measured as 370 Mbytes? Are they compressed? How many fields each entry has? The comparison may not be correct. Ignite stores entries in a different way than relational database, f.e. for each field it spends 4 bytes, so if you have 10 fields, t

Re: Memory consumption in apache ignite

2016-11-21 Thread dkarachentsev
Approximate calculation for custom object overhead on heap will look like: entries = N fields number = flds header size = 24 fields id size = 4 BinaryObjectImpl = 40 byte arr header 16 + len 4 = 20 (at least, omitted padding) N*(24 + flds*4 + 40 + 20) = 4*N*(21 + flds), so for one entry with one

Re: while updating the cache, can I get notification

2016-11-22 Thread dkarachentsev
Don't continuous queries[1] suite your case? [1] https://apacheignite.readme.io/docs/continuous-queries -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/while-updating-the-cache-can-I-get-notification-tp9122p9125.html Sent from the Apache Ignite Users mailing lis

Re: How to apply the distributed lock on all the ignite remote instances

2016-11-22 Thread dkarachentsev
Hi, could you please describe in more details what do you want to achieve? If you want to aquire a distributed lock on some key you may use pessimistic transaction with REPEATEABLE_READ isolation level [1] on transactional cache. [1] https://apacheignite.readme.io/v1.7/docs/transactions#pessimist

Re: Cache Memory Behavior \ GridDhtLocalPartition

2016-11-22 Thread dkarachentsev
Hi! Have you checked that without backups you have no OOME? Can you be sure that all events are removed? Please verify that number of entries doesn't grow constantly during application run, for that you may use IgniteCache.size() and IgniteCache.sizeLong() with PRIMARY and/or BACKUP peek modes. T

Re: Restarting Tomcat container and Rebalancing

2016-11-22 Thread dkarachentsev
Hi, You can get to know if rebalancing is started/finished only via events and how you'll use this information is up to you :) Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Restarting-Tomcat-container-and-Rebalancing-tp9033p9128.html Sent from the Apa

Re: Cluster can not let more than one client to do continuous queries

2016-11-22 Thread dkarachentsev
Hi, What do you mean "another client can not join the cluster to do continuous queries"? Is there some specific error? Could you please provide logs from client and server? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cluster-can-not-let-more-than-one-client-

Re: Cluster can not let more than one client to do continuous queries

2016-11-23 Thread dkarachentsev
Hi, I'm not able to reproduce exact your issue, but found that there problem if enabled peer class loading [1]. Could you please give me al your configurations and full logs? And it would be very helpful if you create toy project which reproduces the problem. Thanks! [1]: https://issues.apache.o

Re: Cache Memory Behavior \ GridDhtLocalPartition

2016-11-23 Thread dkarachentsev
Hi, To get to know what cache represents CacheMetricsMXBean you can call name() method of it. And yes, it's worth to check if that entries cause your problem. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cache-Memory-Behavior-GridDhtLocalPartition-tp8835p9149

Re: Memory consumption in apache ignite

2016-11-23 Thread dkarachentsev
Hi, The main point of doing that was not to give data classes to server, that it would be unable to deserialize values on his size and force to use binary format. But if server doesn't know classes (data classes are not available in classpath) the only way to enable SQL queries is via QueryEntity.

Re: Cluster can not let more than one client to do continuous queries

2016-11-24 Thread dkarachentsev
Hi, Thanks for the reproducer, but it works for both tests. I think your issue entails in too large timeouts, for example, you set 5 min timeout for join, so it may take too long to connect. Is there any reason for such decision? -- View this message in context: http://apache-ignite-users.7051

Re: Cache Memory Behavior \ GridDhtLocalPartition

2016-11-24 Thread dkarachentsev
Hi, Yes, you're right, this is a cache that holds data for distributed datastructures, and IgniteQueue as well. Is it possible that you add items to queue faster than poll? TxCommittedVersionsSize and TxRolledbackVersionsSize are common for all caches and just store versions of finished transacti

Re: Cluster can not let more than one client to do continuous queries

2016-11-25 Thread dkarachentsev
>From logs that you sent I see discovery issue: unsuccessful first connect and long retry. Please do the following: in discovery config leave only server address and reset timeouts to default value. Small timeouts will force client fail fast and do not wait response from server. -- View this mes

Re: Job scheduling in apache ignite for single node system

2016-11-25 Thread dkarachentsev
Hi, could you please describe your use case a bit more detailed? If I understand correctly you want to send jobs into another JVM processes? What's the point of such solution? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Job-scheduling-in-apache-ignite-for-sin

Re: Server Node Stops Unexpectedly

2016-11-25 Thread dkarachentsev
Hi, Node could be segmented if it doesn't respond during some time. The most common reasons for that: 1) Long GC pause. 2) Operation system could slow down process (f.e. starts swap to disk process memory). 3) Network issues. To find out the actual reason you should take GC logs (-XX:+PrintGCDeta

Re: How can I save the job result which was ran on server which lost the connection.

2016-12-12 Thread dkarachentsev
Hi, Try job checkpointing [1]. [1] https://apacheignite.readme.io/docs/checkpointing -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-can-I-save-the-job-result-which-was-ran-on-server-which-lost-the-connection-tp9462p9479.html Sent from the Apache Ignite Use

Re: Affinity not based on the fields in the key

2016-12-12 Thread dkarachentsev
Hi! Could you please give/describe some simple example of your usage? I can't actually get your point. Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Affinity-not-based-on-the-fields-in-the-key-tp9450p9480.html Sent from the Apache Ignite Users mailing

Re: Cache stopped

2016-12-13 Thread dkarachentsev
Hi, Cache could be stopped when was called IgniteCache.close(), IgniteCache.destroy() or node is stopping. Please, attach logs to find out your reason. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cache-stopped-tp9503p9509.html Sent from the Apache Ignite Use

Re: BinaryObjectException after Ignite restarts

2016-12-16 Thread dkarachentsev
Hi, This could be if in client discovery configuration only one server node address set, that is restarted. In this case clients are unsuccessful in connecting to stopped node and are shutting down. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/BinaryObjectExc

Re: Does Ignite support query and index the embedded object column?

2016-12-20 Thread dkarachentsev
Hi, Check out this answer [1]. [1] http://apache-ignite-users.70518.x6.nabble.com/Querying-over-fields-in-the-object-inside-Cache-value-td9426.html -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Does-Ignite-support-query-and-index-the-embedded-object-column-tp

Re: Variation in BinaryObjectImpl object size with number of entries

2016-12-21 Thread dkarachentsev
What arguments do you pass to JVM when load 39M entries? What is the heap size in that case? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Variation-in-BinaryObjectImpl-object-size-with-number-of-entries-tp9673p9674.html Sent from the Apache Ignite Users mailin

Re: Variation in BinaryObjectImpl object size with number of entries

2016-12-21 Thread dkarachentsev
When heap size exceeds 32Gb reference compression is disabled, now JVM uses 64-bit references. What's your version of JVM? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Variation-in-BinaryObjectImpl-object-size-with-number-of-entries-tp9673p9678.html Sent from

Re: Off heap memory contents in linux

2016-12-22 Thread dkarachentsev
Hi, You may use JMX beans or visorcmd for that purpose. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Off-heap-memory-contents-in-linux-tp9677p9694.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Improve data loading speed from persistant data storage

2016-12-22 Thread dkarachentsev
loadCache() internally already uses IgniteDataStreamer. How long does it take to fetch all data from DB? Do you use SQL indexing for entities? How many data nodes in topology? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Improve-data-loading-speed-from-persist

Re: Improve data loading speed from persistent data storage

2016-12-22 Thread dkarachentsev
So, most of the time are spent on getting data from DB - 3.5 min. The rest, I think, could be indexing process in cache (you may check it by removing setIndexedTypes()). For speedup you may load data from CSV file, but Ignite doesn't provide such parser, you should implement it by yourself. Of cour

Re: Error while writethrough operation in Ignite

2016-12-22 Thread dkarachentsev
Looks like a bug in your CacheStore implementation - wrong SQL request is built. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-while-writethrough-operation-in-Ignite-tp9696p9700.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Error while writethrough operation in Ignite

2016-12-22 Thread dkarachentsev
Could you please share a simple reproducer? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-while-writethrough-operation-in-Ignite-tp9696p9716.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: NullPointerException on ScanQuery

2016-12-23 Thread dkarachentsev
Hi Alper, This is caused because of race. NPE happens between two events: removing affinity nodes and change cache state to STOPPED. In other words: 1. Remove affinity nodes; -- Start scan query. 2. Start exchange; 3. Change cache state. I've opened a ticket for that [1]. [1] https://issues.a

Re: Error while writethrough operation in Ignite

2016-12-26 Thread dkarachentsev
That happens because key and value fields mapped to the same DB columns. You should use at least one unique column for value mapping. Ignite throws away all fields from value that intersect with key fields. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-

Re: Get a Key from cache vs SQL Indexed parameter search performance

2016-12-26 Thread dkarachentsev
Hi Oru, If you need just key/value operations then simple get() will be much faster than SQL queries. Because indexing, parsing and processing query consumes resources. But if you need quite often search for cache entities by their fields, using of SQL + indexes is preferable, because no need to

Re: Error while writethrough operation in Ignite

2016-12-28 Thread dkarachentsev
Val, Of course it's possible, but why Ignite should restrict this case? Why not to build such update request: UPDATE table_name SET col1=1, col2=2, col3=3 WHERE (col1=1 AND col2=1 AND col3=1) ? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-while-writethr

Re: Affinity Key

2016-12-28 Thread dkarachentsev
Hi Tejas, You may do the following: cache1.put(eqID, value1); or cache1.put(new AffinityKey<>(pk0, eqID), value2); cache2.put(new AffinityKey<>(pk, eqID), value2); In that case keys in Cache 2 will be collocated with keys in Cache 1. -- View this message in context: http://apache-ignite-user

Re: Afinity Key

2016-12-28 Thread dkarachentsev
Duplicates [1] [1] http://apache-ignite-users.70518.x6.nabble.com/Affinity-Key-td9772.html -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Re-Afinity-Key-tp9774p9778.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Affinity Key

2016-12-28 Thread dkarachentsev
Tejas, What is your use-case? AffinityKey helps collocate related data. F.e. if you have Person and Organization entities and want that Person`s related to Organization was resided on the same node, you may use AffinityKey: // Organizations. Organization org1 = new Organization("

Re: IgniteDataStreamer with Continuous Query

2016-12-28 Thread dkarachentsev
Hi Ankit, Yes, you can use ContinuousQuery with DataStreamer. Code samples you may found here [1] and [2]. [1] https://github.com/apache/ignite/blob/master/examples/src/main/java/org/apache/ignite/examples/streaming/StreamTransformerExample.java [2] https://github.com/apache/ignite/blob/master/e

Re: Make changes to cache entry before data rebalanicng.

2016-12-28 Thread dkarachentsev
No, but you can subscribe on such events: EventType.EVT_CACHE_REBALANCE_OBJECT_LOADED, EventType.EVT_CACHE_REBALANCE_OBJECT_UNLOADED [1] and, for example, update another cache with some metadata. [1] https://apacheignite.readme.io/v1.8/docs/events -- View this message in context: http://apache

Re: Afinity Key

2016-12-29 Thread dkarachentsev
Yes, that's right. Could you, please, describe more detailed what exact problem you faced with? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Re-Afinity-Key-tp9774p9794.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Afinity Key

2016-12-29 Thread dkarachentsev
Could you give example of your query? I will try to reproduce. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Re-Afinity-Key-tp9774p9799.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Affinity

2017-01-02 Thread dkarachentsev
Could you please add ignite-client.xml as well? Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Affinity-tp9744p9815.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: BinaryObject and String.intern

2017-01-02 Thread dkarachentsev
This won't give you any benefit, because Strings will be marshaled and stored in binary format. In other words you'll get a binary copy of your string, which is managed just like any other object. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/BinaryObject-and-S

Re: 答复: class org.apache.ignite.binary.BinaryObjectException: Wrong value has been set

2017-01-03 Thread dkarachentsev
You may use BinaryObjectBuilder#setField(String, T, Class) to explicitly set argument type. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/class-org-apache-ignite-binary-BinaryObjectException-Wrong-value-has-been-set-tp9829p9832.html Sent from the Apache Ignite

Re: 答复: BinaryObject and String.intern

2017-01-03 Thread dkarachentsev
Actually no, because Ignite internally will store it as a BinaryObject and will send to other nodes in a binary format as well, where all string fields will be unmarshaled without intern(). -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/BinaryObject-and-String-

Re: Error with ignite-rest-http

2017-01-03 Thread dkarachentsev
It looks like you have another version of Jetty in classpath. Do you have IGNITE_HOME environment variable set? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-with-ignite-rest-http-tp9835p9838.html Sent from the Apache Ignite Users mailing list archive at

Re: Near cache can be used with SQL Database

2017-01-03 Thread dkarachentsev
Yes, it's possible. You may start from here [1]. [1] http://apacheignite.gridgain.org/docs/odbc-driver -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Near-cache-can-be-used-with-SQL-Database-tp9805p9840.html Sent from the Apache Ignite Users mailing list archiv

Re: 答复: 回复:BinaryObject and String.intern

2017-01-04 Thread dkarachentsev
Hi Shawn, BitSet will be marshaled using BitSet.writeObject() serialization implementation. In other words, if this approach saves your memory in heap, it will save it in Ignite as well. If you save collection of strings, Ignite will not check for duplicates as JVM does, and as mentioned Alexey,

Re: compute SQL returned data.

2017-01-04 Thread dkarachentsev
You can use compute tasks [1], in which invoke SQL query and process results. [1] https://apacheignite.readme.io/docs/compute-grid -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/compute-SQL-returned-data-tp9890p9893.html Sent from the Apache Ignite Users mailin

Re: Exception while resolving topology version.

2017-01-06 Thread dkarachentsev
Hi Tolga, Please attach full logs from client and server, and your Ignite configurations. Do you constantly create/destroy caches during runtime? -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Exception-while-resolving-topology-version-tp9926p9927.html

Re: Trigger query in ignite

2017-01-06 Thread dkarachentsev
Hi, You may use IgniteScheduler [1,2]: [1] https://www.gridgain.com/sdk/1.8.1/javadoc/org/apache/ignite/IgniteScheduler.html [2] http://apacheignite.gridgain.org/docs/cron-based-scheduling -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Trigger-query-in-ignite-

Re: compute SQL returned data.

2017-01-09 Thread dkarachentsev
Hi Shawn, For map-reduce operations is most suitable ComputeTask [1], which has map/reduce methods. In map() method you may select nodes on which start processing according to key (refer Ignite.affinity() [2,3]). Result will be reduced and returned to the client. In summary, client invokes SQL to

Re: Efficient way to get partial data of a cache entry

2017-01-09 Thread dkarachentsev
Probably 1 and 3 would be the most effective ways if you're getting objects on affinity node [1], not use CacheMemoryMode#OFFHEAP_VALUES mode and CacheConfiguration.setCopyOnRead() is set to false (for query also with Query.setLocal() set to true). But copyOnRead = false flag could be the cause of

Re: Index Maintenance During Transactions

2017-01-17 Thread dkarachentsev
Hi, After each transaction all affected indexes are rebuilt, and this behavior is not configurable for now. - Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Index-Maintenance-During-Transactions-tp10088p10095.html Sent from the Apache Ignite Users mai

Re: Distributed query is too slow.

2017-02-02 Thread dkarachentsev
Hi Vladimir, When you run test on single node it works just locally, without node communication overhead. Good point will be to test on client node. In that case, even with one server node, query will be sent over network with all that communication stuff. Also, if cache is REPLICATED, query alway

Re: Distributed query is too slow.

2017-02-02 Thread dkarachentsev
I've just ran your tests, the project attached. Could you please, in turn, send your? This will help understand what goes wrong. Thanks! ignite-perf-test.zip -Dmitry. -- View this message in context: http://

Re: Error CacheConfig

2017-02-07 Thread dkarachentsev
Hi, You need to configure indexing to use queries. For that you may use CacheConfiguration.setIndexedTypes() or setup QueryEntity [1, 2]. For example, if you configuring cache with Integer key and String value: CacheConfiguration cfg = new CacheConfiguration<>("cache-name"); cfg.setIndexedTypes(I

Re: Distributed query is too slow.

2017-02-07 Thread dkarachentsev
OK, now I see that locally we have equal results. As I understand, remote means that nodes connected over network and placed on different machines. Then 5 sec per 10K requests (0.5 ms per request), probably, caused by network delays. -- View this message in context: http://apache-ignite-users

Re: Ignite client connections hanged

2017-02-13 Thread dkarachentsev
Hi Raja, Could you please attach logs for updated and not updated client, and thread dump for hanged client? - Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-client-connections-hanged-tp10561p10595.html Sent from the Apache Ignite Users mailing

Re: Distributed job scheduling

2017-02-13 Thread dkarachentsev
Hi Sergei, Unfortunately IgniteScheduler doesn't provide such guarantees. You will have to write your own implementation based on top of compute tasks and ComputeTaskSession, or use external job submission from client. Thanks. -Dmitry. -- View this message in context: http://apache-ignite-us

Re: Flink Streamer

2017-02-16 Thread dkarachentsev
Hi, I'm not quite familiar with Flink and Kafka connectors, but I'm going to figure them out and come back to help you. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Flink-Streamer-tp10650p10663.html Sent from the Apache Ignite Users mailing

Re: Issue in starting IgniteSinkConnector with Distributed Worker mode

2017-02-16 Thread dkarachentsev
Hi, I'm not quite familiar with Kafka connector, but I'm going to figure it out and come back to help you. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Issue-in-starting-IgniteSinkConnector-with-Distributed-Worker-mode-tp10647p10664.html Se

Re: Node hangs while accessing cache from Compute Task

2017-02-16 Thread dkarachentsev
Hi, This is a correct behavior. It's not allowed to use cache API in CacheEntryProcessor, query listeners, interceptors and so forth, because it leads to deadlocks. In your example it looks like (threads T1, T2): T1 put entry -> T1 lock entry -> T1 call listener -> T1 execute job -> T1 wait for re

Re: Node hangs while accessing cache from Compute Task

2017-02-17 Thread dkarachentsev
I haven't found such documentation, so opened a ticket to improve it [1]. [1] https://issues.apache.org/jira/browse/IGNITE-4718 Thanks! -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Node-hangs-while-accessing-cache-from-Compute-Task-tp10637p10700.htm

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

2017-02-20 Thread dkarachentsev
Hi, Check that file in path igniteCfgFile that you pass to IgniteSink constructor is available. If class initialization failed NoClassDefFoundError will be thrown. Also verify if IgniteSink$SinkContext$Holder.class is present in ignite-flink-2.0.jar. -Dmitry. -- View this message in context:

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

2017-02-20 Thread dkarachentsev
Is it possible to provide reproducible example? -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/java-lang-NoClassDefFoundError-Could-not-initialize-class-org-apache-ignite-sink-flink-IgniteSink-Sir-tp10703p10750.html Sent from the Apache Ignite Users ma

Re: Flink Streamer Compatibility.

2017-02-21 Thread dkarachentsev
ignite-flink is a thin, one-class module, and yes, it's compatible with newest Apache Flink versions. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Flink-Streamer-Compatibility-tp10727p10755.html Sent from the Apache Ignite Users mailing list archive

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

2017-02-22 Thread dkarachentsev
Hi, I tried your sample and it works fine to me. In case of initialization error, exception would be thrown on IgniteSink constructor invocation step, but it looks like Holder was successfully intialized, but failed later. Could you please attach logs for provided example? -Dmitry. -- View thi

Re: Issue in starting IgniteSinkConnector with Distributed Worker mode

2017-03-14 Thread dkarachentsev
Hi, Could you please attach logs and thread dumps (in case of hang) if problem is still relevant? -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Issue-in-starting-IgniteSinkConnector-with-Distributed-Worker-mode-tp10647p11161.html Sent from the Apache

Re: Can I let Ignite to do rebalance at a particular time?

2017-03-19 Thread dkarachentsev
Hi, Yes, you can set for caches that you want CacheConfiguration.setRebalanceMode(CacheRebalanceMode.NONE), and call IgniteCache.rebalance() when you need. To schedule rebalancing you may refer IgniteScheduler [1]. -Dmitry. [1] https://apacheignite.readme.io/v1.9/docs/cron-based-scheduling --

Re: Apache Ignite with log4J2 KafkaAppender - class not found

2017-03-20 Thread dkarachentsev
Hi, I suppose you need kafka log4j appender [1] in classpath. [1] https://mvnrepository.com/artifact/org.apache.kafka/kafka-log4j-appender -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Apache-Ignite-with-log4J2-KafkaAppender-class-not-found-tp11296p

Re: REST API authentication

2017-03-20 Thread dkarachentsev
Hi Ivan, REST API is based on Jetty server, so you need to configure SSL connector and certificates. Please refer [1, 2] for details. [1] https://apacheignite.readme.io/docs/rest-api#general-configuration [2] https://wiki.eclipse.org/Jetty/Howto/Configure_SSL -Dmitry. -- View this message in

<    1   2   3   4   >