Re: Working Directly with Binary objects

2016-05-25 Thread Denis Magda
Hi, Actually it’s not a difficult task to write a cache entry in a byte representation into a storage if it’s needed. The easiest way is just to take an instance of a marshaller that is globally used (ignite.configuration().getMarshaller()) and convert a value and a key of an entry passed to

Affinity Key Mapping

2016-05-25 Thread amitpa
If I have two domain objects lets say A, B, do I need to put them in the same cache to use Affinity key mapping? Or can it work with different caches? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Affinity-Key-Mapping-tp5212.html Sent from the Apache Ignite

Re: How can I use H2 database ROWNUM() function

2016-05-25 Thread 张鹏鹏
Hi, thank you! This's the schema. id character varying(50) NOT NULL, openid character varying(50) NOT NULL, yyyappid character varying(50) NOT NULL, logtime timestamp without time zone DEFAULT now(), clienttime timestamp without time zone NOT NULL, logaction character varying(10) NOT

Re: Exception when starting second node

2016-05-25 Thread Andrew
Thanks for reply. And Yes, the system runs well, though it occurs. I hope the next version would be released soon. Sincerely, Andrew -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Exception-when-starting-second-node-tp5164p5207.html Sent from the Apache Ignite

Re: off heap indexes - setSqlOnheapRowCacheSize - how does it improve efficiency ?

2016-05-25 Thread Tomek W
| Also it would be interesting to see result of | SELECT count(*) from the query above in both cases. (number of rows = 2 798 685) SELECT count(*) FROM postgresTable; 456 ms SELECT count(*) FROM postgresTable; 314 ms SELECT count(*) FROM igniteTable; 9746 ms SELECT count(*) FROM igniteTable;

Two nodes in cluster

2016-05-25 Thread tomk
Hello, At now I have only one node, but I am going to add more machines (in one local network). What should I know to do it ? I have PARTITIONED type of cache. Hot loading (my use case is caching postgresql) is done on one machine. How to force ignite to distribute these rows to all

Re: off heap indexes - setSqlOnheapRowCacheSize - how does it improve efficiency ?

2016-05-25 Thread Tomek W
| Also it would be interesting to see result of *| SELECT count(*) from the query above in both cases.* (number of rows = 2 798 685) SELECT count(*) FROM postgresTable; 456 ms SELECT count(*) FROM postgresTable; 314 ms SELECT count(*) FROM igniteTable; 9746 ms SELECT count(*) FROM igniteTable;

Ignite 1.6.0 binary - compilation Issues

2016-05-25 Thread Agneeswaran
Hi We have downloaded the 1.6.0 binaries from the following link, http://ignite.apache.org/download.cgi#binaries Among following command as mentioned in DEVNOTES.txt, we have completed all commands except the final make command Platform : Linux libtoolize && aclocal && autoheader &&

Re: meaning of backup options.

2016-05-25 Thread Tomek W
Yes, I did mean: ** 2016-05-25 13:52 GMT+02:00 vkulichenko : > Did you forget to paste something here? What options are you asking about? > > -Val > > > > -- > View this message in context: >

Ignite and H2?

2016-05-25 Thread phalverson
What's the relationship between Ignite and H2? My sense is that H2 creates, updates, and queries indexes built on cached values, while Ignite handles actual data storage (e.g. cache, vs records in a data file) and distributing queries and gathering results to/from cache nodes. Thus, H2 isn't

Re: Ignite Transaction performance

2016-05-25 Thread amitpa
Server Node. Disabled Backups. But all changes are SYNCED synchronously. Caches are all partitioned and there are 4 caches. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Transaction-performance-tp5085p5199.html Sent from the Apache Ignite Users mailing

Re: Working Directly with Binary objects

2016-05-25 Thread guill-melo
Hello Denis, I am not trying to add this to production, I am investigating the feasibility of having a CacheStore that writes to HBase or something similar in a byte[] representation of the BynaryObject, as it is more efficient than java.io. I am trying to see what I can do with the API, as I

Re: Working Directly with Binary objects

2016-05-25 Thread guill-melo
Hello Alexei, Thanks again for your time, by a lot more compact I mean that a object like: Entity entity = Entity .build() .withId("12345") .withField("value field") .withOtherField(33) .build(); using java.io

Re: Ignite Transaction performance

2016-05-25 Thread amitpa
Val, Its correct that its so. Hwoever If I add one more node, this adds serious overhead. if I add more threads and start giving more concurrent inputs some transactions start slowing down with some going more than 3 seconds !!!. However I read about affinity key, does it help while inserting

Re: Exception when starting second node

2016-05-25 Thread vkulichenko
This is possible under some circumstances, see this ticket (should be fixed soon): https://issues.apache.org/jira/browse/IGNITE-3197 This exception should be harmless, only flooding the logs. Is this the case for you? -Val -- View this message in context:

Re: Downsides of Spark-Ignite for extended cache management and access?

2016-05-25 Thread phalverson
Thanks. That was precisely my concern, and I appreciate the guidance. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Downsides-of-Spark-Ignite-for-extended-cache-management-and-access-tp5154p5191.html Sent from the Apache Ignite Users mailing list archive at

Re: How can I use H2 database ROWNUM() function

2016-05-25 Thread vkulichenko
Hi, ROWNUM is not supported, and I'm not sure it's possible to properly implement it in the distributed environment. How do you intend to use it? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-can-I-use-H2-database-ROWNUM-function-tp5161p5190.html

Re: View contents of cache

2016-05-25 Thread vkulichenko
Do you have only one node? Can you attach the log file? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/View-contents-of-cache-tp5118p5192.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Downsides of Spark-Ignite for extended cache management and access?

2016-05-25 Thread vkulichenko
Hi, IgniteRDD is useful when you already have a Spark application and want to use Ignite as an underlying storage to share the state between different Spark jobs (which is not possible with plain Spark) and to get advantage of fast indexed SQL queries provided by Ignite (there are no indexes in

Re: DiscoverySpiNodeAuthenticator implementation

2016-05-25 Thread vkulichenko
Why did you implement validateNode() method? It's not a security concept, it's just a generic way that can be used by components to check the node validity (e.g., to avoid misconfiguration). Looks like in your case it always return result which is the reason of the failure (for valid node it

Re: Ignite Transaction performance

2016-05-25 Thread vkulichenko
Do you mean that it takes 22 seconds to execute 10 transactions? This means around 0.2ms per transaction, which seems to be good latency. Note that you're executing them synchronously in a single thread, waiting for the network each time. If you need to increase throughput, you should run more

Re: Nodes running on different operating systems

2016-05-25 Thread vkulichenko
Hi Graham, Note that all nodes in topology have to be able to connect to each other in both directions. Looks like one of your nodes can accept connections, but can't create them (or other way around). Probably your Windows box has a firewall enabled? -Val -- View this message in context:

Re: View contents of cache

2016-05-25 Thread Alexey
Thank you for your answer! Unfortunately it doesn't help. I copyed ignite-rest-http folder to lib, add this module to dependancies and started node but I still unable to get access to the site http://node1:8080/ignite?cmd=size=myCache -- View this message in context:

Re: meaning of backup options.

2016-05-25 Thread vkulichenko
Did you forget to paste something here? What options are you asking about? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/meaning-of-backup-options-tp5134p5180.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Interested in discussing the product in detail for a large scale music distribution and data matching project

2016-05-25 Thread vkulichenko
Hi Scott, I think you should definitely try Ignite for your use case. It will allow you to have scalable caches to store the data and different ways to read and process the data, like SQL queries and map-reduce. We also have transactional support, streaming capabilities and many other features

Re: off heap indexes - setSqlOnheapRowCacheSize - how does it improve efficiency ?

2016-05-25 Thread Alexei Scherbakov
For postgres test I mean initial jdbc query and result set traversal. For Ignite I mean sql query and iterator traversal. Also it would be interesting to see result of *SELECT count(*) from the query above in both cases.* 2016-05-25 12:00 GMT+03:00 Tomek W : > [image:

Re: off heap indexes - setSqlOnheapRowCacheSize - how does it improve efficiency ?

2016-05-25 Thread Tomek W
[image: Obraz w treści 1] What code do you mean ? JDBC client ? 2016-05-25 10:25 GMT+02:00 Alexei Scherbakov : > What's the batch size for postgresql ? > What's the size of one entry ? > Could you provide the test code for both postgres and Ignite (just the > query

Re: off heap indexes - setSqlOnheapRowCacheSize - how does it improve efficiency ?

2016-05-25 Thread Tomek W
[image: Obraz w treści 1] What code do you mean ? JDBC client ? *Additional test:*Before, I tested with 3000 000 rows. Now, I tested with 5000 000 rows. *SELECT * FROM table WHERE A> 1614289770;* *Postgresql: *38s. *Ignite: *10s. So, it seems that Ignite defeated postgresql. What do yout

Re: Working Directly with Binary objects

2016-05-25 Thread Alexei Scherbakov
Hi, You can marshall and unmarshall BinaryObject using marshaller like any other type. BTW, what are you trying to achieve ? If you store cache values as byte arrays, you need to deserialize them on each data access to do something useful. And how do you conclude "as its a lot core compact" ?

Re: off heap indexes - setSqlOnheapRowCacheSize - how does it improve efficiency ?

2016-05-25 Thread Alexei Scherbakov
What's the batch size for postgresql ? What's the size of one entry ? Could you provide the test code for both postgres and Ignite (just the query + read with the time estimation) ? 2016-05-25 11:13 GMT+03:00 Tomek W : > | How many entries are downloaded to the client in

Re: off heap indexes - setSqlOnheapRowCacheSize - how does it improve efficiency ?

2016-05-25 Thread Tomek W
| How many entries are downloaded to the client in both cases? 3000 000 | Do the both queries involve network I/O ? No, I have only local one server (for testing purpose). 2016-05-25 9:59 GMT+02:00 Alexei Scherbakov : > SELECT * is not really a good test query. >

Re: off heap indexes - setSqlOnheapRowCacheSize - how does it improve efficiency ?

2016-05-25 Thread Alexei Scherbakov
SELECT * is not really a good test query. It's result can be affected not only by engine performance. How many entries are downloaded to the client in both cases? Do the both queries involve network I/O ? 2016-05-25 7:58 GMT+03:00 Denis Magda : > In general Ignite is

Re: Unordered Messages do not arrive on a different Thread

2016-05-25 Thread Oru
Hi, Thank you for the response. It works now. Regards, Debasish -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Unordered-Messages-do-not-arrive-on-a-different-Thread-tp5160p5165.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Exception when starting second node

2016-05-25 Thread Andrew An
Hi, We are testing with Ignite v1.6. It was OK with Ignite v1.5 but after upgrade to v1.6, we encountered an Exception like below. The exception occurs only at starting second node. We are executing 1 client and 1 server node on 1 JVM(2 ignite nodes on 1 JVM). The client goes first then if the

How can I use H2 database ROWNUM() function

2016-05-25 Thread 张鹏鹏
I want to get rownum from the sql query. But when I use the H2 database ROWNUM() function I got Exception. Caused by: class org.apache.ignite.IgniteCheckedException: Unsupported expression: ROWNUM() [type=Rownum] at

Unordered Messages do not arrive on a different Thread

2016-05-25 Thread Oru
Hi There! While experimenting with Topic Based Messaging I found that the Listener cannot receive unordered messages if the listener is on another Java Thread. This limitation does not hold true for ordered messaging. I am attaching the Java Project as a Zip file. Please let me know what's wrong.