Re: Poor cross cache join SQL performance (v2.0.0)

[afedotov]

Hi,

Add Value2 to the list of the indexed classes (setIndexedTypes).
What is the reason for setting copyOnRead(false)?

If the problem still stands after the fix, please check GC or take a JFR.

Kind regards,
Alex

6 июля 2017 г. 7:29 AM пользователь "iostream [via Apache Ignite Users]" <
ml+s70518n14373...@n6.nabble.com> написал:

Hi,

I have 2 caches, each with POJO values that look like -

public class Value1 {

        @QuerySqlField(index = true)
        private Long a;

        @QuerySqlField(index = true)
        private String b;

}

public class Value2 {

        @QuerySqlField(index = true)
        private Long a;

        @QuerySqlField(index = true)
        private String c;

}

I have to run the following SQL query on my Ignite Cluster -

SELECT * from Value1 v1, Value2 v2 WHERE v1.a = v2.a

To test the query performance, I configured my Ignite Cluster to have only
1 server node and used 4 clients nodes to run the query. Added 50,000
Value1 objects and around 800,000 Value2 objects in the cache. I used a
single node cluster in order to avoid using affinity collocation problems
when performing cross cache joins. The average response time of the query
was around 150 seconds! :(

Server node - 4 CPUs, 8 GB Heap
Client node - 4 CPUs / client, 1 GB Heap / client

I am quite surprised to see the SQL perform poorly. I am posting my
cacheConfiguration for your reference (same for both the caches).

cacheConfig.setAtomicityMode("transactional");
cacheConfig.setCacheMode("partitioned");
cacheConfig.setBackups(1);
cacheConfig.setCopyOnRead(false);
cacheConfig.setIndexedTypes(Long.class, Value1.class);

I am wondering if the query performed poorly because of my cache
configuration or is Ignite not very efficient with cross cache joins (given
that I used only 1 node to avoid non-collcation)

Any help is appreciated!

Thank you.

------------------------------
If you reply to this email, your message will be added to the discussion
below:
http://apache-ignite-users.70518.x6.nabble.com/Poor-cross-cache-join-SQL-
performance-v2-0-0-tp14373.html
To start a new topic under Apache Ignite Users, email
ml+s70518n1...@n6.nabble.com
To unsubscribe from Apache Ignite Users, click here
<http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=YWxleGFuZGVyLmZlZG90b2ZmQGdtYWlsLmNvbXwxfC0xMzYxNTU0NTg=>
.
NAML
<http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>




--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Poor-cross-cache-join-SQL-performance-v2-0-0-tp14373p14379.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.