Re: How to set -DIGNITE_QUIET=false in service.sh?

2023-02-01 Thread Айсина Роза Мунеровна
, не пересылайте письмо! Hi, you can use -v option for ignite.sh script in this case you will have -DIGNITE_QUIET=false On Wed, Feb 1, 2023 at 1:56 PM Айсина Роза Мунеровна mailto:roza.ays...@sbermarket.ru>> wrote: Hola! We run Ignite via service from DEB package and use service.sh to st

How to set -DIGNITE_QUIET=false in service.sh?

2023-02-01 Thread Айсина Роза Мунеровна
Hola! We run Ignite via service from DEB package and use service.sh to start it. In the service file we set env JVM_OPTS like this: Environment="JVM_OPTS=-server -Xms10g -Xmx10g … … -DIGNITE_QUIET=false” The problem is that parseargs.sh (look here

Cross join on empty table

2023-01-18 Thread Айсина Роза Мунеровна
Hola! Is there way to make CROSS JOIN on empty table with distributedJoins=true so that the result will be NOT empty table (when left table is not empty itself)? I tried to do LEFT JOIN ON 1=1 but distributed join requires index to be used in ON statement. Thanks! -- Роза Айсина Старший разра

Re: How to check that affinity key works?

2023-01-12 Thread Айсина Роза Мунеровна
ll be difficult to affect runtime performance using this strategy. On Tue, Jan 10, 2023, 13:32 Айсина Роза Мунеровна mailto:roza.ays...@sbermarket.ru>> wrote: Hola! We want to optimize our SQL queries that make collocated JOINs on several tables (about ~8 tables). Some tables have column “pro

How to check that affinity key works?

2023-01-10 Thread Айсина Роза Мунеровна
Hola! We want to optimize our SQL queries that make collocated JOINs on several tables (about ~8 tables). Some tables have column “product_id” on which these tables are joined. Business meaning is that the result are features for each product_id. So based on documentation we set “product_id” as

Re: Method get_all does not work in Python

2022-12-27 Thread Айсина Роза Мунеровна
Hi Ivan! Thank you very much for your reply! And explanations :) Function you wrote works like a charm. On 26 Dec 2022, at 6:59 PM, Ivan Daschinsky wrote: Внимание: Внешний отправитель! Если вы не знаете отправителя - не открывайте вложения, не переходите по ссылкам, не пересылайте письмо! A

Re: Method get_all does not work in Python

2022-12-26 Thread Айсина Роза Мунеровна
, 26 дек. 2022 г. в 11:31, Айсина Роза Мунеровна mailto:roza.ays...@sbermarket.ru>>: Hola! I can’t use method get_all for caches from PyIgnite client. The problem is that keys are some binary strings that I do not know how to parse. Here what I do: class ProductFeaturesKey( met

Method get_all does not work in Python

2022-12-26 Thread Айсина Роза Мунеровна
Hola! I can’t use method get_all for caches from PyIgnite client. The problem is that keys are some binary strings that I do not know how to parse. Here what I do: class ProductFeaturesKey( metaclass=GenericObjectMeta, schema={ 'product_sku': IntObject }, type_name='io.

Re: How to use Hash Join in SQL API?

2022-12-22 Thread Айсина Роза Мунеровна
On 22 Dec 2022, at 1:21 PM, Stephen Darlington wrote: What indexes have you created on RetailerProductFeatures? In general, there’s no need to specify the index to use in your query. On 22 Dec 2022, at 09:53, Айсина Роза Мунеровна mailto:roza.ays...@sbermarket.ru>> wrote: Hi! Thank y

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-22 Thread Айсина Роза Мунеровна
, everything will work automatically. Otherwise, it is advisable to set up this flag manually. For pyignite it is not required to specify it, it is up to you. чт, 22 дек. 2022 г. в 13:42, Айсина Роза Мунеровна mailto:roza.ays...@sbermarket.ru>>: Okay, I got that. Thank you for your expla

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-22 Thread Айсина Роза Мунеровна
Okay, I got that. Thank you for your explanation! Will it be wright and more consistent to set up compact_footer = True both in application that creates and fills data (java thin client) and in python client explicitly? Should I somehow put this flag on server config? On 22 Dec 2022, at 1:18 P

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-22 Thread Айсина Роза Мунеровна
Dec 2022, at 12:20 PM, Айсина Роза Мунеровна wrote: Hi Ivan! Thank you for your reply! I tested your snippets with client and server node. When I raise server node in the snippet - everything works as expected, the same output (key exists). When I raise cluster manually on localhost and raise

Re: How to use Hash Join in SQL API?

2022-12-22 Thread Айсина Роза Мунеровна
It seems, you should replace `HASH_JOIN_IDX` with your actual index name. You can find all indexes with `SELECT * FROM SYS.INDEXES` 21 дек. 2022 г., в 20:43, Stephen Darlington написал(а): I don’t think it’s ever been in Ignite. On 21 Dec 2022, at 16:49, Айсина Роза Мунеровна mailto:roza.ays...@sber

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-22 Thread Айсина Роза Мунеровна
In that version, compactFooter equals to false, but on server side and pyignite it is by default enabled. But pyignite has an ability to detect this param after fetching the data. That is the reason why you code started working after fetching few data by a scan query. чт, 22 дек. 2022 г. в 09:1

Re: How to use Hash Join in SQL API?

2022-12-21 Thread Айсина Роза Мунеровна
! Если вы не знаете отправителя - не открывайте вложения, не переходите по ссылкам, не пересылайте письмо! Where did you get that syntax from? I don’t think Ignite supports hash joins, though there are other distributions of Ignite that do. On 21 Dec 2022, at 16:22, Айсина Роза Мунеровна

How to use Hash Join in SQL API?

2022-12-21 Thread Айсина Роза Мунеровна
Hola again! I have a problem when trying to use Hah Join in SQL API. I am using this doc: What I am doing: query = """ SELECT pf.product_sku, pf.total_cnt_orders_with_sku, rpf.mean_daily_sku_retailer_popularity FROM ProductFeatures AS pf LEFT JOIN RetailerProductFeatures

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-21 Thread Айсина Роза Мунеровна
cursor or reading data from it happens AFTER cache.get(key) - everything fails and key is not found. Is it ok? Maybe there is some dynamic binding of classes? Looks really weird. Help please! On 20 Dec 2022, at 1:35 PM, Айсина Роза Мунеровна wrote: Hola! I can’t get data by key in Python

Can't access binary key from Python client

2022-12-20 Thread Айсина Роза Мунеровна
Hola! I can’t get data by key in Python in caches created in Java with binary objects. 1. Cache was created though DDL in SQL API: CREATE TABLE IF NOT EXISTS PUBLIC.ProductFeatures ( product_sku INT PRIMARY KEY, total_cnt_orders_with_sku INT ) WITH "CACHE_NAME=PUBLIC_ProductFeatures,

Re: How to handle missed indexes and affinity keys?

2022-12-20 Thread Айсина Роза Мунеровна
duct_sku) equals the affinity key (product_sku). In such cases Ignite skips creating an additional index because _key_PK index already covers primary key. Thanks, Maksim On Fri, Dec 16, 2022 at 2:06 PM Айсина Роза Мунеровна wrote: Hello Stephen! This DDL we use: CREATE TABLE IF NOT EXISTS PU

Re: How to handle missed indexes and affinity keys?

2022-12-19 Thread Айсина Роза Мунеровна
4:30 PM, Maksim Timonin wrote: Hi Roza, In this ddl primary key (product_sku) equals the affinity key (product_sku). In such cases Ignite skips creating an additional index because _key_PK index already covers primary key. Thanks, Maksim On Fri, Dec 16, 2022 at 2:06 PM Айсина Роза Мунеровна

Re: How to handle missed indexes and affinity keys?

2022-12-16 Thread Айсина Роза Мунеровна
TABLE commands for those tables? On 16 Dec 2022, at 09:39, Айсина Роза Мунеровна mailto:roza.ays...@sbermarket.ru>> wrote: Hola! We've discovered some strange behaviour in Ignite cluster and now we are trying to understand how to recover from this state. So we have 5 node cluster with

How to handle missed indexes and affinity keys?

2022-12-16 Thread Айсина Роза Мунеровна
Hola! We've discovered some strange behaviour in Ignite cluster and now we are trying to understand how to recover from this state. So we have 5 node cluster with persistence and all caches either replicated or partitioned with affinity key. All caches are created via DDL with CREATE TABLE IF N

Re: Crash recover for Ignite persistence cluster (lost partitions case)

2022-11-24 Thread Айсина Роза Мунеровна
ld I add reset_lost_partitions command after activation or redeploy? I don't fully understand what you mean, but there are no problems with automatic deployments. In most cases, the situation with partition losses tells that cluster is in invalid state. вт, 22 нояб. 2022 г. в 19:49, Айсина

Re: Crash recover for Ignite persistence cluster (lost partitions case)

2022-11-22 Thread Айсина Роза Мунеровна
вложения, не переходите по ссылкам, не пересылайте письмо! Please check if this helps: https://ignite.apache.org/docs/latest/configuring-caches/partition-loss-policy#handling-partition-loss Also any reason baseline auto adjustment is disabled? On Tue, Nov 22, 2022 at 6:38 PM Айсина Роза Мунеровна

Re: Crash recover for Ignite persistence cluster (lost partitions case)

2022-11-22 Thread Айсина Роза Мунеровна
and local rebalance completion... I forgot to add that service is tarted with service.sh, not ignite.sh. Please help! On 22 Nov 2022, at 1:17 PM, Айсина Роза Мунеровна wrote: Hola! I have a problem recovering from cluster crash in case when persistence is enabled. Our setup is - 5 VM nodes with 40

Crash recover for Ignite persistence cluster (lost partitions case)

2022-11-22 Thread Айсина Роза Мунеровна
Hola! I have a problem recovering from cluster crash in case when persistence is enabled. Our setup is - 5 VM nodes with 40G Ram and 200GB disk, - persistence is enabled (on separate disk on each VM), - all cluster actions are made through Ansible playbooks, - all caches are either partitioned wi