Re: IEP-68: Thin Client Data Streamer

2021-03-05 Thread Ivan Daschinsky
Pavel, thank you for your effort. BTW, are you sure that receiver should be a param of STREAMER_START_REQUEST? Receiver is mostly internal stuff and I can hardly imagine why someone would decide to change defaults. пт, 5 мар. 2021 г. в 13:01, Pavel Tupitsyn : > Igor, > > As per our private conve

Re: IEP-68: Thin Client Data Streamer

2021-03-05 Thread Ivan Daschinsky
IMHO, also STREAMER_FLUSH_REQUEST should be added too. Client can flush large batches instead of closing resource. IMHO this is preferable than creating streamer per batch. пт, 5 мар. 2021 г. в 14:48, Ivan Daschinsky : > Pavel, thank you for your effort. > > BTW, are you sure that

Re: IEP-68: Thin Client Data Streamer

2021-03-05 Thread Ivan Daschinsky
org/apache/ignite/stream/package-summary.html > > > On Fri, Mar 5, 2021 at 2:50 PM Ivan Daschinsky > wrote: > > > IMHO, also STREAMER_FLUSH_REQUEST should be added too. Client can flush > > large batches instead of closing resource. > > IMHO this is preferable tha

Re: IEP-68: Thin Client Data Streamer

2021-03-05 Thread Ivan Daschinsky
I also suppose, that closing should be done wia OP_RESOURCE_CLOSE. It'is more consistent and resembles with existing cursor api. пт, 5 мар. 2021 г. в 15:37, Ivan Daschinsky : > >> Both proposed requests have a Flush flag - please see Details sections > in the IEP. > Ok,

Re: IEP-68: Thin Client Data Streamer

2021-03-05 Thread Ivan Daschinsky
o achieve server-side filtering. > > > > I also suppose, that closing should be done wia OP_RESOURCE_CLOSE > > Thanks, forgot to mention this - updated the IEP. > > > On Fri, Mar 5, 2021 at 3:42 PM Ivan Daschinsky > wrote: > > > I also suppose, that closing shou

Re: IEP-68: Thin Client Data Streamer

2021-03-05 Thread Ivan Daschinsky
in clients. > > This approach is already used for Services, Compute, ScanQuery, > ContinuousQuery. > > If you have a better idea in mind, please share. > > On Fri, Mar 5, 2021 at 4:12 PM Ivan Daschinsky > wrote: > > > >>> - Corresponding types should exi

Re: IEP-68: Thin Client Data Streamer

2021-03-05 Thread Ivan Daschinsky
Agree, this is completely offtopic here. пт, 5 мар. 2021 г. в 17:02, Pavel Tupitsyn : > > custom DSL > This is a topic for 3.0 - would you like to start a separate thread? > > On Fri, Mar 5, 2021 at 4:54 PM Ivan Daschinsky > wrote: > > > I suppose, that the best var

Re: [DISCUSSION] Common approach to print sensitive information

2021-04-05 Thread Ivan Daschinsky
Taras, it's strange that table schema and binary object schema are considered sensitive information. I suppose, that current realization is what it is because of simplicity of implementation. I've never heard from any cybersecurity expert, that sql plan or table schema are personal or sensitive inf

Re: [DISCUSSION] Common approach to print sensitive information

2021-04-05 Thread Ivan Daschinsky
Ilya, great idea, but I suppose that third option is a little bit paranoid. But nevertheless, let it be, it's quite simple to implement it. пн, 5 апр. 2021 г. в 14:04, Ilya Kasnacheev : > Hello! > > I have two ideas here: > > - Let's have more than a single level of sensitive information withhold

Re: [DISCUSS] Query API for Ignite 3.0

2021-04-06 Thread Ivan Daschinsky
Hi Taras! >> 1.1. Thin JDBC client will be really thin: provide network communication layer and transparently map to native API. But we have already this in AI 2.x >> 1.2. Thick JDBC client implementation will be trivial: start client node and open JDBC connection on the started node. We have alrea

Re: [DISCUSS] Query API for Ignite 3.0

2021-04-06 Thread Ivan Daschinsky
be extended to unify JDBC and > ODBC). > > We already have this in AI 2.x (JDBC and ODBC is mostly unified) > It is absolutely wrong. > ODBC, JDBC and thin client use the same port and unified head of the > handshake message. > The protocols are different a lot. > > &

[DISCUSSION] Release 0.4.0 version of ignite python thin client (pyignite)

2021-04-08 Thread Ivan Daschinsky
Igniters! I suppose it is time to finally release new version of python thin client Recently, multiple bug fixes, features and other goodies have been implemented. For example: 1. Partition awareness. 2. Asyncio support. 3. Cluster API support. 4. Multiple performance improvements, especially for

Re: [ANNOUNCE] Welcome Ivan Daschinsky as a new committer

2021-04-13 Thread Ivan Daschinsky
> > > Congrats! Well deserved. > > > > > > > > > >> 13 апр. 2021 г., в 09:34, Zhenya Stanilovsky > > > > > > > > > > > >> написал(а): > > > > >> > > > > >> > > > > >&g

Re: [DISCUSSION] MaxLineLength checkstyle rule

2021-04-15 Thread Ivan Daschinsky
Hi! Personally, I suppose that 120 chars per line is OK. Moreover, many codestyles suggests less chars per line. For example PEP8 recommends 80 (but we use 120 in pyignite and flake8 codestyle checks it). Google java codestyle insists on 100. More than 120 chars is too long as for me and is not co

Re: Re[2]: [DISCUSSION] MaxLineLength checkstyle rule

2021-04-15 Thread Ivan Daschinsky
But super long lines are a real problem while merging. It is super inconvenient. 120 chars is a good compromise. чт, 15 апр. 2021 г. в 14:39, Zhenya Stanilovsky : > > Python is not so verbose as java ) > +1 for 140 > > >Hi! > >Personally, I suppose that 120 chars per line is OK. Moreover, many >

[VOTE][EXTENSION] Release pyignite 0.4.0-rc0

2021-04-15 Thread Ivan Daschinsky
Dear Igniters! Release candidate binaries are at least uploaded and ready for vote You can find them here: https://dist.apache.org/repos/dist/dev/ignite/pyignite/0.4.0-rc0 If you follow the link above, you will find source package (*.tar.gz and *.zip) and binary packages (wheels) for windows (x86

Re: [VOTE][EXTENSION] Release Apache Ignite performance-statistics-ext, spring-data-all-ext and spring-tx-ext extensions 1.0.0 RC1

2021-04-15 Thread Ivan Daschinsky
I'm sorry, but is it OK, that artifacts are signed with signature of non-PMC? чт, 15 апр. 2021 г. в 19:26, Nikita Amelchev : > Dear Ignite Community, > > I have uploaded a release candidate of the following extension modules: > > performance-statistics-ext > spring-data-ext > spring-data-2.0-ext

[CANCEL] [VOTE] Release pyignite 0.4.0-rc0

2021-04-15 Thread Ivan Daschinsky
Dear Igniters Unfortunately, vote should be cancelled, because there is an absence of LICENSE and NOTICE in source package and NOTICE in binary packages. Issue created https://issues.apache.org/jira/browse/IGNITE-14564 New vote will appear soon. -- Sincerely yours, Ivan Daschinskiy

Re: [VOTE][EXTENSION] Release Apache Ignite performance-statistics-ext, spring-data-all-ext and spring-tx-ext extensions 1.0.0 RC1

2021-04-15 Thread Ivan Daschinsky
t > contain > > any mention of PMC role and only committers are mentioned there. It > > might be not an answer, since a lot of projects have PMC=Committer and > just > > one election. > > > > Sincerely, > > Dmitriy Pavlov > > > > чт, 15 апр. 2021 г

[VOTE] Release pyignite 0.4.0-rc1

2021-04-16 Thread Ivan Daschinsky
Ivan Daschinsky чт, 15 апр., 21:37 (19 часов назад) кому: dev Dear Igniters! Release candidate binaries are at least uploaded and ready for vote You can find them here: https://dist.apache.org/repos/dist/dev/ignite/pyignite/0.4.0-rc1 If you follow the link above, you will find source package

Re: [VOTE] Release pyignite 0.4.0-rc1

2021-04-17 Thread Ivan Daschinsky
; > On Fri, Apr 16, 2021 at 5:05 PM Ivan Daschinsky > wrote: > > > Ivan Daschinsky > > чт, 15 апр., 21:37 (19 часов назад) > > кому: dev > > Dear Igniters! > > > > Release candidate binaries are at least uploaded and ready for vote > > You

Re: [VOTE] Release pyignite 0.4.0-rc1

2021-04-17 Thread Ivan Daschinsky
> > On Fri, Apr 16, 2021 at 10:05 AM Ivan Daschinsky > wrote: > > > Ivan Daschinsky > > чт, 15 апр., 21:37 (19 часов назад) > > кому: dev > > Dear Igniters! > > > > Release candidate binaries are at least uploaded and ready for vote > > Yo

Re: [VOTE] Release pyignite 0.4.0-rc1

2021-04-17 Thread Ivan Daschinsky
4, Denis Magda : > >> +1 >> >> Does it require documentation updates? >> >> - >> Denis >> >> >> On Fri, Apr 16, 2021 at 10:05 AM Ivan Daschinsky >> wrote: >> >> > Ivan Daschinsky >> > чт, 15 апр., 21:37 (19 часов наза

[RESULT][VOTE] Release pyignite-0.4.0-rc1

2021-04-21 Thread Ivan Daschinsky
Hello, Igniters! Release pyignite-0.4.0-rc1 has been accepted. The votes received: 3 "+1" binding votes 2 "+1" votes There are no "+0" or "-1" Here the votes received: - Denis Magda (binding) - Igor Sapego (binding) - Anton Vinogradov (binding) - Ivan Da

[ANNOUNCE] Apache IGNITE python thin client (pyignite) 0.4.0 released

2021-04-22 Thread Ivan Daschinsky
https://archive.apache.org/dist/ignite/pyignite/0.4.0/ Please let us know if you have any problems https://ignite.apache.org/community/resources.html#ask Regards, Ivan Daschinsky on behalf of the Apache Ignite community.

[DISCUSSION] Documentation of thin clients (python, php, nodejs)

2021-04-22 Thread Ivan Daschinsky
ith ignite release cycle, it is by default outdated and doesn't resemble the latest version of thin client. I suggest just remove all documentation from the main docs except simple installation instruction (i.e. pip install pyignite) and link to readthedocs.io Regards, Ivan Daschinsky

Re: [DISCUSSION] Documentation of thin clients (python, php, nodejs)

2021-04-23 Thread Ivan Daschinsky
e. > And migrating the key information to readthedocs.io is really an option. > > Let's see what other Igniters think about this idea. > > I'd be glad if Igor Gusev could share his opinion on this. > > Regards, > Nikita > > > > чт, 22 апр. 2021 г. в 22:

Re: [DISCUSSION] Array to BinaryObject serialization

2021-05-01 Thread Ivan Daschinsky
Hi! First of all, when array is serialized, marshaller actually DO PRESERVE type of element (seel org.apache.ignite.internal.binary.BinaryUtils#doReadObjectArray and org.apache.ignite.internal.binary.BinaryWriterExImpl#doWriteObjectArray). AFAIK, the motivation of Nickolay proposal, is the fact, th

Re: Thin Clients: enable partition awareness by default

2021-05-12 Thread Ivan Daschinsky
Huge +1 from me. PA should be enabled by default. ср, 12 мая 2021 г. в 13:33, Pavel Tupitsyn : > > Igniters, > > Partition Awareness (PA) is implemented in 5 out of 6 thin clients [1]. > > However, this feature is disabled by default in most clients for > compatibility reasons: > initially we only

Re: Extensions section on the downloads page

2021-05-13 Thread Ivan Daschinsky
Hi! And what about creating "download" page for thin clients? I created issue for this https://issues.apache.org/jira/browse/IGNITE-14628 Btw, to be honest, I was unable to set up website with working download page locally. May be instruction is incomplete, but locally everything works fine except

Re: Thin Clients: enable partition awareness by default

2021-05-14 Thread Ivan Daschinsky
me. There were no major issues with this feature and it gives > > > good performance boost for many cases. > > > > > > Best Regards, > > > Igor > > > > > > > > > On Wed, May 12, 2021 at 5:18 PM Ivan Daschinsky > &g

Re: Extensions section on the downloads page

2021-05-14 Thread Ivan Daschinsky
ot; to "download.html" locally. > > - > Denis > > > On Fri, May 14, 2021 at 2:40 AM Ivan Daschinsky > wrote: > > > Hi! And what about creating "download" page for thin clients? I > > created issue for this > > https://issues.apache.org/jir

Re: Extensions section on the downloads page

2021-05-14 Thread Ivan Daschinsky
erge > to the prod where scripts can be checked. > > > On Friday, May 14, 2021, Ivan Daschinsky wrote: > > > Denis, have you tried this? I tried, and see broken links and js code > > doesn't work. > > > > пт, 14 мая 2021 г. в 15:08, Denis Magda : > &g

Re: Extensions section on the downloads page

2021-05-14 Thread Ivan Daschinsky
The thing is that Apache INFRA doesn't allow executing the server-side > logic anyway (the CGI code snippets that you can find on the downloads page > are added by INFRA). But the client-side JS works and can be tested locally. > > > - > Denis > > > On Fri, May 1

Re: Extensions section on the downloads page

2021-05-14 Thread Ivan Daschinsky
>> What exactly are you trying to do? Denis, what I wanted I have described here -- https://issues.apache.org/jira/browse/IGNITE-14628 пт, 14 мая 2021 г. в 19:37, Ivan Daschinsky : > > Denis, there are screenshots from locally hosted site. > > https://imgbox.com/Zeqb0DVD &g

Re: Proposal to remove explicit "GC disable" startup suggestion

2021-05-15 Thread Ivan Daschinsky
Hi, Val! Please take a look to java.nio.Bits.reserveMemory (jdk8). In this method you can see explicit call of System.gc() вс, 16 мая 2021 г., 01:22 Valentin Kulichenko : > Hi Ilya, > > Out of curiosity - what are the potential problems with memory buffers that > you're referring to? > > -Val > >

Re: Extensions section on the downloads page

2021-05-17 Thread Ivan Daschinsky
CGI code snippets that you can find on the downloads > > page > > > are added by INFRA). But the client-side JS works and can be tested > > locally. > > > > > > > > > - > > > Denis > > > > > > > > > O

Re: [DISCUSS] Python thin client development approach.

2021-05-18 Thread Ivan Daschinsky
sonal talk about this few months ago but nothing changed. пт, 22 янв. 2021 г. в 16:12, Ivan Daschinsky : > > Igor, I've never talked about complete removal of TC builds. > I just suggested to add TC jobs for different python versions and use travis > heavily. > > Currently, we

Re: Building with maven 3.8.1

2021-05-21 Thread Ivan Daschinsky
Hi. But where is TC run? And I suppose, that https://travis-ci.com/github/apache/ignite/jobs/506675544 should be at least fixed пт, 21 мая 2021 г. в 10:22, Petr Ivanov : > > Hi, Ilya. > > > Left small comment on formatting issue. > Otherwise looks good! > > > Considering 3.8.1 maven support — we w

Re: Building with maven 3.8.1

2021-05-24 Thread Ivan Daschinsky
runner. > I think it will be available with 2021.1 version that is going to be > delivered soon. > > > > On 21 May 2021, at 12:28, Ivan Daschinsky wrote: > > > > Hi. But where is TC run? And I suppose, that > > https://travis-ci.com/github/apache/ignite/jobs/50

Re: [DISCUSSION] Transactional cache could be in inconsistent state after node recovery.

2021-05-24 Thread Ivan Daschinsky
As for me, it is logical to remove this flag after merging IGNITE-6324. I suppose that the slowdown is negligible. BTW, yardstick reports contains no information about confidence interval. I suppose that another run could show not drop but improvement :) пн, 24 мая 2021 г. в 12:06, Zhenya Stanilov

Re: [MTCGA]: new failures in builds [6024739] needs to be handled

2021-05-28 Thread Ivan Daschinsky
Hi, Pavel, could you please look at this [1]? It seems after updating TC, few new inspections arrived. ]1] -- https://ci.ignite.apache.org/buildConfiguration/IgniteTests24Java8_PlatformNetInspections/6024739?buildTab=Inspection пт, 28 мая 2021 г. в 04:55, : > > Hi Igniters, > > I've detected s

[DISCUSSION] Release python-0.5.0

2021-06-08 Thread Ivan Daschinsky
Hi, folks! I suppose, that it's time to release the next version of python thin client, because we are ready to ship new cool features. 1. Expiry policy (TTL) support (merged to master) [1] 2. Transactions (patch available) [2] 3. As part of tx api, huge performance improvement of asyncio [3] 4.

Re: [DISCUSSION] Release python-0.5.0

2021-06-11 Thread Ivan Daschinsky
Since nobody has any contradiction and all planned issues are merged to master, I am going to cut release branch next tuesday and to prepare release binaries for voting. Stay tuned. чт, 10 июн. 2021 г. в 09:54, Nikolay Izhikov : > > +1 > > > 9 июня 2021 г., в 09:48, Ivan Daschi

Re: Apache Ignite 2.11

2021-06-11 Thread Ivan Daschinsky
I suppose that python thin client documentation should be removed, only link to actual readthedocs.io documentation should remain пт, 11 июн. 2021 г., 14:01 Игорь Гусев : > > Hello all. > > I’d also join in on Nikita’s question n what docs are required for > release. Currently we only have one do

Re: [DISCUSSION] Release python-0.5.0

2021-06-15 Thread Ivan Daschinsky
I've created release branch [1]. I suppose that since there is not any open issue related to python, code freeze will be at 06/15/2021 12:00 UTC. [1] -- https://github.com/apache/ignite-python-thin-client/commits/pyignite-0.5.0 пт, 11 июн. 2021 г. в 17:29, Ivan Daschinsky : > > S

Re: [DISCUSSION] Release python-0.5.0

2021-06-15 Thread Ivan Daschinsky
Ok, guys, code is freezed. RC is almost ready, the voting is going to start soon. Stay tuned. вт, 15 июн. 2021 г. в 10:35, Ivan Daschinsky : > > I've created release branch [1]. > > I suppose that since there is not any open issue related to python, > code freeze will be at

[VOTE] Release pyignite 0.5.0-rc0

2021-06-15 Thread Ivan Daschinsky
Dear Igniters! Release candidate binaries for subj are uploaded and ready for vote You can find them here: https://dist.apache.org/repos/dist/dev/ignite/pyignite/0.5.0-rc0 If you follow the link above, you will find source package (*.tar.gz and *.zip) and binary packages (wheels) for windows (amd

Re: [VOTE] Release pyignite 0.5.0-rc0

2021-06-15 Thread Ivan Daschinsky
documentation for tag 0.5.0.rc0 on readthedocs.io вт, 15 июн. 2021 г. в 21:58, Ivan Daschinsky : > > Dear Igniters! > > Release candidate binaries for subj are uploaded and ready for vote > You can find them here: > https://dist.apache.org/repos/dist/dev/ignite/pyignite/0.5.0-rc0 > >

Re: [VOTE] Release pyignite 0.5.0-rc0

2021-06-15 Thread Ivan Daschinsky
/info/verification.html вт, 15 июн. 2021 г. в 22:01, Ivan Daschinsky : > > +1 From me > Checked building from source on Ubuntu 20.04 amd64 for pythons 3.6.12 > 3.7.9 3.8.6 3.9.1. > Checked installing binary packages on Ubuntu 20.04 amd64 and Windows > 10 amd 64 for pythons 3.6.12

Re: Seconds and milliseconds confusion in python thin client

2021-06-15 Thread Ivan Daschinsky
Igor, I suppose that you are probably right. But there is no need to notice or deprecate something. This functionality is not released yet вт, 15 июн. 2021 г., 23:41 Igor Sapego : > Hi Igniters, > > I've noticed a weird behaviour of python thin client. In those places where > we have > timeouts o

Re: Seconds and milliseconds confusion in python thin client

2021-06-15 Thread Ivan Daschinsky
., 23:49 Ivan Daschinsky : > Igor, I suppose that you are probably right. But there is no need to > notice or deprecate something. This functionality is not released yet > > вт, 15 июн. 2021 г., 23:41 Igor Sapego : > >> Hi Igniters, >> >> I've noticed a weird beh

Re: Seconds and milliseconds confusion in python thin client

2021-06-15 Thread Ivan Daschinsky
> > I can see client.sql(timeout) in 0.4.0 for example, which is int number of > ms. > > Best Regards, > Igor > > > On Tue, Jun 15, 2021 at 11:52 PM Ivan Daschinsky > wrote: > > > BTW, common approach is to treat both ints and floats as seconds. Floats > &g

Re: Seconds and milliseconds confusion in python thin client

2021-06-16 Thread Ivan Daschinsky
I've created ticket for it https://issues.apache.org/jira/browse/IGNITE-14911 ср, 16 июн. 2021 г. в 08:37, Ivan Daschinsky : > > Ops, i don't even know about it. I believe that this is so rarely used, i > don't even noticed it. I am talking about transactions and expiry p

Re: Seconds and milliseconds confusion in python thin client

2021-06-16 Thread Ivan Daschinsky
, because it corresponds to socket.settimeout method in python (accepts floating point number) This is a compromise between usability and backward compatibility WDYT? ср, 16 июн. 2021 г. в 11:09, Ivan Daschinsky : > > I've created ticket for it https://issues.apache.org/jira/browse/I

Re: [VOTE] Release pyignite 0.5.0-rc0

2021-06-16 Thread Ivan Daschinsky
.5.0/ > > > > Everything looks good. > > > > Best Regards, > > Igor > > > > > > On Tue, Jun 15, 2021 at 10:09 PM Ivan Daschinsky > > wrote: > > > >> Also checked hash sums and signature. Packages are verified and > >> signatur

[CANCEL][VOTE] Release pyignite 0.5.0-rc0

2021-06-16 Thread Ivan Daschinsky
This vote was canceled since it was decided to add [1] to the release. [1] has been already merged to master branch and cherrypicked to release branch. New vote will be created soon. [1] -- https://issues.apache.org/jira/browse/IGNITE-14911

[VOTE] Release pyignite 0.5.0-rc1

2021-06-16 Thread Ivan Daschinsky
Dear Igniters! Release candidate binaries for subj are uploaded and ready for vote You can find them here: https://dist.apache.org/repos/dist/dev/ignite/pyignite/0.5.0-rc1 If you follow the link above, you will find source package (*.tar.gz and *.zip) and binary packages (wheels) for windows (amd

Re: [VOTE] Release pyignite 0.5.0-rc1

2021-06-16 Thread Ivan Daschinsky
The vote will end at June, 17 15:00 UTC. ср, 16 июн. 2021 г. в 17:33, Ivan Daschinsky : > > Dear Igniters! > > Release candidate binaries for subj are uploaded and ready for vote > You can find them here: > https://dist.apache.org/repos/dist/dev/ignite/pyignite/0.5.0-rc1 >

Re: [DISCUSSION] Code style. Variable abbrevations

2021-06-17 Thread Ivan Daschinsky
I'm sorry, but the rule is not strict and, moreover, not clear enough for constans. See here [1] ``` Type and method names are usually not abbreviated (except for the well-accepted abbreviations such as EOF, Impl, Fifo, etc.). Abbreviation applies to local variables, method parameters, class field

Re: [VOTE] Release pyignite 0.5.0-rc1

2021-06-17 Thread Ivan Daschinsky
xtend voting period till June 18, 15:00 UTC ср, 16 июн. 2021 г. в 17:34, Ivan Daschinsky : > The vote will end at June, 17 15:00 UTC. > > ср, 16 июн. 2021 г. в 17:33, Ivan Daschinsky : > > > > Dear Igniters! > > > > Release candidate binaries for subj are uploaded an

Re: IEP-75 Thin Client MsgPack Serialization for 3.0

2021-06-17 Thread Ivan Daschinsky
Hi, Pavel. Have you considered format with schema? Or schemaless of a candidate format was a prerequisite? As for me, msgpack is great, but I suppose that we should benchmark formats thoroughly. And not only for Java. чт, 17 июн. 2021 г. в 15:29, Pavel Tupitsyn : > Igniters, > > I have drafted a

Re: IEP-75 Thin Client MsgPack Serialization for 3.0

2021-06-17 Thread Ivan Daschinsky
Could you please share your code for benchmarks? чт, 17 июн. 2021 г. в 15:56, Ivan Daschinsky : > Hi, Pavel. Have you considered format with schema? Or schemaless of a > candidate format was a prerequisite? > As for me, msgpack is great, but I suppose that we should benchmark

Re: IEP-75 Thin Client MsgPack Serialization for 3.0

2021-06-17 Thread Ivan Daschinsky
ss.com/2019/09/29/net-serialization-benchmark-2019-roundup/ > [2] https://github.com/apache/ignite/pull/9178 > > On Thu, Jun 17, 2021 at 4:02 PM Ivan Daschinsky > wrote: > > > Could you please share your code for benchmarks? > > > > чт, 17 июн. 2021 г. в 15:56, Ivan

Re: IEP-75 Thin Client MsgPack Serialization for 3.0

2021-06-17 Thread Ivan Daschinsky
uot;a schemaful way" and "field names are not > included" in the same sentence. > > > On Thu, Jun 17, 2021 at 4:46 PM Ivan Daschinsky > wrote: > > > Also, it's well known use case of msgpack in the world of memory grids -- > > tarantool.io uses msgp

Re: IEP-75 Thin Client MsgPack Serialization for 3.0

2021-06-17 Thread Ivan Daschinsky
Andrey, >> arbitrary object graph Also, that is not true, msgpack format doesn't handle circular graphs. Think about msgpack as binary json. You couldn't understand full structure of message if you didn't deserialize it fully before, maps and arrays are serialized just as contiguos chunks of value

Re: IEP-75 Thin Client MsgPack Serialization for 3.0

2021-06-17 Thread Ivan Daschinsky
>> Double checked -- there is not any links to PR either in IEP or in jira issue Sorry, there is a link in IEP, but not in jira ticket. чт, 17 июн. 2021 г. в 21:39, Ivan Daschinsky : > Andrey, > >> arbitrary object graph > Also, that is not true, msgpack format doesn

Re: IEP-75 Thin Client MsgPack Serialization for 3.0

2021-06-17 Thread Ivan Daschinsky
field read > operation. > So, BO solution produces a lot of garbage and BO has noticable overhead > which affects the object footprint. > > чт, 17 июн. 2021 г., 21:41 Ivan Daschinsky : > > > >> Double checked -- there is not any links to PR either in IEP or in >

Re: IEP-75 Thin Client MsgPack Serialization for 3.0

2021-06-18 Thread Ivan Daschinsky
scussing the format, not the implementation. > > Important takeaway is: > The format does not prevent someone from implementing it efficiently. > > > > [1] > > https://github.com/apache/ignite/blob/master/modules/core/src/main/java/org/apache/ignite/internal/binary/Binar

Re: [VOTE] Release pyignite 0.5.0-rc1

2021-06-18 Thread Ivan Daschinsky
gt; > >> Checked pip install from tar.gz on Python 3.8 on Ubuntu 20.04, ran some > of > >> the examples. > >> > >> On Thu, Jun 17, 2021 at 2:32 PM Igor Sapego wrote: > >> > >>> +1 from me > >>> > >>> Best Regards

Re: [VOTE] Release pyignite 0.5.0-rc1

2021-06-18 Thread Ivan Daschinsky
Just rechecked test on release branch, add extra check with cluster activation and putting some data -- everything works ok. Authentication enabled, persistence enabled, with and without ssl. Could you please provide you ignite config and your code. пт, 18 июн. 2021 г. в 12:46, Ivan Daschinsky

Re: [VOTE] Release pyignite 0.5.0-rc1

2021-06-18 Thread Ivan Daschinsky
. Who wants authentication that sent without encryption? пт, 18 июн. 2021 г. в 12:54, Ivan Daschinsky : > Just rechecked test on release branch, add extra check with cluster > activation and putting some data -- everything works ok. Authentication > enabled, persistence enabled, > with and

Re: [VOTE] Release pyignite 0.5.0-rc1

2021-06-18 Thread Ivan Daschinsky
And this behavior is thoroughly described in docs https://apache-ignite-binary-protocol-client.readthedocs.io/en/latest/examples.html#password-authentication пт, 18 июн. 2021 г. в 12:59, Ivan Daschinsky : > AHA! I see, this is not a bug -- this is a feature. If you pass username > and pa

Re: [VOTE] Release pyignite 0.5.0-rc1

2021-06-18 Thread Ivan Daschinsky
>> we explicitly set use_ssl=True. Sorry, typo -- implicitly пт, 18 июн. 2021 г. в 12:59, Ivan Daschinsky : > AHA! I see, this is not a bug -- this is a feature. If you pass username > and password, we explicitly set use_ssl=True. So if your cluster is > configured witho

Re: [VOTE] Release pyignite 0.5.0-rc1

2021-06-18 Thread Ivan Daschinsky
:08, Ivan Daschinsky : > >> we explicitly set use_ssl=True. > Sorry, typo -- implicitly > > пт, 18 июн. 2021 г. в 12:59, Ivan Daschinsky : > >> AHA! I see, this is not a bug -- this is a feature. If you pass username >> and password, we explicitly set us

[RESULT] [VOTE] Release pyignite 0.5.0-rc1

2021-06-18 Thread Ivan Daschinsky
Hello, Igniters! Release pyignite-0.5.0-rc1 has been accepted. The votes received: 3 "+1" binding votes 4 "+1" votes There are no "+0" or "-1" Here the votes received: - Igor Sapego (binding) +1 - Pavel Tupitsyn (binding) +1 - Nickolay Izhikov (bind

[ANNOUNCE] Apache IGNITE python thin client (pyignite) 0.5.0 released

2021-06-21 Thread Ivan Daschinsky
m here: https://dist.apache.org/repos/dist/release/ignite/pyignite/0.5.0/ Please let us know if you have any problems https://ignite.apache.org/community/resources.html#ask Regards, Ivan Daschinsky on behalf of the Apache Ignite community.

Re: IEP-75 Thin Client MsgPack Serialization for 3.0

2021-06-23 Thread Ivan Daschinsky
г. в 14:07, Pavel Tupitsyn : > Igniters, > > Looks like there are no objections and we can accept the proposal. > I will close it tomorrow and move on to the thin client protocol itself. > > On Fri, Jun 18, 2021 at 12:10 PM Ivan Daschinsky > wrote: > > > >>

Re: IGNITE-14812: Statistics

2021-06-23 Thread Ivan Daschinsky
AFAIK, it is enough to include mention of this library in NOTICE, please see here [1][2][3] [1] -- https://www.apache.org/legal/src-headers.html#3party [2] -- https://www.apache.org/legal/src-headers.html#notice [3] -- https://www.apache.org/legal/resolved.html ср, 23 июн. 2021 г. в 17:36, Valent

Re: Setting IGNITE_TO_STRING_INCLUDE_SENSITIVE=false prevents VM Arguments output

2021-06-30 Thread Ivan Daschinsky
I suppose, that we should revert this particular line. I don't understand who ever considers vm options as sensitive info. ср, 30 июн. 2021 г., 22:52 Shishkov Ilya : > Hi Igniters, > > This feature [1, 2] prevents logging of the VM arguments when > IGNITE_TO_STRING_INCLUDE_SENSITIVE option is set

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
Pavel, but IEP is in progress, isn't it? 1. There is not any information about tuple serialization. And there isn't a clear consensus about it. 2. There is not any information about schrma serialization format. And AFAIK, there isn't a clear consensus also. чт, 1 июл. 2021 г., 13:26 Pavel Tupitsy

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
Also, is there any clear information about KV api? Is there any plan to implement it? Or is there any proposal about it? чт, 1 июл. 2021 г., 13:51 Ivan Daschinsky : > Pavel, but IEP is in progress, isn't it? > > 1. There is not any information about tuple serialization. And there i

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
only, since it is the only > API that we have right now, as noted in Risks and Assumptions. > > On Thu, Jul 1, 2021 at 1:53 PM Ivan Daschinsky > wrote: > > > Also, is there any clear information about KV api? Is there any plan to > > implement it? Or is there any prop

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
2021 г., 14:56 Pavel Tupitsyn : > Ivan, tuple serialization section added to the IEP, let me know if it is > clear enough. > > Thanks! > > On Thu, Jul 1, 2021 at 2:06 PM Ivan Daschinsky > wrote: > > > I can't find any description of tuple serialization in IEP, on

Re: Apache Ignite 2.11

2021-07-01 Thread Ivan Daschinsky
https://apache-ignite-binary-protocol-client.readthedocs.io/en/stable/ AFAIK, thin clients have been already removed since 2.10 чт, 1 июл. 2021 г., 15:57 Nikita Safonov : > Hi guys! > > Sorry, totally missed this email. > > I can do this right away. > > Just a couple of questions first: > > [1]

Re: Apache Ignite 2.11

2021-07-01 Thread Ivan Daschinsky
Binary prorocol description should stand and improved (there are some mistakes in this article) чт, 1 июл. 2021 г., 16:05 Ivan Daschinsky : > https://apache-ignite-binary-protocol-client.readthedocs.io/en/stable/ > > AFAIK, thin clients have been already removed since 2.10 > > чт

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
ction. > > > > As for me, these excercises with schema's doesn't worth a lot > > I'll add a benchmark and we'll see. > > > On Thu, Jul 1, 2021 at 3:17 PM Ivan Daschinsky > wrote: > > > I suppose, that there is not neccesary to write schema v

Re: Setting IGNITE_TO_STRING_INCLUDE_SENSITIVE=false prevents VM Arguments output

2021-07-01 Thread Ivan Daschinsky
I suppose, that all normal users should not suffer from this restrictions. Nobody will pass password using jvm options. It is absolutely insane, normal users pass passwords using environment variables. At least, we could just hide params that match specific pattern Ilya, go ahead, file ticket and

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
rate thread to discuss this? Or I can do this > a bit later. > > On Thu, Jul 1, 2021 at 4:41 PM Ivan Daschinsky > wrote: > > > > This is described in all operations that include multiple tuples. > > No it isn't, I have carefully read code and IEP, in you

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
lot чт, 1 июл. 2021 г., 17:50 Ivan Daschinsky : > > Here is the description of TUPLE_GET_ALL: > - UUID: table ID > - int: schema ID > - arr of arr: array of rows with values for all columns in given schema > > I suppose that we should describe this more verbose and explicit

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
out? > > Best Regards, > Igor > > > On Thu, Jul 1, 2021 at 5:52 PM Ivan Daschinsky > wrote: > > > > I agree. But this was decided before in IEP-54, and is out of scope for > > current IEP. > > Would you like to start a separate thread to discuss this? O

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
> > Ivan, what are extra serde steps you are talking about? > > > > Best Regards, > > Igor > > > > > > On Thu, Jul 1, 2021 at 5:52 PM Ivan Daschinsky > > wrote: > > > > > > I agree. But this was decided before in IEP-54, and is out of scop

Re: Setting IGNITE_TO_STRING_INCLUDE_SENSITIVE=false prevents VM Arguments output

2021-07-01 Thread Ivan Daschinsky
head, file ticket and prepare a PR. > > Please do not rush. Let's listen to other community members. This > question > > is about security and it should not be discussed in a hurry (even though > it > > looks like an obvious thing). > > > > Thanks, > > S.

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
27;colname' VARCHAR DEFAULT "abc"; > ) > INSERT INTO t1 VALUES(1) > > Actually, this will add a row (1, "abc") > > Your suggestion related to missed fields will not work this way as it is > impossible to distinct > case with 'null' value

Re: Setting IGNITE_TO_STRING_INCLUDE_SENSITIVE=false prevents VM Arguments output

2021-07-01 Thread Ivan Daschinsky
. I would still go with opt-in rather > than opt-out though, but I guess that is up to a discussion. > > -Val > > On Thu, Jul 1, 2021 at 9:29 AM Ivan Daschinsky > wrote: > > > This is security through obscurity, an obvious and a well-known anti > > pattern. I

Re: Setting IGNITE_TO_STRING_INCLUDE_SENSITIVE=false prevents VM Arguments output

2021-07-01 Thread Ivan Daschinsky
p to a discussion. > > > > -Val > > > > On Thu, Jul 1, 2021 at 9:29 AM Ivan Daschinsky > > wrote: > > > > > This is security through obscurity, an obvious and a well-known anti > > > pattern. I suppose that printing jvm options, that is registered

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
flexible > enough to allow other implementations for different languages and > platforms. > > -Val > > On Thu, Jul 1, 2021 at 9:38 AM Ivan Daschinsky > wrote: > > > Andrey, yep, you are right. This was just a quick idea. As for me, I just > > don't want

Re: Setting IGNITE_TO_STRING_INCLUDE_SENSITIVE=false prevents VM Arguments output

2021-07-01 Thread Ivan Daschinsky
GNITE_SQL_MERGE_TABLE_MAX_SIZE) are OK to appear in the logs. > > -Val > > On Thu, Jul 1, 2021 at 9:47 AM Ivan Daschinsky > wrote: > > > We can add add an extra param in annotation, that blocks param to be > > printed, just set it to false by default and block it wh

Re: IEP-76 Thin Client Protocol for Ignite 3.0

2021-07-01 Thread Ivan Daschinsky
> can be stored as blobs. So if you need a basic KV cache, you can always > create a table with two blob fields - one for key and one for value - and > store anything there. > > -Val > > On Thu, Jul 1, 2021 at 9:55 AM Ivan Daschinsky > wrote: > > > Val, am I right, t

Re: Ignite 3.0 Tuple API: how to check if value is null?

2021-07-05 Thread Ivan Daschinsky
Sorry, but what is wrong with simple method isNull() вт, 6 июл. 2021 г., 09:55 Pavel Tupitsyn : > Val, > > > I don't think there is a significantly better way > > of doing this in Java. > > Yep looks like there is no way to return two values without boxing. > No ref, no out, no value types. > > >

  1   2   3   4   5   >