Re: Regarding TRANSACTIONAL_SNAPSHOT

2020-09-04 Thread Denis Magda
Hi Dana,

Here you can find a list of known high-level limitations:
https://apacheignite.readme.io/docs/multiversion-concurrency-control#limitations

Also, the performance might not be satisfactory and not all the cluster
failure scenarios might be covered.

Generally, as of know, I would advise you to use the key-value transactions
of Ignite that are battle-tested and used in productions since the
inception of Ignite.

-
Denis


On Thu, Sep 3, 2020 at 6:41 AM danami  wrote:

> Roman Kondakov wrote
> > 1. TRANSACTIONAL_SNAPSHOT is still in beta version. Perhaps the current
> > version of MVCC will be completely redone in the future. So, it is not a
> > good idea to use it in production systems right now.
> >
> > 2. Events are not implemented for MVCC yet. As well as several other
> > features that presented in conventional TRANSACTIONAL cache:
> > interceptors, recovery, etc.
>
>
> Hi all,
>
> Can someone elaborate on the missing features of TRANSACTIONAL_SNAPSHOT
> cache mode or point me to some source of information that elaborates them?
>
> Are there any known bugs related to it in current Ignite version?
>
> Besides the possibility of it completely getting redone in the future, what
> would other major throwbacks be if it were used in production?
>
> Thank you very much,
> Dana
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>


ADODb recorsed and Ignite ODBC driver

2020-09-04 Thread selis
Hi,
I've tried to use AdoDB with ignite ODBC driver. 
Connect passed fine.
Insert operator for City  passed fine
Select * from City does not return Recordsed. Formally Fields properties are
filled fine but EOF BOF = True.
table  
If I try GetRows the error happen
"Either BOF or EOF is True, or the current record has been deleted.
Requested operation requires a current record."

I've tried different values for RecordSet.CursorType,
RecordSet.CursorLocation, but without success.

In Excel I can select this table througth ODBC connect.

Is it possible to use ADODb with Ignite odbc driver for Select?




--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/


Re: Lag before records are visible after transaction commit

2020-09-04 Thread Evgenii Zhuravlev
You can put the number of entries in B cache related to this object A right
in the object A. After that, you can use this number to make keys of all
objects from cache B, as you already know q and r. But it depends on use
case.

Evgenii

пт, 4 сент. 2020 г. в 03:21, ssansoy :

> Thanks Evgenii,
>
> Could you please elaborate a bit on how the get would work here.
>
> E.g. parent object A has properties p, q, r
> child object B has properties q, r, s, t
>
> {q, r, s} are the primary key of B (as defined in backing SQL table DDL
> which is how the cache was created)
>
> When an A update comes in with values p1, q1, r1, we were doing a select *
> from B where q=q1 and r=r1 which would return multiple records.
>
> Is there an equivalent using igniteCacheForB.get(key). What would key be
> here?
>
> Thanks
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>


Re: Increase the indexing speed while loading the cache from an RDBMS

2020-09-04 Thread Michael Cherkasov
>I've checked the RDBMS perf metrics. I do not see any spike in the CPU or
memory usage.
>Is there anything in particular that could cause a bottleneck from the DB
perspective ? The DB in use is a Postgres DB.

if you use cache store, each node will read the full table you want to
load, but only records which belong to a node will be saved(based on data
affinity), so Ignite will do N parallel read of the same table, where N is
number of nodes.
So if you have 50 nodes, then you should use data streamer, so one node
will read data and stream them to the cluster.
However if you have relatively small amount of nodes, it's fine to use
CacheStore to load data.

>Is there a sample/best practice reference code for Using Datastreamers to
directly query the DB to preload the cache ?
> My intention is to use Spring Data via IgniteRepositories. In order to
use an Ignite repository, I would have to preload the cache.
>And now, to preload the cache, I would have to query the DB. A bit of a
chicken and egg problem.
I would say, use JDBC and Ignite Data Streamer, it's one time action that
you don't need to repeat often, you can even java separate app to do this.

Thanks,
Mike.

чт, 27 авг. 2020 г. в 14:01, Srikanta Patanjali :

> Thanks Anton & Mikhail for your responses.
>
> I'll try to disable the WAL and test the cache preload performance. Also
> will execute a JFR to capture some info.
>
> @Mikhail I've checked the RDBMS perf metrics. I do not see any spike in
> the CPU or memory usage. Is there anything in particular that could cause a
> bottleneck from the DB perspective ? The DB in use is a Postgres DB.
>
> @Anton Is there a sample/best practice reference code for Using
> Datastreamers to directly query the DB to preload the cache ? My intention
> is to use Spring Data via IgniteRepositories. In order to use an Ignite
> repository, I would have to preload the cache. And now, to preload the
> cache, I would have to query the DB. A bit of a chicken and egg problem.
>
> Regards,
> Srikanta
>
> On Thu, Aug 27, 2020 at 7:54 PM Mikhail Cherkasov 
> wrote:
>
>> btw, might be bottleneck is your RDBMS, it can just stream data slowly,
>> slower then ignite can save, if make sense to check this version too.
>>
>> On Thu, Aug 27, 2020 at 10:46 AM akurbanov  wrote:
>>
>>> Hi,
>>>
>>> Which API are you using to load the entries and what is the node
>>> configuration? I would recommend to share the configs and try utilizing
>>> the
>>> data streamer.
>>>
>>> https://apacheignite.readme.io/docs/data-streamers
>>>
>>> I would recommend recording a JFR to find where the VM spends most time.
>>>
>>> Best regards,
>>> Anton
>>>
>>>
>>>
>>> --
>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>
>>
>>
>> --
>> Thanks,
>> Mikhail.
>>
>


Re: Preprocessing of data to use in Naive-Bayes

2020-09-04 Thread Igor Belyakov
Alexey,

Do you have any thoughts regarding that?

Igor

On Fri, Sep 4, 2020 at 10:03 AM Priya Yadav  wrote:

> Hi,
>
>
>
> Problem Statement: I have a feedback sentences having words separated by
> spaces like normal English sentences. Using these sentences I need to
> classify into categories based on some keywords. How should I preprocess my
> data in order to use it in Naive-Bayes.
>
> Any leads would be helpful.
>
> Thanks in advance.
>
>
> This email and any files transmitted with it are confidential, proprietary
> and intended solely for the individual or entity to whom they are
> addressed. If you have received this email in error please delete it
> immediately.
>


Re: Problems with Apache Ignite and PHP PDO

2020-09-04 Thread manueltg89
Hi Igor!

My Apache Ignite version is 2.8.1 and the PHP version is 7.3.21. I've
attached the PHP code.

Thanks! apache-ignite-pdo-code.txt

  



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/


Re: Problems with Apache Ignite and PHP PDO

2020-09-04 Thread Igor Belyakov
Can you provide SQL query and the code that you use for the prepared
statement creation? Which version of Ignite do you use?

Igor

On Thu, Sep 3, 2020 at 10:42 PM manueltg89 <
manuel.trinidad.gar...@hotmail.com> wrote:

> Hi!
> I have problems with my Apache Ignite app, the problem is the next:
>
> I have a field price with decimal precision, when I update from my PHP APP
> with PDO and bindParam function, Apache Ignite store other value, It
> doesn't happen always, only with any values, for example with: 1.85 or 1.86
> ... Apache Ignite store -0.57, -0.58 etc, but It doesn't happen for example
> with 2.85.
>
> I've checked with:
> $res->bindParam(':price', $price,PDO::PARAM_STR); and
> $res->bindParam(':price', $price);
> with same results.
>
> If I update with raw SQL without bindParam It works perfectly.
>
> Any suggestion?
>
> Thnaks un advance.
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>


RE: [External]Re: Private network setup for server nodes in ignite cluster

2020-09-04 Thread Kamlesh Joshi
Hi Ilya,

We have tried the setup by putting public ips for discoverySpi and private ips 
for CommunicationSpi.

Cluster is up and running but clients not able to connect cluster. IgniteVisor 
able to connect to cluster as it is on one of the server node, we are able to 
see clients connected to cluster in visor. But below error is getting at client 
side while connecting.

class org.apache.ignite.IgniteCheckedException: Failed to connect to node (is 
node still alive?). Make sure that each ComputeTask and cache Transaction has a 
timeout set in order to prevent parties from waiting forever in case of network 
issues [nodeId=51868027-53dc-47bc-9d47-b6ec77b9edf5, addrs=[/PRIVATEIP:47100]]
at 
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:3459)
at 
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createNioClient(TcpCommunicationSpi.java:2987)
at 
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2870)
at 
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:2713)

Below is the server config used while starting server nodes.

  












  






Thanks and Regards,
Kamlesh Joshi

From: Ilya Kasnacheev 
Sent: 18 August 2020 16:05
To: user@ignite.apache.org
Subject: [External]Re: Private network setup for server nodes in ignite cluster


The e-mail below is from an external source. Please do not open attachments or 
click links from an unknown or suspicious origin.
Hello!

You need to do setLocalHost(private IP) on all of your server nodes. Or use 
IGNITE_LOCAL_HOST system property/environment variable.

For client connector/REST/etc, you can specify public IP explicitly.

Regards,
--
Ilya Kasnacheev


вт, 18 авг. 2020 г. в 09:21, Trilok Joshi 
mailto:trilok.jo...@ril.com>>:
Hi,

We want to configure private network for server nodes in ignite cluster so that 
all communication among the server nodes happen using the network like 
handshake. And also clients will use different network to connect to the 
cluster and serving the requests

Could you please help us how to configure the cluster setup.

Regards,
Gangaiah

"Confidentiality Warning: This message and any attachments are intended only 
for the use of the intended recipient(s), are confidential and may be 
privileged. If you are not the intended recipient, you are hereby notified that 
any review, re-transmission, conversion to hard copy, copying, circulation or 
other use of this message and any attachments is strictly prohibited. If you 
are not the intended recipient, please notify the sender immediately by return 
email and delete this message and any attachments from your system.

Virus Warning: Although the company has taken reasonable precautions to ensure 
no viruses are present in this email. The company cannot accept responsibility 
for any loss or damage arising from the use of this email or attachment."
"Confidentiality Warning: This message and any attachments are intended only 
for the use of the intended recipient(s). 
are confidential and may be privileged. If you are not the intended recipient. 
you are hereby notified that any 
review. re-transmission. conversion to hard copy. copying. circulation or other 
use of this message and any attachments is 
strictly prohibited. If you are not the intended recipient. please notify the 
sender immediately by return email. 
and delete this message and any attachments from your system.

Virus Warning: Although the company has taken reasonable precautions to ensure 
no viruses are present in this email. 
The company cannot accept responsibility for any loss or damage arising from 
the use of this email or attachment."


Re: Lag before records are visible after transaction commit

2020-09-04 Thread ssansoy
Thanks Evgenii,

Could you please elaborate a bit on how the get would work here.

E.g. parent object A has properties p, q, r
child object B has properties q, r, s, t

{q, r, s} are the primary key of B (as defined in backing SQL table DDL
which is how the cache was created)

When an A update comes in with values p1, q1, r1, we were doing a select *
from B where q=q1 and r=r1 which would return multiple records.

Is there an equivalent using igniteCacheForB.get(key). What would key be
here?

Thanks



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/


Preprocessing of data to use in Naive-Bayes

2020-09-04 Thread Priya Yadav
Hi,


Problem Statement: I have a feedback sentences having words separated by spaces 
like normal English sentences. Using these sentences I need to classify into 
categories based on some keywords. How should I preprocess my data in order to 
use it in Naive-Bayes.

Any leads would be helpful.

Thanks in advance.

This email and any files transmitted with it are confidential, proprietary and 
intended solely for the individual or entity to whom they are addressed. If you 
have received this email in error please delete it immediately.