sql Injection prevention in ignite

2017-08-21 Thread kotamrajuyashasvi
Hi Using PreparedStatement of JDBC we can avoid/prevent sql Injection. Does *SqlFieldsQuery.setArgs(..)* in ignite also have same functionality to prevent sql Injection or Are there any other ways to prevent sql Injection in ignite. -- View this message in context: http://apache-ignite-users.

Re: 2.1 new feature - warm up the cache / memory

2017-08-21 Thread kane
Hi Val, very appreciate you support, and one more question here. is there any data housekeeping for the file stored in on the disk ? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/2-1-new-feature-warm-up-the-cache-memory-tp16278p16323.html Sent from the Apache

2.1 PersistentStoreConfiguration is not configurable by spring injection

2017-08-21 Thread kane
Most of setter method of the properties in PersistentStoreConfiguration are returned as PersistentStoreConfiguration, which leads a spring injection error if we try to simply configure the properties of PersistentStoreConfiguration by doing the spring bean configure in the spring bean .xml config f

Re: 2.1 new feature - warm up the cache / memory

2017-08-21 Thread Alexey Kukushkin
Hi, The data is loaded by pages (somehow similar to file system's virtual memory). Persistence is transparent to all kinds of APIs - a page is loaded by Ignite when you get data from that page. If you really want to guarantee that the data your app is going to use are already in memory you might

Re: 2.1 PersistentStoreConfiguration is not configurable by spring injection

2017-08-21 Thread kane
I tried to customize the persistenceStorePath programmatically, but it seems not work. I cannot see any file created under the configured folder. could anyone pointing out if anything is wrong or what should be the right way to customize the persistence store path. the sample code is as well Ign

Re: docker external libs

2017-08-21 Thread Nikolai Tikhonov
Hello, I think in this case that the better way it to extend existing a docker image and add your libs by "ADD" command. On Thu, Aug 17, 2017 at 4:47 PM, luqmanahmad wrote: > Hi there, > > In docker deployment can we provide jars from our local system to > EXTERNAL_LIBS parameter. Let say we ha

Re: sql Injection prevention in ignite

2017-08-21 Thread Alexey Kukushkin
Hi, Yes, Ignite prevents SQL injection. Also, I think PreparedStatement is not about preventing you from SQL injection. PreparedStatement is about compiling a query so that it can be efficiently re-used if executed multiple times. What prevents form SQL injection is binding parameters instead of

Re: JDBC store Date deserialization problem

2017-08-21 Thread franck102
I understand for the store implementation, thanks. I have attached a sample project, simply run this test (Ignite and DB are embedded): ignite-binary-sample.zip org.apache.ignite.sample.test.ServerTests#load

Re: docker external libs

2017-08-21 Thread luqmanahmad
Thanks Nikolai for coming back. That's what I am doing and I needed one based on the centos anyway. So had to create one from scratch. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/docker-external-libs-tp16254p16330.html Sent from the Apache Ignite Users mailin

Re: JDBC store Date deserialization problem

2017-08-21 Thread franck102
BTW, if I remember correctly the server write -2 as a type ID because java.util.Date is not in this array: org.apache.ignite.internal.processors.query.QueryUtils#SQL_TYPES If I use java.sql.Date in the Ignite configuration I get a different exception (Wrong value has been set). Franck -- View

Re: docker external libs

2017-08-21 Thread Nikolai Tikhonov
Yes, you can easily to create your own image. As example you can look at Apache Ignite docker file [1]. 1. https://github.com/apache/ignite/blob/master/modules/docker/2.1.0/Dockerfile On Mon, Aug 21, 2017 at 1:31 PM, luqmanahmad wrote: > Thanks Nikolai for coming back. That's what I am doing an

Re: Failure to deserialize simple model object

2017-08-21 Thread franck102
Awesome, thanks! Franck -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Failure-to-deserialize-simple-model-object-tp15440p16333.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: 2.1 PersistentStoreConfiguration is not configurable by spring injection

2017-08-21 Thread slava.koptilin
Hi Kane, Could you please try the following example in order to set 'persistentStorePath' property? If you are trying to set an absolute path, you need to provide correct definition of pathname, which is system dependent. On UNIX syste

Re: Performance of persistent store too low when bulb-loading

2017-08-21 Thread dkarachentsev
Hi, The reason of slowdown might be the fact, that Ignite by default consumes 80% of available memory, which forces OS to start a lot of swapping, so all memory operations limited by disk speed. Try to reduce memory size [1]. [1] https://apacheignite.readme.io/v2.1/docs/memory-configuration#memor

RE: Strange problems with Ignite native Persistence when Data exceeds Memory

2017-08-21 Thread dkarachentsev
Hi Roger, The reason of slowdown might be the fact, that Ignite by default consumes 80% of available memory, which forces OS to start a lot of swapping, so all memory operations limited by disk speed. Try to reduce memory size [1]. [1] https://apacheignite.readme.io/v2.1/docs/memory-configuration

答复: 答复: problems in test ignite PersistentStore

2017-08-21 Thread 罗 辉
got it ,thank you Val, I got to have another try. 发件人: vkulichenko 发送时间: 2017年8月19日 1:54:11 收件人: user@ignite.apache.org 主题: Re: 答复: problems in test ignite PersistentStore You don't see anything in /ssd folder, because you provided it in PersistenceStoreConfigura

Re: IGFS With HDFS Configuration

2017-08-21 Thread Michael Cherkasov
Hi Pradeep, https://issues.apache.org/jira/browse/ZEPPELIN-2674 is resolved, Zeppelin 0.8 will be issued with ignite 2.0 support. Thanks, Mikhail. 2017-08-04 19:09 GMT+03:00 Mikhail Cherkasov : > Hi Pradeep, > > I can't run it with 1.9 too, however, the same config works fine with 2.0. > You c

Re: CacheAtomicityMode and CacheMode

2017-08-21 Thread dkarachentsev
Hi, 1. In most cases that exception might be thrown if cache store cannot be updated. Regularly even on unstable topology you won't get it, so the easiest would be to do putAll() with failed keys, it should be finished successfully. 2. By default memory shared across all caches, so you may check

Re: Activation: slow and: Ignite node crashed in the middle of checkpoint.

2017-08-21 Thread dkarachentsev
Hi, Please share full logs and thread dumps, it's hard to understand the root cause. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Activation-slow-and-Ignite-node-crashed-in-the-middle-of-checkpoint-tp16144p16341.html Sent from the Apache Ign

Re: Performance of persistent store too low when bulb-loading

2017-08-21 Thread dkarachentsev
Hi, Could you please take dstat, Ignite and GC logs and few thread dumps when application is experiencing slowdown? Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Performance-of-persistent-store-too-low-when-bulb-loading-tp16247p16342.html Sen

Re: CacheAtomicityMode and CacheMode

2017-08-21 Thread userx
Thanks Dmitry! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/CacheAtomicityMode-and-CacheMode-tp16313p16343.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Amazon AMI not available in a specific region

2017-08-21 Thread Nikolai Tikhonov
Hello, Yes, Apache Ignite doesn't provide straight forward way for it, but you can start Ignite nodes via yarn manually. For it you need to connect to master node and perform steps from this instruction: https://apacheignite.readme.io/docs/yarn-deployment On Tue, Aug 1, 2017 at 9:46 PM, raksja w

Re: Performance of persistent store too low when bulb-loading

2017-08-21 Thread dkarachentsev
Use this command for dstat: dstat -cmdgs --fs > dstat.txt Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Performance-of-persistent-store-too-low-when-bulb-loading-tp16247p16345.html Sent from the Apache Ignite Users mailing list archive at Nabb

ignite.active(true) blocking forever

2017-08-21 Thread userx
Hi all, *QUESTION:-Is there a way to timeOut the ignite.active(true) so that the client does not block forever and moves ahead for some other important processing ?* *OBSERVATIONS:-* I have a client(-Xms512m -Xmx512m) which is represented by the following piece of code package org.apache.ignite.

Re: getAsMap ??

2017-08-21 Thread dkarachentsev
Hi Chris, 1. Indexing may slowdown insertions, but in will not be used if no CacheConfiguration.setIndexedTypes() or CacheConfiguration.setQueryEntities() set. 2. It depends on conditions. If you have a lot of data, but you need to filter out a small set of them, then indexing may greatly help yo

Task Session (compute) API in Ignite .NET

2017-08-21 Thread davida
Hi All, I can't find compute grid's checkpoint functionality and FifoQueueCollisionSpi in .NET's version of Apache Ignite. Are there any plans to port this to .NET ? Thx -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Task-Session-compute-API-in-Ignite-NET-tp16

Re: Streaming test

2017-08-21 Thread vkulichenko
Jessie, If it's a preprocessing done on client side, then I think it should happen on application level. Do required preprocessing, convert to Ignite's data model and then do cache operations. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Streaming-test-

Re: JDBC store Date deserialization problem

2017-08-21 Thread vkulichenko
Franck, This looks like a bug, I will create tickets. For now your workaround looks like the best way to solve the issue. Create your own transformer that will convert java.sql.Date to java.util.Date, this will fix the issue. -Val -- View this message in context: http://apache-ignite-users.7

Re: Cluster segmentation

2017-08-21 Thread vkulichenko
Hi Biren, What is the use case and what are you trying to achieve by all this? First of all, there is a difference between node_left/failed and node_segmented events. The former is fired on nodes that are still in topology to notify that one of the nodes left or failed. But the latter means that

Re: Re: In which scenario the ignite nodes will shutdown by itself

2017-08-21 Thread aa...@tophold.com
hi All, we notice this cause by the backend DB issue for the JDBC cache store. So we have a concern, if the backend DB outline for while, will all those cached objects be stuck in heap memory. Possible those data swap to off-heap? when DB back then write back to DB? we already set the onhe

Re: 2.1 PersistentStoreConfiguration is not configurable by spring injection

2017-08-21 Thread kane
Hi Slava, It all works, thanks a lot. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/2-1-PersistentStoreConfiguration-is-not-configurable-by-spring-injection-tp16324p16354.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: JDBC store Date deserialization problem

2017-08-21 Thread franck102
Thanks Val! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/JDBC-store-Date-deserialization-problem-tp16276p16355.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Confused about QueryEntity configuration

2017-08-21 Thread Vasiliy Sisko
Hello @franck102 Please properly subscribe to the mailing list so that the community can receive email notifications for your messages. To subscribe, send empty email to user-subscr...@ignite.apache.org and follow simple instructions in the reply. 'empNo' field is a key field and is not included

Re: Confused about QueryEntity configuration

2017-08-21 Thread Vasiliy Sisko
I'm sorry. I found that you are subscribed but mail put your letter to spam -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Confused-about-QueryEntity-configuration-tp16281p16357.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.