Re: Pecuilar loopback address on Mac seems to break cluster of linux and mac....

2016-04-14 Thread Denis Magda
Kristian, According to the sources UnknownHostException should have been processed gracefully and discovery SPI should have been used the next host address trying to connect to it. Do you turn on DEBUG logging level to see this exception (could you attach the full log)? Isn’t the Linux node tr

Re: link cache to object class?

2016-04-14 Thread Denis Magda
I'm not sure I understand you properly. However in any case you can use a code block like the one below to get an instance of a cache related to a specific class String cacheName = object.getClass().getSimpleName().toLowerCase(); IgniteCache cache = ignite.cache(cacheName); The caches have to b

Re: Pecuilar loopback address on Mac seems to break cluster of linux and mac....

2016-04-14 Thread Denis Magda
Hi Kristian, Thanks for reporting on this. I've opened in issue in Apache Ignite JIRA https://issues.apache.org/jira/browse/IGNITE-3011 As a workaround as you already noted you can set -Djava.net.preferIPv4Stack=true to JVM upon startup. Other solution that may work in your case is to set a hos

Re: multiple value key

2016-04-14 Thread vkulichenko
Yes, what IDE generates should be fine. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/multiple-value-key-tp4138p4209.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Transactional SQL queries

2016-04-14 Thread vkulichenko
Hi Colin, This is not possible, transactional guarantees are fully supported only for key-based access. This is something that we have on the roadmap, but I don't think that it will be available very soon. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Tr

Transactional SQL queries

2016-04-14 Thread colinc
Is it possible for SQL queries to participate in Ignite transactions in the same way that cache get/put operations do? So far, I've not managed to get them to do so. For example, an optimistic/serializable transaction around a query (and with a concurrent put in another transaction) doesn't throw

Re: multiple value key

2016-04-14 Thread tomk
Ok, so loading data into cache from database may be done in *arbitrary* way, -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/multiple-value-key-tp4138p4205.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: re: querying, sql performance of apache ignite

2016-04-14 Thread vkulichenko
Responded in [1]. Let's continue the discussion there. [1] http://apache-ignite-users.70518.x6.nabble.com/multiple-value-key-td4138.html -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/querying-sql-performance-of-apache-ignite-tp4135p4204.html Sent from th

Re: multiple value key

2016-04-14 Thread vkulichenko
You can use loadCache method to load any set of data from the DB. It takes optional list of arguments that you can use to parametrize the loading process (e.g., use them to provide time bounds and query the DB based on these bounds). You can load based on any criteria, there are no limitation and

Re: Database transaction updating more than 1 table from CacheStore

2016-04-14 Thread vkulichenko
Hi Binti, Can you please properly subscribe to the mailing list so that the community can receive email notifications? Here is the instruction: http://apache-ignite-users.70518.x6.nabble.com/mailing_list/MailingListOptions.jtp?forum=1 bintisepaha wrote > We have a use case where multiple databas

Re: UPDATE sql query in ignite

2016-04-14 Thread vkulichenko
SQL updates are not supported. To update two entries atomically you can do this within a single transaction. But note that to do this, caches have to work in TRANSACTIONAL atomicity mode. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/UPDATE-sql-query-in-i

Re: do you support json based cache?

2016-04-14 Thread vkulichenko
Can you store in binary format and convert to JSON and back when needed? Is there any particular reason to *store* the data in JSON format? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/do-you-support-json-based-cache-tp4160p4200.html Sent from the Apache

Re: how to connect hibernate database to fetch and put data in ocnfiguration.xml

2016-04-14 Thread vkulichenko
Ravi, Ignite uses Spring for configuration, so you can add any beans in the configuration file and use them in your application code. So the answer to all the questions is YES, but if you need to integrate the database with Ignite, you should use persistence store. -Val -- View this message in

Re: UPDATE sql query in ignite

2016-04-14 Thread tusharnakra
No, I know that. I want to know if we can use UPDATE sql query with ignite or not? Because, I want to do something like this: I have a table each in 2 different cache, I want to update some column entry in one table as well as cache by performing cross-cache sqlqueryfield join. How do I do that?

Re: multiple value key

2016-04-14 Thread tomk
I mean following situtation: my key is integer and timestamp. Now, using SELECT * FROM ... WHERE timestamp IS BETWEEN (A, B) AND integer IN {1,2} (it is only pseudocode) It loads into cache ignite entire data with integer key = 1;2 and timestamp from interval (A,B) ANd now, having this double va

Re: Ignite Services and Data Collocation

2016-04-14 Thread Kamal C
Thanks for your quick response Val! I'll test throughly and update here. --Kamal On Thu, Apr 14, 2016 at 11:57 PM, vkulichenko wrote: > Kamal, > > I'm not sure I understood what you're trying to achieve. When you use cache > API, all affinity mappings are done automatically, so you don't need

Re: How to load 2 tables in a cache

2016-04-14 Thread vkulichenko
Hi, Is it possible for you to create a small GitHub project that will reproduce the issue and share it with us? I'm a bit lost in the amounts of code that you copy-pasted here :) -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-load-2-tables-in-a-cac

Re: re: querying, sql performance of apache ignite

2016-04-14 Thread tomk
I think that I unclearly showed my case: 1. I have timestamp, something of form: 2001-01-21-21:31:12.121. Now I am going to set it as key. Tell me, Will it be possible to load cache all rows with timestamp from 2000 year to 2001 ? We know, that given the fact that key is timestamp then get('2001-0

Re: Ignite Services and Data Collocation

2016-04-14 Thread vkulichenko
Kamal, I'm not sure I understood what you're trying to achieve. When you use cache API, all affinity mappings are done automatically, so you don't need to worry about this. In your particular case, the client is not aware of affinity and essentially sends a request to a random node, so the cache u

Re: how to connect hibernate database to fetch and put data in ocnfiguration.xml

2016-04-14 Thread Ravi kumar Puri
No this is not the thing that i was looking for! Just answer three things is it possible 1 . Can i get the hibernate database connection url,username n paserd in ur ignite-config.xnl ? 2. Will i beable to retreive the data from database using above configurTion ? 3. Wil i be able to use the same

Re: How to configure user data type for sql queries?

2016-04-14 Thread vkulichenko
Kamal, Generally, binary format is recommended for all use cases. OptimizedMarshaller implements legacy serialization format, it's also compact and efficient, but requires to have classes on all nodes and do not support dynamic schema changes. If there are any limitations in binary format, most li

Re: Ignite Data Grid with write through mode to HDFS with layer of IGFS

2016-04-14 Thread vijayendra bhati
Hi Vladimir,Not really, we do not want to store historical data in cache or may be cache it for few hours and then evict it.But if recent data is missing in cache then yes we want to cache it.So it would require some custom caching logic to decide which data to cache.So seems like storing histor

Re: re: querying, sql performance of apache ignite

2016-04-14 Thread vkulichenko
1. Yes, this is possible. 2. In a key-value storage, each entry has to have unique key. Entries with the equal keys will overwrite each other. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/querying-sql-performance-of-apache-ignite-tp4135p4188.html Sent fr

Re: do you support json based cache?

2016-04-14 Thread Ravi kumar Puri
I want to cache the json formated object data of a class into ignite cache as json parameter and able to retrieve individual attributes from json cached data. Same i need to update the cache as new data wil come into my json data On 14-Apr-2016 23:42, "vkulichenko" wrote: > Hi Ravi, > > What ki

Re: Off-heap memory usage questions

2016-04-14 Thread vkulichenko
Hi Shaomin, 1. Yes, this is a per node setting. So if there are two nodes on one box, it's possible that 20G will be allocated on this box. You should make sure that this limit correlates with the amount of physical memory you have. 2. In 1.5. IgniteCache.metrics() return values for local node onl

Re: multiple value key

2016-04-14 Thread vkulichenko
What do you mean by "partially defined key"? Can you provide an example? Generally, you can query by any field(s) that can reside in both key and value objects. Answer on the second question is yes (assuming that you have enough memory to hold the data, of course). -Val -- View this message in

Re: Passing argument in sql query under where clause giving error

2016-04-14 Thread vkulichenko
No, SQL is read-only now. Support for UPDATE and INSERT statements is on the roadmap, though. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Passing-argument-in-sql-query-under-where-clause-giving-error-tp4164p4184.html Sent from the Apache Ignite Users ma

Re: how to connect hibernate database to fetch and put data in ocnfiguration.xml

2016-04-14 Thread vkulichenko
Ravi, This can be achieved with persistence store [1]. You can use loadCache() for bulk loading or warming up the cache, or utilize read-through. Is this what you're looking for? [1] https://apacheignite.readme.io/docs/persistent-store -Val -- View this message in context: http://apache-ign

Re: do you support json based cache?

2016-04-14 Thread vkulichenko
Hi Ravi, What kind of support are you looking for? Can you describe the use case? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/do-you-support-json-based-cache-tp4160p4182.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: UPDATE sql query in ignite

2016-04-14 Thread pgarg
To update the database, you need to implement CacheStore.write() and enable writeThrough mode of CacheConfiguration. CacheStore.write() method is called whenever IgniteCache.put() method is called. See Cache Store section of Persistent Store documentation[1] for more information and example code.

UPDATE sql query in ignite

2016-04-14 Thread tusharnakra
Hi, Can we use UPDATE SQL query in ignite cache to update the cache and then write the update back to the database?? I have the following method: private static void queryChange() { IgniteCache, Person> cache = Ignition.ignite().cache("PCache"); // Execute query to get

Re: Passing argument in sql query under where clause giving error

2016-04-14 Thread tusharnakra
Is is possible to use update sql queries in ignite?? I have the following method: private static void queryChange() { IgniteCache, Person> cache = Ignition.ignite().cache("PCache"); // Execute query to get names of all employees. String sql = "update

Ignite Services and Data Collocation

2016-04-14 Thread Kamal C
Hi all, I've a cluster of 2 ignite server nodes + 1 client node (non-ignite). I've collocated the data resides in ignite cache based on affinity key. e.g. Server 1 - contains all the data related to the affinity key (A, C, E) Server 2 - contains all the data related to the affinity key (B, D,

Re: How to configure user data type for sql queries?

2016-04-14 Thread Kamal C
Val, Can you explain with use-case when to use Binary, Optimized, GridOptimized and JDK Marshallers ? --Kamal On Tue, Apr 5, 2016 at 3:41 AM, edwardkblk wrote: > Yes, it works with OptimizedMarshaller. Thank you. > > > > -- > View this message in context: > http://apache-ignite-users.70518.x6

Re: Passing argument in sql query under where clause giving error

2016-04-14 Thread tusharnakra
Thanks it works now! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Passing-argument-in-sql-query-under-where-clause-giving-error-tp4164p4176.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: How to load 2 tables in a cache

2016-04-14 Thread tusharnakra
[09:35:06,774][ERROR][main][GridMapQueryExecutor] Failed to execute local query: GridQueryRequest [reqId=1, pageSize=1024, space=PCache, qrys=[GridCacheSqlQuery [qry=SELECT "PCache".PERSON._KEY __C0, "PCache".PERSON._VAL __C1 FROM "PCache".PERSON WHERE (SALARY > ?1) AND (SALARY <= ?2), params=[0, 1

Re: Passing argument in sql query under where clause giving error

2016-04-14 Thread Alexey Kuznetsov
Just download nightly build https://builds.apache.org/view/H-L/view/Ignite/job/Ignite-nightly/lastSuccessfulBuild/ Start Schema Import Utility and re-generate POJOs and configs. On Thu, Apr 14, 2016 at 9:44 PM, tusharnakra wrote: > Is there any quick fix? What changes do I need to make in my Ja

Re: Passing argument in sql query under where clause giving error

2016-04-14 Thread tusharnakra
Is there any quick fix? What changes do I need to make in my Java code to fix this error? Or do I just need to download the enterprise 7.5.9 (I'm currently using 7.5.8) and use its schema-import-utility?? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Passing-ar

Re: Passing argument in sql query under where clause giving error

2016-04-14 Thread Alexey Kuznetsov
I also had error like this recently. After investigation I found that there was a bug in Schema Import Utility - it generate XML / Java for QueryEntites using primitives in fields description. I solved my issue by changing all int to Integer (and other primitives too) in all QueryEntities. Also I

Re: Ignite Data Grid with write through mode to HDFS with layer of IGFS

2016-04-14 Thread tomk
Could you tell more about it ? How to do it ? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Data-Grid-with-write-through-mode-to-HDFS-with-layer-of-IGFS-tp4122p4171.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: spark and ignite - possibilities

2016-04-14 Thread tomk
Could you tell how to do it ? Thriftserver may read data from filesystem (for example parquets files) -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/spark-and-ignite-possibilities-tp4055p4170.html Sent from the Apache Ignite Users mailing list archive at Nabble.

Re: multiple value key

2016-04-14 Thread tomk
So the conclusion is: Each sql query can fastly be done on ignite cache memory (but not through). Is it possible to query by partially defined key ? I would like be able to load data into memory (cahce ignite) by partially defined key. The second question: Lets assume that my key is timestamp. Ca

Re: re: querying, sql performance of apache ignite

2016-04-14 Thread tomk
Try to reply to my: 1. When my key is timestamp. Ii it possible to load to cache memory all rows from year 2000 to year 2012 ? 2. When my key is timestamp and id (Integer). Is it possible to load load to cache memory all rows from year 2000 to year 2012 ? Note, that I don't set value of key id (onl

Re: spark and ignite - possibilities

2016-04-14 Thread Vladimir Ozerov
IGFS is a Hadoop-compatible file-system. If ThriftServer doesn't have strong dependencies on some HDFS-specific features, then yes - it could be used instead of HDFS. Could you please provide more detailed explanation of your use case with ThriftServer? On Wed, Apr 13, 2016 at 3:17 PM, tomk wrot

Re: Ignite Data Grid with write through mode to HDFS with layer of IGFS

2016-04-14 Thread Vladimir Ozerov
Hi Vij, Storing hot recent data in cache, and historical data in persistent store sounds like a perfectly reasonable idea. If you decide to store historical data in HDFS, then you should be able to construct HDFS path from the key because store interface accepts keys to store/load data. If this i

Re: How to load 2 tables in a cache

2016-04-14 Thread Vladimir Ozerov
Could you please provide more detailed error description and its stack trace? On Wed, Apr 13, 2016 at 7:03 PM, tusharnakra wrote: > OK, UPDATE: > > This method is working, but how do I add setArgs (I mean, I want to pass > the > argument for orgname as "Ignite" i.e. to only print person names in

Passing argument in sql query under where clause giving error

2016-04-14 Thread tusharnakra
Hi, I'm trying to execute the cross-cache sql fields query with join and it executes fine as long as I don't do setArgs and pass an argument, when I need to pass an argument with the where clause, then it gives error: Failed to execute local query: GridQueryRequest [reqId=1, pageSize=1024, space=P

Off-heap memory usage questions

2016-04-14 Thread Shaomin Zhang
Hi I am trying to use OFFHEAP_TIERED caches, and have this setting for the memory , virtual memory is disenabled. I have a couple questions: 1. Does this mean that 10G off-heap memory is allocated for each cache? If I have two Ignite instances on a single hard node, 20G will be allocated? What

Re: Ignite Data Grid with write through mode to HDFS with layer of IGFS

2016-04-14 Thread vijayendra bhati
Thanks Vladimir !! The drawback with using HDFS as persistent store behind Ignite cache is how we will take care of appending single key value pair to HDFS file.Ideally we should use some NoSQL store or RDBMS as persistent back up behind Ignite cache and then run some scheduled batch to transfer

Re: do you support json based cache?

2016-04-14 Thread Alexey Kuznetsov
Hi, Ravi! Not yet, but we have an issue for that https://issues.apache.org/jira/browse/IGNITE-962 You can track it JIRA. On Thu, Apr 14, 2016 at 6:20 PM, Ravi Puri wrote: > I want to know do you support json based data to be cached and > implemnented? > > > > -- > View this message in context:

do you support json based cache?

2016-04-14 Thread Ravi Puri
I want to know do you support json based data to be cached and implemnented? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/do-you-support-json-based-cache-tp4160.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

how to connect hibernate database to fetch and put data in ocnfiguration.xml

2016-04-14 Thread Ravi Puri
i want to connect my sql hibernate database in your ignite.xml and once the configuration is loaded it should be automatically connected to database. is there any option so that i can fetch the data from database (which is already defined in configuration ignite.xml ) and retrieve it at client sid

C++ Distributed cache for caching files

2016-04-14 Thread rajs123
Hi, In my current program, I frequently need multiple files. Those files are currently loaded in NFS server and I access files through that. I want to move to a distributed system, where there are multiple machines and files will be distributed in cache of those machines. Is there any way to do t

Re: how to check whether server and client connected?

2016-04-14 Thread Denis Magda
Ravi, To connect from a client to the cluster consisting of server nodes you need to provide the client node with a list of server nodes addresses through IP finder. Please refer to this doc https://apacheignite.readme.io/docs/cluster-config#static-ip-based-discovery — Denis > On Apr 13, 2016

Pecuilar loopback address on Mac seems to break cluster of linux and mac....

2016-04-14 Thread Kristian Rosenvold
I was seeing quite substantial instabilities in my newly configured 1.5.0 cluster, where messages like this would pop up, resulting in the termination of the node.: java.net.UnknownHostException: no such interface lo at java.net.Inet6Address.initstr(Inet6Address.java:487) ~[na:1.8.0_60] at java.ne

Re: Ignite: ERROR: Java classpath is empty

2016-04-14 Thread rajs123
Hi. I had posted the same question on stack overflow. Resolved. Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-ERROR-Java-classpath-is-empty-tp4118p4155.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

re: problem of using object as key in cache configurations

2016-04-14 Thread Zhengqingzheng
You are right Val, I did not read all the examples. Hopefully problem solved. Cheers, Kevin -邮件原件- 发件人: vkulichenko [mailto:valentin.kuliche...@gmail.com] 发送时间: 2016年4月14日 14:34 收件人: user@ignite.apache.org 主题: Re: problem of using object as key in cache configurations We already have su