Re: Cache Memory Behavior \ GridDhtLocalPartition

2016-11-09 Thread Isaeed Mohanna
Hi My cache configurations appear below. // Cache 1 - a cache of ~15 entities that has a date stamp that is updated every 30 - 120 seconds CacheConfiguration Cache1Cfg = new CacheConfiguration<>(); Cache1Cfg cheCfg.setName("Cache1Name"); Cache1Cfg .setCacheMode(CacheMode.REPLICATED); Cache1Cfg

Re: IN Query

2016-11-09 Thread Anil
HI Val, I was trying to do following select * from Person p where p.id in ('1', '3') OR name in ('name0', 'name1') order by id both id and name fields are indexed. As IN query does not use index as per http://apacheignite.gridgain.org/docs/sql-queries#performance-and-usability-considerations

Re: How many nodes within your ignite cluster

2016-11-09 Thread Duke Dai
Thanks for your comment, there are a lot of tunings and testings before knowing whether 100 nodes are OK. Another question, one of 4 nodes failed why all other 3 nodes also fail instead of working continuously? Any configuration to control the behavior? -- View this message in context:

server node is java , and client is c++, client can't access the server ?

2016-11-09 Thread smile
Yes, because I was mistakenly submitted this email yesterday, And please tell how to solve this question: http://apache-ignite-users.70518.x6.nabble.com/server-node-is-java-and-client-is-c-client-can-t-join-cluster-td8825.html -- Original -- From:

Re: Ignite JDBC Driver -> JDBC Connection Pool

2016-11-09 Thread Victor Chan
When C3P0 attempts to create a new connection pool, it first tries to set the isolation level for each transaction through the connection provided by the JDBC driver. At this point, when the method getTransactionIsolation() is called on the Connection, the Ignite driver throws the

Hive job submsiion failed with exception ”java.io.UTFDataFormatException“

2016-11-09 Thread lapalette
Hi,there is a error when i run TPC-DS testsets on ignite-enhanced hive2.0 over hadoop2.6.0, and here is the log: java.io.IOException: Failed to submit job. at org.apache.ignite.internal.processors.hadoop.proto.HadoopClientProtocol.submitJob(HadoopClientProtocol.java:128) at

Re: Kafka - Failed to stream a record with null key

2016-11-09 Thread Roman Shtykh
I will add the functionality to transform Kafka values. Please follow it on Jira. -Roman On Wednesday, November 9, 2016 8:27 PM, vdpyatkov wrote: Hi, In my view, you try to do something strange. You have got exception at compile time, how are you want assign

Upcoming Webinar About Apache Ignite SQL Engine

2016-11-09 Thread Denis Magda
Igniters, The next week I’ll be conducting the webinar about Apache Ignite SQL Engine https://www.gridgain.com/resources/webinars/distributed-memory-sql-queries-apacher-ignitetm I thought that it

Re: Ignite JDBC Driver -> JDBC Connection Pool

2016-11-09 Thread Denis Magda
There is a ticket to introduce the transactional support for the JDBC driver. https://issues.apache.org/jira/browse/IGNITE-4191 Hope this will be implemented in the beginning of the next year. — Denis > On Nov 9, 2016, at 2:01 PM,

Re: [EXTERNAL] Re: Query on using Ignite as persistence data and processing layer

2016-11-09 Thread vkulichenko
No, this is not available yet. Here is the corresponding ticket: https://issues.apache.org/jira/browse/IGNITE-961 -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Query-on-using-Ignite-as-persistence-data-and-processing-layer-tp8775p8858.html Sent from the

Re: Problem with v for listening updates

2016-11-09 Thread vkulichenko
Yes, that's what I got. I just copy-pasted the code and ran it without any changes. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Problem-with-Continuous-query-for-listening-updates-tp8709p8857.html Sent from the Apache Ignite Users mailing list archive

Re: Very high memory consumption in apache ignite

2016-11-09 Thread vkulichenko
Data is consumed not only by data, but by JVM in total, so it's hard to tell. If you don't have any issues associated with this, then most likely these are mostly temporary objects that will be eventually garbage collected. If you have any concerns, I would recommend to grab a heap dump and check

Re: server node is java , and client is c++, client can't access the server ?

2016-11-09 Thread vkulichenko
This thread is a duplicate of this one: http://apache-ignite-users.70518.x6.nabble.com/server-node-is-java-and-client-is-c-client-can-t-join-cluster-td8825.html -- View this message in context:

Re: Requirements to Inspect a 'local' Apache Ignite Cache with h2 Console

2016-11-09 Thread vkulichenko
On the high level, H2 works only with the query itself - parses it, creates execution plan and goes through the execution flow. Indexes and data storage are both part of Ignite and H2 uses them when needed. -Val -- View this message in context:

Re: Swap space

2016-11-09 Thread vkulichenko
Can you clarify what you mean by "i can swap folders but no files"? Are there any errors? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Swap-space-tp8156p8853.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Requirements to Inspect a 'local' Apache Ignite Cache with h2 Console

2016-11-09 Thread techbysample
Val, Hi, Thank very much for the clarification.. The Ignite documentation I have read as well as information received from webinars imply that H2 provides the 'in memory storage' for Ignite. If possible, will you provide additional information on how H2 participates with Ignite cache? Please

Re: Multiple servers in a Ignite Cluster

2016-11-09 Thread Tracyl
Thanks. Works fine now. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Multiple-servers-in-a-Ignite-Cluster-tp8840p8851.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: ignite-spring conflict

2016-11-09 Thread vkulichenko
What version of Spring do you use? Ignite depends on 4.1.0 and if they are different, then this can be the reason for such behavior. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/ignite-spring-conflict-tp8837p8850.html Sent from the Apache Ignite Users

Re: Ignite JDBC Driver -> JDBC Connection Pool

2016-11-09 Thread vkulichenko
Transactions are not supported because updates are not supported. However, I'm not sure I understand why transactions are required by C3PO in read-only scenarios. Do you have any idea how it tries to use transactions in this case? -Val -- View this message in context:

Re: Requirements to Inspect a 'local' Apache Ignite Cache with h2 Console

2016-11-09 Thread vkulichenko
Hi, Data is already stored in Ignite caches, outside of H2. H2 only maintains the query execution flow and interacts with caches to get the data. Therefore if you don't configure SQL, H2 does not participate at all. -Val -- View this message in context:

Inspecting a 'local' Apache Ignite Cache with h2 Console

2016-11-09 Thread techbysample
Forum, I have been reviewing the examples that come with Apache Ignite 1.5 and have the following question: Given the excerpt (ie; adapted from 'CachePutGetExample'), I notice that without the 'cfg.setIndexedTypes(Integer.class, String.class);' call, Ignite will NOT create 'String' table

Ignite JDBC Driver -> JDBC Connection Pool

2016-11-09 Thread Victor Chan
Hi Ignite community, I'm making the switch from SparkSQL to Ignite, but I noticed the Ignite JDBC driver doesn't seem to support any transactions at all. As a result, I've been having some difficulty setting up a connection pool. I've tried with C3P0 and HikariCP, but again due to the driver not

Re: Multiple servers in a Ignite Cluster

2016-11-09 Thread Vladislav Pyatkov
HI, It will not always. Discovery SPI responsible for this process. It will be may TcpDiscoveryMulticastIpFinder[1] (any node with same configuration and starts in same network will be joined) or TcpDiscoveryVmIpFinder[2] (only nodes with specific IP will be joined) or any other. [1]:

Re: Multiple servers in a Ignite Cluster

2016-11-09 Thread Tracyl
Thanks. In that case, my question is how to define the scope of cluster(Or how to specify the cluster a server belongs to)? I assume if someone else start a ignite node, would my ignite server auto-discover it as well? -- View this message in context:

Re: Multiple servers in a Ignite Cluster

2016-11-09 Thread Vladislav Pyatkov
Hi Tracyl, You are need to start each Ignite service separately. But you always can do it over ssh using simple bash script. On Wed, Nov 9, 2016 at 6:55 PM, Tracyl wrote: > I have following ignite config: > > def initializeIgniteConfig() = { > val ipFinder = new

Re: How can I obtain a list of executing jobs on an ignite node

2016-11-09 Thread Alexey Kuznetsov
Hi Vinay, I think IgniteCompute.activeTaskFutures() will give you map of active tasks. And you may iterate over that map and cancel that tasks. But you should do it on all nodes with tasks, because in javadoc I see "Gets tasks future for active tasks started on local node." /** * Gets tasks

How can I obtain a list of executing jobs on an ignite node

2016-11-09 Thread Vinay B,
Could someone point me to the applicable API that can return a list of executing jobs on an ignite node? Additionally, given a list of executing jobs, I would like to be able to cancel selected jobs. What is the API I should be looking at? Thanks in advance

Multiple servers in a Ignite Cluster

2016-11-09 Thread Tracyl
I have following ignite config: def initializeIgniteConfig() = { val ipFinder = new TcpDiscoveryVmIpFinder() val HOST = "xx.xx.xx.xx:47500..47509" ipFinder.setAddresses(Collections.singletonList(HOST)) val discoverySpi = new TcpDiscoverySpi()

Re: Cache Memory Behavior \ GridDhtLocalPartition

2016-11-09 Thread Andrey Mashenkov
Hi Isaeed Mohanna, Would you please provide your cache configurations? On Wed, Nov 9, 2016 at 5:37 PM, Isaeed Mohanna wrote: > Hi > i have an ignite 1.7.0 cluster with 3 nodes running , i have 3 PARTITIONED > ATOMIC CACHES and 2 REPLICATED ATOMIC CACHES, Most of these caches

One server node seems to hang onto heap memory after clear

2016-11-09 Thread styriver
Hello Created a load test where we had two server nodes in our topology and loaded with 10 gig of data. After loading to the point where off heap max was reached we issued a clear and emptied the cache. Verified that off heap entry counts were set back to zero on both our servers. The heap cleared

ignite-spring conflict

2016-11-09 Thread ewg
I am very very new with Apach Ignite :) I will apreciate If someone can point me to a right direction with the problem I am getting in my project. In my project we use Spring quite heavily, but as soon as I add ignite-spring dependency to the project it starts to fail with following exception:

Re: DataStreamer is closed

2016-11-09 Thread Anil
Would there be any issues because of size of data ? i loaded around 80 gb on 4 node cluster. each node is of 8 CPU and 32 GB RAM configuration. and cache configuration - CacheConfiguration pConfig = new CacheConfiguration(); pConfig.setName("Person_Cache");

Cache Memory Behavior \ GridDhtLocalPartition

2016-11-09 Thread Isaeed Mohanna
Hi i have an ignite 1.7.0 cluster with 3 nodes running , i have 3 PARTITIONED ATOMIC CACHES and 2 REPLICATED ATOMIC CACHES, Most of these caches are populated with events data, so each cache entry is short lived its inserted, processed later by some task and removed. so the caches are pretty much

Re: DataStreamer is closed

2016-11-09 Thread Anil
HI, Data streamer closed exception is very frequent. I did not see any explicit errors/exception about data streamer close. the excption i see only when message is getting added. I have 4 node ignite cluster and each node have consumer to connection and push the message received to streamer.

Re: Null column values - bug

2016-11-09 Thread Anil
Thanks. On 9 November 2016 at 17:27, vdpyatkov wrote: > Hi Anil, > > You should not to pay attention on version warning message in nightly build > or manual build version. Because the message is right only for versions > which already released (this is simple comparison

Re: Swap space

2016-11-09 Thread Anil
Hi Vladislav, i was trying swap space and see it is not working in unix but my test program worked on windows. i can swap folders but no files. Did you see any issue in the below configuration ? CacheConfiguration pConfig = new CacheConfiguration

Re: java.lang.ClassNotFoundException: Failed to peer load class

2016-11-09 Thread alex
sorry for that. last post not add to mailing list. So I post it again and subscribe to mailing list. And the new one give more detail information. Thank for replying @vdpyatkov -- View this message in context:

Re: SQLQuery

2016-11-09 Thread devis76
Hi, thank you very much -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/SQLQuery-tp8785p8830.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Question: When to use CacheConfiguration.setIndexedTypes()?

2016-11-09 Thread techbysample
Forum, Thank you! Regards, techbysample -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Question-When-to-use-CacheConfiguration-setIndexedTypes-tp8721p8829.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: [EXTERNAL] Re: Class objects are fetched as string when JDBC api is used

2016-11-09 Thread vdpyatkov
Hi, Difficult understand what are you meant. Could you please provide full working example? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Class-objects-are-fetched-as-string-when-JDBC-api-is-used-tp8720p8828.html Sent from the Apache Ignite Users mailing list

Re: Null column values - bug

2016-11-09 Thread vdpyatkov
Hi Anil, You should not to pay attention on version warning message in nightly build or manual build version. Because the message is right only for versions which already released (this is simple comparison with last released version on this site http://ignite.run/update_status_ignite.php). When

server node is java , and client is c++, client can't join cluster

2016-11-09 Thread smile
Hi, all when I start one c++ server node, and then start java server node, which successfully joins in the cluster, and finally when I start one c++ client node, then I have find that the c++ client can't join the cluster, in the java server node throw exception as follow: log4j:WARN

Re: Kafka - Failed to stream a record with null key

2016-11-09 Thread vdpyatkov
Hi, In my view, you try to do something strange. You have got exception at compile time, how are you want assign new reference onto return value? Please, create a ticket on Ignite Jira[1], as Roman said. [1]: https://issues.apache.org/jira/browse/IGNITE -- View this message in context:

server node is java , and client is c++, client can't access the server ?

2016-11-09 Thread smile
Hi, all when I start one c++ server node, and then start java server node, which successfully joins in the cluster, and finally when I start one c++ client node, then I have find that the c++ client can't join the cluster, in the java server node throw exception as follow:

Very high memory consumption in apache ignite

2016-11-09 Thread rishi007bansod
I have 9 tables with number of entries as mentioned below, total size of database is 370MB but when I put data in cache it almost consumes 7GB of Memory. Following are memory consumption details. Memory consumption before

Re: Not able to store key value on remote ignite instances

2016-11-09 Thread vdpyatkov
Hi, It is look like node cannot to establish connection over CommunicationSPI. Please check are ports of communication (by default 47100 with range 100) open in remote server machine. See this article[1] in additional. [1]:

Re: How many nodes within your ignite cluster

2016-11-09 Thread vdpyatkov
I think 100 node is large cluster, but if you configured each machine (FS, look at this document[1]) equally and debugged work - this can be done. 100 nodes is difficult task, because the cluster will be have many point of failure, but in the other side cluster will have height failover tolerance.

Re: Problem with v for listening updates

2016-11-09 Thread Andry
Hi vkulichenko,Just to confirm, did you get output like this:Local Listener: Event Type = UPDATED, Old val = *old*, New val = newIf yes, could please share you configuration for Ignite, might be we have missed smth there.I'm sure that I'm running the same version and my expectation was that I

Re: java.lang.ClassNotFoundException: Failed to peer load class

2016-11-09 Thread vdpyatkov
It is a duplicate of the topic: http://apache-ignite-users.70518.x6.nabble.com/java-lang-ClassNotFoundException-Failed-to-peer-load-class-tt8778.html -- View this message in context:

Re: Apache ignite hadoop accelerator not starting

2016-11-09 Thread vdpyatkov
Hi, Please properly subscribe to the user list so that we can see your questions as soon as possible and provide answers on them quicker. All you need to do is send an email to ì user-subscr...@ignite.apache.orgî and follow simple instructions in the reply. The class is part of hadoop-common

Not able to store key value on remote ignite instances

2016-11-09 Thread Navneet Kumar
Java Client::: TcpDiscoverySpi spi = new TcpDiscoverySpi(); TcpDiscoveryVmIpFinder ipFinder = new TcpDiscoveryVmIpFinder(); ipFinder.setAddresses(Arrays.asList("172.26.116.216")); spi.setIpFinder(ipFinder); IgniteConfiguration cfg = new