?????? NullPointerException When Use ReadThrough

2016-05-12 Thread Level D
Console shows : [14:33:38,735][SEVERE][sys-#19%null%][GridPartitionedSingleGetFuture] Failed to get values from dht cache [fut=GridCompoundIdentityFuture [super=GridCompoundFuture [rdc=Collection reducer: [], flags=1, lsnrCalls=1, done=true, cancelled=false, err=class o.a.i.IgniteCheckedExcept

Re: Apache Ignite vs BI tools

2016-05-12 Thread Dillip Sahoo
Hello Igor, Along with ODBC driver in v1.6, is it also possible to put some video on Youtube explaining, how ODBC can be used along with few famous reporting tools in a stable manner. (something done by Gridgrain for Ignite with zeppelin integration). I think you would be already testing many repo

CacheJdbcPersonStore Example

2016-05-12 Thread Kamal C
Hi, In the CacheJdbcPersonStore example[1], why *IgniteDataStreamer* is never used while loading the bulk elements from the persistent store. What is the purpose of using IgniteBiInClosure in the example ? [1] https://github.com/apache/ignite/blob/master/examples/src/main/java/org/apache/ign

Re: beloved ignite vs. xxx: what is the actual status

2016-05-12 Thread Dmitriy Setrakyan
On Thu, May 12, 2016 at 8:35 PM, minisoft_rm wrote: > Hi dsetrakyan , > Thank you so much. I have told it to my colleagues. > > Now I would like to know the difference between GridGain prod and ignite... > commerce vs. free, right? > Right, all the info is available on the GridGain site. > > a

Re: beloved ignite vs. xxx: what is the actual status

2016-05-12 Thread minisoft_rm
Hi dsetrakyan , Thank you so much. I have told it to my colleagues. Now I would like to know the difference between GridGain prod and ignite... commerce vs. free, right? and the performance are different as well ? or same as each other? thanks. -- View this message in context: http://apache-i

Re: Graceful shutdown

2016-05-12 Thread vkulichenko
Hi, Yes, ignite.close() cancels all currently running tasks. You can replace this call with the following: Ignition.stop(ignite.name(), false) The second parameter means that the stopping node should not cancel tasks and will wait for their completion. Hope this helps. -Val -- View this mes

Re: Unexpexted exception

2016-05-12 Thread vkulichenko
Responded on SO: http://stackoverflow.com/questions/37143793/unexpexted-exception-apache-ignite-web-session-clustering -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Unexpexted-exception-tp4847p4919.html Sent from the Apache Ignite Users mailing list archi

Re: What will happend in case of run out of memory ?

2016-05-12 Thread vkulichenko
You can use loadCache() method for bulk loading. It allows to provide a set of optional parameters that can be used to specify different conditions, like time ranges. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/What-will-happend-in-case-of-run-out-of-me

Re: NullPointerException When Use ReadThrough

2016-05-12 Thread Dmitriy Setrakyan
Can you please provide the stack trace? On Thu, May 12, 2016 at 2:12 AM, Level D <724172...@qq.com> wrote: > Hi, > > When I use readthrough to get a key neither existed in ignite cache nor in > hbase, console shows nullpointerexception. > > Is it nessary for hbase to have the record? In addition

Re: visorcmd alerts: improvements and fixes

2016-05-12 Thread Dmitriy Setrakyan
Thanks Vasily! The custom alert logic is a great addition. Do we need to add documentation for it? On Thu, May 12, 2016 at 2:30 AM, Vasiliy Sisko wrote: > Hello Igniters. > > I implement execution of custom script on alert for visorcmd: > https://issues.apache.org/jira/browse/IGNITE-2919. Now so

How REPLICATED cache is more performant comparing to PARTITIONED

2016-05-12 Thread zshamrock
I have couple of caches which are initialized per system event, and then almost stay untouched for the next 1 or 2 hours. And only reads are used. First of all is it a good use case for the REPLICATED cache? Data is small, just int to int mapping. The main question is why REPLICATED cache behaves

Re: Async workers

2016-05-12 Thread djm132
Thanks for pointing me to ComputeJobMasterLeaveAware interface. I've implemented this the following way: 1) Created TaskInfo object with task parameters object, status, result, task class name, etc. 2) During node selection in map method, taskInfo saved to cache with master node id, assigned node

Re: Can't stop Ignite instance using Ignition.stopAll() or Ignition.kill() until writeBehindFlushFrequency passed

2016-05-12 Thread Alexey Goncharuk
Hi, Can you take a thread dump of the process in this 'hanging' state and attach in to the thread?

Re: beloved ignite vs. xxx: what is the actual status

2016-05-12 Thread Dmitriy Setrakyan
On Thu, May 12, 2016 at 8:39 AM, minisoft_rm wrote: Now May I get some professional performance statistics, for example: > read/write performance per second? > I know redis can handle over 10k operations per second. > As Apache project we are not allowed to publish any benchmark comparisons, how

Graceful shutdown

2016-05-12 Thread djm132
Hi, I've implemented grid task workers and what to shutdown them gracefully (after finishing all active tasks). I see there is ignite.close() method which can be broadcasted to remote nodes. One of solution I've got from another thread looks now like this: static class PoisonPill implements

Re: Get client node instance

2016-05-12 Thread arthi
Hi Igor, The server and client are started by one application. I need to get access to this client node from another application, possibly in another host (but on the same n/w). Possible? Thanks, Arthi -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Get-client-

Re: Eviction Events with offheap values

2016-05-12 Thread abraham
Hi Alexei, thanks for having a look at my issue. What I would like to accomplish: We have a cache where we update the entries a lot. Basically we cache a users session over the period he is active and do a lot of updates. Once the session is over we persist the user back to a database. I couldn't

Re: Get client node instance

2016-05-12 Thread Igor Sapego
Hi Arthi, Where was the original Ignite client started that you want to re-use? Is it in the same application or was it started in some other application/on some other machine? Best Regards, Igor On Thu, May 12, 2016 at 5:20 PM, arthi wrote: > Hi, > > I have a ignite grid started with 2 server

Re: Async workers

2016-05-12 Thread Alexei Scherbakov
Hi, If the master leaves, tasks will still continue to execute. If your tasks need to be aware of the master state you should implement ComputeJobMasterLeaveAware interface. Considering the case I see two ways: 1) Put the task state into a cache where the key is task id and the value is task sta

Re: ODBC Driver?

2016-05-12 Thread Igor Sapego
Hi Arthi, In new release you should not run libtolize, aclocal and other autotools for every directory. Now you only should do that once in the root directory i.e. $IGNITE_HOME/platforms/cpp. Please refer to DEVNOTES.txt for detailed instructions. Best Regards, Igor On Thu, May 12, 2016 at 5:16

Re: Eviction Events with offheap values

2016-05-12 Thread Alexei Scherbakov
Hi, I was not able to reproduce your case. In my test I have correct old value on eviction event. Please provide a reproducer. BTW: what are you trying to accomplish? Generally events are not very good for cluster performance and may not be delivered in case of the listener node failure. 2016-05

Re: How to cache Spark Dataframe in Apache ignite

2016-05-12 Thread Denis Magda
Hi, Replied to you on StackOverflow http://stackoverflow.com/questions/37180715/how-to-cache-dataframe-in-apache-ignite/37192299#37192299 > On May 12, 2016, at 11:12 AM, Vignesh Irulappan wr

Re: Cluster Formation between nodes in different data centers

2016-05-12 Thread vdpyatkov
Hello, Can you check ping between data centers? If delay of network may be long, you can incrase FailureDetectionTimeout (use org.apache.ignite.configuration.IgniteConfiguration#setFailureDetectionTimeout) In additional you need make sure what communication ports are available in all nodes (by de

Re: Unexpexted exception

2016-05-12 Thread Alexey Kuznetsov
MRE - minimal reproducible example This may be a simple project with a couple of files. On Thu, May 12, 2016 at 10:31 PM, kajzur wrote: > What is MRE? Whole code of project? Repository on github? > > > > -- > View this message in context: > http://apache-ignite-users.70518.x6.nabble.com/Unexpext

beloved ignite vs. xxx: what is the actual status

2016-05-12 Thread minisoft_rm
Dear Experts, I am testing ignite functions for some weeks. although there are a number of bugs to be fix, I can successfully run it over DB, hiding some table from the cache by sql interaction with ignite. this is really cool. Now May I get some professional performance statistics, for example: r

Re: Unexpexted exception

2016-05-12 Thread kajzur
What is MRE? Whole code of project? Repository on github? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Unexpexted-exception-tp4847p4900.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Can't stop Ignite instance using Ignition.stopAll() or Ignition.kill() until writeBehindFlushFrequency passed

2016-05-12 Thread Vladislav Pyatkov
I do exactly what you say, but can not see any delay. I try to reproduce in last Ignite version (1.5.0.final). Try this version, if you use another. Could you please provide example or configuration xml at least? On Thu, May 12, 2016 at 5:37 PM, zshamrock wrote: > They do indeed are saved immedi

Re: Can't stop Ignite instance using Ignition.stopAll() or Ignition.kill() until writeBehindFlushFrequency passed

2016-05-12 Thread zshamrock
They do indeed are saved immediately, the issue is that the ignite process is not stopping until writeBehindFlushFrequency elapsed after `kill` or `stopAll` call. So, in my case for that specific IT case I have to wait 5 minutes before it completes, unless I overwrite the value of writeBehindFlushF

Get client node instance

2016-05-12 Thread arthi
Hi, I have a ignite grid started with 2 servers and 1 client. I want my c++ application to be able to retrieve the client node instance from the grid, with out starting a new server/client. Is there an API I can use? Ignition.ignite() fails - Exception in thread "main" class org.apache.ignite.Ign

Re: ODBC Driver?

2016-05-12 Thread arthi
Hi Igor, We tried to build using the binaries from the below nightly build - https://builds.apache.org/view/H-L/view/Ignite/job/Ignite-nightly/lastSuccessfulBuild/artifact/target/bin/apache-ignite-fabric-1.6.0-SNAPSHOT-bin.zip But, the C++ is missing a few config files. We get errors on build- [

Re: Tcp discovery with clustered docker nodes

2016-05-12 Thread Dmitriy Setrakyan
On Thu, May 12, 2016 at 6:26 AM, Kristian Rosenvold wrote: > To ny understanding no; the java process running innside the docker > container has no possibility of binding to the externally visible ip/port. > I think if you add “—net=host” parameter to your docker script, then docker will allow bi

Re: Affinity Collocation - more details

2016-05-12 Thread vdpyatkov
Hello, Affinity collocation what you need exactly. Affinity function this is a mapping keys to partitions. In other word when you are explicitly calling put(key, value), you are implicitly assigning partition and node, where data will store. But in many cases you want to store some data entries

Re: Tcp discovery with clustered docker nodes

2016-05-12 Thread Alexei Scherbakov
Sorry, previous message was incomplete. TcpDiscoverySPI has two properties(*localAddress *and *localPort*), allowing you to set local address and port for Discovery SPI to bind. These properties will be published by JDBC discovery manager in *shared * mode. Does it solve your problem? 2016-05-12

Re: Tcp discovery with clustered docker nodes

2016-05-12 Thread Alexei Scherbakov
Please look at IgniteConfiguration.setAddressResolver. It should do the job by mapping internal to external IP. 2016-05-12 16:26 GMT+03:00 Kristian Rosenvold : > To ny understanding no; the java process running innside the docker > container has no possibility of binding to the externally visible

Re: Tcp discovery with clustered docker nodes

2016-05-12 Thread Kristian Rosenvold
To ny understanding no; the java process running innside the docker container has no possibility of binding to the externally visible ip/port. Kristian 12. mai 2016 3.22 p.m. skrev "Alexei Scherbakov" < alexey.scherbak...@gmail.com>: > Hi, > > TcpDiscoverySPI has two properties(localAddress and l

Re: Tcp discovery with clustered docker nodes

2016-05-12 Thread Alexei Scherbakov
Hi, TcpDiscoverySPI has two properties(localAddress and localPort), which allows you to set local address and port for Discovery SPI to bind. T Does it solve your problem? . 2016-05-12 10:56 GMT+03:00 Kristian Rosenvold : > We have been using jdbc based discovery successfully, but have been t

Re: Can't stop Ignite instance using Ignition.stopAll() or Ignition.kill() until writeBehindFlushFrequency passed

2016-05-12 Thread vdpyatkov
Hello, I can not reproduce the issue. In my test case all data entries save immediately after call Ignition.stopAll(true). If you had have example, which demonstrate the behavior, can you please provide source code? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com

Re: What will happend in case of run out of memory ?

2016-05-12 Thread tomk
Yes, I remember about case of SQL queries. In practice, before executing query Apache Ignite client should use method .get to loading actual data (queried by SQL). Is it possible to load to cache data that fit to some conditions ? For example data from last year (table contain column date). -

visorcmd alerts: improvements and fixes

2016-05-12 Thread Vasiliy Sisko
Hello Igniters. I implement execution of custom script on alert for visorcmd: https://issues.apache.org/jira/browse/IGNITE-2919. Now some logic can be defined in case of specific grid conditions in format sh/bat file. Also fixed reaction on alert condition switch: https://issues.apache.org/jira/b

NullPointerException When Use ReadThrough

2016-05-12 Thread Level D
Hi, When I use readthrough to get a key neither existed in ignite cache nor in hbase, console shows nullpointerexception. Is it nessary for hbase to have the record? In addition to this way,how can I avoid that exception?

How to cache Spark Dataframe in Apache ignite

2016-05-12 Thread Vignesh Irulappan
Hello, I am writing a code to cache RDBMS data using spark SQLContext JDBC connection. Once a Dataframe is created I want to cache that reusltset using apache ignite thereby making other applications to make use of the resultset. Here is the code snippet. object test { def main(args:Array[S

Tcp discovery with clustered docker nodes

2016-05-12 Thread Kristian Rosenvold
We have been using jdbc based discovery successfully, but have been trying to get this to work with docker. The problem is of course that all the internal IP's inside the docker container are useless, so we'd really need some way to override the discovery mechanism. Now you could of course say that