Data Streamer

Hello. I have a problem with stream API and Ignite. The value of "sum" variable should be 100 (that equals to length of file test.csv), but it equals 999424. If file length is small (10 or even 1000) there is nothing in cache. Thank you. Если вы знаете русский, ответьте, пожалуйста, на русск

Re: Data Streamer

Hi Alexander, Please make sure that you flush data streamer before checking the "sum" value: fileStream.mapToInt(Integer::parseInt).forEach(line->streamer.addData(line,1L)); streamer.flush(); Vladimir. On Mon, May 23, 2016 at 10:35 AM, Александр Савинов wrote: > > Hello. > I have a problem w

Ignite Transaction performance

I have four caches which I write in a transaction. I have two nodes running. The transaction configuration is OPTIMISTIC and READ_COMMITED isolation. I am observing that sometimes ignite is taking 16milliseconds and sometimes 20-30 milliseconds for commiting a transaction. This is actually too s

Re[2]: Data Streamer

Thanks you! It works correctly. >Понедельник, 23 мая 2016, 11:11 +03:00 от Vladimir Ozerov >: > >Hi Alexander, > >Please make sure that you flush data streamer before checking the "sum" value: >fileStream.mapToInt(Integer::parseInt).forEach(line->streamer.addData(line,1L)); >streamer.flush(); >

DiscoverySpiNodeAuthenticator implementation

Hi, I need to implement token-based security authenticator. The best place I've found so far is to extend discovery SPI TcpDiscoverySpi discoSpi = new TcpDiscoverySpi(); … discoSpi.setAuthenticator(new TokenAuthenticator()); igniteConfig.setDiscoverySpi(discoSpi); Then I've implemented simple

Re: Graceful shutdown

Thanks, now it waits for task completion. I've also implemented shutdown check during the tasks to allow correct termination. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Graceful-shutdown-tp4911p5088.html Sent from the Apache Ignite Users mailing list archive

Re: Efficiency worse than postgresql. Why ?

With 100 rows there is a bigger chance to get improvement, but I would still recommend to test with real queries and get some relevant numbers. Note that you should use queries unless simple get() operation is not enough. The latter will always perform better. -Val -- View this message in

Re: Can't stop Ignite instance using Ignition.stopAll() or Ignition.kill() until writeBehindFlushFrequency passed

I can't reproduce this either. GridCacheWriteBehindStore flushes all the data immediately after stop process is initiated. Is it possible that it just takes more time to flush the whole queue? With bigger timeout it's possible that you collect more data. It would be also great if you provide a sma

Re: What index should I create ?

Hi, It depends on the query that you're going to execute, size of the table and sizes of the result sets. Please provide this information and I will try to help. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/What-index-should-I-create-tp5068p5091.html Se

Re: off heap indexes - setSqlOnheapRowCacheSize - how does it improve efficiency ?

Are you using offheap? What is your data size? Generally, I would recommend to use on-heap with SQL queries if this possible (unless you have a very big data sets and want to avoid having large heap sizes). If you still have to use offheap, you can try playing with this parameter and see what perf

Re: Flush the cache into the persistence store manually

If write-though is used, there is no need to do this, because each update will be propagated to the cache store synchronously. In case of write-behind there is no way to flush the data manually, but it will be flushed eventually. Also, as we discussed in the chat, since you're going to clean the c

Re: Clear cache from Visor throws an exception

Hi, The versions of the cluster and Visor have to be the same. We just released 1.7, can you try it? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Clear-cache-from-Visor-throws-an-exception-tp4848p5094.html Sent from the Apache Ignite Users mailing list

Re: exception during starting client

We just released 1.7 where this issue should be fixed. Please try it out and let us know if it works for you. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/exception-during-starting-client-tp4396p5095.html Sent from the Apache Ignite Users mailing list ar

Re: Persistence using Cassandra

Thank you Alexey. I am unable to locate the test resources like the ignite configuration files and the persistent descriptors in the package. Could you please help me find them? I downloaded apache-ignite-fabric-1.6.0-SNAPSHOT-bin.zip

Re: Persistence using Cassandra

Mentioned below are the complete logs class org.apache.ignite.IgniteException: Failed to instantiate Spring XML application context [springUrl=file:/C:/Users/D-UA96OU/Desktop/Ignite /apache-ignite-fabric-1.6.0-SNAPSHOT-bin/apache-ignite-fabric-1.6.0-SNAPSHOT-bin/config/default-config.xml, err=Conf

Nodes running on different operating systems

I assume that it's a supported scenario to have an Ignite setup consisting of nodes running on different operating systems? For instance, I've got a Windows host machine, and two virtual Linux guests. All three machines are running the same version of Apache Ignite (1.6.0) and the same version of

Re: Error on apache-ignite-fabric-1.5.0.final-bin with 1.6.0 package on Make command

Hi Agneeswaran, Can you please properly subscribe to the mailing list so that the community can receive email notifications? Here is the instruction: http://apache-ignite-users.70518.x6.nabble.com/mailing_list/MailingListOptions.jtp?forum=1 Agneeswaran wrote > Hi Team, > > We have merged the pa

Re: Ignite Transaction performance

Hi, Can you provide your benchmark so that someone can take a look and investigate? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Transaction-performance-tp5085p5101.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Clear cache from Visor throws an exception

I meant 1.6, of course. Here is the download page: http://ignite.apache.org/download.cgi#binaries -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Clear-cache-from-Visor-throws-an-exception-tp4848p5102.html Sent from the Apache Ignite Users mailing list arch

Re: exception during starting client

I meant 1.6, of course. Here is the download page: http://ignite.apache.org/download.cgi#binaries -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/exception-during-starting-client-tp4396p5103.html Sent from the Apache Ignite Users mailing list archive at Nab

Re: how the figures in apache ignite website be drawed

As far as I know this is not done by an automated tool. I think someone will correct me if I'm wrong. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/how-the-figures-in-apache-ignite-website-be-drawed-tp5081p5104.html Sent from the Apache Ignite Users maili

Re: Why during launching ignite client( or server) it show also size heap of client ?

Currently we're showing the amount of heap and number of CPUs for the whole topology including clients. But I think your point makes sense, can you create a JIRA ticket for this? You're also welcome to contribute, I believe it's a good task to start studying the code if you're interested. -Val

Re: DiscoverySpiNodeAuthenticator implementation

Hi, To add security capabilities to the Ignite cluster you need to implement GridSecurityProcessor and provide it as a plugin. The blog [1] provides a good example of how this can be done. Also GridGain provides the implementation as a part of their commercial offering. See [2] for details if you

Re: Get client node instance

Hi Arthi, Looks like the tickets are in progress, so I would expect some result soon (I'm not working on them, so I don't have any exact ETAs; feel free to ask on dev list for more details). -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Get-client-node-i

Re: Unexpexted exception

There is some exception exception happening during the cache update. Due to a bug in the code it's lost and actual reason is not shown. I just fixed this in master, can you build from there and try? There trace should appear in the log. You can also wait for a nightly build which should be availab

Re: Nodes running on different operating systems

Yes, this is supported. Looks like your configuration is wrong or nodes stop for some external reason. Can you attach your configuration file and the whole logs from all the nodes? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Nodes-running-on-different-

Re: statistics of cache - number of loaded rows to particular tires.

Sure, you can have a look at VisorCache.estimateMemorySize sources if you really needs this. — Denis > On May 22, 2016, at 1:28 AM, Tomek W wrote: > > Ok, maybe something that use ignitevisorcmd ? > > 2016-05-21 21:44 GMT+02:00 Denis Magda >: > Hi, > > Size in n

Re: Ignite Transaction performance

I will try to. But the code is difficult to replicate for obvious reasons. The cache keys are Long and the values are Java POJO's. There are two nodes running on different systems. There is however a massive amount of concurrent transactions. I saw there is an optimization in Ignite 1.6 RC1 for thi

Re: Unexpected performance issue with SQL query followed by error

Hi, In current state of SQL engine where is a very high probability for necessity of query modification for efficient use with Ignite. I'll look into your data soon. Was very busy last week. 2016-05-17 17:37 GMT+03:00 jan.swaelens : > Hello, > > Please find the attached pojo instances with group

Re: Persistence using Cassandra

If you need tests - you need to download sources ( https://ignite.apache.org/download.cgi#sources). Also, today we released Ignite 1.6 it should be available on Maven now. Hope this help. On Mon, May 23, 2016 at 6:35 PM, ChickyDutt wrote: > Mentioned below are the complete logs > > class org.ap

Re: Nodes running on different operating systems

Hi Val, I'm actually using a default configuration, just running bin/ignite.sh|bat without any arguments. I'll look at creating and using configuration files instead. Thanks, Graham On 23 May 2016 at 13:55, vkulichenko wrote: > Yes, this is supported. Looks like your configuration is wrong

Re: Error on executing Make command.

Agneeswaran wrote > Hi Team, > > Please help us, on following error on executing Make command. > > make[3]: Entering directory > `/opt/apache-ignite-fabric-1.5.0.final-bin/platforms/cpp/common' > CXXLD libignite-common.la > libtool: link: `os/linux/src/common/concurrent_os.lo' is not a valid >

Re: Error on executing Make command.

Hi, We are using Linux 2.6.32 compiler and we have used nightly build to build the code. https://builds.apache.org/view/H-L/view/Ignite/job/Ignite-nightly/211/ Build : apache-ignite-fabric-1.6.0-SNAPSHOT-bin.zip The error we got after merging the code from apache-ignite-fabric-1.6.0-SNAPSHOT-bin

View contents of cache

Hi All, I am trying to check the contents of cache as shown in example https://apacheignite.readme.io/docs/kafka-streamer but see an error. Ignite nodes started using ExampleNodeStartup. What is my mistake? Thanks. Example: HTTP http://node1:8080/ignite?cmd=size&cacheName=myCacheName -- V

Please subscribe

Re: Error on executing Make command.

Agneeswaran, What do you mean by "merging code"? Is it possible for you to just switch to Ignite 1.6? Ignite 1.6 have been released recently. You can get stable version here: [1]. Please, try it out and let us know if it helps. [1] - https://ignite.apache.org/download.cgi#binaries Best Regards,

Re: DiscoverySpiNodeAuthenticator implementation

I've tried the code from http://smartkey.co.uk/development/securing-an-apache-ignite-cluster/ too. The second (blocked) node just throw exception as in my example with DiscoverySpiNodeAuthenticator: 2016/05/23 17:28:08.062 [main] ERROR Failed to start manager: GridManagerAdapter [enabled=true, nam

Re: View contents of cache

Hi Alexey, You attached the link to the page about Kafka streamer, are you sure it's correct? What error do you get? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/View-contents-of-cache-tp5118p5122.html Sent from the Apache Ignite Users mailing list arc

Re: View contents of cache

Yes, I need to create Kafka streamer. I try to create simple example, but it doesn't work and I want to check the contents of my cache like described in https://apacheignite.readme.io/docs/kafka-streamer -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/View-conte

Re: View contents of cache

I see error: "Unable to access the site" It seems address http://node1:8080/ignite?cmd=size&cacheName=myCacheName is incorrect -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/View-contents-of-cache-tp5118p5124.html Sent from the Apache Ignite Users mailing lis

Re: Ignite Transaction performance

There are too many variables to say if this performance is OK or not without having the code. So please provide the test if you want someone in the community to help you. BTW, 1.6 is released, you can try it: ignite.apache.org/download.cgi#binaries -Val -- View this message in context: http:/

Re: Nodes running on different operating systems

Graham, Default config means that multicast is used for discovery. Can you try static IP configuration [1] and see if the issue is reproduced? [1] https://apacheignite.readme.io/docs/cluster-config#static-ip-based-discovery -Val -- View this message in context: http://apache-ignite-users.705

Re: off heap indexes - setSqlOnheapRowCacheSize - how does it improve efficiency ?

Hi, Generally speaking, settings setSqlOnheapRowCacheSize to larger value increases SQL performance in OFFHEAP_TIERED mode, but also means more job for GC, so it should be used with care. The value should be set to the size of your application's working(frequently accessed) data set. 2016-05-23

Re: Ignite Transaction performance

Val, Understand that. I will try to come up with some code. I think by Friday I will have something that can be replicated... Lastly one thing what can be the none causes of something like this ? Regards -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Tr

Re: Please subscribe

Please send an email to user-subscr...@ignite.apache.org and follow easy steps in the reply. On Mon, May 23, 2016 at 7:07 AM, Ponnuraman, Agneeswaran < agneeswaran.ponnuraman...@nielsen.com> wrote: > >

Re: off heap indexes - setSqlOnheapRowCacheSize - how does it improve efficiency ?

Ok, I am going to use OFF_HEAP. On each node I am going to use about 10 GB. (My ram is 16GB). Can you help me adjust configuration for this aim ? It is very important for me. Aim: Extremely fast sql quries. 2016-05-23 18:13 GMT+02:00 Alexei Scherbakov : > Hi, > > Generally speaking, settings

R: Please subscribe

I want to unsubscribe but the procedure didn't work. Help unregistering my email please . Andrea Inviato da smartphone Samsung Galaxy. Messaggio originale Da: Dmitriy Setrakyan Data: 23/05/16 20:45 (GMT+01:00) A: user Cc: agneeswaran.ponnuraman...@nielsen.com Oggetto: Re: P

Working Directly with Binary objects

Hello All, I have just recently started using Ignite, and I am really enjoying it, I am trying to profile the size of some objects and compare it with other types of serializations, is it possible to use the serialization without starting a Ignite process? The only way I could do it was: Ig

Re: Efficiency worse than postgresql. Why ?

I must use sql queries due to jdbc client. I am not sure if I correctly undersand you - in jdbc client should I implement using get ? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Efficiency-worse-than-postgresql-Why-tp5040p5132.html Sent from the Apache Igni

Re: What index should I create ?

1. WHERE {A,B,C,D} (all possible combinations - AND, for example) where A > 100 AND D < 1000 WHERE B > 20 GROUPBY(A) GROUPBY(B) GROUPBY(C) GROUPBY(D) -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/What-index-should-I-create-tp5068p5133.html Sent from the

meaning of backup options.

Hi, What does it mean following options: ? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/meaning-of-backup-options-tp5134.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

What does SPI stand for?

Maybe this is blindingly obvious to others, but I can't seem to find reference to what SPI stands for? http://apacheignite.gridgain.org/v1.1/docs/cluster-config e.g. org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi