Ignite Select Query Performance

Hi, We have inserted a table in Ignite with 10 million rows. The execution time for the following query is around 10 seconds: *select * from tableName offset 500 rows fetch next 100 rows only* The Ignite database was installed on servers with 150 GB RAM. The same table was inserted in MemSQL

RE: 'Deploy' ignite cluster into a spark cluster

Hi Stan, 'executor die, that leads ignite cluster rebalance', I haven't expected this before. Our solution is strange, it's a bit like borrowing spark job scheduling API to deploy ignite and other platforms, so, how to persuade them work together is the major consideration, below is my plan, will

RE: Ignite as Hibernate L2 Cache

Hi, If you’d like to contribute (that’s great!) please follow this process: https://ignite.apache.org/community/contribute.html In short, you need to introduce yourself as a contributor on d...@ignite.apache.org, create a pull request on GitHub, run tests and request a review. Good luck! Stan

RE: 'Deploy' ignite cluster into a spark cluster

Well… I mean, if you really want to… :) The issue is that spark may start or stop its executors as it sees fit – or, at least, not taking Ignite’s lifecycle into account. If an executor dies, the Ignite node dies. It doesn’t always lead to data loss, but it does lead to topology changes and re

Re: Ignite as Hibernate L2 Cache

hi, I have committed my hibernate-5.2 code to a local repo in github and filed a jira ticket https://issues.apache.org/jira/browse/IGNITE-9893 repo -> https://github.com/scottmf/ignite -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: webconsole generated project - cache load performance

Yep, that sounds right. The primary ways to load data into Ignite from another source are a custom cache store or a data streamer. Data streamer will mostly outperform cache stores for initial/periodic data loading. Cache stores are good when you need to sync data between Ignite and backing DB

RE: 'Deploy' ignite cluster into a spark cluster

Hi Stan, Thank you for providing the information. Yes, it's exact 'embedded deployment', but it looks like to be deprecated because of performance issues. Stanislav Lukyanov wrote > Embedded Mode Deprecation > Embedded mode implies starting Ignite server nodes within Spark executors > which can c

Re: odbc caches - cannot browse

It looks like an error. I filed a ticket [1]. I'll try to fit to to 2.7 [1] - https://issues.apache.org/jira/browse/IGNITE-9891 Best Regards, Igor On Mon, Oct 15, 2018 at 10:46 AM wt wrote: > here is the log file generated when opening a new odbc connection to ignite > in excel. > > odbc3.log

RE: 'Deploy' ignite cluster into a spark cluster

Hi, Sorry, I didn’t really get what you mean here… Can you explain: - What exactly you’re doing? - How is it different from normal Ignite-Spark integration, e.g. from shared deployment (https://apacheignite-fs.readme.io/docs/installation-deployment)? - What would be an alternative solution you’re

RE: Priority on affinityCalls

Hi, Nope, there is no priority queue for affinity calls. ComputeTaskSplitAdapter seems to be the best way to handle this. As an alternative, you could do something similar with a cluster singleton service: submit tasks to it, sort by priority, and send them to the servers as affinityRun. Not s

Priority on affinityCalls

Hello and thank you for this project. It's awesome! I'm adapting an older DB-centric application to use Ignite in order to be more scalable and I'm trying to make my affinityCalls work in a prioritized order but can't really work it out. There seems to be a bit of documentation on Job Scheduling b

RE: .net Datetime loads without error but table empty

this is sorted now thanks Stan - >net has several ways to do it and it didn't seem to like the other ways i was trying. simply setting it to datetime.touniversaltime resolved it. I do however think it odd that ignite was not throwing any errors -- Sent from: http://apache-ignite-users.70518.x6.n

RE: .net Datetime loads without error but table empty

Actually… Do you create the cache with `CREATE TABLE`? How do you create objects to pass to the data streamer? Most likely, you’re using some .Net type for the timestamp which doesn’t map correctly to the java.sql.Timestamp. And Ignite will expect the java.sql.Timestamp when you create it as a `C

RE: .net Datetime loads without error but table empty

A guess: the value is being saved, but due to an issue with name or type matching in the QueryEntity SQL engine doesn’t return it. Look for the problem in the cache config (queryEntities property), pay attention to the names, etc. Stan From: wt Sent: 15 октября 2018 г. 12:47 To: user@ignite.ap

Re: Persistence store data not getting distributed across files on different machine in cluster

Looks like you baseline topology (nodes used for persistence) contains only 1 node. Have you tried adding other nodes to the baseline topology? Please follow this guide https://apacheignite.readme.io/docs/baseline-topology#section--add-nodes-to-the-topology to do so. -- Sent from: http://apache-

.net Datetime loads without error but table empty

Running into an issue where i have an underlying sql server with a DateTime field. That is loaded into a class that has DateTime field in .net. I set the class field to its value like this from the data reader value = dataReader.GetDateTime(ordinal); the load code uses GetDataStreamer and compl

Re: Writing binary [] to ignite via memcache binary protocol

Hi, I kind of able to reproduce it with a small python script import pylibmc client = pylibmc.Client (["127.0.0.1:11211"], binary=True) ##abc val = "abcd".decode("hex") client.set("pyBin1", val) print "val decode w/ iso-8859-1: %s" % val.encode("hex") get_val = client.get("pyBin1") print "V

RE: data streamer - failed to update keys (GUID)

please ignore this thread - i have found the problem and it was some old residual test code that was being called instead. Correcting that has resolved the issue. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: odbc caches - cannot browse

here is the log file generated when opening a new odbc connection to ignite in excel. odbc3.log -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Delay queue or similar?

Hello! You could have secondary (SQL) index on time, and do SELECT ORDER BY time to get most eager hosts. For initial time, you could 0L as default value. I.e. check for null => use 0L if null. Regards, -- Ilya Kasnacheev чт, 11 окт. 2018 г. в 0:20, matt : > Thanks for the feedback, Ilya! >

Re: Duplicate Table Error

Hello! I don't think you need both queryEntities and indexedTypes at the same time (and there's probably a problem in your queryEntities too). Regards, -- Ilya Kasnacheev пт, 12 окт. 2018 г. в 20:45, Skollur : > Getting an error Duplicate table name > [cache=CustomerCache,tblName=CUSTOMER, >