Re: Affinity key for specific node

Well, I would like to use a partitioned cache so that the data in the cache stays intact if that node goes down for a while, but if more nodes go down it might be lost anyway so maybe I need to use a local cache and persist it instead, was trying to avoid that. Den 2017-12-06 kl. 00:00, skrev

How IGFS URIs work

Hi, According to https://apacheignite-fs.readme.io/docs/file-system#section-file-system-uri, a URI for connecting to a ignite file system from a Hadoop compatible application follows the pattern igfs://myIgfs@myHost:12345/. Let's assume I have a ignite cluster with 5 nodes running in 5 different h

ClassNotFoundException when using IgniteHadoopIgfsSecondaryFileSystem

Hi, I'm trying to use IgniteHadoopIgfsSecondaryFileSystem on EMR, and I have been able to make this work using HDFS in the uri. But when I use a different scheme for another file system that is working ok with `hadoop fs` and other applications, I get ``` [hadoop@ip-10-0-0-242 ~]$ hadoop fs -ls

Re: Error running ignite in YARN

Hi Ilya, Thanks a lot for your help, I'll try and the test the patch. Regarding how I run this, I wait for the cluster to enter in WAITING state and then I ssh to the master node as described in https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-connect-master-node-ssh.html, and then I ju

Apache Ignite talks in Austin, TX

Folks, The nearest couple of days I’m spending in Austin, TX in order to meet with current and believe (!) future Ignite users diving into the following topics: 1. Apache Ignite Machine Learning capabilities: https://www.meetup.com/austindata/events/245472777/

Re:Re: Re:Re: index about jdbc thin mode

The code is here: String sql = "explain SELECT FID,FNUMBER FROM \"customerCache\".CustomerIgniteInfo WHERE FUSEDSTATUS = 3)"; Class.forName("org.apache.ignite.IgniteJdbcThinDriver"); Connection conn = DriverManager.getConnection("jdbc:ignite:thin://192.168.63.36?distributedJoins=true"); Pre

Re:Re: Re: Re: Re: Re: Re:Poor performance select query with jdbc thin mode

No, the problem is poor performance. This query should not take that time. That just took 10ms in oracle ,but It took 2200ms in ignite. Thanks.

Re: Affinity key for specific node

If it's a single node, I would just create a special local cache for these entries and deploy it on that node. Will this work? -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Affinity key for specific node

Hi! I have a singleton service running on a specific node, It access a serial port so it must be running on that specific node so I can't use affinity key for the service, now I want to create some values in a cache that will be used by the service, is there any way I can create affinity keys

Re: Web Console on Kubernetes Cluster

O, thanks. Maybe there is docker image with webagents? I'm using https://hub.docker.com/r/apacheignite/ignite/ -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: DataStreamer vs CacheStoreAdapter

Hi, I guess I did not understand what you mean for the DataStreamer. When I have a distributed database (or distributed files maybe) I want to be able to load all of these resources simultaneously into the same cache since there arent duplicates. the resources are distinct from each other. So i

Re: DataStreamer vs CacheStoreAdapter

Hello! You're thinking in the right way. In the first case DataStreamer looks preferable. If I understood correctly then you have a distributed database and you need to do some preparation before loading data to Apache Ignite. In this case you can create needed count of DataStreamer (one DataStre

DataStreamer vs CacheStoreAdapter

Hello, im new to ignite and im not completely sure about the different use cases for `igeniteDataStreamer` and `CacheStoreAdapter`. In my application I have two different usecases but both rely on preloading data from a database into the ignite cache. 1. The first usecase is just some kind of bu

Re: Problem with loading data

Hello! It looks that Web Console generated an incorrect schema for PositionCache cache. Can you share CacheConfiguration and schema for the related table? On Tue, Dec 5, 2017 at 5:00 PM, Ahmad Al-Masry wrote: > Hi; > Want to to test Ignite to improve the performance of our reporting system. >

Re: ignite.compute(ClusterGroup) is broken??

Chris, That's right. You get nodes from affinity function, that doesn't know anything about a cluster group. And you ignore *subgrid *parameter, that is collected with regard to the ClusterGroup. Denis вт, 5 дек. 2017 г. в 18:08, Chris Berry : > Denis, > > My current theory is that in the map m

Re: ignite.compute(ClusterGroup) is broken??

Denis, My current theory is that in the map method -- as shown above -- this line Map> nodeToKeysMap = ignite.affinity(getIgniteAffinityCacheName()).mapKeysToNodes(cacheKeys); overrides the whole ClusterGroup mechanism?? In other words, the subgrid is ignored. Because Affinity.ma

Re: ignite.compute(ClusterGroup) is broken??

Denis, Actually. I still do not understand. Reading back thru all of the code… All of the Javadoc seem to indicate that what I am trying to do should work. public interface ComputeTask extends Serializable { /** * @param subgrid Nodes available for this task execution. Note that order o

How to do 'stream processing' and more questions of a Ignite newbie

Hello! I've finally overcome the hurdle of getting Kafka Connect to work with Apache Ignite. For people reading this, that have issues with it: At the end of the mail I'm posting my currently used Converter and Extractor. Connecting multiple topics to Ignite was possible after setting different RE

Re: ignite.compute(ClusterGroup) is broken??

Thank you Denis. That was not clear to me. Cheers, -- Chris -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Student Blog about Apache Ignite & Questions how to efficiently handle data

Hello Nikolai, Since I'm already pretty lost in the deeps of Ignite I will start another topic with more information, code and questions soon - in this case, here's one fo the extractors I'm currently using: public class AccelerationPointExtractor implements StreamSingleTupleExtractor { @Over

Problem with loading data

Hi; Want to to test Ignite to improve the performance of our reporting system. The datasource is MySQL. We used The Web Console to create the integration with MySQL and used the auto generated package from there to load the data. Some the tables have loaded successfully and the rest did not, and

Re: Student Blog about Apache Ignite & Questions how to efficiently handle data

Hello Sven! Glad hear that you solved the problem by yourself! Any way, if you are able to share code snippet that shows how you use kafka streamer then community can provide some additional suggest. On Tue, Dec 5, 2017 at 2:45 PM, svonn wrote: > I solved the key issue with a singleTupleExtract

RE: Ignite poor performance

Thanks, now its much better. it’s a little bit weird because I already tried to create those Indexes via JDBC…. Regards, Sasha Haykin Senior BI Developer T. +972-77-7745-163 M. +972-54-7939-700 [cid:image001.png@01D36DD2.48D9CF30] From: Michael Cherkasov [mailto:michael.

Re: fabric8 ignite-service.yaml

Hello, I haven't seen that users use ignite with the fabric8-maven-plugin. Any way, feel free to share your experience with community. ;) On Tue, Dec 5, 2017 at 11:57 AM, Humphrey wrote: > Has anyone used fabric8 in combination with Ignite to deploy ignite > services > and discovery using the T

Re: Student Blog about Apache Ignite & Questions how to efficiently handle data

I solved the key issue with a singleTupleExtractor - For both GpsPoints and AccelerationPoints I'm simply adding a hashvalue over the Object. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Semaphore Stuck when no acquirers to assign permit

Tim, Thank you for your contribution! I'll look at your changes and leave my comment to jira ticket. On Tue, Dec 5, 2017 at 6:18 AM, Timay wrote: > From what i found, it looks like the DataStructuresProcessor EventListener > get invoked after the dsMap has been cleared which prevents the > onNo

Re: ignite.compute(ClusterGroup) is broken??

Chris, Tasks are sent to all nodes, that return from map() method, regardless of the provided ClusterGroup. ClusterGroup only affects a list of nodes, that are specified in *subgrid* parameter. So, it's your responsibility to assign tasks to nodes, that match your needs. If you want to send them

Re: using JDBC with Ignite cluster, configured with persistent storage

Hi, I can not understand from your email what was wrong, could you please provide more details about your case? Maybe you can send me a demo app that will show the exception you have? Thanks, Mike. 2017-12-05 1:45 GMT+03:00 soroka21 : > Hi, > I'm trying to use JDBC connection to run SQL on clu

Re: Re:Re: index about jdbc thin mode

Hi, Actually, the same exact code I sent you works as expected on my side. Could you share a reproducer so that I can take a look at it? At least, please Ignite configuration and how you run explain query via thin JDBC driver. Kind regards, Alex -- Sent from: http://apache-ignite-users.70518.

Re: Re: Re: Re: Re: Re:Poor performance select query with jdbc thin mode

So, the problem was in measurement, right? Denis вт, 5 дек. 2017 г. в 12:39, Lucky : > > now it is about the same as JDBC thin mode. > > > > > > At 2017-12-05 16:52:48, "Denis Mekhanikov" wrote: > > Lucky, > > Thanks for the code. > And what is the time for cache.query() for the same query? > >

Re:Re: Re: Re: Re: Re:Poor performance select query with jdbc thin mode

now it is about the same as JDBC thin mode. At 2017-12-05 16:52:48, "Denis Mekhanikov" wrote: Lucky, Thanks for the code. And what is the time for cache.query() for the same query? Denis

Re: Ignite poor performance

Hi Sasha, Did you have time to try my advice? Did it help you? Thanks, Mike. 2017-12-04 17:00 GMT+03:00 Sasha Haykin : > Hi, > > I Working on big POC for telecom industry solution > > > I have loaded to ignite 5,000,000 objects/rows (I loaded it in the client > side Please find the code below)

fabric8 ignite-service.yaml

Has anyone used fabric8 in combination with Ignite to deploy ignite services and discovery using the TcpDiscoveryKubernetesIpFinder? I'm looking for a way to define my ignite-service.yaml file in my project so and configure it with the fabric8-maven-plugin so it will automatically be deployed (and

Re: Re: Re: Re: Re:Poor performance select query with jdbc thin mode

Lucky, Thanks for the code. And what is the time for cache.query() for the same query? Denis вт, 5 дек. 2017 г. в 11:25, Lucky : > Denis, > The code is here: > public static void main(String[] args){ > try { String sql = "SELECT \"T0\".\"FID\" AS \"ID\", > \"T0\".\"FCUSTOMERGROUPSTANDAR

Re: Register Contentious query quit slow

Jin, > Fact is after I commented out IQ, RF and keep local listeners exists, no more meta data update happened and the program still work. I already explained you in the previous letter, where this metadata update comes from. It's because you transfer IQ and RF over network. On the other hand, lo

Re:Re: Re: Re: Re:Poor performance select query with jdbc thin mode

Denis, The code is here: public static void main(String[] args){ try { String sql = "SELECT \"T0\".\"FID\" AS \"ID\", \"T0\".\"FCUSTOMERGROUPSTANDARDID\" AS \"T1.ID\", \"T0\".\"FCUSTOMERGROUPID\" AS \"T2.ID\", \"T0\".\"FCUSTOMERID\" AS \"T3.ID\", \"T0\".\"FCUSTOMERGROUPFULLNAME\" AS \"CU

Re: "HandshakeException: Remote node ID is not as expected" occurs when tested with 1000 clients

It's a known problem, which doesn't affect anything https://issues.apache.org/jira/browse/IGNITE-4939 Evgenii 2017-12-05 7:53 GMT+03:00 yonggu.lee : > I go to the machine where cannot be connected (cc3a7x2183), and found the > following exception message > > java.lang.IllegalArgumentException: C