Re: Getting UnknownHostException: kubernetes.default.svc.cluster.local when using hostNetwork

I found a solution to this which you might want to update your documentation with. The answer is to add a dnsPolicy for the pod along with hostNetwork, as per below: spec: hostNetwork: true dnsPolicy: ClusterFirstWithHostNet serviceAccountName: ignite containers:

Getting UnknownHostException: kubernetes.default.svc.cluster.local when using hostNetwork

Hello, I have setup a Kubernetes environment with auto discovery and the nodes are able to find one another no problem. I did have several issues along the way which this forum has helped resolve, including some modifications to YAML that differ from those from the Ignite docs. However, now when

Re: Getting Spring XML exception when using Ignite .NET with Kubernetes

I fixed this by following http://apache-ignite-users.70518.x6.nabble.com/ignite-kubernetes-seems-to-be-missing-the-jackson-annotations-dependency-td25670.html (Copying a missing JAR) This gets past that error and now I am left with the following but thats probably more environmental... class

Re: Getting Spring XML exception when using Ignite .NET with Kubernetes

Pruning the list down to the bin distribution gets past that error but now I am getting: Unhandled Exception: Apache.Ignite.Core.Common.IgniteException: Java class is not found (did you set IGNITE_HOME environment variable?): com/fasterxml/jackson/annotation/JsonView --->

Re: Getting Spring XML exception when using Ignite .NET with Kubernetes

Ah ok, let me try that. I was using your Docker project https://github.com/ptupitsyn/ignite-net-docker . Seems like the nuget package has different versions bundled together. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Getting Spring XML exception when using Ignite .NET with Kubernetes

No problem, This is everything that is logged: at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761) at

Re: Getting Spring XML exception when using Ignite .NET with Kubernetes

I figured that I needed the optional kubernetes JARS which are part of the binary distribution but not he Nuget package, so I added the ignite-kubernetes libs to my docker image as well, now I get a different error of null pointer: Caused by:

Getting Spring XML exception when using Ignite .NET with Kubernetes

Hello, I have built a docker image of my Ignite .NET application and am instantiating this as a pod in my Kubernetes deployment. This all works as expected and Ignite initializes fine. However, I want my nodes to be discoverable so I am attempting to use the Spring XML file located here

Re: Expected serialization performance of Ignite .NET

Ok thanks. I have managed to get the times down to 13 seconds write and 7.5 seconds read, basically double your times, on my 12 processor Intel i7-8850 laptop which is running 100% so you must have some good kit! Does Java version have any bearing on performance? -- Sent from:

Re: Expected serialization performance of Ignite .NET

It seems a combination of a better spec machine and a parallel for loop has improved performance, although it still takes 8 seconds to run through all the cache items. Here is some basic test code...would appreciate any tips on how to improve access in this type of usage pattern:

Expected serialization performance of Ignite .NET

I have a 21 property C# class (mix of int and string) and am using IBinarizable interface as suggested in the documentation. My cache is configured such that each cache entry is a collection of these objects, lets say each cache item is a List. I have 10 million instance of this class. For

Re: Does affinity work with cache mode of LOCAL?

Thank you, that makes sense. My use case is to match Spark dataframe functionality using only C# if possible, without using Spark Specifically we have CSV files we wish to load into the cache and then we have compute functions that act on those rows, adding columns as they do, so the cache will

Re: Does affinity work with cache mode of LOCAL?

Actually the code is adding data to each nodes individual LOCAL cache, its just the affinity is not working as expected, all affinity jobs are run on the node which is invoking them (in my case the client node) rather than where the actual data exists. -- Sent from:

Re: Does affinity work with cache mode of LOCAL?

Actually maybe I do not understand what a LOCAL cache is. I create a LOCAL cache in my client and I have 2 server nodes. I send a compute function to each node to load some data into the cache. I assumed as the cache is LOCAL that the nodes would load the data into their own local cache?

Does affinity work with cache mode of LOCAL?

I have been using affinity keys with a PARTITIONED cache and then use those keys to send computations to the nodes that have the data which all works as expected. I wanted to test LOCAL mode for performance but I found no calculations are now sent to the nodes. Is that expected behavior? How

Re: Ignite .NET and TcpDiscoveryStaticIpFinder failure

I created a new VM and it now seems to work ok, I have this message which would indicate everything is connected (which would be correct, 3 nodes, 2 hosts and 6 CPU total) H/N/C [hosts=2, nodes=3, CPUs=6] Also btw, when creating the new VM I had to install Java, I chose jdk-8u221-windows-x64 to

Re: Ignite .NET and TcpDiscoveryStaticIpFinder failure

I dont know about that, is that maybe because I had both addresses down as endpoints? I have modified app.config on both machines to only point to one another: / 10.0.2.5:47500..47502 /

Re: Ignite .NET and TcpDiscoveryStaticIpFinder failure

I just realised this is the same situation that is logged here here -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Ignite .NET and TcpDiscoveryStaticIpFinder failure

I am using 2 Azure virtual machines, both part of the same VNET. The network security policy is applied at the network level and allows all traffic in/out from the VNET. I am trying to run a cluster across both machines. Seeing as Azure does not support broadcast I am using a static IP list,

Re: Is there a binary of Apache.Ignite.Exe for .NET Core

Perfect thanks -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Is there a binary of Apache.Ignite.Exe for .NET Core

I am using VS Code which complicates things slightly however I managed to get this working minus service support seeing as ServiceBase is not available in .NET Core. This is fine for my purposes at the moment. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Is there a binary of Apache.Ignite.Exe for .NET Core

The source code provides solution and proj files for .NET Core however there is no equivalent for the Apache.Ignite.Exe executable. I am trying to coerce the existing proj file to build a netcoreapp2.0 but am running into compiler complaints so was wondering is there is a csproj file that exists

Re: How to perform distributed compute in similar way to Spark vector UDF

Reading a little more in the Java docs about AffinityKey, I am thinking that, much like vector UDF batch sizing, one way I could easily achieve my result is to batch my rows into affinity keys. That is, for every 100,000 rows the affinity key changes for example. So cache keys [0...9] have

How to perform distributed compute in similar way to Spark vector UDF

I asked this question on StackOverflow However I probably put too much weight on Spark. My question really is, how can I load in a large CSV file to

Re: Question about memory when uploading CSV using .NET DataStreamer

Ok yes i see. Seems like with my code changes I made to provide the example that the memory consumption is way more inline with expectations, so I guess it was a code error on my part. However, it seems strange that my client node, which has no cache, still wants to hang onto over 1Gb of heap

Re: Question about memory when uploading CSV using .NET DataStreamer

In my sample code i had a bit of a bug, this should be the line to add: var _ = ldr.AddData(id++,data); However it doesnt appear to make any difference, this is the state of memory (with ignite.exe being my client executable). This is paused after insertion of 1 million rows, why is my client

Re: Question about memory when uploading CSV using .NET DataStreamer

Here is my source file and a 1 million row CSV file. I am not sure whats different between my code and yours but my version quickly consumes memory on the client side for some reason. Caveat, I am normally a Python programmer so i might have missed something obvious...

Question about memory when uploading CSV using .NET DataStreamer

I have a large CSV file (50 million rows) that i wish to upload to a cache. I am using .NET and a DataStreamer from my application which is designated as a client only node. What i dont understand is i quickly run out of memory on my C# streaming (client) application while my data node (an

Re: Confusion about how to connect to Kubernetes cluster remotely from client app

Thanks Ilya, Am i able to use the .NET API in this way? Connecting to a remote cluster? I am finding the documentation of the configuration a little hard to understand in regards to the options for connection. In the Kubernetes YAML file I see ports for REST, SQL and thin clients, would you use

Confusion about how to connect to Kubernetes cluster remotely from client app

I am new to Ignite and am struggling to figure out how to connect my client application to my Ignite cluster hosted in Azure Kubernetes. Effectively I want to remotely connect, that is, I dont want my client machine to be in the topology, its probably not even in the same country, I would like to