Re: 3rd-party-store not working (Record is not getting updated in Hive)

2018-09-26 Thread Evgenii Zhuravlev
You can read JavaDoc to this parameter, it have information about 3rd party persistent store: https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/IgniteDataStreamer.html#allowOverwrite-- чт, 27 сент. 2018 г. в 8:35, vbm : > Hi, > > We will try by setting it to True. But the name

Re: 3rd-party-store not working (Record is not getting updated in Hive)

2018-09-26 Thread vbm
Hi, We will try by setting it to True. But the name of the parameter is misleading for the 3rd party store usage. We will get back, if we find issues again. Regards, Vishwas -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Connecting Ignite Cache from Spark examples

2018-09-26 Thread Hemasundara Rao
Hi All, Could you please share some good example on how to consume Ignite Cache on Spark. I am using Ignite on Linux and ignite clients on windows. Thanks and Regards, Hemasundara Rao Pottangi | Senior Project Leader [image: HotelHub-logo] HotelHub LLP Phone: +91 80 6741 8700 Cell: +91 99

Re: Flink Streamer Compatibility.

2018-09-26 Thread Saikat Maitra
Hi, There are multiple options available to check cache contents, separate client is one of the option or you can add dependency of ignite-rest-http and use the rest service. You can also deploy Ignite Web Console and use it. The details to use any of these options are available here

Ignite + Spark: json4s versions are incompatible

2018-09-26 Thread eugene miretsky
Hello, Spark provides json4s 3.2.X, while Ignite uses the newest version. This seems to cause an error when using some spark SQL commands that use a json4s methods that no longer exist. Adding Ignite to our existing Spark code bases seems to break things. How do people work around this issue?

Ignite Web Agent

2018-09-26 Thread Daryl Stultz
Hello, I'm trying to run the Web Console locally using these instructions: https://apacheignite-tools.readme.io/docs/getting-started#section-ignite-web-agent Apache Ignite Tools Documentation

Re: Flink Streamer Compatibility.

2018-09-26 Thread Anand Vijai
Thank you so much for this. Is there an example demonstrating how the cache is accessible? Do we have to start a separate client node to inspect the cache and its contents? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Java 11 and the future of Apache Ignite

2018-09-26 Thread Kamil Misuth
Hi, since Java 11 is not only about new features but also about new licensing terms and new release schedule, I would like to ask about the long term goals of the Apache Ignite project. Question 1: With the new Java release model, it seems Oracle will provide security fixes and backports to

RE: java.lang.NullPointerException in GridDhtPartitionsExchangeFuture

2018-09-26 Thread HEWA WIDANA GAMAGE, SUBASH
Hi Kasnacheev, Thank you very much for the response.. We use v1.9, because 2.x uses mandatory ignite native persistence(local disk) along with durable memory management(RAM), and no option for a **java heap only** cache storage. We wanted to keep away from storing anything in disk. Hence using

Re: Unreasonable segmentation in Kubernetes on one node reboot

2018-09-26 Thread artem_zin
As I noted before, we see these issues on smaller deployments too. Ie right now I'm running configuration with 2 Ignite server pods and 4 Ignite client pods, we see both mentioned symptoms: sudden cache read latency spikes on clients for some requests and topology split between just two Ignite

Re: Unreasonable segmentation in Kubernetes on one node reboot

2018-09-26 Thread artem_zin
Sure, my bad. For context, we run it as distributed key/value storage and don't run any computations on it nor SQL. *Ignite XML config for the server pods:* ``` http://www.springframework.org/schema/beans; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; xsi:schemaLocation="

Re: java.lang.NullPointerException in GridDhtPartitionsExchangeFuture

2018-09-26 Thread Ilya Kasnacheev
Hello! This is a bad error message. I believe that cache in question is no longer consistent between nodes on metadata level, and you can't fix that without full restart or at least dropping and recreating the cache. I don't think that you will get much support from community on 1.x since the

RE: java.lang.NullPointerException in GridDhtPartitionsExchangeFuture

2018-09-26 Thread HEWA WIDANA GAMAGE, SUBASH
This is the only single error from ignite happened after JVM startup. Looks like I only posted the exception stack trace. Here’s the message and from which thread it logged. level:ERROR logger: org.apache.ignite.internal.processors.cache.GridCacheIoManager

Re: Is ID generator split brain compliant?

2018-09-26 Thread Pavel Pereslegin
Anton, IgniteAtomicSequence should work fine with persistence. Ankit, what issue did you encounter when using IgniteAtomicSequence with enabled persistence? What version of Apache Ignite you are using? вт, 25 сент. 2018 г. в 15:11, Anton Vinogradov : > Denis, > > As far as I understand,

Re: Reading from the SQLServer persistence store with write-behind setting

2018-09-26 Thread Ilya Kasnacheev
Hello! You can run cache.loadCache(), it would try to use cache store to restore cache. You could also enable readThrough, test on per key basis. Regards, -- Ilya Kasnacheev ср, 26 сент. 2018 г. в 17:06, michal23849 : > Hi, > > I have the persistence store setup to use the write-behind

Re: ignite .net index group definition

2018-09-26 Thread wt
anyone? i have tried applying it like this but it just creates 2 indexes [QuerySqlField(IsIndexed = true, IndexGroups = new[] { "name=aa,order=1" })] My understanding is under the hood it is essentially btree index and these index structures require an ordinal column configuration to build

Re: ignite .net programatically access cluster config (not working)

2018-09-26 Thread Ilya Kasnacheev
Hello! I don't think so. Why would you want to do that? Regards, -- Ilya Kasnacheev ср, 26 сент. 2018 г. в 16:54, wt : > I don't but looking to query what data regions exist on the cluster. Is > there > a way to do this from the client? > > > > -- > Sent from:

Reading from the SQLServer persistence store with write-behind setting

2018-09-26 Thread michal23849
Hi, I have the persistence store setup to use the write-behind setting and it works pretty smoothly. I wanted to ask how we can use this persistence store as the source of data - actually read from the database

Re: ignite .net programatically access cluster config (not working)

2018-09-26 Thread wt
I don't but looking to query what data regions exist on the cluster. Is there a way to do this from the client? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Inconsistent data.

2018-09-26 Thread Shrikant
I have a scala akka app which is using Ignite to store data. I am using Ignite SDK ignite-spring.2.6.0 to connect to Ignite cluster. Ignite has 3 nodes in the cluster. The app has an endpoint which gets the data from ignite cluster. In normal operation the request to the app is getting the correct

Re: 3rd-party-store not working (Record is not getting updated in Hive)

2018-09-26 Thread Evgenii Zhuravlev
Hi, do you use allowOverwrite=true for DataStreamer Only in this case updates will be propogated to the underlying cache store. Evgenii ср, 26 сент. 2018 г. в 16:27, vbm : > Hi, > > I am using Ignite Data Streamer to pull the record from Kafka and store it > in 3rd party store (hive). > > I am

3rd-party-store not working (Record is not getting updated in Hive)

2018-09-26 Thread vbm
Hi, I am using Ignite Data Streamer to pull the record from Kafka and store it in 3rd party store (hive). I am able to pull the record from kafka and put it in ignite cache, but the write through behaviour is not working and no insert/update is happening to hive. I see entries only in ignite

ignite .net index group definition

2018-09-26 Thread wt
Hi In java a the index groups are defined in a way that makes sense e.g. @QuerySqlField(orderedGroups={@QuerySqlField.Group( name = "age_salary_idx", order = 0, descending = true)}) in .net however it looks like this [QuerySqlField(IsIndexed =true, IndexGroups = new[] {"someIndexGroup"})]

Load data into particular Ignite cache from HDFS

2018-09-26 Thread Divya Darshan DD
Can you tell me a method to load files from HDFS into particular cache region of Ignite. I know loadCache can be used but it is expecting parameters in the form of Key value pair so not able to understand how to use this method for loading complete files Apologies for any usage of wrong

Re: determine when client is connected

2018-09-26 Thread Ilya Kasnacheev
Hello! boolean ignite.cluster().active(); Regards, -- Ilya Kasnacheev ср, 26 сент. 2018 г. в 12:13, wt : > the Isactive method only checks if the grid is active. is there a way to > check when the client has connected to resume processing? > > > > -- > Sent from:

Re: ignite .net programatically access cluster config (not working)

2018-09-26 Thread Ilya Kasnacheev
Hello! Why do you have data regions on client node? Regards, -- Ilya Kasnacheev вт, 25 сент. 2018 г. в 20:24, wt : > hi > > I have a single node cluster started with the following config > > >maxSize="124288000"/> > > persistenceEnabled="true" maxSize="524288000"

determine when client is connected

2018-09-26 Thread wt
the Isactive method only checks if the grid is active. is there a way to check when the client has connected to resume processing? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: java.lang.IllegalArgumentException: Can not set final

2018-09-26 Thread Ilya Kasnacheev
Oh! Normally, BinaryObject should of course work with both boxed and unboxed fields. Note that BinaryObject has setField(name, val, type) - > you can pass Integer.class or you may pass Integer.TYPE there to get different behaviour. Unfortunately it's hard to say more just from the fragments of

Issues running Ignite with Cassandra and spark.

2018-09-26 Thread Shrey
Hi, we are using Ignite as a cache layer over Cassandra for faster read queries using spark. Our cluster has 10 nodes running an instance of Cassandra and Ignite. However, we came across a few issues: 1) We currently store the data from spark to cassandra. Hence to load data, we need to call

Re: Unreasonable segmentation in Kubernetes on one node reboot

2018-09-26 Thread Maxim.Pudov
What about logs from other nodes? This one doesn't tell much. Could you share you kubernetes config? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Working example for HDFS-Ignite data eviction

2018-09-26 Thread Divya Darshan DD
Is there some working example where data is pulled from HDFS and saved into Ignite cache and based on some eviction policy, data is being swapped between HDFS and Ignite Thanks and Regards, Divya Bamotra