RE: Error while persisting from Ignite to Hive for a BinaryObject

2019-01-24 Thread Premachandran, Mahesh (Nokia - IN/Bangalore)
that actual type of apnId in ApnDiameter5Min is neither Long nor String but some other complex type? Can you attach those types? Regards, -- Ilya Kasnacheev ср, 23 янв. 2019 г. в 18:37, Premachandran, Mahesh (Nokia - IN/Bangalore) mailto:mahesh.premachand...@nokia.com>>: Hi Ilya, The

RE: Error while persisting from Ignite to Hive for a BinaryObject

2019-01-23 Thread Premachandran, Mahesh (Nokia - IN/Bangalore)
will serialize value to one big field in BinaryObject formar. Regards, -- Ilya Kasnacheev ср, 23 янв. 2019 г. в 15:47, Premachandran, Mahesh (Nokia - IN/Bangalore) mailto:mahesh.premachand...@nokia.com>>: Hi all, I am trying to stream some data from Kafka to Ignite using IgniteDataSt

Error while persisting from Ignite to Hive for a BinaryObject

2019-01-23 Thread Premachandran, Mahesh (Nokia - IN/Bangalore)
Hi all, I am trying to stream some data from Kafka to Ignite using IgniteDataStreamer and use 3rd party persistence to move it to HIVE. The data on Kafka is in avro format, which I am deserailising, populating an Ignite BinaryObject using the binary builder and pushing it to Ignite. It works

Ignite Cache metrics on K8s

2018-09-19 Thread Premachandran, Mahesh (Nokia - IN/Bangalore)
Hi, I am trying to fetch some cache metrics from Ignite 2.5 running on k8s. Enabled the cache level metrics by setting the below property in ignite config xml for specific cache. But both "ignite_org_apache_ignite_internal_processors_cache_cacheclustermetricsmxbeanimpl_cacheputs" and

RE: Spark Ignite connection using Config file

2018-06-06 Thread Premachandran, Mahesh (Nokia - IN/Bangalore)
HI Bhaskar, I am not sure about that, we ran into few issues while integrating spark 2.3 with Ignite 2.4 on K8s, was told that spark 2.3 is not supported as of now. I switched to 2.2 spark and was able to get it working on VMs, but not on k8s. -Original Message- From: bhaskar

RE: Spark Ignite connection using Config file

2018-06-05 Thread Premachandran, Mahesh (Nokia - IN/Bangalore)
Hi Bhaskar, I see that you're using spark 2.3, which ignite does not support as of now. https://issues.apache.org/jira/browse/IGNITE-8534 -Original Message- From: bhaskar [mailto:bhaskar.thungathu...@gmail.com] Sent: Wednesday, June 06, 2018 7:26 AM To: user@ignite.apache.org Subject:

RE: Spark + Ignite standalone mode on Kubernetes cluster.

2018-06-05 Thread Premachandran, Mahesh (Nokia - IN/Bangalore)
We are trying to integrate spark 2.2.0 with Ignite 2.4 on kubernetes, and getting the following exception. 2018-06-06 03:23:51 INFO GridDiscoveryManager:495 - Topology snapshot [ver=3, servers=2, clients=1, CPUs=12, offheap=3.1GB, heap=3.0GB] Exception in thread "main"

Spark + Ignite standalone mode on Kubernetes cluster.

2018-06-01 Thread Premachandran, Mahesh (Nokia - IN/Bangalore)
Hello, I have been trying to use Spark with Ignite (standalone mode) on a Kubernetes cluster and is running into some issues. Some details about the setup. K8s Version: 1.9.7 Spark Version: 2.3.0 Ignite Version: 2.4.0 RBAC disabled. I have been using the example provided