Re: Passing Elastic Search Mappings in Spark Conf

2015-04-16 Thread Deepak Subhramanian
Thanks Nick. I understand that we can configure the index by creating the index with the mapping first. I thought it will be a good feature to be added in the es-hadoop /es-spark as we can have the full mapping and code in a single space especially for simple mappings on a particular field. It

Passing Elastic Search Mappings in Spark Conf

2015-04-15 Thread Deepak Subhramanian
Hi, Is there a way to pass the mapping to define a field as not analyzed with es-spark settings. I am just wondering if I can set the mapping type for a field as not analyzed using the set function in spark conf as similar to the other es settings. val sconf = new SparkConf()

Re: Passing Elastic Search Mappings in Spark Conf

2015-04-15 Thread Nick Pentreath
If you want to specify mapping you must first create the mappings for your index types before indexing. As far as I know there is no way to specify this via ES-hadoop. But it's best practice to explicitly create mappings prior to indexing, or to use index templates when dynamically creating