Re: Problem with ES- Shield

2015-04-03 Thread 'BEN SALEM Omar' via elasticsearch
I've tried this : create external table es_word(word string,cnt bigint) STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler' TBLPROPERTIES('es.resource' = 'secure/secure', 'es.nodes'='192.168.238.130:9200', 'es.net.http.auth.user'='myysername',

Re: Problem with ES- Shield

2015-04-03 Thread Costin Leau
Turn on logging in es-hadoop on the REST package [1]. This will indicate the type of connection made and any authentication scheme applied and its result. [1] http://www.elastic.co/guide/en/elasticsearch/hadoop/master/logging.html On 4/3/15 4:05 PM, 'BEN SALEM Omar' via elasticsearch wrote:

Re: Problem with ES- Shield

2015-04-02 Thread Costin Leau
The configuration example is correct - one can pass any configuration property there and it will be picked up as explained here [1] Additionally, to verify one can turn on logging [2] to see the connection is properly authenticated [1]

Re: Problem with ES- Shield

2015-04-02 Thread 'BEN SALEM Omar' via elasticsearch
Hey Cosin, And when It comes to the marvel? Can you see why It's not seeing my indices? Thanks, On Thu, Apr 2, 2015 at 9:46 PM, Costin Leau costin.l...@gmail.com wrote: The configuration example is correct - one can pass any configuration property there and it will be picked up as explained

Re: Problem with ES- Shield

2015-04-02 Thread 'BEN SALEM Omar' via elasticsearch
Hi Jay, I have a question, now that I've added an esuser as an admin, I can not run my Kibana anymore, Any idea on what to do to overcome this? Another basic question, when I open the marvel, it shows no indice because the sample of data I'm working with is in 2014, how to change my time span

Re: Problem with ES- Shield

2015-04-02 Thread Jay Modi
Hi Omar, Have you configured Kibana and Marvel to work with Shield? For Kibana 4, please see http://www.elastic.co/guide/en/kibana/current/production.html#configuring-kibana-shield and http://www.elastic.co/guide/en/shield/current/_shield_with_kibana_4.html. For Marvel, see

Re: Problem with ES- Shield

2015-04-02 Thread 'BEN SALEM Omar' via elasticsearch
Hi Jay, Now that I have shield in both ES and Kibana, and I want to load some data from my hadoop cluster to ES. I usually do this : create external table es_word_count(word string, count int) STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler' TBLPROPERTIES('es.resource' =

Re: Problem with ES- Shield

2015-04-02 Thread 'BEN SALEM Omar' via elasticsearch
That would be a problem ! Last question (as for now :p ), how to change the marvel timepicker? I can't see any indice of mine(as I already told you) And hey, thank you for your cooperation Jay ᐧ On Thu, Apr 2, 2015 at 6:26 PM, Jay Modi j...@elastic.co wrote: Hi Omar, I think you need to add

Re: Problem with ES- Shield

2015-04-02 Thread 'BEN SALEM Omar' via elasticsearch
Yes I had, I used to manage my cluster with marvel perfectly and all the indices used to show up. But now, none of them seem to be found due to time span; and even when I removed the shield this porblem occured. I don't see how to restore the previous configuration. Any idea? ᐧ On Thu, Apr 2,

Re: Problem with ES- Shield

2015-04-02 Thread Jay Modi
Hi Omar, I think you need to add es.net.http.auth.user and es.net.http.auth_password as additional TBLPROPERTIES. You will need to using elasticsearch Hadoop 2.1 beta 3 for this to work as far as I know. -Jay On Thursday, April 2, 2015 at 11:18:12 AM UTC-4, BEN SALEM Omar wrote: Hi Jay,

Re: Problem with ES- Shield

2015-04-02 Thread 'BEN SALEM Omar' via elasticsearch
Or not, that wenti as I'd like to go :)) Here is the last remaining issue : ​ ᐧ On Thu, Apr 2, 2015 at 6:32 PM, BEN SALEM Omar omar.bensa...@esprit.tn wrote: That would be a problem ! Last question (as for now :p ), how to change the marvel timepicker? I can't see any indice of mine(as I

Re: Problem with ES- Shield

2015-04-02 Thread Jay Modi
There should not be anything extra necessary to work with Marvel. The browser prompted you for credentials and you entered admin credentials, correct? On Thursday, April 2, 2015 at 12:39:03 PM UTC-4, BEN SALEM Omar wrote: Or not, that wenti as I'd like to go :)) Here is the last remaining

Re: Problem with ES- Shield

2015-04-02 Thread 'BEN SALEM Omar' via elasticsearch
Jay, when it comes to adding the .user and .password in the tblproperties Do you know what exactly to do? let's suppose that my admin esuser is omar and pwd omar what should I do? TBLPROPERTIES('es.resource' = 't/t', 'es.nodes'='192.168.238.130:9200', and now what to write); and is

Re: Problem with ES- Shield

2015-04-02 Thread Jay Modi
Still not sure what's going on with Marvel, unfortunately. No idea if this will help, but have you tried clearing your browser cache or using a incognito window? I think something like this: TBLPROPERTIES('es.resource' = 't/t', 'es.nodes'='192.168.238.130:9200',

Problem with ES- Shield

2015-04-01 Thread BEN SALEM Omar
I wanted to add authentication to my ES, thus I downloaded the shield : https://www.elastic.co/downloads/shield Then I've tried to add a user to give him the admin role as it's mentionned here : http://www.elastic.co/guide/en/shield/current/getting-started.html (I've added it with root, cause I

Re: Problem with ES- Shield

2015-04-01 Thread 'BEN SALEM Omar' via elasticsearch
When I try to add an esuser and grant him a role: bin/shield/esusers useradd rdeniro -p taxidriver -r admin It says that there is an error in the esusers file in the elef['$ES_INCLUDE] line, I think the line 31 or 38, I forgot. In the line above, there is a $...done: which ends with :, if you

Re: Problem with ES- Shield

2015-04-01 Thread Jay Modi
I'm glad you were able to fix this issue. I have a few questions that may help us ensure this fix is pulled back into Shield. What OS and Shell are you using? Which line in the script did you change exactly? I'm looking at the script right now and I don't see any instance of done: Just an FYI,

Re: Problem with ES- Shield

2015-04-01 Thread BEN SALEM Omar
Ok, I've managed to solve my own problem. First of all things, if you want to just remove the shield plugin run under the elasticsearch : $ bin/plugin --remove shield Now, to the syntax error in the elef line in the esusers, generally, when there is such an error, it's related to things