By using this statement 'es.mapping.names’ = ‘time:@timestamp’
You've changed the name of the 'time' field in your hive table to '@timestamp' in your elasticsearch index. See if you have a can find a field called @timestamp in kibana and use that as your time field in ES. Alternatively try removing that line from your hive creation table see if that changes anything. On Sat, Mar 21, 2015 at 2:39 PM, BEN SALEM Omar <omar.bensa...@esprit.tn> wrote: > I want to push data I have in my hadoop cluster to ES and then visualize > the hole thing in kibana4. > > this is what I’ve done : > > 1) > > CREATE TABLE xx(traffic_type_id INT, caller INT, time STRING, > tranche_horaire INT, called INT, call_duration INT, code_type_trafic > STRING, code_destination_trafic STRING, location_number STRING, id_offre > INT, id_service INT) > ROW FORMAT DELIMITED FIELDS TERMINATED BY ‘\t'; > > LOAD DATA INPATH ‘/user/hive/outt.csv’ OVERWRITE INTO TABLE xx; > > ______________________________________________________________ > > 2) > > CREATE EXTERNAL TABLE esxx (caller INT, time STRING, tranche INT, > called_number INT, duration INT, code_type STRING, code_destination STRING, > location STRING, offre INT, service INT) > STORED BY ‘org.elasticsearch.hadoop.hive.EsStorageHandler’ > TBLPROPERTIES(‘es.resource’ = ‘xx/xx’, > ‘es.nodes’=’192.168.238.130:9200′, > ‘es.mapping.names’ = ‘time:@timestamp’); > > INSERT OVERWRITE TABLE escdr SELECT s.caller, s.time, s.tranche_horaire, > s.called, s.call_duration, s.code_type_trafic, s.code_destination_trafic, > s.location_number, s.id_offre, s.id_service FROM xx s; > > _____________________________________________________________ > > 3) > > CREATE EXTERNAL TABLE xx ( > caller INT, > time TIMESTAMP, > tranche INT, > called_number INT, > duration INT, > code_type STRING, > code_destination STRING, > location STRING, > offre INT, > service INT) > STORED BY ‘org.elasticsearch.hadoop.hive.EsStorageHandler’ > TBLPROPERTIES(‘es.resource’ = ‘xx/xx/’, > ‘es.nodes’=’192.168.238.130:9200′, > ‘es.mapping.names’ = ‘time:@timestamp’); > > But Kibana doesn’t seem to recognize my timestamp “time”, ES keeps on > mapping it as a string (the time field in my csv file is as so : exp : > 01AUG2014:19:02:11 ! What should I do and change to let ES do the > appropriate mapping and thus recognize my timestamp? > Best regards, > Omar, > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/30597efd-b762-473d-94aa-9c1671fb0ff4%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/30597efd-b762-473d-94aa-9c1671fb0ff4%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAO9TxdPRV%2BaGkScp58hRfhSzAK4ojDO2NV0MTWt7LGGU9cb-Ow%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
