I set max_gram=20. It's better but at the end I have this many times : [2014-06-20 11:42:14,201][WARN ][monitor.jvm ] [ik-test2] [gc][young][528][263] duration [2s], collections [1]/[2.1s], total [2s]/[43.9s], memory [536mb]->[580.2mb]/[1015.6mb], all_pools {[young] [22.5mb]->[22.3mb]/[66.5mb]}{[survivor] [14.9kb]->[49.3kb]/[8.3mb]}{[old] [513.4mb]->[557.8mb]/[940.8mb]}
I put ES_HEAP_SIZE : 2G. I think it's enough. Something wrong ? Le jeudi 19 juin 2014 17:57:46 UTC+2, Tanguy Bernard a écrit : > > Hello > I have some issue, when I index a particular data "note_source" (sql > longtext). > I use the same analyzer for each fields (except date_source and id_source) > but for "note_source", I have a "warn monitor.jvm". > When I remove "note_source", everything fine. If I don't use analyzer on > "note_source", everything fine, but if I use my analyzer on "note_source" I > have some crash. > > I think I have enough memory, I have used ES_HEAP_SIZE. > Maybe my problem it's with accent (ascii, utf-8) > > Can you help me with this ? > > > > *My Setting* > > public function createSetting($pf){ > $params = array('index' => $pf, 'body' => array( > 'settings' => array( > 'number_of_shards' => 5, > 'number_of_replicas' => 0, > 'analysis' => array( > 'filter' => array( > 'nGram' => array( > "token_chars" =>array(), > "type" => "nGram", > "min_gram" => 3, > "max_gram" => 250 > ) > ), > 'analyzer' => array( > 'reuters' => array( > 'type' => 'custom', > 'tokenizer' => 'standard', > 'filter' => array('lowercase', 'asciifolding', > 'nGram') > ) > ) > ) > ) > )); > $this->elasticsearchClient->indices()->create($params); > return; > } > > > *My Indexing* > > public function indexTable($pf,$typeElement){ > > $params =array( > "index" =>'_river', > "type" => $typeElement, > "id" => "_meta", > "body" =>array( > > "type" => "jdbc", > "jdbc" => array( > "url" => "jdbc:mysql://ip/name", > "user" => 'root', > "password" => 'mdp', > "index" => $pf, > "type" => $typeElement, > "sql" => select id_source as _id, id_sous_theme, > titre_source, desc_source, note_source, adresse_source, type_source, > date_source from source, > "max_bulk_requests" => 5, > ) > ) > > ); > > > $this->elasticsearchClient->index($params); > } > > Thanks in advance. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/154b8ca2-a130-4062-b5ce-0e0fa63d98fe%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.