I see. You probably have to merge mappings with very big mappings!
What is your application searching for? Logs? Users?
--
David ;-)
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 9 janv. 2014 à 10:06, xjj210...@gmail.com a écrit :
> Thanks David .
> Yes , I test it with curl. If the json data is not too big, There is
> no problem. The test json format is following:
> {
> "name":["user1","user2","user3",....],
> "product":{},
> "price":{}
> }
>
> The difference is the two json data is :
> The last json data include too many key/value, like the following:
>
> {
> "name":["user1","user2","user3",....],
> "product":{},
> "price":{},
> "attr":{
> "user1":{{"costprice":"122"},{"sellprice":"124"},{"stock":"12"},{"sell":"122"},{},{}],
> "user2":{{"costprice":"122"},{"sellprice":"124"},{"stock":"12"},{"sell":"122"},{},{}],,
> "user3":{{"costprice":"122"},{"sellprice":"124"},{"stock":"12"},{"sell":"122"},{},{}],
> ......
> }
> }
>
> There are more than 3000 items in attr key. So it used too many memory.
> Thanks again.
>
>
> On Thursday, January 9, 2014 3:15:59 PM UTC+8, David Pilato wrote:
>>
>> Just wondering if you are hitting the same RAM usage when inserting without
>> thrift?
>> Could you test it?
>>
>> Could you gist as well what gives:
>>
>> curl -XGET 'http://localhost:9200/_nodes?all=true&pretty=true'
>>
>>
>> --
>> David Pilato | Technical Advocate | Elasticsearch.com
>> @dadoonet | @elasticsearchfr
>>
>>
>> Le 9 janvier 2014 at 07:11:33, xjj2...@gmail.com (xjj2...@gmail.com) a écrit:
>>
>>> The env is following:
>>> --elasticseasrch v0.90( i use 0.90.9 , the problem is still exist).
>>> -- java version is 1.7.0_45
>>>
>>> On Wednesday, January 8, 2014 6:58:02 PM UTC+8, xjj2...@gmail.com wrote:
>>>>
>>>> Dear all:
>>>> I insert 10000 logs to elasticsearch, each log is about 2M, and
>>>> there are about 3000 keys and values.
>>>> when i insert about 20000, it used about 30G memory, and then
>>>> elasticsearch is very slow, and it's hard to insert log.
>>>> Could someone help me how to solve it? Thanks very much.
>>> --
>>> You received this message because you are subscribed to the Google Groups
>>> "elasticsearch" group.
>>> To unsubscribe from this group and stop receiving emails from it, send an
>>> email to elasticsearc...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/elasticsearch/caec9b84-c543-4bb3-8cb0-e90113972716%40googlegroups.com.
>>> For more options, visit https://groups.google.com/groups/opt_out.
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to elasticsearch+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/elasticsearch/d8d1c975-a9f2-47c6-97e4-54ba5f163284%40googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9B042F72-32F3-43EE-8BD2-2A32347E0984%40pilato.fr.
For more options, visit https://groups.google.com/groups/opt_out.
