Hi, we are setting up a Elasticsearch 1.0 (RC2) Cluster and I think I need some help were to start with (settings related). We have got 6 physical server with 265GB RAM and 2TB local SAS storage (seperated in two Raid10 Groups as LVM VGs). Those six servers are running Ubuntu 14.04. All "roles" (Application Server [NGINX+PHP-FPM+GlusterFS-Client+Elasticsearch "searcher"], Database Server [Galera Cluster], Storage Server [GlusterFS], Cache Server [Redis] ...) will be running in LXC containers. Most of them Ubuntu 14.04 only the Galera Cluster in 12.04. We expect about 100GB of data to index and the data is changing not that fast (5% per day?). The idea is to install Elastic Search on all 6 Application Severs as "searcher" with:
cluster.name: search001 node.master: false node.data: false #node.master: true #node.data: true node.max_local_storage_nodes: 1 index.number_of_shards: 5 index.number_of_replicas: 2 Add 3 "data" Nodes with: cluster.name: search001 node.master: false #node.data: false #node.master: true node.data: true node.max_local_storage_nodes: 1 index.number_of_shards: 5 index.number_of_replicas: 2 bootstrap.mlockall: true and 3 "master" nodes: cluster.name: search001 #node.master: false node.data: false node.master: true #node.data: true node.max_local_storage_nodes: 1 index.number_of_shards: 5 index.number_of_replicas: 2 The LXCs for those "searchers" get 8GB RAM, the "masters" get 2GB RAM and the "data" LXCs get 60GB and 300GB storage. What about the Java settings for those "data" nodes??? cat /etc/default/elasticsearch # Run Elasticsearch as this user ID and group ID ES_USER=elasticsearch ES_GROUP=elasticsearch # Heap Size (defaults to 256m min, 1g max) ES_HEAP_SIZE=30g # Heap new generation ES_HEAP_NEWSIZE=1g # max direct memory ES_DIRECT_SIZE=??? # Maximum number of open files, defaults to 65535. MAX_OPEN_FILES=65535 # Maximum locked memory size. Set to "unlimited" if you use the # bootstrap.mlockall option in elasticsearch.yml. You must also set # ES_HEAP_SIZE. MAX_LOCKED_MEMORY=unlimited # Maximum number of VMA (Virtual Memory Areas) a process can own MAX_MAP_COUNT=262144 #more???? # Elasticsearch log directory #LOG_DIR=/var/log/elasticsearch # Elasticsearch data directory #DATA_DIR=/var/lib/elasticsearch # Elasticsearch work directory #WORK_DIR=/tmp/elasticsearch # Elasticsearch configuration directory #CONF_DIR=/etc/elasticsearch # Elasticsearch configuration file (elasticsearch.yml) #CONF_FILE=/etc/elasticsearch/elasticsearch.yml # Additional Java OPTS #ES_JAVA_OPTS= # Configure restart on package upgrade (true, every other setting will lead to not restarting) #RESTART_ON_UPGRADE=true What about the master and searcher settings? I guess I do not have to tune them? Thank you for any help! Regards, Flo -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/15991fc2-749e-4197-b854-88b5f64fc14a%40googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
