There's heaps of good docs;
http://logstash.net/docs/1.4.2/
http://www.logstashbook.com/
If you want separate data then keep separate stacks! You can use the one ES
cluster if you want and then just use different indexes.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma
I'd go with option 3 and use puppet to manage it.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 15 October 2014 08:10, Rémi Nonnon remi.non...@gmail.com wrote:
Hi,
I think the 2nd proposition could be the worst
Yes it will work, and probably the same way as pre 1.X.
The elasticsearch puppet module could handle this for you.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 14 October 2014 20:21, haries fajar nugroho harie
Increasing queues isn't going to help if there are underlying problems
stopping the processing.
Based on those errors it looks like you may have network issues, but they
are from July?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web
It's all absolute paths.
You could just run multiple, contained instances rather than multiple data
dirs.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 13 October 2014 03:03, Alexandre Rafalovitch arafa
You can use the same binaries, but if you setup multiple configs pointing
to different data directories then you can leverage -Des.config pointing to
each config and then run multiple instances.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web
From what I understand (which may not be 100% right), most of the overhead
is with generating and dealing with the HTTP request as it's a heavy
operation.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 11 October
Why not use aliases?
This way you can move larger customers to their own index if need be.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 11 October 2014 01:54, jnortey jeremy.nor...@gmail.com wrote:
Lets say
A and B should be ok, not sure on C as I believe that a/sync is on an index
level and would apply to any and all replicas.
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/docs-index_.html#index-replication
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email
We use VMs as we knew the tech, we did consider containers (eg docker) but
they were still new to us and considered a risk.
Running multiple instance on a single node can work, you just need to be
able to manage it. The Elasticsearch puppet module lets you do this though.
Regards,
Mark Walkom
Only set ES_HAP_SIZE, there is no point setting all 3 separately.
Best practise is to use 50% of system RAM, in your case that'd be 15GB.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 11 October 2014 20:20, Deepak
Did you get better writes?
What sort of storage are you on, did you measure before and after, are you
reaching I/O limits?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 9 October 2014 17:33, Kang-min Liu gu
How much data is in your cluster?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 9 October 2014 18:25, David Pilato da...@pilato.fr wrote:
Any chance you could try elasticsearch 1.3.4?
David
Le 9 oct. 2014 à
This entirely depends on your data structure, volume and cluster sizing.
Hundreds works, thousands should be ok if you have a lot of nodes, tens of
thousands is even more nodes.
Aliases will also affect your requirements.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma
Why are you restarting the node every week?
That sounds like a problem you should solve to stop this one happening.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 8 October 2014 07:56, Ankush Jhalani ankush.jhal
/_cluster/settings.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 8 October 2014 04:27, Larry killerbea...@gmail.com wrote:
I've been playing with both Elasticsearch and Solr. I have made much more
progress
I vaguely recall a way of doing this by adding the URL of the cluster to
the URL you enter in the browser, but I can't find a way in the docs.
Have a search through the archives here, I am pretty sure the author (Roy)
posted it.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
can't open it then install something like ElasticHQ or
kopf.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 8 October 2014 02:02, Pitaga ach...@blarg.net wrote:
I'm running Elasticsearch 1.0 on an Ubuntu 13.10
It's a 0.90 release.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 8 October 2014 09:02, Tim Swetonic sweto...@gmail.com wrote:
Thanks. Is there a disconnect in the version numbers here? Is 0.90.10 a
1.0 release
You should ask this over on the Logstash list -
https://groups.google.com/forum/?hl=en-GB#!forum/logstash-users
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 4 October 2014 22:24, Madhu Neal madhu.n...@gmail.com
If you haven't already, check out the docs -
http://www.elasticsearch.org/guide/
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 5 October 2014 14:53, naveen gayar navind...@gmail.com wrote:
Hi
I wish to know
Nope, it's for the node as a whole.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 3 October 2014 07:18, Andrew Mehler meh...@gmail.com wrote:
If I hava multiple data dirs on a node, can I apply these settings
You can easily add more nodes.
You cannot however add more shards to an index, which is probably what you
are getting at.
The simple solution to that is to over allocate your initial shard count to
cater for more servers.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma
You might be able to achieve this with versioning -
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/docs-index_.html#index-versioning
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 2 October
Kibana does everything via the Elasticsearch APIs.
You might want to have a poke around the docs -
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/index.html
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web
, then you may have to pay someone ;)
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 30 September 2014 05:00, shakul shakul.hameed...@gmail.com wrote:
Hi Mark,
Thanks for the response.
I'm expecting a load of 100 M
Can you do an ls -ld /srv/backup and provide the output?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 29 September 2014 18:45, Alex Harvey alexharv...@gmail.com wrote:
Hi all,
I have been struggling to put
Are you running the same version across all the nodes?
Is there anything in the logs on your master?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 26 September 2014 22:49, satishmallik satishmal...@gmail.com wrote
Is the cluster external to the LS instance?
Check the logs of your ES master server, it should show the logstash node
join, if you aren't seeing that then enable verbose mode in LS and you
should see the issue.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma
, if
you're wanting this functionality then it'd be worth creating a github
issue with the request.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 28 September 2014 01:12, vic hargrave vichargr...@gmail.com wrote
You want to move the mapping?
This might help -
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/indices-put-mapping.html
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 25 September 2014 17:52
categorisation.
If you want to know more about the Logstash side of things then it's a good
idea to sign up to that mailing list as well -
https://groups.google.com/forum/?hl=en-GB#!forum/logstash-users
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
.
As for your pattern problem, if the rsyslog output contains the daemon name
that generated the log entry, as it should, then it is simple to categorise
the entry.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 25
Raid 0 , don't use 5 as the performance is sucky and ES is i/o intensive.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 26 September 2014 06:01, joergpra...@gmail.com joergpra...@gmail.com
wrote:
If you have
Checked your logs?
What ES and java version, how many nodes (data and master) and how much
data do you store (doc, size and index counts).
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 25 September 2014 00:09
There are a few blog posts, but nothing consolidated.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 25 September 2014 07:58, pavan.bkv pavan@gmail.com wrote:
Thanks Mark. Appreciate the response
You're first bet is always the docs - http://www.elasticsearch.org/guide/
You want with either the _cat/indices or the indices API.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 26 September 2014 02:11, gthoman
Not unless it's a single node cluster :)
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 26 September 2014 10:59, vic hargrave vichargr...@gmail.com wrote:
I'm new to the Elasticseach snapshot API
Now is an entirely relative time period and you cannot fix it to a specific
point.
I'm not sure you can achieve a fixed period in kibana though.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 25 September 2014 04
ES does scale better horizontally.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 24 September 2014 08:24, pavan.bkv pavan@gmail.com wrote:
Can anyone answer this?
--
View this message in context:
http
What state is your cluster in? Can you get _cat/health to return?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 25 September 2014 08:16, Chris Denneen cdenn...@gmail.com wrote:
If anyone can help me understand
I don't think it's anything you should be overly worried about as GC is
normal.
I am not sure why this is considered a warn level though.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 23 September 2014 00:27
The work directory is deprecated as far I know, so you shouldn't need to
worry about it.
Logging will depend on what you do and how you manage retention, eg I just
checked one of our nodes and it has 400MB of logs for this month so far.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign
An announce list would be awesome :)
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 22 September 2014 04:06, Igal @ getRailo.org i...@getrailo.org wrote:
I understand, but thanks to your project's success
What are the ownership and permissions on the directory?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 21 September 2014 19:42, vyeluri vyelu...@gmail.com wrote:
Hi,
I have a similar problem. Ive defined
If you can send an email like this to the list then you're already
subscribed!
Otherwise check out https://support.google.com/groups/answer/1067205?hl=en
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 21 September
, and then move the indexes onto slower
SAS/SATA drives after that time.
A lot of what you may need depends on our retention period and how you
expect to have the data accessed.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 20
You can disable http entirely, that's it
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-http.html#_disable_http
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 20 September 2014 01:41
It looks like networking issues, lots of connection reset/closed/timeout.
It might help if you can out your configs into a pastebin too.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 20 September 2014 04:33
There is a few good results here
https://www.google.com.au/?gws_rd=ssl#q=kibana+https+apache
Check out
http://blog.stevenmeyer.co.uk/2014/02/securing-kibana-and-elasticsearch-with-https-ssl.html
for example
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma
Also given you're over 32GB heap your java pointers aren't going to be
compressed, which means GC will suffer.
You haven't mentioned what ES and java versions you are using, which would
be useful.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web
Does your server have hardware RAID capabilities?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 18 September 2014 19:30, bob.web...@gmail.com wrote:
Good point on heap, so I will bring that back down to 30GB
You'd get a much greater benefit from RAID than you will by using all disks
as individuals.
You can however use multiple mountpoints to store ES data it's just an
array in path.data.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web
Check out Tribe Nodes -
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-tribe.html#modules-tribe
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 19 September 2014 00:43, Sree srssreej
That's a lot of data, do you have a big budget, automation, monitoring?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 17 September 2014 20:41, P Suman papanaboina.su...@gmail.com wrote:
Hello,
We are planning
Can you manually test all of that using telnet?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 16 September 2014 20:09, Abhishek Aggarwal boyobo...@gmail.com wrote:
Thanks for the reply. I am facing this error
though, if you're new then
install plugins like ElasticHQ and kopf, they will give you some good
visual insight into Elasticsearch and lets you manage it via the GUI.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 16
You should ask this over on the logstash list -
https://groups.google.com/forum/?hl=en-GB#!forum/logstash-users :)
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 17 September 2014 06:04, Marty Hillman antimi
Are they on the same network?
Can you telnet to each of the hosts?
It looks like the two nodes don't have access to each other, hence the no
route to host error.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 15
Your problem is a docker networking issue, not an ES one.
I'm not familiar with docker so can't help much more sorry.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 15 September 2014 21:34, Anand kumar anandv1
You should really ask that on the logstash group -
https://groups.google.com/forum/?hl=en-GB#!forum/logstash-users
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 12 September 2014 18:27, Atul K atulnkhair
That's a lot of data for 3 nodes!
You really need to adjust your infrastructure; add more nodes, more ram, or
alternatively remove some old indexes (delete or close).
What ES and java version are you running?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma
across, as that is where ES excels and also how
many other big data platforms operate.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 12 September 2014 19:01, Pavel P pa...@kredito.de wrote:
Java version is 1.7.0_55
for one primary shard per node but you can over
allocate if you expect to grow - ie create 6 shards if you expect to grow
to 6 servers. This applies on larger clusters as well, to a point.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web
into it and you would have an awesome elastic compute
platform. Or just use something like OpenStack, though it might be a bit
heavy.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 13 September 2014 03:16, Jack Park jackp
?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 12 September 2014 22:40, spezam spe...@gmail.com wrote:
Hi All,
we currently have an Elasticsearch (1.1.1) cluster distributed among DCs
* 3 Data nodes in 3 DC
* 1
We also use it in dev for months across various ES and Java 8 releases, I
have been considering rolling it out to a smaller prod cluster as well as
we've had no problems at all.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web
You should be able to just copy them across and then start ES with your new
path value, yes.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 12 September 2014 03:37, shriyansh jain shriyanshaj...@gmail.com wrote
in that regards.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 12 September 2014 05:03, Konstantin Erman kon...@gmail.com wrote:
We have different indexes for different log types and one index of each
type is generated
Your assumption is correct, one node per shard. You can over allocate if
you expect or want to add more nodes in the future.
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send
Because kibana connects from the users desktop to ES.
You can reverse proxy this very easily, there are a few example configs in
the KB code to help ad it's worth doing.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
If you're running a cluster across those links then you need to expect
problems as ES is latency sensitive.
You may be better off looking into tribe nodes -
http://www.elasticsearch.org/guide/en/elasticsearch/reference/master/modules-tribe.html
Regards,
Mark Walkom
Infrastructure Engineer
Check out the cat APIs for, there are end points for indexes and shards
that will give you this info.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 8 September 2014 23:34, Johnathan Phan jp...@berryjar.com wrote
Your second two links do not work.
Can you add another node, or close some old indexes?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 4 September 2014 20:18, 王星龙 xinglong.w...@upai.com wrote:
Hi,everyone
I'm
Easiest way is to drop the replicas and then re-add them.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 5 September 2014 08:30, daa qqu daa...@gmail.com wrote:
Hello everyone,
I am new to ES and need some help
Ok I'll bite, what do you mean by moustache search?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 3 September 2014 07:33, Damian Wood damian.woood9...@gmail.com wrote:
I want to use search templates to generate
Did you change path.data as well in elasticsearch.yml?
If not, what are the two values you have on each node.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 3 September 2014 20:46, Andrew Lakes alakes...@gmail.com
If it's a replica, which it appears to be, then just drop the replicas on
the problem index to 0 and then readd them.
This is a quick and dirty fix, I'm not sure if there is a way to recover
the underlying shard as it.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma
Yes you can use wildcards.
The easiest way to tell would be to use the cat APIs, eg _cat/shards?v
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 4 September 2014 08:58, eistconn david.mant...@gmail.com wrote:
I
Oh right, yeah that'd fix it too :p
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 4 September 2014 09:22, eistconn david.mant...@gmail.com wrote:
Just did this:
curl -XPUT 'localhost:9200/_settings' -d
Have you checked your hardware status as the error mentioned? I'd also do a
FS check to be safe.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 3 September 2014 14:58, David Kleiner david.klei...@gmail.com wrote
That's the best method as per
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-cluster.html#allocation-awareness
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 29 August 2014 20:45
Are you using marvel at all? It uses an index with a single shard by
default.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 29 August 2014 02:04, Eddy Meds zqckf...@gmail.com wrote:
Hello
I created an index
Yep, the easiest way is to drop the replica and then add it back and see
how you go.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 29 August 2014 08:40, David Kleiner david.klei...@gmail.com wrote:
Greetings
It'd be worth raising this as an issue on Github if you are concerned, at
least then the ES devs will see it :)
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 27 August 2014 18:34, Martin Forssen m
It depends on what you are exactly doing but there are document TTLs that
might suit, but they are resource intensive.
A plugin could work as you could leverage the quartz scheduler libraries to
handle running it.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma
You cannot launch/access a plugin on a different port, it has to be on the
same port that ES is running on.
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email
to
Check the logs under /var/log/elasticsearch, they should have something.
Also please be aware that 1.2.0 has a critical bug and you should be using
1.2.1 instead.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 27
ElasticHQ is a community plugin, the ES devs can't help here.
I have raised issues against ElasticHQ in the past and Roy has fixed them
pretty quickly :)
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 27 August
Nope.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 27 August 2014 09:14, kti...@hotmail.com wrote:
Hi,
I started using Marvel for my cluster monitoring.
Does Marvel have a way to set notification such as send
/elasticsearch/reference/current/modules-gateway.html#recover-after
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 26 August 2014 23:37, Chris Neal chris.n...@derbysoft.net wrote:
Hello all,
Question
about
can
handle, then extrapolate.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 27 August 2014 06:24, Gaurav Tiwari gtins...@gmail.com wrote:
Hi ,
We are analyzing ES for storing our log data (~ 400 GB/Day
Also, you should really be monitoring your systems and core measurements
(disk, CPU etc) with something specific for the job.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 27 August 2014 09:16, Mark Walkom ma
(You should really set Xms and Xmx to be the same.)
But it's not faulty, it's probably just GC which should be visible in the
logs. How much data do you have in your cluster?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web
That sort of shard count is ok on your cluster as you have 17 nodes :)
Can you give us more details on what sort of hardware you run on, your
java, ES and OS versions and releases?
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web
You should really ask this on the Logstash list -
https://groups.google.com/forum/#!forum/logstash-users
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 26 August 2014 00:49, Shih-Peng Lin shihpeng@gmail.com
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-indices.html
states It is a global setting that bubbles down to all the different
shards allocated on a specific node.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web
Very little as you have found.
But you might find aggregating will take a fair bit of resources.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
On 21 August 2014 18:34, 'Sandeep Ramesh Khanzode' via elasticsearch
important
optimizations that can buy you a lot of performance.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
--
You received this message because you are subscribed to the Google Groups
elasticsearch group
to Elasticsearch as you are expecting.
However you can check out a few visualisation plugins like ElasticHQ or
kopf which will show you if anything has been indexed into ES.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
701 - 800 of 1266 matches
Mail list logo
