Re: Regarding data copy

Yes. Data dir naming is: /data/clustername/nodes/… So if you change the cluster name… -- David Pilato | Technical Advocate | Elasticsearch.com @dadoonet | @elasticsearchfr | @scrutmydocs

Re: Regarding data copy

No David Mycluster name on the new server was changed.is this be a problem? On Tuesday, January 27, 2015 at 12:19:58 PM UTC+5:30, David Pilato wrote: > > Are you sure you have same config file on new server? > I mean cluster name? > > -- > David ;-) > Twitter : @dadoonet / @elasticsearchfr / @scru

Re: Regarding data copy

Are you sure you have same config file on new server? I mean cluster name? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 27 janv. 2015 à 07:46, phani.nadimi...@goktree.com a écrit : > > yes David i changed permissions recursively. > >> On Tuesday, January 27, 2015 at 1

Re: Regarding data copy

Did you that while elasticsearch was running? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 27 janv. 2015 à 07:46, phani.nadimi...@goktree.com a écrit : > > yes David i changed permissions recursively. > >> On Tuesday, January 27, 2015 at 12:03:14 PM UTC+5:30, David Pi

Re: Regarding data copy

yes David i changed permissions recursively. On Tuesday, January 27, 2015 at 12:03:14 PM UTC+5:30, David Pilato wrote: > > Did you change permission recursively ? > > -- > David ;-) > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > > Le 27 janv. 2015 à 06:39, phani.n...@goktree.com a écr

Re: Regarding data copy

Did you change permission recursively ? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 27 janv. 2015 à 06:39, phani.nadimi...@goktree.com a écrit : > > No David , First i copied indices folder under nodes/0 (old cluster data > dir) and copied to new cluster and cha

Re: Restoring indices from snapshot to a test server

Could you try to set verify to false? http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-snapshots.html#_repositories Not sure if it works but would love to know. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 27 janv. 2015 à 07:09, Amos S a

Re: Restoring indices from snapshot to a test server

Thanks David, That would explain it. Is there a way to skip the validation? On Tuesday, 27 January 2015 16:52:11 UTC+11, David Pilato wrote: > > IIRC when you create a repository we first try to validate it by writing a > sample file in it. > > As you set it to read only, I guess it could be th

Re: Restoring indices from snapshot to a test server

IIRC when you create a repository we first try to validate it by writing a sample file in it. As you set it to read only, I guess it could be the cause. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 27 janv. 2015 à 06:20, Amos S a écrit : > > Hello, > > For some inv

Re: ElasticsearchIllegalArgumentException can't parse config file

Could you test this config locally and add one setting at a time and check which one is incorrect? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 27 janv. 2015 à 06:39, Xavier Garcia a écrit : > > Any idea ? Someone know if a configuration validator exist for ElasticSe

Re: ElasticsearchIllegalArgumentException can't parse config file

Any idea ? Someone know if a configuration validator exist for ElasticSearch? Or how i can improve the loggin to find which line it's Thank you, Le lundi 26 janvier 2015 15:13:09 UTC-8, Xavier Garcia a écrit : > > Yep False so and rewrite all number i can, change the charset of file. > It's cra

Re: Regarding data copy

No David , First i copied indices folder under nodes/0 (old cluster data dir) and copied to new cluster and changed permission to elastic search but when i tried to access the index it is showing index missing exception even though index resides in data folder. Next i deleted the indices

Re: Regarding data copy

Did you copy the full "data" dir? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 27 janv. 2015 à 06:13, phani.nadimi...@goktree.com a écrit : > > Hi David, > >We need to copy Entire data folder or indices folder from existing cluster > to other cluster when i did

Re: Restoring indices from snapshot to a test server

Correction - the body of the request was messed up because I was trying to reorder its content. The correct PUT body is and error are: $ curl -XPUT 'http://localhost:9200/_snapshot/amos0' -d '{ "s3dev0": { "settings": { "base_path": "elasticsearch/prod/snapshots0",

Re: Restoring indices from snapshot to a test server

Correction - the body of the request was messed up because I was trying to reorder its content. The correct PUT body is and error are: $ curl -XPUT 'http://localhost:9200/_snapshot/amos0' -d '{ "s3dev0": { "settings": { "base_path": "elasticsearch/dev/snapshots0",

Restoring indices from snapshot to a test server

Hello, For some investigation work, I'm trying to restore specific indices from our production ES cluster to a single one-off node. We run a cluster of ES 1.4.2 on EC2, the data is stored locally on each EC2 instance with snapshots stored on an S3 bucket. I've setup a one-off EC2 instance and

Re: Regarding data copy

Hi David, We need to copy Entire data folder or indices folder from existing cluster to other cluster when i did this the elastic search server not detecting the indices we copied , and it is showing indices are not recovered in to cluster state and when i access the index it is not showing

Re: Regarding data copy

Hi David, We need to copy Entire data folder or indices folder from existing cluster to other cluster when i did this the elastic search server not detecting the indices we copied , and it is showing indices are not recovered in to cluster state and when i access the index it is not showing

Confusing results from fuzzy query (1 term, 1 field)

For a well formatted example, please see: http://stackoverflow.com/questions/28161480/fuzzy-not-functioning-as-expected-one-term-search-see-example Here's my problem: Consider the following results from: curl -XGET 'http://localhost:9200/megacorp/employee/_search' -d '{ "query" :

Re: Accessing Port 9200 Remotely

You should bind to 0.0.0.0 not localhost. Then you can hit it remotely. You can also use a reverse-proxy. It is what we do :-) On Mon, Jan 26, 2015 at 6:16 PM, Dave Mittner wrote: > I'm binding to "localhost"; nothing else seems to work. I get "Failed to > bind" errors in the log if I try using

Re: Accessing Port 9200 Remotely

I'm binding to "localhost"; nothing else seems to work. I get "Failed to bind" errors in the log if I try using the actual hostname. On Monday, January 26, 2015 at 5:04:34 PM UTC-7, James Carr wrote: > > * make sure you haven't bound to 127.0.0.1 > * make sure relevant security groups have been o

Re: Accessing Port 9200 Remotely

* make sure you haven't bound to 127.0.0.1 * make sure relevant security groups have been opened. On Mon, Jan 26, 2015 at 5:58 PM, Mark Walkom wrote: > You don't need the plugin, it can make discovery easier though. > > You haven't bound ES to localhost only have you? > > On 27 January 2015 at 0

Re: Accessing Port 9200 Remotely

You don't need the plugin, it can make discovery easier though. You haven't bound ES to localhost only have you? On 27 January 2015 at 09:42, Dave Mittner wrote: > I'm at a bit of a loss here... > > I have a pretty standard setup of elasticsearch and I'm able to > curl/telnet to port 9200 local

How to use "function_score" mehod to modify the score for a document?

I have this JSON object where I wish to change the scoring function of the search query: POST /index/document/_search { "query": { "function_score": { "query": {"match": {"_all": "fox"}}, "script_score": { "script": "_score" } } } } I want to change the s

Re: ElasticsearchIllegalArgumentException can't parse config file

Yep False so and rewrite all number i can, change the charset of file. It's crasy i don't understabd what happend. Le lundi 26 janvier 2015 14:32:40 UTC-8, David Pilato a écrit : > > Of course, you did it for False as well? > > > David > > Le 26 janv. 2015 à 23:14, Xavier Garcia > a > écrit : >

Wildcard search on raw not_analyzed field

I have a dynamic template that sets up not_analyzed raw mappings for all my string fields. When I perform a query search like this: field.raw=KnownValue it works (has hits). When I do this: field.raw=Known?alue it doesn't return any data (? wildcard doesn't work). However, field.raw=* does

Re: integrating ELK with SSO (CA Siteminder)

That doesn't look valid, it should be more like elasticsearch: "http:// elasticsearch:9200", If elasticsearch is the DNS name of your node. On 27 January 2015 at 00:20, Scott Lee wrote: > Sure it's: > elasticsearch: "/elasticsearch/", > > > On Friday, January 23, 2015 at 5:08:59 PM UTC-5, Mark

Re: Building a Cluster / Adding a node.

If you just downloaded and started ES then your settings will be default ones. Change cluster.name to something that isn't elasticsearch, and make sure it is the same on both nodes. Just list both hosts under discovery.zen.ping.unicast.hosts. Also make sure you disable multicast at the same time.

Accessing Port 9200 Remotely

I'm at a bit of a loss here... I have a pretty standard setup of elasticsearch and I'm able to curl/telnet to port 9200 locally, but the connection is refused if accessed from another server. I'm likewise unable to connect to port 9300. For Kibana3 I've also added: http.cors.allow-origin: "*"

Re: Open closed index automatically

That's still massively different to creating and allocating a completely empty index. On 27 January 2015 at 08:23, Drew Kutcharian wrote: > I agree. But they both go thru shard allocation, no? I’m assuming > opening/closing small 1 shard indexes (max 100MB total size) shouldn’t be > that bad. >

Re: ElasticsearchIllegalArgumentException can't parse config file

Of course, you did it for False as well? David > Le 26 janv. 2015 à 23:14, Xavier Garcia a écrit : > > Already try but doesn't work. > > Le lundi 26 janvier 2015 14:08:39 UTC-8, David Pilato a écrit : >> >> Could you try replacing True by true? >> >> David >> >>> Le 26 janv. 2015 à 22:49,

Re: ElasticsearchIllegalArgumentException can't parse config file

Already try but doesn't work. Le lundi 26 janvier 2015 14:08:39 UTC-8, David Pilato a écrit : > > Could you try replacing True by true? > > David > > Le 26 janv. 2015 à 22:49, Xavier Garcia > a > écrit : > > Hello guy, > > I'm configuring a ES cluster and i got this issue - > *ElasticsearchIlleg

Re: ElasticsearchIllegalArgumentException can't parse config file

Could you try replacing True by true? David > Le 26 janv. 2015 à 22:49, Xavier Garcia a écrit : > > Hello guy, > > I'm configuring a ES cluster and i got this issue - > ElasticsearchIllegalArgumentException[value cannot be parsed to boolean [ > true/1/on/yes OR false/0/off/no ] ] > I try to

Optimizing filter bitsets

We're storing Kibana-style time series documents across three indexes on a 10 node cluster (i2.xlarges). These indexes have between 20M-500M docs at peak and we use bool filters extensively while querying. Query volumes are pretty low (maybe around 100 searches/sec at peak) versus index ops (4K/se

ElasticsearchIllegalArgumentException can't parse config file

Hello guy, I'm configuring a ES cluster and i got this issue - *ElasticsearchIllegalArgumentException[value cannot be parsed to boolean [ true/1/on/yes OR false/0/off/no ] ]* I try to increase the level of logging but nothing work i can't find the right line, do you have any idea where is this

Re: Open closed index automatically

I agree. But they both go thru shard allocation, no? I’m assuming opening/closing small 1 shard indexes (max 100MB total size) shouldn’t be that bad. > On Jan 26, 2015, at 12:42 PM, David Pilato wrote: > > Opening an index is a costly operation. > Creating a new index is not. > > My 2 cents

Re: Building a Cluster / Adding a node.

Ok so I looked at the config file and found this: cluster.name - which you are saying I set it to the same on both machines... got it. discovery.zen.ping.unicast.hosts: ["host1", "host2:port"]--- since I am not on the same network in this case they are in different but accessible domains

Re: Simultaneous indexing and searching in 2 threads gets "Failed to execute phase" exception...

Without seeing the code, I guess your ES cluster is a bit slow in starting up new shards, which is pretty normal. There is a small time span after index creation and getting ready for accepting docs. You should wait for the created index to get initialized. Usually this is not required, because act

Re: Open closed index automatically

Opening an index is a costly operation. Creating a new index is not. My 2 cents -- David Pilato | Technical Advocate | Elasticsearch.com @dadoonet | @elasticsearchfr | @scrutmydocs > Le 26

Open closed index automatically

Hi, Is there a way to tell ES to open closed indices automatically on first access (search or indexing)? I can do it on the application side by looking for IndexClosedException, but this seems like a natural thing that ES should be able to do, after all ES creates new indices automatically. -

Re: Building a Cluster / Adding a node.

I'm doing this in windows. I'm crossing internal domains for each node so I thought I'd have to tell something somewhere that there is another node. Also I probably want it configured the same way. Also I don't see where I select a cluster name for the nodes. With the single node install a

Re: Building a Cluster / Adding a node.

Hey, it is as simple as running the first node. Just install ES, select a cluster name for the nodes, start it on the nodes, and let the node discovery join the nodes. I recommend odd numbers and at least 3 nodes to avoid a split brain. Or did I miss something? Jörg On Mon, Jan 26, 2015 at 8:59

Building a Cluster / Adding a node.

Is there a place where someone can point me to a simple set of instructions for adding a node to an Elastic Search cluster? I think I understand Sharding and Nodes and that's what the documents do is talk about them. But what I don't understand is... How do install ElasticSearch on the second

Re: Simultaneous indexing and searching in 2 threads gets "Failed to execute phase" exception...

It always easier to share a project for which we only have to do: git clone mvn install But, you could also share on gist.github.com a pom.xml and a test class. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 26 janv. 2015 à 19:27, TimOnGmail a écrit : > > I could do

Re: Simultaneous indexing and searching in 2 threads gets "Failed to execute phase" exception...

I could do that - I'll have to see if I can trim it down to a reasonable size without all the unrelated code in it. Is it obvious on GitHub where people can submit error samples? I haven't done that before. - Tim On Friday, January 23, 2015 at 1:27:05 AM UTC-8, David Pilato wrote: > > Yes I am

Odd 'Connection Reset by peer' issue when URL contains a query string

Hi all, So I have an ES cluster that is currently exhibiting the following properties: If I do: > curl -k -vv http://elasticsearch.example.com:9200/logstash*/_search > The request returns properly with the expected results (I get a 200 OK > with the search results). If I do: curl -k -vv htt

Re: how to pass 2 different timestamp in RangeFilterBuilder for elasticsearch

Thanks David... I got the idea. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web v

dynamic complex fields filter

Hi, I am using version 1.3.7 and have problems with dynamic mappings of complex fields and filters. It seems this is not supported as I cannot obtain the results, but get an empty set response each time. I have found this link suggesting the same http://elasticsearch-users.115913.n3.nabble.co

Re: Kibana - IIS 7.5

Yes, It works when I'm on my localhost serving it to me connected to a remote elasticsearch. It just isn't working when I'm serving it from a dedicated Windows 2008 web server connected to the same remote elasticsearch. Config Working: Desktop: IIS 8 installed on Windows 8.1 - Kibana Installe

Re: I can't find anything after hypens or underscores

Il 21/01/2015 11:43, Alessandro Bonfanti ha scritto: Il 02/12/2014 09:21, Alessandro Bonfanti ha scritto: Il 12/11/2014 17:43, Alessandro Bonfanti ha scritto: Il 12/11/201

Re: Querystring filter dosn't work

I have done test and found out following: { "query": { "filtered": { "query": { "query_string": { "query": "uri:video\\-ondemand\/video\/flv\/test\/" } }, "filter": { "bool": { "must": [ { "range": { "@timestamp": { "from": "2014-12-01T00:00:00.001", "to": "2014-12-01T23:59:59.999" } } } ] } }

Re: Kibana - IIS 7.5

You may want to give this a try: https://github.com/synhershko/KibanaDotNet/tree/owin -- Itamar Syn-Hershko http://code972.com | @synhershko Freelance Developer & Consultant Lucene.NET committer and PMC member On Mon, Jan 26, 2015 at 3:58 PM, GWired wrote: > I

Re: Kibana - IIS 7.5

On Monday, January 26, 2015 at 14:58 CET, GWired wrote: > I was able to get Kibana setup on my localhost and did a generic entry > to allow everything into the elasticsearch.yml > http.cors.allow-origin: "/.*/" > Now I'm trying to getting it to run on my remote server running IIS > 7.5 on po

Logstash stuck on “Sending bulk of actions to client”

Hi, Has anyone encountered a problem with logstash where there are several filters (~8 grok filters, multiline and json) that causes logstash to get stuck when sending bulk of actions to elasticsearch ? I tried playing with the amount of filters to see if that what causes the issue. - Only mult

Kibana - IIS 7.5

I was able to get Kibana setup on my localhost and did a generic entry to allow everything into the elasticsearch.yml http.cors.allow-origin: "/.*/" Now I'm trying to getting it to run on my remote server running IIS 7.5 on port 8080. The page loads but only the top bar loads and nothing else

Re: Basic authentication for each Kibana dashboards

AFAIK, Kibana by default saves it's dashboards in an ES index called kibana-int, as referenced in your httpd.conf file here: You could restrict commands on that index based on authentication, like x user can do GET POST, whereas y user can do DELETE GET POST PULL, etc. On Tuesday, January 20

Re: integrating ELK with SSO (CA Siteminder)

Sure it's: elasticsearch: "/elasticsearch/", On Friday, January 23, 2015 at 5:08:59 PM UTC-5, Mark Walkom wrote: > > Can you post the applicable line from your kibana config that points to ES? > > On 24 January 2015 at 07:50, Scott Lee > > wrote: > >> Hello, I am new to the ELK stack technology

Kibana 4 - Issues with Filters Aggregations

Hi, We tried to create panels based on Filters Aggregation on the latest Kibana source, and we encountered the following problems: 1) Buckets from Filters aggregation are not display

Re: Sorting strings that contain numbers

Yes, there is a version for ES 1.3.4 Jörg On Fri, Jan 23, 2015 at 7:13 PM, bbehling wrote: > Jörg, > > Will your plugin work with ES version 1.3.4? > > > > -- > View this message in context: > http://elasticsearch-users.115913.n3.nabble.com/Sorting-strings-that-contain-numbers-tp4024553p4069501

Re: Not able to see whether data stemmed or not!

"document": { "properties": { "text": { "type": "string", "store": true, "index": "analyzed", "term_vector": "with_positions_offsets_payloads", "filter": "stopper",

Re: jdbc river re-indexing after each start of server?

Thanks for you quick help! Am Montag, 26. Januar 2015 13:15:26 UTC+1 schrieb Jörg Prante: > > You should delete the river instance after usage. Otherwise, the river is > executed each time the node starts. > > Jörg > > On Mon, Jan 26, 2015 at 1:09 PM, Abid Hussain > wrote: > >> Hi all, >> >> I c

Re: jdbc river re-indexing after each start of server?

You should delete the river instance after usage. Otherwise, the river is executed each time the node starts. Jörg On Mon, Jan 26, 2015 at 1:09 PM, Abid Hussain wrote: > Hi all, > > I configured a river for one-time indexing like: > PUT /_river/my_river/_meta > { > "type": "jdbc", >

Re: Bulk importing CSVs with different headers

Looks solid, I'll give it a run today. On Sunday, January 25, 2015 at 7:57:29 AM UTC-5, Jörg Prante wrote: > > I finally managed to modify the CsvJdbc driver from > http://csvjdbc.sourceforge.net/ so it behaves nicely and pushed it to > > https://github.com/jprante/jdbc-driver-csv > > So the

jdbc river re-indexing after each start of server?

Hi all, I configured a river for one-time indexing like: PUT /_river/my_river/_meta { "type": "jdbc", "jdbc": { "driver": "com.mysql.jdbc.Driver", "url": "jdbc:mysql://192.168.110.180:3306/my_db", "user": "user", "password": "password", "ind

Re: Querystring filter dosn't work

So here more details: { "query": { "filtered": { "query": { "query_string": { "query": "uri:video\\-ondemand\/video\/flv\/test\/" # one thing with video\-ondemand I get an Error ( nested: JsonParseException[Unrecognized character escape '-' (code 45)) } }, "filter": { "bool": { "must": [ { "

Re: ElasticSearch dynamic_date_formats is not working if there is a mapping in the index (even if empty)

I'm having this problem as well. I opened a bug for it here: https://github.com/elasticsearch/elasticsearch/issues/9410 On Friday, January 16, 2015 at 4:29:06 AM UTC-8, Ipatios Asmanidis wrote: > > Using version : 1.4.2 > OS: Ubuntu Linux 14.04 > JVM: 1.7 > > Here is how you can reproduce the iss

Re: Bulk importing CSVs with different headers

So I also looked at logstash, but you have to define the field names for each file. Same as the others. Logstash is almost worse because you need a restart of the service when you update the config file. -- You received this message because you are subscribed to the Google Groups "elasticsear

Re: Sorting strings that contain numbers

Jörg, Will your plugin work with ES version 1.3.4? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Sorting-strings-that-contain-numbers-tp4024553p4069501.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message b

Re: Help creating a near real time streaming plugin to perform replication between clusters

Hi, A common approach for replicating changes across multiple geographically distributed clusters if to put a message queue in front of Elasticsearch and feed all data modifications through this so that they can be applied to the clusters independently. This allows issues with unreliable connec

Re: Querystring filter dosn't work

I have no idea but for sure, I'd prefer using a term filter on uri field and I would not set _cache. But may be you could GIST a full example we can reproduce? David > Le 26 janv. 2015 à 08:47, Messias a écrit > : > > Hi, > > I have some issue with a filtered query. If I use the query: > "

Re: top_hits and post_filter

Can you use a filter agg? http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-aggregations-bucket-filter-aggregation.html David > Le 26 janv. 2015 à 09:46, Radim Novotny a écrit : > > Hi, > > I'm using ES 1.4.2 to search across 4 slightly different types in a single

Re: Sorting and range filtering semantic versions

Range and sort are two different challenges. There is one solution for sort using a custom analyzer. You can create binary sort keys for natural sort. Use https://github.com/jprante/elasticsearch-analysis-naturalsort and try this example PUT /test/ { "index": { "analysis": {

top_hits and post_filter

Hi, I'm using ES 1.4.2 to search across 4 slightly different types in a single index. The following example is simplified version with only two types "profile" and "publication". Profiles can have related publications, publications can have related profiles. I want to do a full text search (si