Hey Alex
That's great! I started a project like this some months ago but did not find
enough time to finish it.
Thanks for sharing it!
--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr
Le 17 janvier 2014 at 01:44:26, AlexC (acojoc...@pingidentity.com) a écr
Why do you want to do that? All shards have about the same load unless you use
_primary or _local preference.
primary or replica is just a boolean attribute on a shard, right?
--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr
Le 17 janvier 2014 at 08:05:46,
> Lukáš Vlček :
> In this case I usually instruct Bigdesk about node endpoint URL via
> 'endpoint' URL patameter. It is documented on web or github.
Indeed it is... https://github.com/lukas-vlcek/bigdesk/#url-parameters
("Ooh... there's documentation...?" :-) )
(To quote a friend of mine: R
Why not consider using memcached，redis？
2014/1/17 abhi patel
> I want to store ES query output back to ES. will it possible?
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails fro
Thanks! Could you open an issue or a pull request in elasticsearch repo?
--
David ;-)
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 17 janv. 2014 à 07:36, Abhishek Srivastava a écrit
:
> http://www.elasticsearch.org/guide/en/elasticsearch/client/java-api/current/index_.html
>
> Ind
On a client level. Not by elasticsearch on its own.
--
David ;-)
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 17 janv. 2014 à 07:18, abhi patel a écrit :
> I want to store ES query output back to ES. will it possible?
> --
> You received this message because you are subscribed to t
Thanks a lot. It really solved my problem.
On Thu, Jan 16, 2014 at 11:22 PM, Ivan Brusic wrote:
> I am assuming that you packaged the two Java files into a jar file and
> deploy it to the $ES_PATH lib directory. Elasticsearch will pick up any jar
> files in that directory.
>
> Similarities are
Hello everyone - I have been looking at shard allocation awareness and
trying to see if there is a way I can specify "do not assign
*primary*shards to these set of nodes".
any idea how this can be achieved? thanks much!
-Amit.
--
You received this message because you are subscribed to the Googl
http://www.elasticsearch.org/guide/en/elasticsearch/client/java-api/current/index_.html
IndexResponse response = client.prepareIndex("twitter", "tweet")
.setSource(json)
.execute()
.actionGet();
IndexResponse object will give you report:
// Index name
String _index = resp
I want to store ES query output back to ES. will it possible?
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To vie
In 0.90, we use english stopwords by default.
"A" is a stopword.
I guess it´s your issue.
--
David ;-)
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 17 janv. 2014 à 03:44, Karan Verma a écrit :
> Hi
>
> My field relevancy_tags is index as an array of strings. A document is
> ind
No. Scripts are not supported in fsriver. What do you want to add with scripts?
--
David ;-)
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 16 janv. 2014 à 23:56, vinamar a écrit :
> Hi David,
>
> I'm using fsriver plugin. Is there a way to specify a script to generate a
> field li
Yep, thanks for confirming my understanding, in the case of using term
queries on non-analyzed fields, the search value must match the exact case
of the original value if I understand this correctly.
Bob
On Jan 16, 2014, at 6:23 PM, Ivan Brusic
>
wrote:
Correction: meant to say use *term* queries
Hi
My field relevancy_tags is index as an array of strings. A document is
indexed with relevancy_tags = ["a", "b","c","d"]. I want to return the
document if the query is "a". I've tried using the term and terms filter
but they don't return any results.
Help :( ?
Mapping:
"relevancy_tags"
Correction: meant to say use *term* queries on non-analyzed fields, not
*text* queries.
On Thu, Jan 16, 2014 at 6:22 PM, Ivan Brusic wrote:
> Correct. A term query does not analyze the terms, while a match query
> does. Generally, you should use text queries on non-analyzed fields, and
> match
Correct. A term query does not analyze the terms, while a match query does.
Generally, you should use text queries on non-analyzed fields, and match
queries on analyzed ones. Analysis does not always mean lowercasing terms,
but that is what the default (standard) analyzer does. All these concepts
d
Oh I think I get it now, the analyzed value in the index is all lowercase
and hence the exact match must be lowercase for an exact match using term
query. When using match query, the term is first analyzed making it
lowercase before doing the search, hence case insensitive. Am I right?
On Thursday
I am just learning ES and would appreciate a quick explanation on analyzed
vs not analyzed searches. My basic understanding is that unless indicated
otherwise, fields are analyzed during indexing time but when it comes to
search time, a term query matches documents for terms that are not
analyz
Hi,
I am pretty new to Elastic Search, please help me find out how can I use
name_suggest on the data which I capture from ldap river.
I am trying to put the value of *first name* and *last name* fetched from
ldap river directly to *name_suggest* input so that these can be used in
suggestions.
If anyone is interested in using a Maven plugin to run Elasticsearch for
integration testing, I just published one on GitHub:
https://github.com/alexcojocaru/elasticsearch-maven-plugin.
It is an alternative to starting a node through the code.
The readme should provide enough information, but le
I am wondering if there is a way to use aggregated values inside a query.
Example:
Say our data contains items and their price:
{
"id" : string
"name" : string
"price" : float
}
I want to do a query that returns the top items that have a price far from
the average price of items w
I guess you try to run ES from a drive where no executables are permitted
by the OS (e.g. a shared disk mount, or removable media).
Jörg
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails f
You can continue to set up your document boost field (e.g. a numeric field
named "boost") with a document boost value, and use function score to use
it as a boost factor. That is, a function score script knows how to boost
correctly:
http://www.elasticsearch.org/guide/en/elasticsearch/reference/cu
Hi David,
I'm using fsriver plugin. Is there a way to specify a script to generate a
field like how couchDB river plugin is able to do.
http://stackoverflow.com/questions/15421720/how-do-i-index-all-the-revisions-of-a-couchdb-doc-using-elasticsearch-river-plug
{
"couchdoc" : {
"_
0.90.* and 1.0.0.RC1 node clients can not talk to each other, discovery
fails with errors like
[2014-01-16 23:45:40,885][WARN ][discovery.zen.ping.multicast] [John
Falsworth] failed to read requesting data from /192.168.1.113:54328
java.io.IOException: No transport address mapped to [17519]
at
org
I think it won't work.
--
David ;-)
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 16 janv. 2014 à 22:52, Mark Walkom a écrit :
> Does anyone know if a tribe node can talk to v0.90.* clusters? ie the tribe
> functionality is only required on the designated tribe node and not all it's
Yes. Some metadata are extracted with Tika.
As you said, you should do that operation before indexation (means only index
what you really need).
--
David ;-)
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 16 janv. 2014 à 22:51, ZenMaster80 a écrit :
> Thanks for the reply. the attac
Does anyone know if a tribe node can talk to v0.90.* clusters? ie the tribe
functionality is only required on the designated tribe node and not all
it's connected clusters.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com
Thanks for the reply. the attachment plugin I understand encodes content
before indexing it, this sounds like an expensive operation if we have lots
of pdfs. I was thinking extracting text from pdf early on instead and deal
with text instead.
Does the plugin also work for binaries like images?
A tribe node is built into a usual Node, so there is no special tribe node
class. If you pass parameter like "tribe.t1.cluster.name" etc. to the Node
settings, a tribe service class is used and performs all the necessary work
in the background. Basically the API stays the same but certain features
You should do that on a client level and add a new attribute in your doc or
send the right _id.
My 2 cents.
--
David ;-)
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
Le 16 janv. 2014 à 20:52, vinamar a écrit :
> I'm using ES 0.90.7.
>
> Is there a way to do _id mapped to a custom v
You can use Tika by yourself (recommended). See how I did it in fsriver project.
You can use mapper attachment plugin which is using Tika behind the scene but
gives you less control IMHO.
About versions, elasticsearch does not keep old versions around. If you need
that, you have to manage it you
Judging by the commits, the functionality was only deprecated, not removed.
https://github.com/elasticsearch/elasticsearch/issues/4664
I believe there are many use cases where it makes sense to boost a document
at index time. The process only occurs once instead of every time during
queries.
Tha
I'm using ES 0.90.7.
Is there a way to do _id mapped to a custom value which is based on more
than one field?
http://stackoverflow.com/questions/21041952/using-a-combined-field-as-id-mapping-in-elasticsearch
Like i want _id to combine srId and closeDt as our document key?
this one doesnt work
Hi Alex,
It turns out that it was my fault. But this is a tricky one, I'd like to
explain what happened for others to benefit. The issue was that I was not
storing the field that I was updating. Therefore the getValue was returning
empty from the Java API. The reason that I was able to see the upd
Whichever plugin you are using for the ComboAnalyzer is using the wrong
class name.
Caused by: java.lang.NoClassDefFoundError:
org/elasticsearch/ElasticSearchIllegalArgumentException
at
org.elasticsearch.index.analysis.ComboAnalyzerProvider.get(ComboAnalyzerProvider.java:50)
This class w
Hi all - I have been going through the list of breaking changes in
1.0.0.RC1 and have a question regarding boosting of documents. I see
that "*Support
for document boosting via the _boost field has been removed from Lucene and
is deprecated in Elasticsearch as of v1.0.0.RC1. *"
http://www.elastics
HI Jorg,
I posted a question for the same issue yesterday and I was referenced to
look at
http://www.elasticsearch.org/guide/en/elasticsearch/reference/master/modules-tribe.html
.
My question is lets say I want to query across multiple cluster using
Kibana, then do I need to put tribe node det
- Is there any literature on how to index pdf documents and binary formats
like images?
- Versioning question: If I update an already indexed document, I believe
ES will update the version number. I am wondering if it keeps the previous
document, what if I needed access to the previous document?
Hi,
I'm running through some test cases after upgrading to RC1, I'm getting an
issue when I do this:
CreateIndexResponse mapping = esNode.getClient()
.admin().indices()
.create(new CreateIndexRequest(indexName))
.actionGet();
The error I'm getting is this:
org.elastics
Alex,
Thank-you very much for your reply. I've fixed my issue with your help.
For future reference I added the following to my logstash indexer for
apache;
date {
locale => "en"
timezone => "Europe/Zurich"
match => [ "apachetime", "dd/MMM/:HH:mm:ss Z" ]
target => "@ti
Thanks again. By working with a gist I figured out the problem was with how
I'm using the javascript client. The sort wasn't in the "body" of my json
request.
On Thursday, January 16, 2014 11:52:05 AM UTC-6, David Pilato wrote:
>
> Could you reproduce it with a curl recreation as explained here?
I had been running elasticsearch just fine under Mavericks until a few days
ago and now it won't start up. Originally had used homebrew to install
with launchctl to load the plist and everything was fine, however,
launchctl status now shows "1" which indicates an error.
So tried just download
I am assuming that you packaged the two Java files into a jar file and
deploy it to the $ES_PATH lib directory. Elasticsearch will pick up any jar
files in that directory.
Similarities are either set to be the default for all the indices via the
index.similarity.default.type configuration paramete
I did more digging. Turns out that using version 0.90.9, the _source data
is included in the calculation. In other words, the stats are the entire
disk space used by an index including source data. And it is broken down by
indices, primaries, etc as Alex said.
I did not test to see if it takes
Could you reproduce it with a curl recreation as explained here?
http://www.elasticsearch.org/help/
--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr
Le 16 janvier 2014 at 18:40:12, Travis Bullock (travisrbull...@gmail.com) a
écrit:
Thanks, I already tried
Thanks, I already tried that with no luck.
On Thursday, January 16, 2014 11:31:32 AM UTC-6, David Pilato wrote:
>
> See doc:
> http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-sort.html#_geo_distance_sorting
>
> Missing _ I guess
>
> --
> *David Pilato* | *Te
See doc:
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-sort.html#_geo_distance_sorting
Missing _ I guess
--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr
Le 16 janvier 2014 at 18:21:24, Travis Bullock (travisrbull...@
Actually, I take back what I said about it not working. The example you
posted up on gist is working. Thanks!...I just need to figure out the
difference between the original example I posted up which is not working
and your working post. Thanks again.
On Thursday, January 16, 2014 12:06:54
Hello,
I've set up a mapping on myIndex as follows:
"mappings" : {
"place" : {
"properties" : {
"location" : {
"type" : "geo_point",
"fielddata" : {
"format" : "compressed",
So you have specific settings in elasticsearch.yml file?
What result do you actually get?
--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr
Le 16 janvier 2014 at 18:06:58, thale jacobs (thalejac...@gmail.com) a écrit:
Hi David - Thanks for the reply. I just
Excellent, thank you for the clarification. For some reason I was thinking
that the bulk operation might put a different type of load on the service
just to spin up that operation.
Again, thanks for your time!
On Wednesday, January 15, 2014 8:06:32 AM UTC-6, Jörg Prante wrote:
>
> Bulk request
Hi David - Thanks for the reply. I just tried it on 90.5, 90.9, 90.10, and
1.0.0.RC1. No results were returned in my searches. I forgot to include
that I have ES running on ubuntu if that makes a difference.
Thale
On Thursday, January 16, 2014 10:14:20 AM UTC-5, David Pilato wrote:
>
> Hey!
Hello,
I'm making some test to upgrade from 0.90.3 to 0.90.10
Everything looks good except the following warning in log, below two
examples.
[2014-01-16 17:27:00,669][WARN ][index.engine.robin ] [integration]
[m112][0] failed to prepare/warm
java.lang.IllegalMonitorStateException
Hi,
I have 3 ubuntu VM's on a private network, each has 64GB ram. I started ES
Beta2 (need it to use term vector feature) on each node with 30GB heap
space and with the following changes in the configuration file:
discovery.zen.ping.multicast.enabled: false
discovery.zen.ping.unicast.hosts: ["
I solved the error problem but still ElasticSearch is using its Default
Similariy. Can anyone tell me why is it not taking these new
CustomSimilarity files into consideration.
On Thursday, 16 January 2014 16:54:02 UTC+5:30, coder wrote:
>
> Hi,
>
> I'm using the following two java files for over
I have two document types, in a parent-child relationship:
"myParent" : {
"properties" : {
"weight" : {
"type" : "double"
}
}
}
"myChild" : {
"_parent" : {
"type" : "myParent"
},
"_routing" : {
"required" : true
}
}
The weight field is to be used for custom sc
Hey!
Just tested it with es 1.0.0.RC1 and it's working fine.
See https://gist.github.com/dadoonet/8456535
--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr
Le 16 janvier 2014 at 14:25:02, thale jacobs (thalejac...@gmail.com) a écrit:
Hello - I am attempting
Yes, it makes more sense. Thanks.
Thanks,
Ryan Pedela
Datalanche CEO, co-founder
www.datalanche.com
rped...@datalanche.com
513-571-6837
On Thu, Jan 16, 2014 at 2:38 AM, Alexander Reelsen wrote:
> Hey,
>
> from a quick peek in the source, the StoreStats are generated in
> Store.stats(), which
Note, there is a valuable snapshot/restore facility coming in ES 1.0.0,
with incremental snapshots.
http://www.elasticsearch.org/guide/en/elasticsearch/reference/master/modules-snapshots.html
Jörg
On Thu, Jan 16, 2014 at 3:37 PM, Craig Lebowitz wrote:
> I was talking about using ES as a system
The tribe node can be useful if your organization is maintaining several
clusters (for whatever reasons) but you want to search all of them.
Also useful could be transferring data between clusters by a single client
in a single step.
Reasons can be organizational, or geographical, or logical. May
I was talking about using ES as a system of record with my friendly IT director
today. We were brainstorming about how 'backup" would work.
The lucene index is immutable, so we can think about ES data as a transaction
log. We can recreate from _source at a given time with a scan/scroll archiv
In my Elasticsearch index I have documents that have multiple tokens at the
same position.
I want to get a document back when I match at least one token at every
position.
The order of the tokens is not important. How can I accomplish that?
I use Elasticsearch 0.90.5.
*Example:*
I index a docu
Gotcha, my bad.
On 17/01/2014 12:43 AM, "joergpra...@gmail.com"
wrote:
> minimum_master_nodes is a dynamic cluster setting, that means, it can be
> set via cluster update API.
>
> Jörg
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> T
Hi all,
I took a look at some of the changes that Elasticsearch RC1 brings and I
was wondering what use cases you found for tribe nodes. What are the
benefits of using a tribe node over multiple clusters versus just having
more indexes in the same cluster.
Best,
Mihai
--
You received this m
My bad. I'm using elasticsearch-0.90.3. I guess it's not available in this
version.
On Thu, Jan 16, 2014 at 6:56 PM, Luca Cavanna wrote:
> I guess you are using a not so recent version of elasticsearch then. Which
> version are you working on?
>
>
> On Thu, Jan 16, 2014 at 2:21 PM, Mukul Gupta
minimum_master_nodes is a dynamic cluster setting, that means, it can be
set via cluster update API.
Jörg
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elast
I guess you are using a not so recent version of elasticsearch then. Which
version are you working on?
On Thu, Jan 16, 2014 at 2:21 PM, Mukul Gupta wrote:
> I tried using FunctionScoreQueryBuilders but there is no such thing
> available with me. Do I need to use any package for this ?
>
>
> On
Hello - I am attempting to run a ngram test using elastics 0.90.9. I was
able to replicate the problem I am having in our production system by
following the example from here:
http://blog.rnf.me/2013/exact-substring-search-in-elasticsearch.html
The Mappings looks like this:
{
"mappings":
I tried using FunctionScoreQueryBuilders but there is no such thing
available with me. Do I need to use any package for this ?
On Thu, Jan 16, 2014 at 6:26 PM, Luca Cavanna wrote:
> Not sure what you mean, the function score is a query that is part of the
> query DSL. If you are using the java
Not sure what you mean, the function score is a query that is part of the
query DSL. If you are using the java API, you can find the usual query
builder, called FunctionScoreQueryBuilder or even use the handy
QueryBuilders static methods to create one.
On Thu, Jan 16, 2014 at 1:43 PM, Mukul Gupta
Is there any java api available for function_score ?
On Thu, Jan 16, 2014 at 5:16 PM, Luca Cavanna wrote:
> Using the function_score you could use a script. Since 0.90.10 you can
> access term statistics from a script (
> https://github.com/elasticsearch/elasticsearch/issues/3772), term
> frequ
Using the function_score you could use a script. Since 0.90.10 you can
access term statistics from a script
(https://github.com/elasticsearch/elasticsearch/issues/3772), term
frequency included. You could for instance emit your own score that takes
into account only the term frequency but not t
Hi Friends,
I have index on wiki data but when, I am trying to search with "title"
field. It has to written only these records/ result which title field is
exactly same as I have provided string in query
What I have to?
How will I change existing mapping to add
"title": {"type": "string","inde
Hi,
after the release of Elasticsearch 1.0.0.RC1, I have updated my plugins:
https://github.com/jprante/elasticsearch-analysis-baseform
https://github.com/jprante/elasticsearch-analysis-decompound
https://github.com/jprante/elasticsearch-analysis-german
https://github.com/jprante/elasticsearch-an
Hi,
I'm using the following two java files for overriding the Default
Similarity of ElasticSearch 0.90.3 but it's not working for me.
https://github.com/awnuxkjy/es-custom-similarity-provider/tree/master/src/main/java/org/elasticsearch/index/similarity
I have complied the two java files and ad
Hi everyone!
Can't seem to find an answer to my doubt, so I decided to post the question
and see if someone can help me.
In my application, I have an array of ids which comes from the backend and
which is ordered already as I want, for example: [0] => 23, [1] => 12, [2]
=> 45, [3] => 21
I
Hi,
i'd like to announce a update of the Windows MSI Installer for
Elasticsearch which now installs ES 0.90.10 with Oracle JRE 7 Update 51.
It can be found here:
https://github.com/salyh/elasticsearch-msi-installer/releases/tag/1.0.90.10
What is Windows MSI Installer for Elasticsearch?
Create
Hey,
from a quick peek in the source, the StoreStats are generated in
Store.stats(), which uses the Lucene Index Directory to get its size. Which
again calls file.length() for each file in that directory in the end. So it
is the size used by a lucene index in bytes.
The indices stats API shows th
Hey,
try changing
index:
analysis:
analyzer:
standard:
to
index:
analysis:
analyzer:
default:
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/analysis-analyzers.html#default-analyzers
--Alex
On Wed, Jan 15, 2014 at 9:12 AM, Khoa Nguy
Hi!
I have the following mapping:
curl -XPUT 'http://localhost:9200/bookstore/user/_mapping' -d '
{
"user": {
"properties": {
"user_id": { "type": "integer" },
"gender": { "type": "string", "index" : "not_analyzed" },
"age": { "type": "integer" },
"age_bracket": { "t
I don't know how to do this by function score, but have you looked at it?
Jörg
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@google
Great thread, thanks.
Some points: just because you know how many ( master ) nodes you have
doesn't mean you know or should care about their hostnames ; ec2 . servers
are cattle not pets, etc.
One thing I am not sure about. Would it be possible ( ie , safe) to make
the quorum threshold a runtime
83 matches
Mail list logo
