Thanks David... I got the idea.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web v
Sorry, my question is how to pass 2 different Joda DateTime in
RangeFilter. I'm trying to get an aggregated search result from es for
every 5 min interval from current time till midnight to plot in graph.
One way I think is to convert the DateTime in millis and pass it as long in
RangeFilter's
Hi,
Any ideas?
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://gr
Hi,
I'm currently using the below code to get avg value for every 30min from
current time stamp. How can I pass 2 joda DateTime in this range filter to
query between those timestamp ? Please let me know
public static Double searchAvgResultCPU(String esIndex, String esType,
List ipL
Hi,
In the same context... some times when I'm shutting down tomcat getting the
below exception. And other times it works. Any idea why ?
Jan 19, 2015 8:59:30 AM org.apache.catalina.core.StandardContext
listenerStop
SEVERE: Exception sending context destroyed event to listener instance of
clas
Yeah. I'm using listener, but it was giving some error. Fixed it and now
it's working. My mistake :$
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsea
I'm creating a TransportClient instance in elasticsearch. Below is the code
for the same. The issue is I'm trying to lower the number of threads
spawned with the threadpool that TransportClient initiates.
public static TransportClient getTransportClient(String ip, int port) {
ImmutableSet
Hi Jorg,
Sorry to open the thread again. But the issue is I'm getting OOM error
currently in tomcat and the webapplication is crushing. As u suggested I'm
calling the static TransportClient instance from contextInitialized() and
shutting down with contextDestroyed(). But the methods are not get
Hi Ed,
I my case I have created a singleton TransportClient and querying ES with
the same in frequent interval to get data. I'm not doing any bulk
operations only searching index. threadPool needs to be shutdown once
Tomcat stops I guess, But when my webapplication is up and running is there
a
Hi,
I'm using elasticsearch using TransportClient for multiple operation. The
issue I'm facing now is if my es server goes down my client side app
getting OutOfMemoryError. Getting the below exception. I had to restart my
tomcat every time after this to make my application up. Can some one ple
Hi,
I tried with what you suggested using below code. But getting exception.
DateTime dateTime = new org.joda.time.DateTime();
System.out.println(dateTime);
DateTimeFormatter dateTimeFormatter =
ISODateTimeFormat.dateTime().withZone(DateTimeZone.forTimeZone(TimeZone.getTimeZone("Asia/Calcutta")
Hi Jesse,
My marvel was installed in April. I didn't upgrade es or marvel after that.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...
Hi,
Please help with suggestions.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the w
Hi,
Please help with suggestion.
On Monday, August 11, 2014 7:51:00 PM UTC+5:30, Subhadip Bagui wrote:
>
> Hi,
>
> I'm using below code to insert some documents in elasticsearch index. But
> when inserting in the es the time is coming as UTC format rather than
> or
Hi,
Suddenly my elasticsearch node starts giving issue and refuse to start up..
Giving issue like below
[2015-01-02 17:10:23,678][ERROR][marvel.agent.exporter] [node-master]
error connecting to [localhost:9200]
java.net.SocketTimeoutException: connect timed out
at java.net.PlainSocketImpl.s
where the modification data is given.
>
> Thanks
> Vineeth
>
>
>
> On Fri, Aug 22, 2014 at 7:00 PM, Subhadip Bagui > wrote:
>
>> Hi,
>>
>> I'm doing update in elasticsearch document and the same time one rest api
>
Hi,
I'm doing update in elasticsearch document and the same time one rest api
is calling for search results. Below is my code.
public String updateElasticsearchDocument(String index, String type,
List indexID) {
Client client = ESClientFactory.getInstance();
UpdateResponse updateResponse = null
Hi,
Can someone please give me a hint, I'm having trouble getting a solution
for this.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr.
Hi,
Any ideas how to prevent the time changing while indexing in es, or to
convert in correct format while query ?
Thanks,
Subhadip
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails fro
Hi,
I'm using below code to insert some documents in elasticsearch index. But
when inserting in the es the time is coming as UTC format rather than
original GMT+5:30Z format. Where as the Sysout before indexing is giving me
correct format as *2014-08-11T18:23:13.447+05:30* . Please let me know
Hi Alex,
Yes I tried that and it's working. Thanks :)
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this
Hi,
I'm using the below code to get a singleton object for TransportClient
object. I'm using the getInstance() to get the client object which is
already alive in webapplication.
public static Client getInstance()
{
if (instance == null)
{
logger.debug("the client instance is null, creating
Hi,
I'm using the below code to get the average value of cpu_usage using
aggregation. When I checked the output of cpu value individually and
calculate the avg, it is not matching with the aggregation avg value. I'm
using a boolquery along with rangeFilter here to get the data.
Please help to
I have a code like below where I'm doing multiple must in bool query. Here
I'm passing the must term queries in field "address". Now the ip address
will come to me as a list from other api and I have to pass for all the
ip's in the list as a must term query. Here I'm not getting a way how to
Hi,
I have a document like below
{
"_index": "cpu_usage_metrics",
"_type": "cpu_usage_metrics",
"_id": "CKAAs1n8TKiR6FncC5NLGA",
"_score": 1,
"_source": {
"status": 0,
"occurrences": 1,
"value
Hi,
please suggest...
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
htt
Hi,
I've below kind of documents in elasticsearch which is coming from 3rd
party api and there are values upon which I want to do aggregation.
{
"_index": "virtualmachines",
"_type": "nodes",
"_id": "103",
"_score": 1,
"_source": {
Any help on this ?
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https:/
any suggestion ?
Subhadip
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
Thank you Adrien, I'm getting the aggregation value now.
One doubt here. I have a field which stores values likes "CPU_USED" :
"0.04%"
Want to do aggregation on that. Can I do any string manipulation here on
the field passed on AggregationBuilders ? Tried like this but not working .
Please sugg
Hi,
I have a field of type string in documents and there are values like
"CPU_USED": "0.02%". I want to do average of all the values using some
filters. I tried with below but getting error. Please suggest how to do
this.
POST /virtualmachines/_search
{
"query" : {
"filtered" : {
Hi,
I'm trying to do aggregation using java api. But couldn't get the
*SearchResponse* correctly. Getting below error. I've written method like
below using XContentBuilder.
Couldn't get any working scenarios from google. Please suggest any working
example for aggregation of single value.
* pu
Thanks a lot Ivan. Will try with Java API as u suggested.
One more doubt. There is a field in my document like "CPU_USED": "0.03%"
Can we do aggregation avg on this field ? I tried but got exception like
below as this was a string field. Can u please suggest.
"reason": "QueryPhaseExecutionExcept
Thanks Ivan for your reply.
I tried with *size : 0* but still the metadata is coming. Is there any way
to suppress the metadata.
Can I use java api to do so. Earlier I used the method like below to get
the source response only. Can we do that for aggregation also?
public String searchESIndex(
Hi,
I want to get the average value of MEMORY field from my ES document. Below
is the query I'm using for that. Here I'm getting the aggregation along
with the hits Json also. Is there any way we can get the aggreation result
only. Please suggest.
POST /virtualmachines/_search
{
"query" :
Hi,
I'm trying to use a singleton instance of client for multiple index
creation. Below is the code for the same. But every time I'm getting
instance as null and it's creating a new instance. Please let me know what
I'm doing wrong
*singleton instance* :
public class ESClientSingleton {
publ
Hi,
I'm running elasticsearch through windows using command prompt. The same
started as below.
D:\elasticsearch\elasticsearch-1.0.1\bin>elasticsearch
[2014-04-08 13:39:00,199][WARN ][bootstrap] jvm uses the
client vm, make sure to run `java` with the ser
ver vm for best performa
Hi,
The issue is that if I leave ES inactive for some time I get
java.net.SocketException:
Network is unreachable error. I have to restart ES to get it worked. May be
too many node or client is created.
So I'm trying to use the same client instance created for all ES. But the
singleton instanc
Hi David,
The singleton instance for client I'm not getting for existing client.
Trying something like this. Can you please give some working example.
public class ESClientSingleton {
private static ESClientSingleton instance;
private ESClientSingleton()
{
}
public static Object getIn
Thanks a lot David :)
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
http
Hi David,
I'm trying to store all cloud event related data like create node, delete
node etc. in ES. So whenever a new event occurs I'm creating a new node and
client, doing the indexing and then closing the node.
As you said, should I use same node created and use that in all occurence?
like
Hi David,
If I restart ES the same is working. But gives me this issue if multiple
call made after some time.
My client and server are on the same system. I stopped the firewall also.
Any suggestion how to make multicast working. Can I create and close client
node for multiple times?
--
You
Hi,
If I remove client(true) from node initialization then I'm successfully
indexing documents. But I want to create this node as client only without
shards being allocated to them, as stated
in
http://www.elasticsearch.org/guide/en/elasticsearch/client/java-api/current/client.html
Also I'm g
Please suggest. I'm getting connection error in elasticsearch end even if
the node is running.
[2014-04-07 17:22:40,109][WARN ][transport.netty ] [node-master]
exception caught on transport layer [[id: 0xd2
f92b59, 0.0.0.0/0.0.0.0:64313]], closing connection
java.net.SocketException: Ne
Hi,
I'm using the below code for indexing data from cloud. But getting the
below exception while calling prepareIndex . Please let me know why the
exception is coming.
public static IndexResponse insertESDocument(String nodeName, String json)
{
Node node =
nodeBuilder().clusterName("el
Hi,
I'm to trying to get the filed values of a document which is already been
set. But I have to pass the field name while doing so.
In method call I may not know the fields whatever some one has already set.
Can I get all the fileds from GetField without passing the field name ?
public static
Thanks a lot Mark. That explains a lot.
By backup I meant copy of same data.
One last question, for fast searching what will be the better selection?
single index multiple shards or multiple index single shard?
Can you please give some reference how lucene splits documents and store in
shards
Thanks Mark for the prompt reply, I have some more doubts
1. Suppose one index is running with 3 shards and 1 replica and other index
is running with the cluster settings i.e. 5 shards 2 replica then total 3+1
or 5+2 shards will be available in cluster? I have installed
elasticsearch-head plu
Hi,
I've started working on elasticsearch and having some doubts about shards
and replicas and how they handle data. I don't have any prior knowledge on
Lucene.
As I know lucene will split data in segments and store in disk, and shard
is the lucene index itself. Some of the doubts which I have
My app is in Java only. So what I mean is should I use elasticsearch Java
client or available REST api's only using HttpClient and all.
What will be more flexiable for multiplatform ingration ?
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
Hi,
We have a cloud management framework where all the event data are to be
stored in elasticsearch. I have to start the client side code for this.
I need a suggestion here. Which one should I use, elasticsearch Java API or
REST API for the client ?
Kindly suggest and mention the pros and co
I changed the SearchType as SearchType.QUERY_AND_FETCH and its giving
correct response now.
Thanks...
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticse
Hi,
I'm using the below method to get results from ES. But search hit result is
0. Please let me know the correct way to get results,
public static SearchResponse searchIndex(Client client, Node node)
{
SearchRequestBuilder srequest =
client.prepareSearch("testindex").setTypes("testtype")
Hi,
Pls suggest...
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https:
Hi,
I'm using the below aggs for getting max, avg values from 2 data fields.
But the result is coming in unix timeformat I guess. Can I get the result
normal time format,
query==>
"aggs" : {
"max_time" : {
"max" : {
"script" : "doc['gi_xdr_info_end_time'].
I have changed mapping not to analyze and it's giving correct data. Also
tried with bool query for terms and giving correct search for exact match.
Got the logic now.
Thanks a lot.
-
Subhadip
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
T
Thanks David. Tried with below match query and it's working fine.
{
"match": {
"CLOUD_TYPE" : {
"query": "AWS-EC2",
"type": "phrase"
}
}
As you said I can send the exac
Hi Binh,
I was an issue with json format creation. Now I validated the json and
getting result.
Thanks..
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elast
Hi,
I have some document fields with value like "CLOUD_TYPE": "AWS-EC2"
I'm trying below query to get the results, but it's giving me 0 values.
Please let me know the correct way to fetch the query
POST /aricloud/_search
{
"query": {
"filtered": {
"query": {
"b
My mistake!! the json format was wrong. tried below and it's working fine.
Thanks David
> {
> "query": {
> "filtered": {
> "query": {
> "bool": {
> "must": [
> {
> "range": {
>
Hi,
I'm trying to make a bool query where sending mutiple term under should
block as given in link
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-bool-query.html
But I'm getting SearchPhaseExecutionException while trying to execute below
query. Please inform wh
Hi Clinton,
Thanks for your reply. I tried as suggested and the same is working now :)
One question though, I have to pass the text field in lower case always as
the same is getting analyzed by standard analyzer I guess. Is there any way
to pass multiple match in bool for text search so that I
Hi,
I'm trying to run the below bool query with filter range to fetch all the
node data with CLOUD_TYPE="AWS-EC2"" and NODE_STATUS="ACTIVE".
But I'm getting SearchPhaseExecutionException from elasticsearch. Please
let me know the correct way to do this.
curl -XPOST "http://10.203.251.142:920
Hi,
I'm doing the below query to fetch data date wise. But in the result the
score is coming as null. How to get the score here.
curl -XPOST "10.203.251.142:9200/aricloud/_search" -d
'{
"query": {
"filtered": {
"query" : {
"match" : {
"
Hi David,
I have done following steps u suggested. The string search is working now.
But for filter I have to always pass strings in lowercase; where as for
query text search I can give the proper string sequence inserted in doc.
query shown below.
May be this is very basic and I'm doing somet
Hi David,
I have done following steps u suggested. The exact string search is working
now.
But when I'm trying the below query for string matching it's giving null
result.
May this is very basic and I'm doing something wrong. I'm a week old on
elasticsearch and trying to understand the query-s
Hi David,
The data is coming through logstash and taking default mapping in
elasticsearch. Can I do update mapping for that index id ?
Pls let me know.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop r
Hi Binh,
The query you given is working. Thanks for your help.
But if I change the query and search for string "requestproxyauthentication"
instead, It's not working. Below is the mapping for message field.
I'm trying to understand how elasticsearch analyze the field data. Pls
comment.
"mess
Hi David,
I have done like below for a test sample.
1. deleted index.
2. create index by following
curl -XPUT "http://localhost:9200/movies/"; -d
'{ "index": {"_index": "movies", "_type": "movie", "_id": "1"}}'
3. creating doc
curl -XPUT "http://localhost:9200/movies/movie/1"; -d
'{
mapping...default
{
- "logstash-2014.03.03":{
- "mappings":{
- "apache-access":{
- "dynamic_templates":[
- {
- "string_fields":{
- "mapping":{
- "type":"multi_field",
mapping...
{
- "movies":{
- "mappings":{
- "movie":{
- "properties":{
- "director":{
- "type":"string",
- "fields":{
- "original":{
- "type":"string",
Hi David,
Trying to query as following, but still getting null result. Please suggest.
{
"query": {
"constant_score": {
"filter": {
"term": { "message": "requestproxyauthentication" }
}
}
}
}
-Subhadip
--
You received this messag
Hi,
Actually if I fix the ES_MAX_MEM with some value elasticsearch is starting
with max of that memory usage only. But when used *bootstrap.mlockall: true
*and start elasticsearch it's taking more memory than ES_MAX_MEM.
What I'm trying to understand if how much memory elasticsearch will occ
Hi,
I've a index in my elasticsearch like below
{
- "_index":"logstash-2014.03.03",
- "_type":"apache-access",
- "_id":"snCPRnSHSvm_aaeuHxB84w",
- "_version":1,
- "found":true,
- "_source":{
- "message":"\tat
org.apache.http.client.protocol.RequestProxyAuthenti
Hi,
I’ve allocated max and min heap same with *ES_HEAP_SIZE=1200m* in
elasticsearch and using *bootstrap.mlockall: true *as suggested by
elasticsearch so that process memory won’t get swapped.
But when elasticsearch I start its taking more memory than max heap
mentioned; like 1.4g and holdin
Thanks Binh. It's working now...
On Thursday, March 6, 2014 1:56:26 PM UTC+5:30, Subhadip Bagui wrote:
>
> Hi,
>
> I'm new in elasticsearch and need some help. I'm getting below exception
> while trying to search a string in elasticsearch using Kibana. Below are
&
Hi,
I haven't used elasticsarch api for search results. I'm searchig the string
using kibana gui. Please let me know how to enable special charter seach
using kibana.
---
On Thursday, March 6, 2014 1:56:26 PM UTC+5:30, Subhadip Bagui wrote:
>
> Hi,
>
> I'm ne
Hi,
I'm new in elasticsearch and need some help. I'm getting below exception
while trying to search a string in elasticsearch using Kibana. Below are
the components I'm using.
1. logstash 1.3.3
2. redis : 2.4.10
3. elasticsearch: 1.0
4.kibana
I'm running elasticsearch with default, single clust
ue.
Thanks,
Subhadip
On Saturday, March 1, 2014 2:58:35 PM UTC+5:30, Subhadip Bagui wrote:
>
> Hi ,
>
> I'm trying to move elastic search on a new system, but while trying to
> start the service its giving below exception. Althrough the process is
> running. There was ol
Hi,
When I deleted all in index using rest then elasticsearch is getting up
fine. Any help to identify the issue.
Thanks
On Saturday, March 1, 2014 2:58:35 PM UTC+5:30, Subhadip Bagui wrote:
>
> Hi ,
>
> I'm trying to move elastic search on a new system, but while tryin
Hi,
Please suggest how to resolve the issue.
Thanks,
Subhadip
On Saturday, March 1, 2014 2:58:35 PM UTC+5:30, Subhadip Bagui wrote:
>
> Hi ,
>
> I'm trying to move elastic search on a new system, but while trying to
> start the service its giving below exception. Alth
Hi,
Please help to fix the issue.
On Saturday, March 1, 2014 2:58:35 PM UTC+5:30, Subhadip Bagui wrote:
>
> Hi ,
>
> I'm trying to move elastic search on a new system, but while trying to
> start the service its giving below exception. Althrough the process is
>
Hi ,
I'm trying to move elastic search on a new system, but while trying to
start the service its giving below exception. Althrough the process is
running. There was old elasticsearch 0.90 copied which is not running now
as I checked. Please suggest.
[2014-02-28 16:40:13,588][WARN ][transport.
at
org.elasticsearch.indices.recovery.RecoveryTarget.access$300(RecoveryTarget.java:65)
at
org.elasticsearch.indices.recovery.RecoveryTarget$2.run(RecoveryTarget.java:171)
--
Thanks
Subhadip
On Friday, February 28, 2014 3:45:18 PM UTC+5:30, Subhadip Bagui wrote:
>
> Hi,
>
> I
Hi,
I'm getting the below issue when trying to increase paging in Kibana which
is using elasticsearch.
[2014-02-28 11:24:29,280][DEBUG][action.search.type ] [Nut] [182865] Failed
to execute fetch phase
org.elasticsearch.ElasticsearchException: Java heap space
at
org.elasticsearch.ExceptionsH
85 matches
Mail list logo