Query conatining multiple fields
Hi, This is a part of source in elasticsearch index.
_source: {
InvoiceId: a,
InvoiceNum: b,
LastUpdatedBy: FINUSER1,
SetOfBooksId: 1,
LastUpdateDate: 2015-03-20 18:31:16.592,
VendorId: 5,
InvoiceAmount: 1200,
InvoiceCurrencyCode: USD,
AmountPaid: NotFound,
PaymentCurrencyCode: USD,
}
I need to query on multiple inputs using the JAVA API, for example say I
have provided InvoiceId InvoiceNum as a and b .
How can I query using these multiple inputs? I want a single response for
this.
One thing I came across was
MultiSearchResponse sr =
client.prepareMultiSearch().add(srb1).add(srb2).execute().actionGet(); where
SearchRequestBuilder srb1 =
client.prepareSearch(dbdata2).setTypes(invoices2).setQuery(QueryBuilders.matchQuery(InvoiceId,
a));
SearchRequestBuilder srb2 =
client.prepareSearch(dbdata2).setTypes(invoices2).setQuery(QueryBuilders.matchQuery(InvoiceNum,b));
but these return individual results. Is there any way I can get a single
output?
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/4105c392-462a-4902-a762-c92dc92663ea%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Re: Elsticsearch JDBC river plugin metrics
Got it. Thanks ! -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/a1f56595-9ab1-4e89-97d4-6e257cbb3042%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Incremental updates using the river plugin
Hello,
In order to get the incremental updates form the db, the river query has
the following timestamp attribute.
{
type : jdbc,
jdbc : {
url : jdbc:mysql://localhost:3306/test,
user : ,
password : ,
sql : [
{
statement : select * from \products\ where \mytimestamp\
?,
parameter : [ $river.state.last_active_begin ]
}
],
index : my_jdbc_river_index,
type : my_jdbc_river_type
}
}
Do I need to have a mytimestamp column in my db with the value as time of
the insert of that particular row? Or is this a predefined attribute in
elasticsearch?
Thank you.
--
You received this message because you are subscribed to the Google Groups
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9eba7847-db14-4398-8533-ebeacbd1ca61%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Re: Elsticsearch JDBC river plugin metrics
Okay. Thanks a lot. Is there any other way in which I can see the metrics. If I have indexed my db with 2 records in Elasticsearch, for that I can see the metrics as above. But say that, I have made one new insert/update/delete into my db and that is picked by elasticsearch, is there any way in which I can see the time taken for that one particular insert/update/delete? On Monday, January 19, 2015 at 3:36:47 PM UTC+5:30, Jörg Prante wrote: The numbers in brackets mean the average numbers over the last 1 / 5 / 15 minutes. This useful for a long running indexer. The elapsed time is the time since this metric counter is active. Jörg On Mon, Jan 19, 2015 at 10:41 AM, 4m7u1 amtuln...@gmail.com javascript: wrote: Hi, I've got a small doubt again. *[2015-01-19 15:06:08,410][INFO ][river.jdbc.RiverMetrics ] pipeline org.xbib.elasticsearch.plugin.jdbc.RiverPipeline@1cede282 complete: river jdbc/my_test_river metrics: 34 rows, 170.35844075426294 mean, (147.82076731011736 30.98274869393544 10.409690875802436), ingest metrics: elapsed 8 seconds, 57.57 MB bytes, 177.0 bytes avg, 6.848 MB/s* So here, Average no of rows picked per second is 170 and what do the values in the brackets mean (147.82076731011736 30.98274869393544 10.409690875802436). and also ingest metrics: elapsed 8 seconds mean that the total time taken in the corresponding poll is 8 seconds? Thank you. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com javascript:. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/4c9f209b-cefb-4709-a2b9-a98f971eecb9%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/4c9f209b-cefb-4709-a2b9-a98f971eecb9%40googlegroups.com?utm_medium=emailutm_source=footer . For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/139a365e-aca7-45e3-b1d7-7bd3a08dfbda%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Elsticsearch JDBC river plugin metrics
Hi, I've got a small doubt again. *[2015-01-19 15:06:08,410][INFO ][river.jdbc.RiverMetrics ] pipeline org.xbib.elasticsearch.plugin.jdbc.RiverPipeline@1cede282 complete: river jdbc/my_test_river metrics: 34 rows, 170.35844075426294 mean, (147.82076731011736 30.98274869393544 10.409690875802436), ingest metrics: elapsed 8 seconds, 57.57 MB bytes, 177.0 bytes avg, 6.848 MB/s* So here, Average no of rows picked per second is 170 and what do the values in the brackets mean (147.82076731011736 30.98274869393544 10.409690875802436). and also ingest metrics: elapsed 8 seconds mean that the total time taken in the corresponding poll is 8 seconds? Thank you. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/4c9f209b-cefb-4709-a2b9-a98f971eecb9%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
JDBC plugin Feeder Mode
Hi, This is what I've understood so far, JDBC plugin in Feeder mode is run as a bash script with parameters similar to river. The documentation says that it is a push model. Can anyone explain how does it work? If i have a new data pushed into my db, what role does the feeder play from here on? Thank you. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/54750384-49bd-471d-8cac-86aa9f43a9fb%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Writing custom scripts for indexing data in Elasticsearch
Thank you :) On Friday, January 16, 2015 at 6:27:48 PM UTC+5:30, Jörg Prante wrote: schedule is triggering the JDBC plugin by wall clock time of the machine, where interval simply waits the given time period between two runs. Jörg On Fri, Jan 16, 2015 at 11:12 AM, Amtul Nazneen amtuln...@gmail.com javascript: wrote: Thank you. Is it the interval parameter or schedule parameter? If I set the schedule parameter, then the Elasticsearch will poll the tables accordingly right? On Wednesday, January 14, 2015 at 2:31:07 PM UTC+5:30, David Pilato wrote: I guess you need to set interval. See doc plugin on the home page of the JDBC river. interval - a time value for the delay between two river runs (default: not set) -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 14 janv. 2015 à 06:01, Amtul Nazneen amtuln...@gmail.com a écrit : Ohkay. So the river runs only once when the script starts? And after that won't it be running in the background to fetch the updates according to a schedule? On Monday, January 12, 2015 at 1:23:08 PM UTC+5:30, Ed Kim wrote: It executes once. You could consider running that script on a schedule and doing incremental updates using timestamps. On Sunday, January 11, 2015 at 9:24:28 PM UTC-8, Amtul Nazneen wrote: Thank you. I have a doubt though, once I run the script, the river plugin is started and the data gets indexed into Elasticsearch, I want to know, if the plugin would be running after that, or does it stop once the script execution comes to an end? -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/ msgid/elasticsearch/a0997950-4ca4-4036-9550-d1da3816b503% 40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/a0997950-4ca4-4036-9550-d1da3816b503%40googlegroups.com?utm_medium=emailutm_source=footer . For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com javascript:. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9db75940-2ca3-4140-a681-cba55ac3725a%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/9db75940-2ca3-4140-a681-cba55ac3725a%40googlegroups.com?utm_medium=emailutm_source=footer . For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2c72317f-1d59-4b12-955a-5c990b2491ee%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Elasticsearch JDBC river plugin- Interval vs Schedule.
Okay got it. Thanks :). And are both the same when it comes to performance? -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com javascript:. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8d4069fb-ed3a-4b41-b917-d262366a99c8%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/8d4069fb-ed3a-4b41-b917-d262366a99c8%40googlegroups.com?utm_medium=emailutm_source=footer . For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/7b3f1a29-016b-48f6-899a-08425432e0a8%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Elsticsearch JDBC river plugin metrics
Thank you so much Jörg :) ! On Friday, January 16, 2015 at 6:08:49 PM UTC+5:30, Jörg Prante wrote: These are diagnostic messages which have been crept into one of the releases. Latest version has metrics logging disabled, it must be enabled by settings. The metrics count the number of rows fetched form the database, and prints them at every minute. This is not the number of documents in ES. The metrics print an average mean of the row count, so you can see that your database sent 250 rows per second. It also counts the data volume in bytes, and print the measure of megabytes per second, which is in interesting number for throughput. Jörg On Fri, Jan 16, 2015 at 12:16 PM, 4m7u1 amtuln...@gmail.com javascript: wrote: I'm trying to run a river query which fetches 1 records scheduled at 1 minute interval. The first time it runs, metrics is 1 rows and after a gap of 1 minute that is (scheduled interval) metrics is 2 rows. What does this mean? Although the number of hits i get on querying the river index is 1 itself. Why do the metrics on rows keep on increasing by a factor of 1 each time? *[2015-01-16 16:38:03,406][INFO ][river.jdbc.RiverMetrics ] pipeline org.xbib.elasticsearch.plugin.jdbc.RiverPipeline@20f4b6fe complete: river jdbc/my_jdbc_river metrics: 1 rows, 250.5428448620193 mean, (0.0 0.0 0.0), ingest metrics: elapsed 3 seconds, 3.37 MB bytes, 352.0 bytes avg, 1 MB/s* and also can anyone explain the below values? metrics: 1 rows, 250.5428448620193 mean, (0.0 0.0 0.0), ingest metrics: elapsed 3 seconds, 3.37 MB bytes, 352.0 bytes avg, 1 MB/s. Thank you. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com javascript:. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/a043ffe1-976d-4c07-bca6-a7ef93f14b3b%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/a043ffe1-976d-4c07-bca6-a7ef93f14b3b%40googlegroups.com?utm_medium=emailutm_source=footer . For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9338605d-5b9d-4af2-8b62-625f64c7509a%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
ELasticsearch: Interval vs. Schedule
Hi ! What is the difference between interval and schedule? Both are used to keep Elasticsearch in sync with the database. Which one is better? -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2030b825-5f54-4606-8a6d-166bfd5e8e7c%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Elasticsearch JDBC river plugin- Interval vs Schedule.
In JDBC river plugin for Elasticsearch, what is the difference between interval and schedule? Both are used to keep Elasticsearch in sync with the database. Which one is better? -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8d4069fb-ed3a-4b41-b917-d262366a99c8%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Elsticsearch JDBC river plugin metrics
I'm trying to run a river query which fetches 1 records scheduled at 1 minute interval. The first time it runs, metrics is 1 rows and after a gap of 1 minute that is (scheduled interval) metrics is 2 rows. What does this mean? Although the number of hits i get on querying the river index is 1 itself. Why do the metrics on rows keep on increasing by a factor of 1 each time? *[2015-01-16 16:38:03,406][INFO ][river.jdbc.RiverMetrics ] pipeline org.xbib.elasticsearch.plugin.jdbc.RiverPipeline@20f4b6fe complete: river jdbc/my_jdbc_river metrics: 1 rows, 250.5428448620193 mean, (0.0 0.0 0.0), ingest metrics: elapsed 3 seconds, 3.37 MB bytes, 352.0 bytes avg, 1 MB/s* and also can anyone explain the below values? metrics: 1 rows, 250.5428448620193 mean, (0.0 0.0 0.0), ingest metrics: elapsed 3 seconds, 3.37 MB bytes, 352.0 bytes avg, 1 MB/s. Thank you. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/a043ffe1-976d-4c07-bca6-a7ef93f14b3b%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
