Thank you, JB. You followed my no sequitur to prometheus perfectly! What you
say about prometeus certainly confirms what the documentation says. However, I
cannot find how to push to a prometheus server. I gather this is not done using
decanter. What is the normal/correct way to do this?
> On Nov 3, 2020, at 20:38, Jean-Baptiste Onofre <j...@nanthrax.net> wrote:
>
> Hi,
>
> Decanter Prometheus exposes the Prometheus servlet. So, it’s not pushing,
> it’s polling: prometheus polls data from the prometheus servlet exposed by
> decanter.
> If you want pushing, you can directly push to prometheus backend (but it’s
> not the prometheus appender).
>
> Regards
> JB
>
>> Le 3 nov. 2020 à 23:53, Mark Bordelon <mborde...@savoirtech.com> a écrit :
>>
>> Hi JB.
>> Got things to work by just setting the prefix and making sure everything was
>> lowercase!
>> Next problem is getting the data from the karaf endpoint
>> (decanter/prometheus) to a prometheus server (promeefee:9090/graph)
>> I see nothing in the decanter documentation on prometheus appender for
>> pushing data to a url.
>> Is it assumed that a prometheus server must always pull from the
>> decanter/prometheus endpoint?
>>
>>> On Nov 3, 2020, at 12:51, Jean-Baptiste Onofre <j...@nanthrax.net> wrote:
>>>
>>> Hi Mark
>>>
>>> 6.8, ok, the tests are using newer version.
>>>
>>> But it should work anyway. I will test it tomorrow.
>>>
>>> Regards
>>> JB
>>>
>>>> Le 3 nov. 2020 à 21:44, Mark Bordelon <mborde...@savoirtech.com> a écrit :
>>>>
>>>> Hi JB,
>>>>
>>>> This is the version of the Elastic Search I wish to push to:
>>>>
>>>> {
>>>> "name" : "sitesc104w224m7",
>>>> "cluster_name" : "vela",
>>>> "cluster_uuid" : "fNKKGBcoTJmh42LDDxDkow",
>>>> "version" : {
>>>> "number" : "6.8.12",
>>>> "build_flavor" : "default",
>>>> "build_type" : "tar",
>>>> "build_hash" : "7a15d2a",
>>>> "build_date" : "2020-08-12T07:27:20.804867Z",
>>>> "build_snapshot" : false,
>>>> "lucene_version" : "7.7.3",
>>>> "minimum_wire_compatibility_version" : "5.6.0",
>>>> "minimum_index_compatibility_version" : "5.0.0"
>>>> },
>>>> "tagline" : "You Know, for Search"
>>>> }
>>>>
>>>>> On Nov 2, 2020, at 21:17, Jean-Baptiste Onofre <j...@nanthrax.net> wrote:
>>>>>
>>>>> Hi Mark,
>>>>>
>>>>> What elasticsearch version are you using ?
>>>>>
>>>>> Regards
>>>>> JB
>>>>>
>>>>>> Le 2 nov. 2020 à 22:11, Mark Bordelon <mborde...@savoirtech.com> a écrit
>>>>>> :
>>>>>>
>>>>>> With the following minimal configuration, (just setting the address,
>>>>>> authentication, and index prefix) …
>>>>>>
>>>>>> ################################################
>>>>>> # Decanter Elasticsearch Appender Configuration
>>>>>> ################################################
>>>>>>
>>>>>> # HTTP address of the elasticsearch nodes (separated with comma)
>>>>>> addresses=http://elasticsearch-vela-1.sit.etrade.com:9200
>>>>>> <http://elasticsearch-vela-1.sit.etrade.com:9200/>
>>>>>>
>>>>>> # Basic username and password authentication
>>>>>> username=batchoi
>>>>>> password=batchoipwd
>>>>>>
>>>>>> # The index name.
>>>>>> # The index prefix is a static string used to construct the index
>>>>>> index.prefix=karafCamelCWS
>>>>>> # If true, it creates an index per Decanter event day
>>>>>> #index.event.timestamped=true
>>>>>> # For Elasticsearch < 7.5, index type is mandatory (not defined by
>>>>>> default)
>>>>>> index.type=
>>>>>>
>>>>>> # Marshaller to use (json is heavily recommended)
>>>>>> marshaller.target=(dataFormat=json)
>>>>>>
>>>>>>
>>>>>> I get this 405 error when i install the elasticsearch appender feature.
>>>>>>
>>>>>> 2020-11-02T15:32:15,870 | WARN | EventAdminAsyncThread #23 |
>>>>>> ElasticsearchAppender | 188 -
>>>>>> org.apache.karaf.decanter.appender.elasticsearch - 2.5.0 | Can't append
>>>>>> into Elasticsearch
>>>>>> org.elasticsearch.client.ResponseException: method [POST], host
>>>>>> [http://elasticsearch-vela-1.sit.etrade.com:9200], URI
>>>>>> [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not
>>>>>> Allowed <http://elasticsearch-vela-1.sit.etrade.com:9200], uri
>>>>>> [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not
>>>>>> Allowed>]
>>>>>> {"error":"Incorrect HTTP method for uri [/karafCamelCWS-2020.11.02/] and
>>>>>> method [POST], allowed: [HEAD, GET, PUT, DELETE]","status":405}
>>>>>> at
>>>>>> org.elasticsearch.client.RestClient.convertResponse(RestClient.java:283)
>>>>>> ~[!/:?]
>>>>>> at
>>>>>> org.elasticsearch.client.RestClient.performRequest(RestClient.java:261)
>>>>>> ~[!/:?]
>>>>>> at
>>>>>> org.elasticsearch.client.RestClient.performRequest(RestClient.java:235)
>>>>>> ~[!/:?]
>>>>>> at
>>>>>> org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.send(ElasticsearchAppender.java:172)
>>>>>> ~[!/:?]
>>>>>> at
>>>>>> org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.handleEvent(ElasticsearchAppender.java:152)
>>>>>> [!/:?]
>>>>>> at
>>>>>> org.apache.felix.eventadmin.impl.handler.EventHandlerProxy.sendEvent(EventHandlerProxy.java:415)
>>>>>> [!/:?]
>>>>>> at
>>>>>> org.apache.felix.eventadmin.impl.tasks.HandlerTask.runWithoutBlacklistTiming(HandlerTask.java:82)
>>>>>> [!/:?]
>>>>>> at
>>>>>> org.apache.felix.eventadmin.impl.tasks.SyncDeliverTasks.execute(SyncDeliverTasks.java:104)
>>>>>> [!/:?]
>>>>>> at
>>>>>> org.apache.felix.eventadmin.impl.tasks.AsyncDeliverTasks$TaskExecuter.run(AsyncDeliverTasks.java:166)
>>>>>> [!/:?]
>>>>>> at
>>>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>>>>>> [?:1.8.0_51]
>>>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>>>> [?:1.8.0_51]
>>>>>> at
>>>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>>>> [?:1.8.0_51]
>>>>>> at
>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>>>> [?:1.8.0_51]
>>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>>>
>>>>>>
>>>>>> If the HTTP verb could be set to PUT, seems like it might work based on
>>>>>> this:
>>>>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>>>>> -XPOST "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws
>>>>>> <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{
>>>>>> "field" : "value"}’
>>>>>> {"error":"Incorrect HTTP method for uri [/] and method [POST], allowed:
>>>>>> [HEAD, GET, DELETE]","status":405}
>>>>>>
>>>>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>>>>> -XPUT "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws
>>>>>> <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{
>>>>>> "field" : "value"}’
>>>>>> {"error":{"root_cause":[{"type":"remote_transport_exception","reason":"[sitesm111w88m7][10.247.33.25:9300][indices:admin/create]"}],"type":"illegal_argument_exception","reason":"unknown
>>>>>> setting [index.field] please check that any required plugins are
>>>>>> installed, or check the breaking changes documentation for removed
>>>>>> settings"},"status":400}
>>>>>>
>>>>>
>>>>
>>>
>>
>
