Also you should realise that if you set "basic_auth" in prometheus.yml, this only sets basic auth for the HTTP request from prometheus to json_exporter, not from json_exporter to target.
Does the target endpoint http://localhost:9015/services/v2/mpoints/E_TIP5/statistics require authentication? If so, you'll need a HTTPClientConfig section in your json_exporter configuration. Admittedly I couldn't find this documented in the json_exporter config examples, but you can find what you need here: https://github.com/prometheus-community/json_exporter/blob/v0.4.0/config/config.go#L40-L46 https://github.com/prometheus/common/blob/main/config/http_config.go On Tuesday, 19 April 2022 at 08:03:12 UTC+1 Brian Candler wrote: > The configuration of prometheus isn't really of interest, because it's > json_exporter that's returning the error. > > Scrape the exporter by hand: > > curl -vg ' > http://localhost:7979/probe?target=http:%2f%2flocalhost%3a9015%2fservices%2fv2%2fmpoints%2fE_TIP5%2fstatistics > ' > > I suspect you'll see the 503 error there too, but you may get a more > detailed error message that may help understand what's going on. Also try > scraping the JSON target directly: > > curl -vh 'http://localhost:9015/services/v2/mpoints/E_TIP5/statistics' > > If the latter doesn't work, or doesn't return JSON, then obviously the > former won't work either. > > Likely problems are: > - the .../statistics endpoint isn't working or isn't returning JSON > - the configuration of json_exporter is bad > > On Tuesday, 19 April 2022 at 03:24:40 UTC+1 sivap...@gmail.com wrote: > >> >> Hi, >> I'm getting below error on prometheus console log while scraping metrics >> from json_exporter >> <https://github.com/prometheus-community/json_exporter/tree/c487740bb83f5b2a682d99161cbe8e4209ba4b2e>. >> >> Target endpoint is available and able to get response with curl using basic >> authentication. >> >> ts=2022-04-18T20:58:07.156Z caller=scrape.go:1292 level=debug >> component="scrape manager" scrape_pool=json target=" >> http://localhost:7979/probe?target=http%3A%2F%2Flocalhost%3A9015%2Fservices%2Fv2%2Fmpoints%2FE_TIP5%2Fstatistics"; >> >> msg="Scrape failed" err="server returned HTTP status 503 Service >> Unavailable" >> >> >> Here is the prometheus.yaml >> >> scrape_configs: >> >> ## gather metrics of prometheus itself >> - job_name: prometheus >> static_configs: >> - targets: >> - localhost:9090 >> >> ## gather the metrics of json_exporter application itself >> - job_name: json_exporter >> static_configs: >> - targets: >> - localhost:7979 ## Location of the json exporter's real <hostname>:<port> >> >> ## gather the metrics from third party json sources, via the json exporter >> - job_name: json >> scrape_interval: 15s >> scrape_timeout: 10s >> metrics_path: /probe >> basic_auth: >> username: XXXXXX >> password: XXXXX >> static_configs: >> - targets: ['http://localhost:9015/services/v2/mpoints/E_TIP5/statistics >> '] >> relabel_configs: >> - source_labels: [__address__] >> target_label: __param_target >> - source_labels: [__param_target] >> target_label: instance >> - target_label: __address__ >> replacement: localhost:7979 ## Location of the json exporter's real >> <hostname>:<port> >> > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/1f223f4b-3391-4794-bf4c-ca3f1adb256bn%40googlegroups.com.
