atiaomar1978-hub commented on code in PR #1734: URL: https://github.com/apache/camel-website/pull/1734#discussion_r3889819514
########## content/blog/2026/08/camel-genai-observability-spring-boot/index.md: ########## @@ -0,0 +1,274 @@ +--- +title: "GenAI Observability with Spring Boot and the Camel Observability Stack" +date: 2026-08-29 +draft: false +authors: [atiaomar1978-hub] +categories: ["AI", "Howtos"] +keywords: ["apache camel", "genai", "observability", "spring boot", "prometheus", "opentelemetry", "victoriatraces", "perses", "ollama", "langchain4j", "camel 4.23"] +preview: "Take Camel GenAI observability from JBang prototypes to production — Spring Boot Actuator, Prometheus scraping, OTLP traces in VictoriaTraces, and optional Perses dashboards." +--- + +In [Part 1](/blog/2026/08/camel-genai-observability-jbang/) we prototyped GenAI observability with Camel JBang +and the TUI. This follow-up — **Phase 3 (Operate)** — shows the same `gen_ai.*` telemetry in a **Spring Boot** +application wired to the observability stack Camel uses in test-infra: **Prometheus**, **VictoriaTraces**, and **Perses**. + +Special thanks to **Claus Ibsen** for guidance on this series. Review Comment: Removed — thanks paragraph is no longer in Part 2. _AI-generated reply on behalf of atiaomar1978-hub (Cursor Cloud Agent)_ ########## content/blog/2026/08/camel-genai-observability-spring-boot/index.md: ########## @@ -0,0 +1,274 @@ +--- +title: "GenAI Observability with Spring Boot and the Camel Observability Stack" +date: 2026-08-29 +draft: false +authors: [atiaomar1978-hub] +categories: ["AI", "Howtos"] +keywords: ["apache camel", "genai", "observability", "spring boot", "prometheus", "opentelemetry", "victoriatraces", "perses", "ollama", "langchain4j", "camel 4.23"] +preview: "Take Camel GenAI observability from JBang prototypes to production — Spring Boot Actuator, Prometheus scraping, OTLP traces in VictoriaTraces, and optional Perses dashboards." +--- + +In [Part 1](/blog/2026/08/camel-genai-observability-jbang/) we prototyped GenAI observability with Camel JBang +and the TUI. This follow-up — **Phase 3 (Operate)** — shows the same `gen_ai.*` telemetry in a **Spring Boot** +application wired to the observability stack Camel uses in test-infra: **Prometheus**, **VictoriaTraces**, and **Perses**. + +Special thanks to **Claus Ibsen** for guidance on this series. + +The runnable sample lives in +[`spring-boot/genai-observability`](https://github.com/apache/camel-examples/pull/255/files) on camel-examples Review Comment: Done — Part 2 now links to [camel-spring-boot-examples/genai-observability](https://github.com/apache/camel-spring-boot-examples/pull/191). _AI-generated reply on behalf of atiaomar1978-hub (Cursor Cloud Agent)_ ########## content/blog/2026/08/camel-genai-observability-spring-boot/index.md: ########## @@ -0,0 +1,274 @@ +--- +title: "GenAI Observability with Spring Boot and the Camel Observability Stack" +date: 2026-08-29 +draft: false +authors: [atiaomar1978-hub] +categories: ["AI", "Howtos"] +keywords: ["apache camel", "genai", "observability", "spring boot", "prometheus", "opentelemetry", "victoriatraces", "perses", "ollama", "langchain4j", "camel 4.23"] +preview: "Take Camel GenAI observability from JBang prototypes to production — Spring Boot Actuator, Prometheus scraping, OTLP traces in VictoriaTraces, and optional Perses dashboards." +--- + +In [Part 1](/blog/2026/08/camel-genai-observability-jbang/) we prototyped GenAI observability with Camel JBang +and the TUI. This follow-up — **Phase 3 (Operate)** — shows the same `gen_ai.*` telemetry in a **Spring Boot** +application wired to the observability stack Camel uses in test-infra: **Prometheus**, **VictoriaTraces**, and **Perses**. + +Special thanks to **Claus Ibsen** for guidance on this series. + +The runnable sample lives in +[`spring-boot/genai-observability`](https://github.com/apache/camel-examples/pull/255/files) on camel-examples +(open PR until merged to `main`). + +## Architecture + +``` +┌─────────────────┐ scrape ┌──────────────┐ Review Comment: Thanks! _AI-generated reply on behalf of atiaomar1978-hub (Cursor Cloud Agent)_ ########## content/blog/2026/08/camel-genai-observability-spring-boot/index.md: ########## @@ -0,0 +1,274 @@ +--- +title: "GenAI Observability with Spring Boot and the Camel Observability Stack" +date: 2026-08-29 +draft: false +authors: [atiaomar1978-hub] +categories: ["AI", "Howtos"] +keywords: ["apache camel", "genai", "observability", "spring boot", "prometheus", "opentelemetry", "victoriatraces", "perses", "ollama", "langchain4j", "camel 4.23"] +preview: "Take Camel GenAI observability from JBang prototypes to production — Spring Boot Actuator, Prometheus scraping, OTLP traces in VictoriaTraces, and optional Perses dashboards." +--- + +In [Part 1](/blog/2026/08/camel-genai-observability-jbang/) we prototyped GenAI observability with Camel JBang +and the TUI. This follow-up — **Phase 3 (Operate)** — shows the same `gen_ai.*` telemetry in a **Spring Boot** +application wired to the observability stack Camel uses in test-infra: **Prometheus**, **VictoriaTraces**, and **Perses**. + +Special thanks to **Claus Ibsen** for guidance on this series. + +The runnable sample lives in +[`spring-boot/genai-observability`](https://github.com/apache/camel-examples/pull/255/files) on camel-examples +(open PR until merged to `main`). + +## Architecture + +``` +┌─────────────────┐ scrape ┌──────────────┐ +│ Spring Boot │ ──────────────► │ Prometheus │ +│ Camel + LLM │ │ :9090 │ +│ :8080 │ └──────┬───────┘ +└────────┬────────┘ │ + │ OTLP traces ▼ + ▼ ┌──────────────┐ +┌─────────────────┐ │ Perses │ +│ VictoriaTraces │ ◄── dashboards │ :8088 │ +│ :9428 │ └──────────────┘ +└─────────────────┘ + +Optional: camel tui ──► Spring Boot via cli-connector +``` + +For every LLM call in the YAML route: Review Comment: Fixed — Part 2 architecture and route sections now describe a **Java** `RouteBuilder` (Spring Boot example uses Java; YAML variant noted as optional in the repo). _AI-generated reply on behalf of atiaomar1978-hub (Cursor Cloud Agent)_ ########## content/blog/2026/08/camel-genai-observability-spring-boot/index.md: ########## @@ -0,0 +1,274 @@ +--- +title: "GenAI Observability with Spring Boot and the Camel Observability Stack" +date: 2026-08-29 +draft: false +authors: [atiaomar1978-hub] +categories: ["AI", "Howtos"] +keywords: ["apache camel", "genai", "observability", "spring boot", "prometheus", "opentelemetry", "victoriatraces", "perses", "ollama", "langchain4j", "camel 4.23"] +preview: "Take Camel GenAI observability from JBang prototypes to production — Spring Boot Actuator, Prometheus scraping, OTLP traces in VictoriaTraces, and optional Perses dashboards." +--- + +In [Part 1](/blog/2026/08/camel-genai-observability-jbang/) we prototyped GenAI observability with Camel JBang +and the TUI. This follow-up — **Phase 3 (Operate)** — shows the same `gen_ai.*` telemetry in a **Spring Boot** +application wired to the observability stack Camel uses in test-infra: **Prometheus**, **VictoriaTraces**, and **Perses**. + +Special thanks to **Claus Ibsen** for guidance on this series. + +The runnable sample lives in +[`spring-boot/genai-observability`](https://github.com/apache/camel-examples/pull/255/files) on camel-examples +(open PR until merged to `main`). + +## Architecture + +``` +┌─────────────────┐ scrape ┌──────────────┐ +│ Spring Boot │ ──────────────► │ Prometheus │ +│ Camel + LLM │ │ :9090 │ +│ :8080 │ └──────┬───────┘ +└────────┬────────┘ │ + │ OTLP traces ▼ + ▼ ┌──────────────┐ +┌─────────────────┐ │ Perses │ +│ VictoriaTraces │ ◄── dashboards │ :8088 │ +│ :9428 │ └──────────────┘ +└─────────────────┘ + +Optional: camel tui ──► Spring Boot via cli-connector +``` + +For every LLM call in the YAML route: + +- Actuator `/actuator/prometheus` exposes `gen_ai_client_*` metrics +- OTLP export sends spans with token attributes to VictoriaTraces +- You query traces by `gen_ai.operation.name="chat"` + +## Quick start + +### Prerequisites + +```shell +java -version # 17+ +mvn -version # 3.9+ +docker --version # for observability stack +ollama pull llama3.2 +ollama serve +``` + +### Start the observability stack + +From the example directory: + +```shell Review Comment: Done — Part 2 Quick start now lists **Option A: `camel infra run observability`** (recommended) before the example docker compose, and notes TUI infra panel + aligned ports. _AI-generated reply on behalf of atiaomar1978-hub (Cursor Cloud Agent)_ ########## content/blog/2026/08/camel-genai-observability-spring-boot/index.md: ########## @@ -0,0 +1,274 @@ +--- +title: "GenAI Observability with Spring Boot and the Camel Observability Stack" +date: 2026-08-29 +draft: false +authors: [atiaomar1978-hub] +categories: ["AI", "Howtos"] +keywords: ["apache camel", "genai", "observability", "spring boot", "prometheus", "opentelemetry", "victoriatraces", "perses", "ollama", "langchain4j", "camel 4.23"] +preview: "Take Camel GenAI observability from JBang prototypes to production — Spring Boot Actuator, Prometheus scraping, OTLP traces in VictoriaTraces, and optional Perses dashboards." +--- + +In [Part 1](/blog/2026/08/camel-genai-observability-jbang/) we prototyped GenAI observability with Camel JBang +and the TUI. This follow-up — **Phase 3 (Operate)** — shows the same `gen_ai.*` telemetry in a **Spring Boot** +application wired to the observability stack Camel uses in test-infra: **Prometheus**, **VictoriaTraces**, and **Perses**. + +Special thanks to **Claus Ibsen** for guidance on this series. + +The runnable sample lives in +[`spring-boot/genai-observability`](https://github.com/apache/camel-examples/pull/255/files) on camel-examples +(open PR until merged to `main`). + +## Architecture + +``` +┌─────────────────┐ scrape ┌──────────────┐ +│ Spring Boot │ ──────────────► │ Prometheus │ +│ Camel + LLM │ │ :9090 │ +│ :8080 │ └──────┬───────┘ +└────────┬────────┘ │ + │ OTLP traces ▼ + ▼ ┌──────────────┐ +┌─────────────────┐ │ Perses │ +│ VictoriaTraces │ ◄── dashboards │ :8088 │ +│ :9428 │ └──────────────┘ +└─────────────────┘ + +Optional: camel tui ──► Spring Boot via cli-connector +``` + +For every LLM call in the YAML route: + +- Actuator `/actuator/prometheus` exposes `gen_ai_client_*` metrics +- OTLP export sends spans with token attributes to VictoriaTraces +- You query traces by `gen_ai.operation.name="chat"` + +## Quick start + +### Prerequisites + +```shell +java -version # 17+ +mvn -version # 3.9+ +docker --version # for observability stack +ollama pull llama3.2 +ollama serve +``` + +### Start the observability stack + +From the example directory: + +```shell +cd spring-boot/genai-observability +docker compose up -d +``` + +| Service | Port | Role | +|---------|------|------| +| Prometheus | 9090 | Scrapes Spring Boot Actuator Prometheus endpoint | +| VictoriaTraces | 9428 | Stores OTLP traces; UI at `/select/vmui` | +| Perses | 8088 | Metrics dashboards (optional visualization) | + +Container images match `camel-test-infra-observability` so CI and blog readers use the same stack. + +### Run Spring Boot + +```shell +mvn spring-boot:run +``` + +Wait for: + +```text +Started GenAiObservabilityApplication +LLM reply: Apache Camel is an integration framework... +Models: req=llama3.2 resp=llama3.2 +``` + +## Verify GenAI metrics + +```shell +curl -s http://localhost:8080/actuator/prometheus | grep gen_ai +``` + +Expected Micrometer names: + +- `gen_ai_client_operation` — timer/summary of LLM call duration +- `gen_ai_client_token_usage` — counter with tag `gen_ai_token_type=input|output` + +### Prometheus queries + +Open [http://localhost:9090](http://localhost:9090) and try: + Review Comment: Thanks — glad the PromQL examples are useful! _AI-generated reply on behalf of atiaomar1978-hub (Cursor Cloud Agent)_ ########## content/blog/2026/08/camel-genai-observability-spring-boot/index.md: ########## @@ -0,0 +1,274 @@ +--- +title: "GenAI Observability with Spring Boot and the Camel Observability Stack" +date: 2026-08-29 +draft: false +authors: [atiaomar1978-hub] +categories: ["AI", "Howtos"] +keywords: ["apache camel", "genai", "observability", "spring boot", "prometheus", "opentelemetry", "victoriatraces", "perses", "ollama", "langchain4j", "camel 4.23"] +preview: "Take Camel GenAI observability from JBang prototypes to production — Spring Boot Actuator, Prometheus scraping, OTLP traces in VictoriaTraces, and optional Perses dashboards." +--- + +In [Part 1](/blog/2026/08/camel-genai-observability-jbang/) we prototyped GenAI observability with Camel JBang +and the TUI. This follow-up — **Phase 3 (Operate)** — shows the same `gen_ai.*` telemetry in a **Spring Boot** +application wired to the observability stack Camel uses in test-infra: **Prometheus**, **VictoriaTraces**, and **Perses**. + +Special thanks to **Claus Ibsen** for guidance on this series. + +The runnable sample lives in +[`spring-boot/genai-observability`](https://github.com/apache/camel-examples/pull/255/files) on camel-examples +(open PR until merged to `main`). + +## Architecture + +``` +┌─────────────────┐ scrape ┌──────────────┐ +│ Spring Boot │ ──────────────► │ Prometheus │ +│ Camel + LLM │ │ :9090 │ +│ :8080 │ └──────┬───────┘ +└────────┬────────┘ │ + │ OTLP traces ▼ + ▼ ┌──────────────┐ +┌─────────────────┐ │ Perses │ +│ VictoriaTraces │ ◄── dashboards │ :8088 │ +│ :9428 │ └──────────────┘ +└─────────────────┘ + +Optional: camel tui ──► Spring Boot via cli-connector +``` + +For every LLM call in the YAML route: + +- Actuator `/actuator/prometheus` exposes `gen_ai_client_*` metrics +- OTLP export sends spans with token attributes to VictoriaTraces +- You query traces by `gen_ai.operation.name="chat"` + +## Quick start + +### Prerequisites + +```shell +java -version # 17+ +mvn -version # 3.9+ +docker --version # for observability stack +ollama pull llama3.2 +ollama serve +``` + +### Start the observability stack + +From the example directory: + +```shell +cd spring-boot/genai-observability +docker compose up -d +``` + +| Service | Port | Role | +|---------|------|------| +| Prometheus | 9090 | Scrapes Spring Boot Actuator Prometheus endpoint | +| VictoriaTraces | 9428 | Stores OTLP traces; UI at `/select/vmui` | +| Perses | 8088 | Metrics dashboards (optional visualization) | + +Container images match `camel-test-infra-observability` so CI and blog readers use the same stack. + +### Run Spring Boot + +```shell +mvn spring-boot:run +``` + +Wait for: + +```text +Started GenAiObservabilityApplication +LLM reply: Apache Camel is an integration framework... +Models: req=llama3.2 resp=llama3.2 +``` + +## Verify GenAI metrics + +```shell +curl -s http://localhost:8080/actuator/prometheus | grep gen_ai +``` + +Expected Micrometer names: + +- `gen_ai_client_operation` — timer/summary of LLM call duration +- `gen_ai_client_token_usage` — counter with tag `gen_ai_token_type=input|output` + +### Prometheus queries + +Open [http://localhost:9090](http://localhost:9090) and try: + +```promql +# Total output tokens over time +increase(gen_ai_client_token_usage_total{gen_ai_token_type="output"}[1h]) + +# LLM call rate +rate(gen_ai_client_operation_count[5m]) + +# By Camel component +sum by (camel_component) (gen_ai_client_operation_count) +``` + +### Example alert rule (sketch) + +```yaml +groups: + - name: camel-genai + rules: + - alert: HighGenAITokenBurn + expr: rate(gen_ai_client_token_usage_total[15m]) > 1000 + for: 10m + labels: + severity: warning + annotations: + summary: "High GenAI token usage on {{ $labels.job }}" +``` + +## Explore traces in VictoriaTraces + +Open [http://localhost:9428/select/vmui](http://localhost:9428/select/vmui) + +Useful trace search filters: + +- `gen_ai.operation.name="chat"` +- `gen_ai.request.model="llama3.2"` +- `camel.component="langchain4j-chat"` + +Each span carries `gen_ai.usage.input_tokens`, `gen_ai.usage.output_tokens`, +`gen_ai.response.finish_reasons`, and `gen_ai.system` (e.g. `langchain4j`). + +Correlate traces with logs by passing the trace ID from MDC — see the +[OpenTelemetry docs](/manual/camel-jbang-tui.html#_opentelemetry_spans). + +## Key configuration + +### Maven dependencies (excerpt) + +```xml +<dependency> + <groupId>org.apache.camel.springboot</groupId> + <artifactId>camel-spring-boot-starter</artifactId> +</dependency> +<dependency> + <groupId>org.apache.camel.springboot</groupId> + <artifactId>camel-observability-services-starter</artifactId> +</dependency> +<dependency> + <groupId>org.apache.camel.springboot</groupId> + <artifactId>camel-langchain4j-chat-starter</artifactId> +</dependency> +<dependency> + <groupId>org.apache.camel</groupId> + <artifactId>camel-ai-observability</artifactId> +</dependency> +<dependency> + <groupId>dev.langchain4j</groupId> + <artifactId>langchain4j-ollama-spring-boot-starter</artifactId> +</dependency> +<dependency> + <groupId>org.springframework.boot</groupId> + <artifactId>spring-boot-starter-actuator</artifactId> +</dependency> +<dependency> + <groupId>io.micrometer</groupId> + <artifactId>micrometer-registry-prometheus</artifactId> +</dependency> +``` + +### application.properties + +```properties +# LangChain4j / Ollama (auto-configures chatLanguageModel bean) +langchain4j.ollama.chat-model.base-url=http://localhost:11434 +langchain4j.ollama.chat-model.model-name=llama3.2 +langchain4j.ollama.chat-model.temperature=0.2 +langchain4j.ollama.chat-model.timeout=PT120S + +# Camel YAML routes +camel.main.routes-include-pattern=camel/* + +# GenAI observability +camel.ai.observability.enabled=true +camel.opentelemetry2.enabled=true + +# Spring Actuator (Prometheus scrape target) +management.endpoints.web.exposure.include=health,prometheus,info +management.prometheus.metrics.export.enabled=true + +# OTLP export to VictoriaTraces +camel.opentelemetry2.export-target=jaeger +otel.exporter.otlp.endpoint=http://localhost:9428/insert/opentelemetry/v1/traces +otel.exporter.otlp.protocol=http/protobuf +``` + +### The Camel route (YAML) + +```yaml +- route: + id: genai-chat + from: + uri: timer:genai + parameters: + period: "15000" + steps: + - setBody: + constant: "In one sentence, what is Apache Camel integration?" + - to: + uri: langchain4j-chat:demo + parameters: + chatModel: "#chatLanguageModel" + - log: + message: "LLM reply: ${body}" + - log: + message: "Models: req=${header.CamelLangChain4jChatRequestModel} resp=${header.CamelLangChain4jChatResponseModel}" +``` + +## Optional: Camel TUI against Spring Boot + +Uncomment `camel-cli-connector-starter` in `pom.xml` and set `camel.cli.enabled=true`, then run `camel tui`. +You get the same **Spans** tab and **Ctrl+U** AI Usage view as Part 1, but against a production-style runtime. + +## JBang vs Spring Boot + +| Concern | Part 1 (JBang) | Part 2 (Spring Boot) | +|---------|----------------|----------------------| +| Time to first span | Minutes (`camel run --observe`) | Minutes + docker compose | +| Metrics endpoint | `/observe/metrics` on port 9876 | `/actuator/prometheus` on port 8080 | +| Trace UI (dev) | TUI Spans tab (built-in) | VictoriaTraces VMUI | +| Production fit | Prototyping, CI demos | Standard Spring ops (Actuator, K8s probes) | + +Most teams: **prototype in JBang**, **deploy observability pattern in Spring Boot**. Review Comment: Done — comparison table and closing line now say **prototype in CLI/TUI**. _AI-generated reply on behalf of atiaomar1978-hub (Cursor Cloud Agent)_ ########## content/blog/2026/08/camel-genai-observability-spring-boot/index.md: ########## @@ -0,0 +1,274 @@ +--- +title: "GenAI Observability with Spring Boot and the Camel Observability Stack" +date: 2026-08-29 +draft: false +authors: [atiaomar1978-hub] +categories: ["AI", "Howtos"] +keywords: ["apache camel", "genai", "observability", "spring boot", "prometheus", "opentelemetry", "victoriatraces", "perses", "ollama", "langchain4j", "camel 4.23"] +preview: "Take Camel GenAI observability from JBang prototypes to production — Spring Boot Actuator, Prometheus scraping, OTLP traces in VictoriaTraces, and optional Perses dashboards." +--- + +In [Part 1](/blog/2026/08/camel-genai-observability-jbang/) we prototyped GenAI observability with Camel JBang +and the TUI. This follow-up — **Phase 3 (Operate)** — shows the same `gen_ai.*` telemetry in a **Spring Boot** +application wired to the observability stack Camel uses in test-infra: **Prometheus**, **VictoriaTraces**, and **Perses**. + +Special thanks to **Claus Ibsen** for guidance on this series. + +The runnable sample lives in +[`spring-boot/genai-observability`](https://github.com/apache/camel-examples/pull/255/files) on camel-examples +(open PR until merged to `main`). + +## Architecture + +``` +┌─────────────────┐ scrape ┌──────────────┐ +│ Spring Boot │ ──────────────► │ Prometheus │ +│ Camel + LLM │ │ :9090 │ +│ :8080 │ └──────┬───────┘ +└────────┬────────┘ │ + │ OTLP traces ▼ + ▼ ┌──────────────┐ +┌─────────────────┐ │ Perses │ +│ VictoriaTraces │ ◄── dashboards │ :8088 │ +│ :9428 │ └──────────────┘ +└─────────────────┘ + +Optional: camel tui ──► Spring Boot via cli-connector +``` + +For every LLM call in the YAML route: + +- Actuator `/actuator/prometheus` exposes `gen_ai_client_*` metrics +- OTLP export sends spans with token attributes to VictoriaTraces +- You query traces by `gen_ai.operation.name="chat"` + +## Quick start + +### Prerequisites + +```shell +java -version # 17+ +mvn -version # 3.9+ +docker --version # for observability stack +ollama pull llama3.2 +ollama serve +``` + +### Start the observability stack + +From the example directory: + +```shell +cd spring-boot/genai-observability +docker compose up -d +``` + +| Service | Port | Role | +|---------|------|------| +| Prometheus | 9090 | Scrapes Spring Boot Actuator Prometheus endpoint | +| VictoriaTraces | 9428 | Stores OTLP traces; UI at `/select/vmui` | +| Perses | 8088 | Metrics dashboards (optional visualization) | + +Container images match `camel-test-infra-observability` so CI and blog readers use the same stack. + +### Run Spring Boot + +```shell +mvn spring-boot:run +``` + +Wait for: + +```text +Started GenAiObservabilityApplication +LLM reply: Apache Camel is an integration framework... +Models: req=llama3.2 resp=llama3.2 +``` + +## Verify GenAI metrics + +```shell +curl -s http://localhost:8080/actuator/prometheus | grep gen_ai +``` + +Expected Micrometer names: + +- `gen_ai_client_operation` — timer/summary of LLM call duration +- `gen_ai_client_token_usage` — counter with tag `gen_ai_token_type=input|output` + +### Prometheus queries + +Open [http://localhost:9090](http://localhost:9090) and try: + +```promql +# Total output tokens over time +increase(gen_ai_client_token_usage_total{gen_ai_token_type="output"}[1h]) + +# LLM call rate +rate(gen_ai_client_operation_count[5m]) + +# By Camel component +sum by (camel_component) (gen_ai_client_operation_count) +``` + +### Example alert rule (sketch) + +```yaml +groups: + - name: camel-genai + rules: + - alert: HighGenAITokenBurn + expr: rate(gen_ai_client_token_usage_total[15m]) > 1000 + for: 10m + labels: + severity: warning + annotations: + summary: "High GenAI token usage on {{ $labels.job }}" +``` + +## Explore traces in VictoriaTraces + +Open [http://localhost:9428/select/vmui](http://localhost:9428/select/vmui) + +Useful trace search filters: + +- `gen_ai.operation.name="chat"` +- `gen_ai.request.model="llama3.2"` +- `camel.component="langchain4j-chat"` + +Each span carries `gen_ai.usage.input_tokens`, `gen_ai.usage.output_tokens`, +`gen_ai.response.finish_reasons`, and `gen_ai.system` (e.g. `langchain4j`). + +Correlate traces with logs by passing the trace ID from MDC — see the +[OpenTelemetry docs](/manual/camel-jbang-tui.html#_opentelemetry_spans). + +## Key configuration + +### Maven dependencies (excerpt) + +```xml +<dependency> + <groupId>org.apache.camel.springboot</groupId> + <artifactId>camel-spring-boot-starter</artifactId> +</dependency> +<dependency> + <groupId>org.apache.camel.springboot</groupId> + <artifactId>camel-observability-services-starter</artifactId> +</dependency> +<dependency> + <groupId>org.apache.camel.springboot</groupId> + <artifactId>camel-langchain4j-chat-starter</artifactId> +</dependency> +<dependency> + <groupId>org.apache.camel</groupId> + <artifactId>camel-ai-observability</artifactId> +</dependency> +<dependency> + <groupId>dev.langchain4j</groupId> + <artifactId>langchain4j-ollama-spring-boot-starter</artifactId> +</dependency> +<dependency> + <groupId>org.springframework.boot</groupId> + <artifactId>spring-boot-starter-actuator</artifactId> +</dependency> +<dependency> + <groupId>io.micrometer</groupId> + <artifactId>micrometer-registry-prometheus</artifactId> +</dependency> +``` + +### application.properties + +```properties +# LangChain4j / Ollama (auto-configures chatLanguageModel bean) +langchain4j.ollama.chat-model.base-url=http://localhost:11434 +langchain4j.ollama.chat-model.model-name=llama3.2 +langchain4j.ollama.chat-model.temperature=0.2 +langchain4j.ollama.chat-model.timeout=PT120S + +# Camel YAML routes +camel.main.routes-include-pattern=camel/* + +# GenAI observability +camel.ai.observability.enabled=true +camel.opentelemetry2.enabled=true + +# Spring Actuator (Prometheus scrape target) +management.endpoints.web.exposure.include=health,prometheus,info +management.prometheus.metrics.export.enabled=true + +# OTLP export to VictoriaTraces +camel.opentelemetry2.export-target=jaeger +otel.exporter.otlp.endpoint=http://localhost:9428/insert/opentelemetry/v1/traces +otel.exporter.otlp.protocol=http/protobuf +``` + +### The Camel route (YAML) + +```yaml +- route: + id: genai-chat + from: + uri: timer:genai + parameters: + period: "15000" + steps: + - setBody: + constant: "In one sentence, what is Apache Camel integration?" + - to: + uri: langchain4j-chat:demo + parameters: + chatModel: "#chatLanguageModel" + - log: + message: "LLM reply: ${body}" + - log: + message: "Models: req=${header.CamelLangChain4jChatRequestModel} resp=${header.CamelLangChain4jChatResponseModel}" +``` + +## Optional: Camel TUI against Spring Boot + +Uncomment `camel-cli-connector-starter` in `pom.xml` and set `camel.cli.enabled=true`, then run `camel tui`. +You get the same **Spans** tab and **Ctrl+U** AI Usage view as Part 1, but against a production-style runtime. + +## JBang vs Spring Boot + +| Concern | Part 1 (JBang) | Part 2 (Spring Boot) | +|---------|----------------|----------------------| +| Time to first span | Minutes (`camel run --observe`) | Minutes + docker compose | +| Metrics endpoint | `/observe/metrics` on port 9876 | `/actuator/prometheus` on port 8080 | +| Trace UI (dev) | TUI Spans tab (built-in) | VictoriaTraces VMUI | +| Production fit | Prototyping, CI demos | Standard Spring ops (Actuator, K8s probes) | + +Most teams: **prototype in JBang**, **deploy observability pattern in Spring Boot**. + +## Production checklist + +1. Set `camel.ai.observability.enabled=true` explicitly in all environments Review Comment: Yes — corrected to `camel.aiObservability.enabled` throughout both posts. _AI-generated reply on behalf of atiaomar1978-hub (Cursor Cloud Agent)_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
