apupier commented on code in PR #1141: URL: https://github.com/apache/camel-website/pull/1141#discussion_r1494129890
########## content/blog/2024/02/camel-whatsapp-langchain4j/index.md: ########## @@ -0,0 +1,148 @@ +--- +title: "Integrate your AI models effortlessly with Apache Camel" +date: 2024-02-09 Review Comment: I guess you meant 2024-02-19 ########## content/blog/2024/02/camel-whatsapp-langchain4j/index.md: ########## @@ -0,0 +1,148 @@ +--- +title: "Integrate your AI models effortlessly with Apache Camel" +date: 2024-02-09 +draft: true +authors: [croway] +categories: ["Camel Spring Boot", "Usecases", "AI"] +preview: "Build a conversational AI integration with Apache Camel, langchain4j, and WhatsApp." +--- + + +This blog shows how Apache Camel can help integrate multiple systems with an AI model, in particular, the [camel-whatsapp](/components/4.0.x/whatsapp-component.html) component is used to build a chat on WhatsApp; so that a user can easily communicate with the LLM via WhatsApp. + + +# Overview + + +The objective is the following, I'd like to have specific conversations about some topic, in this case, how to contribute to Apache Camel, with an LLM via WhatsApp. In this context WhatsApp is just an example, Apache Camel offers 300+ components that can be easily integrated! + + +The objective is clear, but what about the implementation? Libraries like langchain4j and Apache Camel help a lot with this kind of use case, in particular, we will leverage the following features: +* camel-whatsapp will take care of the integration with WhatsApp APIs and thanks to the camel-webhook feature the communication with the WhatsApp APIs is effortless. +* On the other hand, langchain4j offers abstractions and toolkits that help developers interact with LLMs. + + +In this example, the model [GPT-3.5 Turbo](https://platform.openai.com/docs/models/gpt-3-5-turbo) is used, and the [camel core contribution documentation](/camel-core/contributing/) is used as an embedding, in this way it will be possible to have clear conversations about camel contributions. + + +# Set up + + +This is the hardest part, if you would like to test it by yourself some requirements need to be fulfilled before executing the code, in particular: + + +* A business WhatsApp account is needed, for development purposes this is free, you can follow the documentation in the [Camel WhatsApp component](/components/4.0.x/whatsapp-component.html) +* An OpenAI API key, the [langchain4j getting started](https://github.com/langchain4j#getting-started) contains information how to generate the API key +* [Webhook](https://developers.facebook.com/docs/whatsapp/cloud-api/guides/set-up-webhooks) needs to be configured in the WhatsApp business account, so that way WhatsApp API can communicate with the running Apache Camel application +* If you are testing locally, the running application's webhook has to be exposed to the internet, for example via [ngrok](https://ngrok.com/) +* Finally, the [sample application](https://github.com/Croway/camel-whatsapp-chatbot) can be cloned and run via `mvn spring-boot:run` + + +# Route Definition + + +Given a chat service that returns a String to an input String message `ConversationalAIAgent.chat(...)`, let's focus on the Camel route. + + +We would like to achieve the following: +* a user sends a message to a WhatsApp business account +* The WhatsApp API then sends the message to our running application +* The application invokes `ConversationalAIAgent.chat(...)` +* under the hood, via langchain4j abstraction, the GPT-3.5 is used to produce a response message +* The message is sent to the WhatsApp API and, finally, to the user. + + +This integration can be easily implemented by the following Camel route: + + +```java +@Autowired +ConversationalAIAgent agent; // [1] + +... + +from("webhook:whatsapp:{{camel.component.whatsapp.phone-number-id}}") // [2] + .log("${body}") + // A lot of events are received by the webhook, in this case, we want to choose only the ones that contain a message + .choice().when().jsonpath("$.entry[0].changes[0].value.messages", true) + // We will use this variable in the transformer to retrieve the recipient phone number + .setVariable("CamelWhatsappPhoneNumber", jsonpath("$.entry[0].changes[0].value.contacts[0].wa_id")) + // The body is used as input String in ConversationalAIAgent.chat(String) + .setBody(jsonpath("$.entry[0].changes[0].value.messages[0].text.body")) // [3] + // Invoke the LLM + .bean(agent) // [4] + .convertBodyTo(TextMessageRequest.class) // [5] + // reply to the number that started the conversation + .to("whatsapp:{{camel.component.whatsapp.phone-number-id}}") // [6] + .end(); +``` + + +[1] `ConversationalAIAgent` is implemented with langchain4j, it uses the camel-contributing.txt to gain information regarding the contributions rules, and GPT-3.5 to generate the response. + + +[2] `from("webhook:whatsapp:{{camel.component.whatsapp.phone-number-id}}")` Expose an HTTP endpoint that is known to the WhatsApp Business account, and, every time a user generates an event with the WhatsApp Business account associated number, events like a message sent, message read, writing message and so on, the HTTP endpoint is invoked with a JSON containing all the information. + + +``` +{ + "object":"whatsapp_business_account", + "entry":[ + { + "id":"****", + "changes":[ + { + "value":{ + "messaging_product":"whatsapp", + "metadata":{ + "display_phone_number":"****", + "phone_number_id":"****" + }, + "contacts":[ + { + "profile":{ + "name":"****" + }, + "wa_id":"****" + } + ], + "messages":[ + { + "from":"****", + "id":"****", + "timestamp":"1708091472", + "text":{ + "body":"What about camels?" + }, + "type":"text" + } + ] + }, + "field":"messages" + } + ] + } + ] +} +``` + + +This is an example JSON sent by the WhatsApp API to our webhook, as you can see the JSON structure is quite complex, but the Apache Camel jsonpath expression can be used to retrieve the required data. + + +[3] We are leveraging Apache Camel jsonpath capabilities to retrieve the message sent by the user `jsonpath("$.entry[0].changes[0].value.messages[0].text.body")`, and the user phone number `jsonpath("$.entry[0].changes[0].value.contacts[0].wa_id")` that we store in variables for further computation. + + +[4] The `bean(agent)` invokes the LLM with the message sent by the user, that we set into the Camel body in [3] once the computation is done, the response message from the LLM is set into the Camel body. + + +[5] `.convertBodyTo(TextMessageRequest.class)` is implemented by a Camel TypeConverter that takes a String message and the Exchange as input and creates a `TextMessageRequest` object that can be serialized and sent to the WhatsApp API. + + +[5] And finally, `.to(whatsapp:{{camel.component.whatsapp.phone-number-id}})` we reply to the phone number that initiated the conversation. + + +# Conclusions Review Comment: ```suggestion # Conclusion ``` ########## content/blog/2024/02/camel-whatsapp-langchain4j/index.md: ########## @@ -0,0 +1,148 @@ +--- +title: "Integrate your AI models effortlessly with Apache Camel" +date: 2024-02-09 +draft: true +authors: [croway] +categories: ["Camel Spring Boot", "Usecases", "AI"] +preview: "Build a conversational AI integration with Apache Camel, langchain4j, and WhatsApp." +--- + + +This blog shows how Apache Camel can help integrate multiple systems with an AI model, in particular, the [camel-whatsapp](/components/4.0.x/whatsapp-component.html) component is used to build a chat on WhatsApp; so that a user can easily communicate with the LLM via WhatsApp. Review Comment: I think you need to define the acronym LLM as first occurence (or provide a link) ########## content/blog/2024/02/camel-whatsapp-langchain4j/index.md: ########## @@ -0,0 +1,148 @@ +--- +title: "Integrate your AI models effortlessly with Apache Camel" +date: 2024-02-09 +draft: true +authors: [croway] +categories: ["Camel Spring Boot", "Usecases", "AI"] +preview: "Build a conversational AI integration with Apache Camel, langchain4j, and WhatsApp." Review Comment: ```suggestion preview: "Build a conversational AI integration with Apache Camel, LangChain4j, and WhatsApp." ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
