On 14/7/24 11:41, Emanuel Berg wrote:
I've made several improvements, including adding the
`string-distance-percentage' that was mentioned. But let's
forget about that branch [1] or visit that URL for the latest
source on that.
Here, in this thread, the context thing with respect to AI,
anyone having any luck knowing what to do with that?
It is mentioned 14 times in llamafile(1) but not how to
actually set it up with your own data?
One way to set context is via the http api which is openai compatible.
You create the queries using python and include your context with the
query. It may have the ability to remember context so you only need it
once, but running locally you can resend the context each time.
https://platform.openai.com/docs/api-reference/chat/create
