Following the same engineering ethos and exploratory learning approach that proved so popular with Northwind Elixir Traders , Elixir Chatbot Alchemy explores the implementation of a chatbot in Elixir. By utilizing the REST API of a self-hosted instance of Ollama and CPU inference on small LLMs, we explore how LLMs operate, the impact of model choice on the quality of inference, and use Phoenix LiveView to build a variety of LLM-based features, such as document summarization and a chatbot that can be used on a webpage.

Still in early alpha in terms of content.