Building a Local-First AI Stack with Open WebUI & Ollama

AI is everywhere, but so are concerns around data privacy, vendor lock-in, and sending sensitive information to closed-source models.

In this talk, I'll introduce a local-first AI stack using Ollama and Open Webui, showing how developers can run and interact with LLMs locally without relying on cloud APIs.

I'll show a quick demo on how to setup your own private AI assitants and how to use it efficiently.

Key Takeaways

• What a Local first AI is

• How to run LLMs locally with Ollama

• How to use Open webui as a self hosted AI interface