Skip to Main Content
Talk Beginner First Talk

Building an open source AI Assistant

Proposal status is Rejected
Session Description

Here we will discuss about the strategies to get Local LLMs working and using Local AI to build beautiful functional products. The current stack include building simple tauri / electron apps with ollama to perform inference locally and get outputs.


We will discuss voice assistant, real time Chatbots and build/ show a quick demo on the same. We will be using a tiny qwen0.5 B / moondream 0.5 B and other local Models that you can use daily, model to play around with.

Session Categories

FOSS

Speakers

sanjay prasad
sanjay prasad Dev | Devkraft

Hey everyone! I'm Sanjay , a Product-person/ designer/ artist / developer from India and I build and hack many different projects. Currently, I'm working on multiple gen AI rpojects, I wanted to build somethign that works for the GPU poor while also being useful , app. Here'sto hoping i can give a talk at FOSS. Hoping to spread Open source tiny LLMs !