Skip to Main Content
Talk Beginner

Build a high-performance context layer for AI agents using free and open-source software.

Proposal status is Rejected
Ramprakash S
Ramprakash S
Session Description

Building a high-performance context layer for AI agents using free and open-source software (FOSS) enables the creation of scalable, transparent, and cost-efficient intelligent systems. Central to this approach is the use of Retrieval-Augmented Generation (RAG) workflows, which combine large language models with external data sources to deliver context-aware outputs.

FOSS tools play a critical role in implementing this architecture. Hugging Face provides access to a wide range of pre-trained models with datasets, forming the backbone of many AI repositories.

CrewAI enables the use of multi agents, allowing them to collaborate, share context, and perform complex tasks efficiently. Gradio app simplifies the development of user-friendly interfaces, making it easier to test and deploy AI applications.

Speech and multimodal capabilities are enhanced by AssemblyAI for transcription and audio intelligence, as well as Cartesia AI for advanced voice synthesis.

PromptLayer adds an additional layer of observability by optimizing prompts, ensuring consistent performance over time. By integrating all, which will reduces dependency on proprietary systems but also fosters innovation, reproducibility, and community-driven improvements, making it ideal for next-generation AI agent development using FOSS.

Key Takeaways

The above uses cases i'll show as demo and theortically i'll also explain as well.

References

Session Categories

Technology architecture

Speakers

Ramprakash Singaravel
Ramprakash Singaravel Assistant Professor | Sir Issac Newton College of Engineering and Technology

Ramprakash S Assistant Professor | Faculty in Computer Science Domain,Resource Person in Data Science, Data Analytics, Tableau, IoT ,Cloud and all Open Source Softwares, Motivational Speaker Thiruvarur, Tamil Nadu, India.

With over a decade at Anna University, my passion lies in cultivating the next wave of tech innovators through a rich curriculum in computer science and practical data science applications.