Skip to Main Content
Talk Intermediate

Everyone’s Hyped About AI Agents: Nobody talks about making them Reliable & Self Evolving!

Proposal status is Rejected
Session Description

Needless to say the recent advances in autonomous agents like OpenClaw & Hermes Agent. Agent frameworks have made developer life easier with tool calling, skills & MCPs adding scaffold and orchestration harness. Almost all agentic architecture layers are prompt driven. Prompts are a great way of interacting with LLMs, but often leads to unreliable outputs. Tuning prompts is quite a manual intrinsic work, given the non-deterministic nature of LLMs.

Hence the next wave of prompting is through reflection driven methodologies that don’t essentially need explicitly RL or fine tuning but can still invoke the self evolving nature in agents. Can we build a system that learns through its own mistakes and makes it better at each turn?


We essentially need to optimize and quantify which change leads to affecting the overall system. One way to achieve this is through text space optimization by refining the behavioral patterns, validation and feedback loops via evaluation structures. 

Key Takeaways

- Why does agents fail in production - analyze real failure patterns in agentic systems such as prompt drift, tool hallucination, and orchestration collapse, memory poisoning

- RL & fine tuning are expensive & slow
- Can continual learning solve this through dynamic adaption

- lets dive into a framework that learns through reflection 

- how optimization loops make agents more reliable, reproducible, and maintainable

- instrument AI agents with traces, evals, and observability pipelines for debugging non-deterministic workflows

- showcase a working live demo 

References

Session Categories

Engineering practice - productivity, debugging
Technology architecture

Which track are you applying for?

Main track

Speakers

Jayita Bhattacharyya
Jayita Bhattacharyya AI Engineer | Domyn

AI ML Nerd with a blend of technical speaking & hackathon wizardry! Applying tech to solve real-world problems. The work focus these days is on generative AI. Helping software teams incorporate AI into transforming software engineering.