Dr. Srinivas Padmanabhuni
ReportCTO and Co-founder of testAIng.com, an AI testing and assurance company based in Bengaluru, India. Creator and maintainer of agentest and its companion open catalogue of 110 agent-test designs.
agentest
agentest is an open-source (Apache-2.0), offline testing framework for AI agents. It runs deterministic checks on an agent's recorded artifacts (execution traces, tool definitions and agent cards) against defined acceptance criteria, and returns pass/fail/n/a verdicts, with no hosted platform, no golden trajectory and no LLM judge. It reads documented open trace formats (OpenTelemetry GenAI traces, A2A AgentCards and MCP tool annotations), with native-log importers for LangGraph, OpenAI Agents SDK, AutoGen, smolagents and n8n. Distributed on PyPI as agentest-ai.
agentest roadmap and community maintenance grant
One-time grant to fund the next stage of agentest, an open-source testing framework for AI agents. Milestones set for evaluation: M1 - framework adapters for PydanticAI, Agno and Mastra, extending the native-log importers (LangGraph, OpenAI Agents SDK, AutoGen, smolagents, n8n); M2 - extend automated coverage of the catalogue of 110 agent-test designs, 37 fully covered today; M3 - community maintenance: co-maintainer onboarding, trace labelling, and stewardship of external contributions.