Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
Claude Agents with SigAgent Tracing
Design a document processing AI agent using the Claude SDK and SigAgent.AI for tracing steps and tool calls, emphasizing early evaluation framework implementation.
We will look at a practical AI Agent design for document processing, and we will employ SigAgent.AI to trace the agent steps and its tool calls.
When designing AI agents, it is essential to put an evaluation framework in place as soon as possible. During development, the eval framework can be used to debug planning, knowledge base lookup, and tool calling. While in the production phase, the eval framework becomes a monitoring tool, tracing costs and providing guardrails.
Document router abstracts multi-provider LLM data extraction using Python, FastAPI, and LiteLLM.
Smart Document Router extracts data using LLMs, FastAPI, and MongoDB.