Udemy - Evaluating AI Agents torrent

Evaluating AI Agents

https://WebToolTip.com

Published 5/2025
MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz, 2 Ch
Language: English | Duration: 1h 5m | Size: 1.1 GB

Master quality, performance & cost evaluation frameworks for LLM agents using Patronus, LangSmith tools

What you'll learn
Explain the core components of AI agents (prompts, tools, memory, and logic) and how they work together to accomplish tasks
Build a simple AI agent from scratch using Python and modern AI frameworks
Design comprehensive evaluation metrics across quality, performance, and cost dimensions
Implement effective logging systems to track agent metrics in real-time
Conduct systematic A/B testing to compare different agent configurations
Use specialized tools like LangSmith, Patronus, and PromptLayer to trace and debug agent workflows
Set up production monitoring dashboards to track agent performance over time
Make data-driven optimization decisions based on evaluation insights

Requirements
Basic understanding of Python programming
Familiarity with AI/ML concepts is helpful but not required
No prior experience with AI agents is necessary - we'll cover the fundamentals