Welcome to Agent Studio Kit
Agent Studio Kit is a powerful set of capabilities designed to augment Microsoft Copilot Studio. The kit empowers makers to develop, govern, and test custom agents with advanced features including AI-powered testing, compliance management, and performance analytics.
Technology Stack
Key Features
🧪 Advanced Testing
Configure and batch test agents with multiple test types including response match, topic match, multi-turn conversations, and AI-powered generative answer analysis.
🛡️ Compliance Hub
Define and enforce governance policies at scale. Automatically evaluate agent configurations and track compliance through an SLA-driven lifecycle.
📊 Conversation KPIs
Track and analyze agent performance with aggregated data in Dataverse. Understand conversation outcomes without complex transcript analysis.
✨ Prompt Advisor
Develop effective prompts with AI-powered analysis, confidence evaluation, and suggested refinements implementing various prompt techniques.
📋 Rubrics Refinement
Create, test, and iteratively improve reusable evaluation standards for AI-generated responses with human-aligned quality standards.
🔍 Agent Inventory
Get tenant-wide visibility of all Copilot Studio agents including features, authentication, knowledge sources, and orchestration details.
🔄 SharePoint Sync
Configure periodic selective content synchronization from SharePoint locations to agent knowledge bases.
🎨 Webchat Playground
Customize the appearance and behavior of agent webchat including colors, fonts, thumbnails, and generate styled HTML.
💬 Adaptive Cards Gallery
Access built-in adaptive card templates demonstrating extensibility with dynamic data binding and implementation examples.
Power Platform Integration
Agent Studio Kit seamlessly integrates with the Microsoft Power Platform ecosystem. Use the PAC CLI (Power Platform CLI) to manage deployments, and leverage Dataverse MCP (Model Context Protocol) for advanced data operations and agent management. The kit supports automated testing through Power Platform Pipelines, ensuring quality gates in your deployment lifecycle.