Debug Copilot Studio Agents with Conversation Transcripts
Diesen Beitrag auf Deutsch lesen
Use test pane snapshots, Application Insights and Dataverse transcripts to trace routing, tools, knowledge sources, latency and outcomes.
TL;DR
Copilot Studio conversation transcripts expose topic routing, tool calls, knowledge searches, orchestration plans, timestamps and session outcomes. Makers can save a botcontent snapshot from the test pane, while support teams can combine Application Insights with Dataverse transcripts. Analysts can use built-in Analytics, the Copilot Studio Kit or Fabric for larger-scale trends.
Original by Roel Schenk, on The Custom Engine. Read the original
This is our own summary, not a republication or full translation.
Governance takeaway
- Makers: Save a botcontent snapshot from the test pane and inspect dialog.json to identify routing, tool, knowledge-source and latency problems with evidence.
- Admins/CoE: Connect production agents to Application Insights, then use the conversation ID to locate errors and pull the Dataverse transcript when deeper context is needed.
- Security/Compliance: Remember that full system prompts and some SharePoint responses containing sensitive data are excluded, so transcripts do not represent every model input or output.
Frequently asked questions
How do I save a Copilot Studio botcontent transcript snapshot from the test pane?
Select the three dots beside Test your agent, choose Save snapshot, then open dialog.json inside the downloaded botcontent zip.
When should I use Application Insights versus the Dataverse ConversationTranscript table for Copilot Studio troubleshooting?
Use Application Insights for near real-time errors, latency and dependency failures; use Dataverse transcripts for orchestration, knowledge-source and session context.
Why can Copilot Studio transcripts omit system prompts and SharePoint grounded responses?
Full system prompts are withheld as a security safeguard, and responses using sensitive SharePoint data may be excluded as a privacy safeguard.