Microsoft 365 Copilot: Measuring Success, Managing Risk

As organisations embrace Microsoft 365 Copilot and other generative AI tools, the need to measure their impact, adoption, and understand the associated risks has never been greater. In this session, Microsoft MVP and data security and governance expert Nikki Chapple will guide you through the essential tools and strategies for tracking Microsoft 365 Copilot and Gen AI usage in your organisation.

To measure Microsoft 365 Copilot and generative AI success, use a layered approach:

- For visibility, track shadow AI apps and traffic volume to identify unmanaged risk and prevent data leakage. Use Defender for Cloud Apps for shadow AI assessment.

- For insight, monitor sensitive prompts and risky usage trends to detect and mitigate compliance breaches. Use Purview Data Security Posture Management (DSPM) for AI to gain data security insights.

- For action, measure prompts per user, active days, retention, and licences to gauge adoption health and user engagement. Also, compare enabled versus active users and adoption growth rate to track rollout success and licence ROI. Use Microsoft 365 Admin Center for Copilot and agent usage, and adoption reports.

- For business value and risk reduction, assess time saved, behavioural change, and sentiment to prove ROI, productivity gains, and cultural adoption. Use Viva Insights for Copilot analytics and impact reporting.

This framework ensures you can demonstrate value, manage risk, and drive continuous improvement in your AI journey.

Whether you're a compliance lead, IT admin, or business decision-maker, this session will equip you with the knowledge to make informed, data-driven decisions about your AI strategy.

Key Takeaways:

• Understand why measuring Copilot and Gen AI usage is critical for success.
• Explore the Copilot Dashboard in Viva Insights for readiness, adoption, impact, and sentiment metrics.
• Discover how Microsoft Purview DSPM for AI helps identify and mitigate risks associated with Copilot and third-party Gen AI tools.
• Gain practical tips for aligning AI usage with business outcomes and compliance requirements.