This session is for members.

Subscribe or log in to watch every GoSec session.

Subscribe Log in

This recording is not available yet.

Have a safe flight! Building security guardrails for Copilot AI assistant

Download resources

About this session

Natalia Semenova, a security architect at EPAM with prior experience at Microsoft and Google, draws on hands-on Microsoft Copilot deployments to walk through where guardrails belong in the Copilot shared-responsibility model. Since Copilot runs as a set of service accounts, access logs can obscure which end user actually touched sensitive data unless prompt-and-response logging is explicitly enabled. She maps controllable choke points onto the architecture: input filtering to block prohibited queries, prompt-injection detection, and output filtering or data loss prevention to catch leaked salaries, addresses or other labeled data before it reaches the user. Data labeling is the real precondition for safety, since an unlabeled file gets surfaced to anyone regardless of access rights, including through Copilot's own file-sharing suggestions. She covers consent and right-to-be-forgotten problems for PII embedded in a vector index, recommends anonymizing and separately encrypting data for retrieval-augmented generation, and points to native Azure reports and frameworks like MITRE ATLAS mapped to NIST as audit substitutes while formal AI compliance certifications remain unavailable. A long Q&A covers custom DLP implementation, multi-cloud non-human identity risk from a real client incident, stale documentation causing hallucinations, training-data guarantees, Copilot Web versus enterprise licensing, and zero trust login practices.

Using AI-powered SaaS assistants has become a common practice for businesses and industries, as it allows improving employee productivity and provides on-spot guidance to junior specialists. The session will cover security best practices and guidance on avoiding most common architecture mistakes related to AI assistant roll-out in the enterprise.

Key takeaways

  • Enable prompt-and-response logging for Copilot explicitly; default logs show the service account, not the end user who requested the data.
  • Label every file before rollout; unlabeled data gets surfaced by Copilot to any user regardless of their actual access rights.
  • Place guardrails at three choke points: input filtering for prohibited queries, prompt-injection detection, and output filtering or DLP for leaked sensitive data.
  • Document consent for PII used in Copilot indexing separately, and plan for how you would purge vector-database embeddings if consent is revoked.
  • Use Azure's native SharePoint, Security Center and OneDrive reports before buying third-party tools, and map logged requests to MITRE ATLAS/NIST since formal AI compliance certifications are not yet available.

Speakers

Natalia Semenova
Natalia Semenova
Security Architect · EPAM
Natalia is a cybersecurity professional with 15+ years of international experience in the industry. She started her career in the academic environment after achieving PhD degree in mathematical statistics and cryptography, but later transitioned… Read moreRead less

Natalia is a cybersecurity professional with 15+ years of international experience in the industry. She started her career in the academic environment after achieving PhD degree in mathematical statistics and cryptography, but later transitioned into the corporate sector where she progressed from identity and access management developer to senior security architect at Microsoft and later at Google Cloud. Currently Natalia is working on securing AI technologies for EPAM customers and partners.

Resources

Tags

More from GoSec 2024

Also from Natalia Semenova

On the same topic

This site is registered on wpml.org as a development site. Switch to a production site key to remove this banner.