Multimodal Understanding and Visual Safety

Introduction

The previous lesson covered creating images and video. This lesson covers the other half of AI-103's Implement computer vision solutions domain (10–15%): understanding visual content and keeping visual workflows safe. The official skills include visual analysis with multimodal models, captions and alt-text, visual question answering, Azure Content Understanding for images and video, object and region detection, unsafe visual content filters, indirect prompt injection through images, visual policy rules, choosing and configuring single-task versus pro-mode pipelines in Azure Content Understanding, processing video segments and extracting visual characteristics with Foundry Tools, and extended image descriptions for accessibility.