Skip to content
ALL WORK
University of Alberta2025AI & ML

Prompt-Based Video Segmentation & Tracking

A video pipeline combining SAM prompt segmentation with YOLOv8 detection and tracking.

A pipeline that takes a point or box prompt on the first frame and carries the resulting mask through a video. SAM handles the segmentation, YOLOv8 provides detection and identity across frames, and the two are reconciled so a mask survives occlusion and re-entry.

Includes a comparison report on where each component fails — SAM's prompt sensitivity, YOLO's identity switches — and how the combination covers for both.

Gallery