Video labeling for object tracking
Define object identity, occlusion, and keyframes before annotating video tracks.
Define what keeps an object ID stable
A track ID represents an object across frames. Specify what happens when a person passes behind a pillar, leaves the view, or reappears after a camera cut. If reviewers restart IDs at different points, the same behavior can produce conflicting training examples.
Review where interpolation breaks
Keyframe interpolation can reduce manual work between steady poses. Inspect frames near turns, scene cuts, motion blur, and rapid scale changes. Those are places where an interpolated box can drift. Review a short clip end to end and check that its IDs, start and end frames, and visibility flags tell a consistent story.
Try a clip where two subjects cross
Take a synthetic clip in which two workers wearing similar clothing pass behind equipment. Track each until the last frame where identity is supported. If your rules allow a track to resume only when identity is clear, require reviewers to mark uncertainty rather than guess. Decide whether the occluded frames carry an invisible track with no box, an inferred box, or no annotation at all.
Store timing in a format you can audit
Specify whether timestamps or frame indices are authoritative. If clips can have a variable frame rate, preserve their original timing or document how your processing pipeline resamples them. Review the first and last frames of each track after export. A track that starts one frame early can look harmless in a UI but still create wrong targets once labels are matched with frames downstream.
Choose keyframes where the motion changes
Add keyframes before and after a turn, a brief occlusion, or a sudden camera move. Preview the interpolated frames between them and add corrections where the trajectory or box shape drifts. For a pilot, compare the time saved by interpolation with how many fixes reviewers make. Long clips with stationary objects will have different economics from sports or handheld footage.
Audit identity separately from geometry
A track can have tight boxes and still switch IDs when two objects overlap. Sample overlapping tracks, reappearances, and cut boundaries. Count identity switches, track breaks, and poorly fitted boxes as distinct defects. If many defects occur just after a cut, change the cut rule or split clips before annotation rather than repeatedly correcting the same failure by hand.