Vision Segment

Segment people from an image with Apple Vision, output as a cutout on a transparent background.

What it does

Vision Segment finds people in an image and cuts them out onto a transparent background, using Apple's on-device Vision framework running on the Neural Engine. Any image wired in produces a live cutout, with no green screen and no manual masking.

Alongside the cutout it outputs the raw greyscale mask (white for person, black for background) for driving something else: a Composite node, a Distance Field, a particle emitter, anything needing the selection rather than the pixels.

When to use it

ParameterTypeDefault
imageOneOf([FieldOf(Raster)])
qualityString"balanced"
invertBooleanfalse
enabledBooleantrue
positionVec3(0, 0, 0)
strengthNumber1

Gotchas

Vision Segment runs on macOS only, on Apple's Neural Engine. On other platforms the node has nothing to compute from.

Worked example

  1. Add a Vision Segment node and wire a Camera or Video node into Image.

  2. Leave Quality on Balanced to start; drop to Fast if the live feed lags, or raise to Accurate for a cleaner still-frame edge.

  3. Take Cutout straight into a Composite to place the person over a new background, or take Mask into another effect that needs the selection rather than the pixels.

See also

Vision Pose · Object Detect · Depth Estimate · Rasters (images)