Point Tracker

Track points across video frames with the CoTracker3 neural point tracker.

What it does

Point Tracker follows a set of points across video frames using CoTracker3, a neural point tracker. Given an image (video, camera, or any other moving raster source) and a set of points to watch, it reports where each point has moved to on every frame, along with velocity, a confidence score and whether the point is still visible.

With Query Points unconnected, it tracks points placed interactively in the viewport. Each tracked point keeps a stable ID and an age, the number of frames it has survived, so tracks can build trails, gate effects, or be dropped once they drift out of view.

When to use it

ParameterTypeDefault
imageOneOf([FieldOf(Raster)])
query_pointsOneOf([Vec2Array, Collection])
enabledBooleantrue
window_lengthNumber16
visibility_thresholdNumber0.500

Gotchas

Window Length trades smoothness against speed: a longer sliding window of frames gives steadier tracks but costs more to compute per frame. Start low and raise it only if tracks are jittery.

Worked example

  1. Add a Point Tracker and wire a video or camera image into Image.

  2. Click in the viewport to place one or more query points on the frame.

  3. Play the video. Tracks, Positions, and Count update every frame as the points move.

  4. Wire Positions into another node, such as a shape's transform, to have it follow a tracked point, or read visibility from Tracks to hide it when the point is lost.

See also

Blob Tracker · Vision Tracker · Optical Flow · Points