Vision-Language Model
CLIP connects images and captions through a shared learning objective. It supports recognizing visual concepts from language descriptions; predicting how an action changes a scene is a separate question.
Why it matters
Matching an observation to language supplies perceptual context. It does not by itself establish planning or control.
Relationships
informsLarge Language Model → Vision-Language ModelinformsVision-Language Model → World model