Computer vision and multimodal learning · MLD-1310
Vision-language model
A model that jointly processes visual and linguistic information for prediction or generation.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Answer questions about an image.
Original caveat
A VLM may be an encoder, a generator, or a combination.
Context and aliases
Level: Intermediate. Stages: Architecture · Training · Inference.
Tags: DL · Vision · Multimodal.
Aliases: VLM.
Related concepts
Concepts linking here
Original references
- Learning Transferable Visual Models From Natural Language Supervision ↗ · Consulted
- Deep Learning: online textbook ↗ · Consulted
- PyTorch neural-network layers ↗ · Reference link
- Original reference URL ↗