Computer vision and multimodal learning · MLD-0246
Cross-modal alignment
Learning representations or correspondences that connect information across different modalities.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Match image embeddings with their text descriptions.
Original caveat
Alignment here differs from alignment with human goals.
Context and aliases
Level: Intermediate. Stages: Architecture · Training · Inference.
Tags: DL · Vision · Multimodal.
Aliases: None recorded.
Related concepts
Concepts linking here
Original references
- Learning Transferable Visual Models From Natural Language Supervision ↗ · Consulted
- Deep Learning: online textbook ↗ · Consulted
- PyTorch neural-network layers ↗ · Reference link
- Original reference URL ↗