- Analogy: like a map: each object has its GPS coordinates, similar objects are neighbors
- Definition: a vector representation of an object, constructed to be useful for some task (not necessarily human-interpretable)
- Examples: words, sentences, images, movies, users, etc.
Example: Sentence Embeddings
(name: u08s1-sentence-embeddings.ipynb; show preview,
open in Colab)
Slides (including graphics)
Notebooks
- Probe an Image Classifier
(name:
u07n1-image-embeddings.ipynb; show preview, open in Colab)
Further Exploration
We’ll discuss this much more in CS 376, but here are some ideas for further exploration:
- Try the SigLIP demo that embeds images and text together. Try computing the dot products between a few texts that you write by hand. Does the dot product reflect the similarity of the texts? Repeat with images. What do you find? (Use Colab for this one.)