Stop Using LLMs For Everything

Overview

• The video explains the difference between large language models (LLMs) and embedding models, then reviews Google’s new Gemini Embedding 2 (announced in a Google blog post).
• Main claim: use embeddings for many retrieval/semantic tasks instead of calling an LLM every time — faster and far cheaper.

Key technical concepts explained

LLM vs embedding model

• LLMs: token predictors that generate text; more complex and expensive to run.
• Embedding models: representation models that map inputs to numeric vectors capturing semantic meaning.

Embeddings as vectors

• Each input (sentence, image, audio, etc.) is mapped to a high-dimensional vector (examples: 768, 1536, 3072 dimensions).
• Similarity between items is measured by distance or cosine similarity between vectors (closer = more semantically related).
• Embeddings can be precomputed and cached for fast, inexpensive similarity searches.

Semantic search use case

• Embedding-based retrieval finds meaning-based matches (e.g., “ReactJS lesson” matching “best course for web development”) without exact keyword overlap.
• Much cheaper and faster than querying an LLM for every comparison.

Gemini Embedding 2 — product and technical features

• Multimodal by design: supports text, images, video, audio, and documents; can accept interleaved/mixed modalities in a single request.
• Cross-modal vectors: returns vectors for different media types in the same embedding space so you can compare text ↔ image ↔ video, etc.
• Flexible output dimensionality via a representation-learning technique (transcribed in subtitles as “matriarchia representation learning / MMRL”):
  • Allows dynamic scaling of output dimension (examples given: 768, 1536, 3072).
  • Training is nested so smaller-dimension vectors are embedded within larger ones, enabling tradeoffs between storage cost and performance/nuance.
• Google reports strong performance (including speech capabilities) and state-of-the-art results on text, image, and video tasks. The video did not show direct public comparisons to OpenAI embedding models.
• Availability: the model is publicly available (per the announcement) to try in developer workflows.

Practical guidance / tutorial elements

• Conceptual walkthrough using a simple geometric analogy (vectors in N-dimensional space).
• Recommendation: precompute and store embeddings for your dataset; use cosine similarity for retrieval instead of running an LLM on every query.
• Encouragement to try a lightweight multimodal semantic search demo mentioned in the video.

Notes, caveats, and context

• Subtitles may contain transcription errors (for example, the exact name of the representation-learning technique). Check Google’s original blog post for precise terminology and benchmarks.
• The video notes Google doesn’t necessarily use this exact model inside Search, but Search uses similar architectures/techniques.
• The speaker emphasizes cost and performance advantages of embeddings over running LLM inference for similarity/retrieval tasks.

Main speaker and sources

• Main speaker: the video’s creator/presenter (unnamed in the subtitles; a YouTube content creator explaining the tech).
• Primary source referenced: Google blog post announcing Gemini Embedding 2 (multimodal embeddings).
• Secondary references: general LLM/embedding literature and comparisons to other providers (e.g., OpenAI), though no direct benchmark comparisons were shown.