Video summary
Building AI Agents that actually work (Full Course)
Main summary
Key takeaways
Main ideas & lessons
-
AI is shifting from “chat” to “agents.”
- Chat models are question → answer.
- Agents are goal → result: they take a task, plan, execute steps, and iterate until completion.
-
Agents operate using an “agent loop.”
- The loop repeatedly does:
- Observe (check context/workspace/available info)
- Think (decide next steps, plans, decisions)
- Act (use tools/write code/run tasks)
- Completion depends on conditions/parameters specified in the prompt (e.g., “research 10 sources then create a PowerPoint”).
- The loop repeatedly does:
-
An “agent” is composed of core elements
- LLM (the brain/model) (examples mentioned: Claude Opus 4.6, GPT 5.4, Gemini 3)
- Loop (keeps working; not one-shot)
- Tool + context connections (so it can use your environment)
- Agent harness/platform (the app that facilitates the loop across tools and context; examples mentioned: Claude Code, Codex, Antigravity, Co-work, Open Claw, Manas)
-
The big practical leap is context + memory setup
- In chat, models often have automatic memory you can’t fully control.
- In agents, you typically must provide explicit context files (e.g.,
agents.md). - Optionally, you can add a manual long-term memory system (e.g.,
memory.md) so preferences persist across sessions.
-
“Context engineering” replaces “prompt engineering.”
- Instead of complicated prompts, you load the agent with rich business context so tasks can be simple (e.g., “write me a cold email”).
-
Tools are connected via MCP (Model Context Protocol)
- MCP acts as a translator/standard connector between the agent (speaks English) and apps (use their own “languages,” like Gmail/Notion/etc.).
- Most agent harnesses support connecting tools through connectors/skills/settings using MCP.
-
Skills are SOPs for AI (standard operating procedures)
- A skill packages a repeated workflow into a reusable “dot-skill” markdown process (e.g.,
skill.md/.dot skill). - Purpose:
- reduce repeated work
- keep formatting consistent
- avoid cluttering persistent memory with tactical details
- A skill packages a repeated workflow into a reusable “dot-skill” markdown process (e.g.,
-
Skills + schedules create automation workflows
- Harnesses introduce scheduled tasks (e.g., run a “daily brief” skill every morning).
- This compounds time savings daily/weekly.
-
Proposed “AI OS” future workflow
- The speaker envisions a central workspace (an “AI OS”) where agents manage departments using connected tools and stored markdown context.
- Emphasis: stop switching between apps; instead operate in a central agent environment.
-
Security should be handled by scoping permissions
- Treat tool access like granting privileges to an employee.
- Use read-only where possible; limit what an agent can do if compromised.
Methodology / step-by-step instructions (as taught)
Build an AI agent workflow (from beginner to working department agent)
-
Choose a goal the agent will achieve
- Example: “Build a minimalist portfolio site for Greg Eisenberg.”
- Provide clear completion criteria in the prompt (e.g., how many sources, output format).
-
Understand the agent loop (observe → think → act)
- Expect the agent to:
- check workspace/files it can use
- do research or planning when needed
- generate outputs (code, drafts)
- iterate until the “task complete” condition is met
- Expect the agent to:
-
Provide onboard context via an
agents.md-type file- Purpose: ensure the agent knows who you are and how your business works.
- Include:
- role definition (e.g., “you are my executive assistant”)
- business overview
- tools used and how to use them
- working preferences
- ideal customer profile / target audience
- tone and formatting preferences
- File behavior described:
- New sessions load this context automatically (when named/configured correctly).
-
(Optional but recommended) Add persistent preference memory via
memory.md- Problem addressed: agents may forget updates across sessions unless you explicitly store them.
- Approach taught:
- Add instructions in
agents.mdtelling the agent to:- read
memory.md - update it when new preferences are learned
- replace outdated info in-place
- read
- Add instructions in
-
Connect tools using MCP
- High-level steps:
- open the harness (e.g., Co-work / Claude Code / Codex / Manas)
- browse connectors
- sign into apps (Gmail, Calendar, Notion, Granola, Stripe, etc.)
- connect via MCP so the agent can call those tools
- High-level steps:
-
Create reusable skills for repeated workflows (SOPs)
- Define what counts as a repeated process you’ll do again (e.g., proposals, cold email formats, referral emails, daily brief, meeting prep).
- Two creation methods mentioned:
- Skill creator skill using a course/transcript
- Upload/transcribe a material (e.g., “viral hooks course”) and instruct the harness to convert it into a skill.
- Skill creator skill after doing the process once
- Complete the workflow manually once, then ask it to package that process as a skill.
- Skill creator skill using a course/transcript
-
Schedule skills for automation
- Example: run “daily brief skill” every morning at a specified time.
-
Chain skills into multi-step workflows
- Example concept:
- morning brief skill checks for meetings/podcasts
- trigger podcast research skill
- prepare talking points
- then send an email or create deliverables
- Example concept:
Build and use an “Executive Assistant” example (as demonstrated)
- Create a local folder/project (e.g.,
executive assistant). - Start with a simple task: “Write me a cold email and send it.”
- If the folder has no context:
- the agent will ask clarifying questions because it doesn’t know your business.
- Add the proper context file (rename to match harness expectation, e.g.,
agents.md/Claude.md/Gemini.md). - After adding context:
- the agent can draft cold emails with correct tone and targeting.
- Add
memory.mdif you want cross-session learning (e.g., signature preferences).
Examples referenced in the video
-
Agent loop demo
- Build a minimalist portfolio site for a named person.
- Agents:
- research the person
- write code
- run/preview locally
- screenshot and verify completion
-
Cold email workflow
- Agent drafts cold email based on onboarding context.
- Suggested outreach use case: bulk pre-made websites offered as an off-the-shelf product.
-
Tool-driven workflow
- Summarize inbox from today using connected email + notes + payments + project management tools.
- Example flow:
- summarize inbox / review meeting notes
- draft email proposal
- create a Stripe payment link
- create a Notion project
- send via Gmail integration
-
Skills examples
- “Viral hooks” skill created from a course transcript.
- “Ads analyst” skill
- scrape competitor ads library
- screenshot landing pages
- analyze copy + creatives
- output master report
- “Sebastian referral skill”
- when asked to refer someone, it knows email and steps to connect an introduced prospect
Security guidance (what was said)
- Think of security as scoping what access the agent has.
- By default, major harnesses are described as secure due to company resources.
- Practical risk control:
- limit tool permissions
- prefer read-only access for sensitive systems
- minimize worst-case damage if something is compromised
- Agent permissions are likened to giving a risky employee privileges (e.g., managing ad budgets).
Speakers / sources featured (and identified)
Speakers
- Greg (host / interviewer; Greg Eisenberg referenced)
- Remy Gaskill (guest; course instructor)
- Cody Schneider (mentioned as someone whose tweet/prediction was referenced)
Other sources / entities mentioned (not speaking)
- MCP (Model Context Protocol) — attributed to Anthropic in the explanation
- Agent harness / platforms mentioned: Claude Code, Codex, Antigravity, Co-work, Open Claw, Manas
- Model examples mentioned: Claude Opus 4.6, GPT 5.4, Gemini 3
- Tools connected via MCP (examples): Gmail, Google Calendar, Granola (meeting notes), Notion, Stripe
- Research tool mentioned: Perplexity
- Transcription tools mentioned: Monologue, Whisper (and “Whisper flows”)
- Guest video mention: “Ross Mac” podcast/video (referenced for MCP explanation)
Rate this summary
Your feedback will help improve summaries.
Improve this summary
Reprocess with a stronger model when the summary feels incomplete or inaccurate.
Translate summary in another language
Ask questions to this video
Chat for follow-up questions, clarifications, and source-backed answers.