Avail.video · Watched for you · 11:05 video · 2 min read

Role Engineering: How to Manage AI Employees Instead of Prompting

Outlier score0.6×Too early to tell

69,680 views vs a median of 122,376 across the channel's last 15 long-form uploads · as of Oct 25 · 2 days old, early

Avail.video calculation

Nick Saraev explains the transition from prompt engineering to 'role engineering,' treating advanced AI systems like persistent staff members rather than single-turn tools. Drawing on internal workflows from Anthropic engineers, he details how to set measurable SMART goals, feed background context through personal knowledge bases, and provide high-quality reference examples. He also covers training AI through iterative feedback loops to build standardized operating procedures (SOPs) and shares strategies for managing token and API costs.

Get the teardown

How the title, thumbnail and first 20 seconds earn the click, and where viewers may leave. Sign in to get it, free for now.

Highlights
  1. 0:40Defining role engineering
  2. 1:58Anthropic internal code stats
  3. 3:56SMART goals framework for AI
  4. 5:2850,000-record knowledge base setup
  5. 8:36Boris Cherny's two-week Swift rewrite
Chapters across the 11:05 runtime
How it's told

An explainer with a pitch at the end

Format: Explainer. Nick Saraev argues that prompt engineering is obsolete and details how managing autonomous AI agents like staff members using role definition, SMART goals, knowledge bases, and SOP training loops yields superior leverage. He shares real Anthropic case studies, demonstrates model evals and cost controls, and concludes with an offer for his agency training community.

Story arc

  1. 0:00IntroductionNick introduces Boris Cherny's Slack-based Claude workflow to show how AI has transitioned from single-prompt tool to autonomous colleague.
  2. 0:43Role Engineering DefinedSaraev defines role engineering as the skill of managing persistent agent sessions that execute tasks autonomously over days or weeks.
  3. 1:47Anthropic's Golden RuleNick explains Anthropic's official advice: treating Claude like a brilliant new hire who understands execution but lacks organizational context.
  4. 2:30Setting SMART GoalsThe video breaks down why agent autonomy relies on verifiable, measurable targets rather than vague qualitative prompts.
  5. 3:19Context & Knowledge BasesSaraev demonstrates how hooking agents up to personal databases, commit logs, and gold-standard examples enables accurate autonomous output.
  6. 5:09Anthropic Case StudiesNick reviews real Anthropic engineering projects, including Boris Cherny's multi-week desktop app rewrite and Nicholas Carlini's 16-agent C compiler.
  7. 6:12The Training Loop & SOPsThe video outlines an iterative feedback loop to train agents over multiple runs, creating institutional SOPs that transfer across future model releases.
  8. 8:18Managing Economics & Token CostsSaraev breaks down model routing, prompt caching discounts, and batch API processing to turn heavy token usage into high-ROI operations.
  9. 10:16Team Integration & PitchNick shows how deploying shared agents directly into team Slack channels scales operations, closing with a pitch for Maker School.

Setups and payoffs

  1. 0:17Setup Nick introduces the high-level transition of AI from a tool to an autonomous staff member.
    ↳
    4:53Payoff Nick presents a concrete onboarding checklist comparing what a new human hire receives to what an AI agent requires.
  2. 0:52Setup Boris Cherny is quoted noting that agents can run autonomously for days or weeks without stopping.
    ↳
    5:17Payoff Saraev reveals the specific prompt and test suite Boris Cherny used to let Claude rebuild the Electron app in Swift across 14 to 15 days.
  3. 2:40Setup The classical SMART management framework is introduced for delegating tasks.
    ↳
    3:02Payoff Saraev demonstrates how replacing a vague website improvement prompt with a measurable target under 2 seconds allows agent self-verification.
  4. 3:25Setup Nick references his personal 50,000+ record SQLite database.
    ↳
    3:52Payoff Nick illustrates how feeding commit logs, transcripts, and emails provides the necessary background for Claude to execute tasks without manual reprompting.
  5. 6:16Setup Saraev introduces scoring agents over ten runs to eliminate noise and build consistency.
    ↳
    8:03Payoff Nick shows an evaluation dashboard measuring task pass rates and scores across upgraded model versions.
  6. 8:21Setup Nick reveals he spent $2,500 on token costs during a single working day.
    ↳
    8:52Payoff Saraev details model tier matching, prompt caching discounts, and batch APIs to make high-volume agent usage economically viable.

Devices

  • Visual MetaphorUsing an iceberg graphic to contrast visible prompt text with the vast unseen knowledge base context beneath it.3:20
  • Contrastive FramingContrasting brittle prompt engineering syntax micro-optimizations against managerial delegation and SMART goal frameworks.1:282:39
  • Industry Case StudyReferencing documented engineering experiments from Anthropic staff Boris Cherny and Nicholas Carlini to validate autonomous agent performance.5:155:48
  • Personal TransparencySharing actual internal business data, daily schedules, and personal daily token expenditures to anchor recommendations in practice.7:198:21
  • 3D Motion GraphicVisualizing task consistency and distribution curves across model generations to show SOP longevity.7:08

From the video's own structure, matched to the transcript and on-screen text.

The explainer

What the video says, with a link to every moment

A 2-minute read. Each underlined phrase opens the video at that second.

The rapid advancement of foundation models has triggered a fundamental paradigm shift from using AI as an occasional utility to treating it as an autonomous, persistent colleague. Nick Saraev introduces this evolution as role engineering0:40, which replaces brittle prompt phrasing with standard organizational management practices. Rather than babysitting every response, teams at Anthropic are already allowing agents to run unattended for weeks, resulting in over 80% of merged code2:04 being authored autonomously by models working within expansive context windows.

slide
role engineeringnoun \ 'rōl 'en-jə-'nir-iŋ \the skill after prompt engineering: giving an AI a role, a goal, context and examples, then managing its work the way you manage a staff memberFirst known use: 2026
▶ 0:39
On screen at 0:39

To effectively delegate work to an AI system, Saraev points to Anthropic's official documentation advising users to treat Claude like a brilliant new employee3:28 who simply lacks organizational context. Delegation starts with structuring tasks using the classic SMART goals framework3:56, in which the 'measurable' (or verifiable) component is paramount. Vague instructions such as improving a site fail because the agent cannot self-evaluate, whereas defining exact parameters—such as loading the homepage in under two seconds5:12—equips the agent to test and confirm completion.

stat
My knowledge baseRecords stored 117Records stored 10,557Records stored 42,593Records stored 49,985Records stored 50,000+Video transcriptsAI sessions
▶ 3:25
On screen at 3:25

Context and reference benchmarks form the other two pillars of successful role engineering. Instead of manually re-pasting context in every session, Saraev utilizes a 50,000-record personal knowledge base5:28 containing past transcripts, conversation logs, emails, and git history. To communicate quality standards, managers must do the task once by hand6:52 to generate an ideal baseline example, enabling the model to compare its output directly against the benchmark rather than guessing what excellence looks like.

quote
“It's been a little over two weeks. So it's like 14 days, 15 days.”Boris ChernyYC Startup School, July 2026
▶ 5:32
On screen at 5:32

Real-world implementations at Anthropic demonstrate this approach at scale. Boris Cherny directed Claude to rewrite an Electron app into Swift8:36 by inspecting Mac UI screenshots pixel by pixel over two weeks, while researcher Nicholas Carlini coordinated 16 parallel Claude agents9:08 to build an entire C compiler. Once a task functions properly, Saraev recommends running it multiple times to establish an iterative training loop11:05, compiling actionable feedback that solidifies into reusable Standard Operating Procedures (SOPs).

slide
Input / OutputClaude API, per million tokensHaiku 5.5Best fitLow-level, straightforward tasks$0.10 // M inputPer million input tokensOutput $0.50Cache hit $0.01Prompts up to 100K tokensSimple tasksSonnet 5.5Best fitRun-of-the-mill knowledge work$2 // M inputPer million input tokensOutput $10Cache hit $0.10Batch $1 in, $5 outEveryday workOpus 5.5High-quality knowledge work$4 // M inputPer million input tokensOutput $20Cache hit $0.20Fable 5.1: $10 in, $50 outThe big work
▶ 9:03
On screen at 9:03

However, autonomous multi-day agent workflows come with steep resource demands. Saraev reports spending thousands of dollars daily on token usage11:05. To make AI management economically viable, operators must practice model routing across tiers like Haiku, Sonnet, and Opus, maximize prompt caching discounts11:05 that lower repeated input rates by up to 90%, utilize asynchronous overnight batch processing, and deploy single shared agents in team messaging channels.

On screen

Everything the video showed you

Slides, frameworks, quotes and formulas, captured verbatim with the moment they appeared. Tap any card to jump there.

Reference shelf

People, ideas and things mentioned

Said means mentioned aloud; Shown means it appeared on screen.

People4

  • Nick SaraevFounder of AI growth agency LeftClick and host of the channel.0:00Said + shown0:43Said + shown2:12Said + shown4:18Said + shown4:33Said + shown4:51Said + shown5:45Said + shown5:59Said + shown7:15Said + shown7:33Said + shown7:47Said + shown8:18Said + shown8:37Said + shown10:16Said + shown10:28Said + shown10:55Said + shown
  • Boris ChernyCreator of Claude Code and software engineer at Anthropic.0:00Said0:02Said + shown0:47Said + shown0:48Said + shown1:04Shown5:17Said + shown5:32Said + shown5:42Said + shown8:36Said
  • Nicholas CarliniAI safety and systems researcher on Anthropic's Safeguards team.5:48Said + shown9:08Said + shown
  • George T. DoranManagement consultant who introduced the SMART goals framework in 1981.2:37Shown3:56Shown

Ideas & frameworks2

  • Role EngineeringManagement discipline of setting goals, context, and feedback loops to manage AI like human staff.0:39Shown0:40Said + shown
  • SMART GoalsGoal-setting framework requiring Specific, Measurable, Attainable, Relevant, and Time-bound objectives.2:30Shown2:37Shown2:39Shown2:45Shown3:56Said + shown4:48Said + shown

Organizations2

  • AnthropicAI research and foundation model company that develops the Claude family of models.0:16Shown0:47Shown0:48Said1:18Shown1:22Shown1:58Said + shown2:07Shown3:24Said + shown5:09Shown5:48Shown9:22Said + shown
  • Maker SchoolNick Saraev's community and coaching program offering AI automation training with a 90-day client guarantee.10:46Said + shown

Things on screen2

Find in this video

Search what was said and shown

One search covers the transcript, on-screen text, claims and references. Every result jumps to its moment.

    Take it to your AI

    Ask Claude or ChatGPT about this video

    Copy this report as context, paste it into a chat, then ask anything. It includes timestamps, so answers can point back to the video.

    Then ask
    • Turn the main ideas into a checklist I can use this week.
    • What are the strongest claims in this video, and what evidence does it give for each?
    • Write a short summary for someone who hasn't watched it, linking the key moments.
    • Quiz me on this video, one question at a time, and cite the timestamp for each answer.
    Video description

    A description you can paste into YouTube

    A hook, a summary, chapters in YouTube's format and what the video mentions. Copy it, edit it, and paste it into YouTube Studio.

    1,418 / 5,000 characters
    By the numbers

    What YouTube shows about this video and its channel

    As of Oct 25, 2026. YouTube's public numbers first, then Avail.video's own arithmetic on them.

    The video

    Views
    69.7K
    Likes
    1.2K
    Comments
    84
    Published
    Oct 23, 2026
    Length
    11:05
    Category
    Science & Technology
    YouTube's topics
    —
    Captions
    No
    HD
    Yes
    Language
    English
    Paid promotion
    None declared
    Made for kids
    No
    License
    Standard YouTube

    Creator's tags

    • automation
    • content creation
    • ai content
    • google sheets
    • chatgpt
    • wordpress
    • openai
    • blogging
    • openai api
    • small business
    • $20K/mo
    • cold email
    • AIAA
    • ai automation
    • ai automation agency
    • ai automation guide
    • n8n
    • n8n guide
    • n8n aiaa
    • ai n8n
    • n8n agents
    • n8n ai
    • n8n ai agent
    • claude code
    • claude
    • claude opus 4.6
    • opus 4.6
    • gemini 3.1
    • gemini 3.1 pro
    • antigravity
    • agents
    • ai agents
    • coding
    • kimi
    • kimi k3
    • agi
    • ai agent
    • ai
    • artificial intelligence
    • asi
    • Codex

    The channel

    Subscribers
    571K
    Videos
    351
    Total views
    26.1M
    Channel age
    6 years (since Mar 2020)
    Country
    Canada
    Uploads
    about every 2 days
    Across the last 15 long-form uploads
    Before this video
    1 day after the previous long-form upload

    Calculated by Avail.video from YouTube's public numbers

    Outlier score
    0.6× · Too early to tell
    Views against the median of the channel's last 15 long-form uploads
    Views per subscriber
    0.12
    Likes vs the channel's usual
    1.1× the channel's usual
    1.7% of views vs a usual 1.7%
    Comments vs the channel's usual
    1.0× the channel's usual
    0.12% of views vs a usual 0.12%
    Rank among recent uploads
    #11 of 16
    By views: this video and the channel's last 15 long-form uploads

    Watched by Avail.video · 2026-10-24