Cut OpenAI costs with the Responses API (migration + workflow triage checklist)

Cut OpenAI costs with the Responses API — learn a step-by-step migration path from Assistants API and a workflow triage checklist for Pipedream and Zapier.

Jul 8, 2026
Cut OpenAI costs with the Responses API (migration + workflow triage checklist)
If you are still running production workflows on the Assistants API, migrating to the Responses API can reduce operational drag, simplify orchestration, and help you control token spend. The big win is not “a cheaper endpoint.” The win is using the migration as a forcing function to measure what each step costs, split work into cheaper and more expensive stages, and eliminate duplicate runs.
Photo by Michael Dziedzic on Unsplash
Photo by Michael Dziedzic on Unsplash

The fastest way to cut OpenAI spend (before any migration)

Token costs come from 3 places:
  • Input tokens (your system prompt, developer instructions, user content, and any retrieved content)
  • Output tokens (the model’s response)
  • Extra calls (tool calls, retries, multi-step chains, or “one logical task = 3 API requests”)
Before you change anything, create a baseline so you can prove you reduced cost.

Lightweight measurement plan (30 minutes)

  1. Pick your top 1 to 3 workflows by volume.
  2. For each run, log:
    • Model name
    • Input tokens, output tokens, total tokens
    • Whether tools ran and how many times
    • Latency
    • Error or retry count
  3. Summarize after 24 hours:
    • Total calls
    • Total tokens
    • Cost estimate
    • Top 3 cost drivers (usually “huge transcripts,” “duplicate runs,” or “too many expensive steps”)
If you are orchestrating in an automation platform, do the same for platform-side costs:
  • In Pipedream, identify the highest task consumption workflows and duplicates.
  • In Zapier, identify which steps consume tasks and which are free utilities.

Assistants API vs Responses API: what changes in practice

Most teams do not migrate because it is “new.” They migrate because it is becoming the path forward and the new mental model is simpler to reason about.
Here is the practical difference:
  • Assistants API tends to encourage “one assistant handles everything,” which can hide cost drivers inside threads, runs, and tool calls.
  • Responses API encourages you to treat each response as an explicit unit of work.
That shift makes it easier to:
  • Split work into smaller calls
  • Route simple steps to cheaper models
  • Keep expensive context out of every request

Migration path: Assistants API → Responses API

Use this order so you do not break production.

Step 1: inventory what your assistants actually do

For each assistant, write down:
  • The job to be done (one sentence)
  • The inputs (transcript, CRM fields, ticket text, etc.)
  • The outputs (JSON fields, summaries, classifications)
  • Any tools (file search, web search, code, function calls)
  • Where it runs (for example, in Pipedream)
If you cannot describe the assistant in one sentence, it is already too broad.

Step 2: turn “one big prompt” into prompt modules

Break the assistant instructions into:
  • Stable system policy (never changes)
  • Workflow-specific instructions (changes by scenario)
  • Per-run inputs (the actual transcript or record)
This makes it much easier to:
  • Reuse the stable part
  • Keep the per-run input small
  • Cache or store prompt components outside your orchestration tool

Step 3: split the workflow into cheap vs expensive steps

This is where most cost savings come from.
A simple pattern that works well:
  • Step A (cheap model): extract obvious fields and do simple classification.
  • Step B (expensive model): do deeper reasoning, root-cause analysis, or multi-constraint decisions.
Examples of “cheap step” tasks:
  • Detect whether a call mentions billing
  • Extract phone numbers or email addresses
  • Identify which product was discussed
Examples of “expensive step” tasks:
  • Diagnose why a deal is stalled
  • Create a coaching plan
  • Generate a multi-part narrative summary with strict constraints

Step 4: migrate the orchestration (and avoid hidden extra calls)

When you switch platforms, watch out for this pitfall:
If your new platform does not support the same assistant-level abstraction, a single action can turn into multiple API calls.
For example:
  • In one platform, sending a message to an assistant may be one “action.”
  • In another platform, you might need to create a thread, add messages, then run it.
That can increase both platform costs and OpenAI costs.
If you are evaluating alternatives, run a simple test:
  • Implement one workflow in Pipedream.
  • Implement the same workflow in Zapier.
  • Compare:
    • Number of API calls
    • Tokens per call
    • End-to-end latency
    • Total platform tasks

Workflow triage checklist (engineer-friendly)

Use this checklist before you tune models.

1) Remove duplicates first

  • Are two versions of the same workflow running in parallel?
  • Did an “A/B test” accidentally become permanent?
Turning off duplicates is usually the fastest cost win.

2) Reduce input tokens at the source

  • Do you pass full transcripts when you only need a segment?
  • Can you send structured metadata instead of raw text?
  • Can you pre-trim irrelevant sections?
If you are processing voice workflows (for example, call analysis that logs into CRMs like Dialpad), trimming inputs can dwarf all other optimizations.

3) Control output length

  • Ask for JSON or bullet outputs, not essays.
  • Use explicit max output constraints.
  • Avoid “tell me everything” prompts.

4) Route models based on task complexity

Create 2 lanes:
  • Low-cost lane: high volume, low stakes, structured extraction
  • High-accuracy lane: lower volume, higher stakes, reasoning-heavy

5) Move expensive enrichment out of the hot path

If you are doing analytics enrichment or reporting, push it into:
  • Scheduled jobs
  • Batch processing
  • A data warehouse workflow (for example, using BigQuery as a staging and reporting layer)

Common mistakes that make costs worse

  • Migrating endpoints without changing behavior. If the workflow still sends huge context and generates long outputs, nothing improves.
  • More orchestration steps = more calls. “Simpler” no-code setups can inadvertently add requests.
  • No measurement. If you do not log tokens and calls, you cannot tell if you improved.

Quick win template: “5 prompts” becomes “2 prompts + routing”

If you have 5 prompts that all read the same transcript:
  1. Create one cheap pass that extracts structured facts once.
  2. Feed only those extracted facts into higher-cost reasoning prompts.
This reduces repeated transcript tokens and makes your expensive calls smaller.

Get help migrating your OpenAI workflows

Migrating from the Assistants API to the Responses API usually breaks at the prompt-splitting step — when you realize your modules are still sending the full context window and costs haven't moved. If that's where you're stuck, book a ZoomFlow session — one of our consultants will triage your workflow stack live and identify the highest-impact cost leaks in the same call.