AI and dataGenerative AI

Agent Builder, Evals and saved prompts shut on 30 November. Here's what to pull out first

Agent Builder, saved prompts and OpenAI Evals go dark on 30 November 2026. If your chat, prompts or tests still sit there, here's what breaks and what to pull out this week.

Cohash AI Practice November 2026 13 min read 8 chapters 3-question check
part 24 of 25 · Platform releases, explained from scratch
Evalsread-only Tools shut 30Nov GPT-4o off 14Jan Oct 2026 Jan 2027

the ideaGet your workflows, prompts and tests out before the tools close.

after reading, you can
  • Track down each chat, app and test still leaning on the tools that close
  • Pull workflows, prompt wording and test results out while you still can
  • Decide who'll run each agent from now on, your developers or staff in ChatGPT

OpenAI is switching off three developer tools on 30 November: the Evals platform, Agent BuilderdefinitionOpenAI's drag-and-drop canvas for agent workflows. Someone publishes a workflow and gets an ID back. Your chat or app has been calling that ID ever since. and saved prompt objects behind the v1/prompts API. If your chat widget, your test suite or your production prompts live in any of them, they need a new home before that date. Evals already went read-only on 31 October, so the test half of this has started.

in plain wordsShutdown: 30 November 2026

Built anything in OpenAI's dashboard? Check it now. Three of its tools close at the end of November.

Lots of teams keep part of their work in OpenAI's dashboard. Someone drew the chat helper there as boxes and arrows, saved the instructions the app fetches by ID, and kept the tests that check the answers are still good. OpenAI is closing those tools. Whatever lives only there has to be copied out and rebuilt somewhere you control. Anything that calls them by ID will stop getting what it expects.

think of it like this

It's like a landlord closing the storage unit where you kept the master copies of your forms. The forms still work, but only if you've got your own copy before the doors lock, and every office that sends people to collect from the unit needs a new address.

who should care
  • Sites whose ChatKit chat runs on Agent Builder
  • Apps that load saved prompts by ID
  • ML teams running tests in OpenAI Evals
  • Product owners of AI features
  • Buyers of tools built on OpenAI
chapter 01

Why it matters to you

The failure here is quiet until it isn't. Nothing in your own code changes on 30 November. A website chat that gets its brains from an Agent Builder workflow loses that backend. An app that fetches its instructions by prompt ID loses the instructions. OpenAI's prompt migration guide doesn't say what those requests return after the date, so plan for them to fail.

30 NovEvals, Agent Builder and the v1/prompts API scheduled to shut down
31 OctExisting evals became read-only. You can still read them
By handHow OpenAI's Promptfoo guide rebuilds evals. It doesn't use an export feature
2 languagesAgent Builder exports workflows as TypeScript or Python Agents SDK code

The tests matter more than they look. For some teams, Evals is where they check that a model swap didn't make answers worse. OpenAI is also retiring several GPT-4o and GPT-4.1 snapshots, minis included, on 14 January, so plenty of teams have a model migration coming right after this one. They'll want their test set out of Evals and running somewhere else before that starts.

There's an access angle too, and it's easy to miss. Today the dashboard holds the prompt text, the workflow and the test data, and anyone with access to the project can change them. Once they move into your repo or a ChatGPT workspace, someone has to decide who can edit them and which API key or connected app each one runs under.

what changesWhat happens to a request on 30 NovemberYour code doesn't change. The thing it points at on OpenAI's side goes away.
  1. 01 Your app makes a call

    A ChatKit session names a workflow ID, or a Responses API call names a saved prompt ID, the same way it has for months.

  2. 02 The target is gone

    OpenAI stops serving Agent Builder workflows and saved prompts. Your code hasn't changed, but it's now calling something that isn't there.

  3. 03 The feature breaks

    The chat on your site goes quiet. Or the app fires off a request and the instructions it relied on aren't there.

  4. 04 Logic moves to your side

    Someone moves the workflow into Agents SDK code or a ChatGPT workspace agent, and copies the prompt wording into the app's own code.

  5. 05 Your own tests check it

    Run the tests you rebuilt outside Evals, say in Promptfoo. If the answers still look right, let users back in.

For engineers: a ChatKit session created against a hosted workflow sends workflow: {id} to the ChatKit sessions endpoint. OpenAI's ChatKit guide says you can keep using that hosted workflow during the transition window, and points new work and migrations at a ChatKit server you run yourself. Saved prompts show up as a prompt parameter on the Responses API with an ID, a version and variables. Search for both before you search for anything else.

chapter 02

What goes, and where OpenAI wants you to move it

The three shutdowns and what replaces each one

removedAgent Builder

The canvas shuts on 30 November. Export each workflow as Agents SDK code first. You can run that yourself or paste it into a ChatGPT workspace agent.

removedSaved prompt objects and v1/prompts

Every prompt someone saved in the dashboard goes, versions and all. Paste the wording into your own code and stop fetching it by ID. That's OpenAI's advice too.

removedEvals dashboard and API

Nobody can edit evals since 31 October, and the whole thing closes on 30 November. OpenAI sends people to Promptfoo, an open-source eval tool.

deprecatedEval graders

Eval graders go too. The deprecations page puts the graders used in eval workflows in this same transition, while fine-tuning keeps its own timeline. If a release check leans on one, rebuild it somewhere else.

changedChatKit

Still available. If your ChatKit chat runs on an Agent Builder workflow, though, it needs a new backend you host with the ChatKit SDK.

changedDatasets

Stays in OpenAI's platform. The Promptfoo guide says dataset review and prompt iteration remain there, so you lose the test runner, not the whole workspace.

Agent Builder is the hard one. The export hands you code, but it doesn't convert the workflow graph. Nobody promises every behaviour survives the trip either, so someone still walks each branch by hand.

Workspace agents have their own catch. OpenAI warns that a workflow built on a strict run of steps might not come across faithfully, so test the awkward paths first. Someone also has to set up the connected apps and permissions again in ChatGPT.

Prompt objects are the simplest move and the easiest to get slightly wrong. The prompt text goes into your code, the variables become ordinary function arguments, and the version history moves to git. OpenAI's guide adds one detail that saves money: keep the fixed instructions first and the parts that change per request last, because prompt caching only works on an exact matching prefix.

Don't expect an export button. The PromptfoodefinitionAn open-source test tool. You write the checks in a config file, then run them on a laptop or in CI. It's where OpenAI sends people leaving Evals. cookbook describes a manual rebuild instead: you recreate the prompts, the model settings, the test cases and the scoring rules in a Promptfoo config file, then run it. One developer on OpenAI's forum who has used Promptfoo said they couldn't point to anything they'd lost. Their team later dropped it for its own rubric-based evals, which is a reasonable choice if your checks are simple.

tableWhere each piece goes, and what you have to redo by hand
What you have todayWhere OpenAI points youWhat moves for youWhat you redo by hand
Agent Builder workflowAgents SDK (TypeScript or Python), or a ChatGPT workspace agentExported SDK codeControl flow, triggers, tools and permissions review
ChatKit on a hosted workflowChatKit with your own serverThe chat front end and widgetsThe backend that answers, built with the ChatKit Python SDK
Saved prompt objectPrompt text in your application codeNothing automatic. Copy the text outVariables, versioning, rollout flags
Evals in the dashboard or APIPromptfoo, or your own harnessTest data you can still read and downloadGraders, scoring thresholds, CI runs

The dates around this shutdown

  1. 26 Aug 2026
    Assistants API removed

    If anything still calls /v1/assistants or threads, it's been failing since late August. OpenAI's replacement is the Responses and Conversations APIs.

  2. 31 Oct 2026
    Evals read-only

    You can still read your evals, runs and results and pull them through the API. You can't edit them any more.

  3. 30 Nov 2026
    Three tools shut

    All three tools are scheduled to close on this day. Anything you haven't copied out by then stays behind.

  4. 6 Jan 2027
    No new fine-tuning jobs

    From here even active fine-tuning customers can't start new jobs. Fine-tuned models you already have keep answering until their base model goes.

  5. 14 Jan 2027
    GPT-4o and GPT-4.1 removed

    GPT-4o and GPT-4.1 snapshots leave the API. You'll want working tests for that switch, so move them out of Evals now.

chapter 03

Your options, side by side

For most teams the choice is really about Agent Builder. Prompts go into code either way, and Evals goes to Promptfoo or your own harness. The agent is where you pick between owning code and handing the logic to ChatGPT.

tablePick the agent route that fits who runs it
RouteBest whenWhat you take onWatch out for
Agents SDK in your appThe agent sits behind a product or website and developers own itHosting, API keys, logs, deploymentValidating config, tools, auth and permissions yourself
ChatGPT workspace agentStaff use it inside ChatGPT for repeatable internal workBusiness, Enterprise or Edu plan, agent-creation rightsStrongly step-by-step workflows may not carry over faithfully
ChatKit plus your own serverYou want to keep the same chat window on your siteA server running the ChatKit SDK and your agentLogging users in properly. We'd authenticate every end user
Plain Responses API wrapperThe workflow was really one or two model callsYour own small loop and tool handlingYou rebuild the agent loop and handoffs the SDK gives you

The last row isn't on OpenAI's migration page. It came up on OpenAI's developer forum, where one practitioner suggested rolling a small wrapper over the Responses API, while calling the Agents SDKdefinitionOpenAI's code library for Python and TypeScript. Your developers drop it into their own app, and it handles the agent loop and handoffs. Hosting and keys are on you. a good replacement and the way to go otherwise. That matches what the SDK overview says about the trade: the SDK runs the agent loop and handoffs for you, and the raw Responses API leaves the whole integration to you.

The workspace agent route changes who owns the thing. It stops being an app your developers deploy and becomes something staff build and share in ChatGPT. That suits internal helpers. It's a poor fit for a customer-facing chat on your website, which is where ChatKit with your own server makes more sense.

chapter 04

What to do before 30 November

Who does what, and by when

Business ownerthis week
  • Ask your tech lead which features use Agent Builder, saved prompts or OpenAI Evals, and who owns each one.
  • Ask any vendor whose chat or AI feature you embed whether it runs on Agent Builder, and get their move date in writing.
  • Put 30 November on the risk register with one named owner per feature.
Developersthis week
  • Search code and config for the prompt parameter, saved prompt IDs and ChatKit session calls that pass a workflow ID.
  • Export every Agent Builder workflow you use as TypeScript or Python Agents SDK code and commit it, even if you'll rewrite it.
  • Copy the live wording of each saved prompt into the repo. The variables become plain function arguments.
ML and QAbefore 30 Nov
  • Pull eval definitions, runs and graded answers through the Evals API now. Once it's gone, so are they.
  • Rebuild the evals you rely on in Promptfoo or your own harness, and compare scores with the old runs.
  • Re-check any test where a model does the grading. Don't let it approve a release until someone has.
Security and identitythis month
  • Decide who can change prompts once they're in the repo, and require pull request review.
  • Give each migrated agent its own API key or project, scoped to what it actually calls.
  • Check what each workspace agent can reach before anyone shares it. Connected apps get the same review as a new hire's access.

Saving the Evals data is mostly a scripted job, so give it to a developer this week. The Evals API still lists your evals at GET /v1/evals, their runs at /v1/evals/{eval_id}/runs and each run's graded answers at /runs/{run_id}/output_items. You can filter those answers down to the failures, and they're usually the cases you'll want again. Page through everything. The output-items list, for one, returns 20 per page unless you ask for more.

Then search the code. The IDs in OpenAI's examples look like pmpt_123 and wf_123, so grep for those prefixes and for calls to chatkit/sessions, but check your config files, environment variables and low-code tools too. A workflow ID often sits in an environment variable on the server that creates ChatKit sessions.

A migration order that holds up

  1. 01
    Inventory by ID

    Write down every workflow ID, saved prompt ID and eval your projects use. Put a feature and an owner next to each, or nobody will chase it.

  2. 02
    Export while you can

    Get every export, prompt and eval into your repo or storage first. Sort out what's worth keeping later, once nothing can disappear on you.

  3. 03
    Move prompts into code

    One named function per prompt in a prompts module. Fixed instructions first, request details last. Versioning happens in git from now on.

  4. 04
    Rebuild the tests

    Recreate the evals you rely on in Promptfoo or your own harness. Check each grader against a few answers someone has marked by hand.

  5. 05
    Rebuild the agent

    Get the exported code running, or set up the workspace agent from it. Then run the rebuilt tests against both old and new while the old one still answers.

  6. 06
    Switch the front end

    Point ChatKit at your own server, or switch the app to the new code path. Keep the old path as a fallback until 30 November.

  7. 07
    Clean up access

    Retire API keys the old setup used, and give the new agent its own key with only what it needs.

chapter 05

Make the next shutdown less painful

OpenAI switched off the Assistants API in August, and now these three. The pattern is the same both times. Anything you build inside the vendor's dashboard is easy to start with and hard to take with you.

before

Before: the logic sits in OpenAI's dashboard

The app holds IDs. The workflow, the prompt wording and the tests all sit in tools that are closing.

Before: the logic sits in OpenAI's dashboard The app holds IDs. The workflow, the prompt wording and the tests all sit in tools that are closing. 01 · YOUR SIDE 02 · OPENAI PLATFORM workflow ID prompt ID tested here Website chat ChatKit embed Product app sends prompt ID AI Agent Builder shuts 30 Nov Saved prompts shuts 30 Nov Evals read-only now © Cohash · cohash.com
01 · YOUR SIDE02 · OPENAI PLATFORM Website chat: ChatKit embed Website chat ChatKit embed Product app: sends prompt ID Product app sends prompt ID Agent Builder: shuts 30 Nov AgentBuilder shuts 30 Nov Saved prompts: shuts 30 Nov Savedprompts shuts 30 Nov Evals: read-only now Evals read-only now workflow ID prompt ID © Cohash · cohash.com
after

After: logic and tests in your repo

OpenAI only serves the models now. Your team owns the agent, the prompts and the tests, and reviews them like any other code.

After: logic and tests in your repo OpenAI only serves the models now. Your team owns the agent, the prompts and the tests, and reviews them like any other code. 01 · YOUR SIDE 02 · OPENAI session instructions tests each change model calls Website chat ChatKit embed Your server Agents SDK Prompts module in git Promptfoo in CI gates changes AI Responses API models only © Cohash · cohash.com
01 · YOUR SIDE02 · OPENAI Website chat: ChatKit embed Website chat ChatKit embed Your server: Agents SDK Your server Agents SDK Prompts module: in git Prompts module in git Promptfoo in CI: gates changes Promptfoo in CI gates changes Responses API: models only Responses API models only model calls © Cohash · cohash.com

Durable fixes, tied to this case

  1. 01
    Keep prompts in source control

    Every wording change becomes a commit with a reviewer. OpenAI's own migration guide recommends this, with tests in CI before release.

  2. 02
    Run tests where you deploy

    Promptfoo runs locally or in CI, so a prompt or model change can't merge until the tests pass.

  3. 03
    One key per agent

    Give each agent or service its own project and key. When something is retired, you can see exactly what still calls it.

  4. 04
    Authenticate chat users

    Whatever server sits behind ChatKit should know who each user is. Don't let anonymous visitors reach an agent that can call your internal tools.

  5. 05
    Watch the deprecations page

    Someone reads OpenAI's deprecations page on a schedule and files a ticket for anything that touches your stack.

chapter 06

If it goes wrong

If something breaks after the shutdown, here's the order we'd work in

After the shutdown there's nothing to roll back to on OpenAI's side. The plan is to have your own copy ready and switch to it fast.

  1. 01Spot itfirst hour
    • Check server logs for failed ChatKit session calls and Responses requests that carry a prompt ID.
    • Tell support which feature is down and what users see, so the help desk isn't guessing.
  2. 02Stop the damagefirst hour
    • Hide or disable the broken chat rather than leave it spinning, and show a contact route instead.
    • Turn off retries for calls that can't succeed, so they don't fill queues or burn rate limits.
  3. 03Switch to your copyfirst day
    • Put the exported Agents SDK code behind ChatKit. Where a saved prompt broke, paste in the text you copied out.
    • If you didn't copy a prompt out, rebuild it from whatever records you have. Don't count on OpenAI's tools still having it.
  4. 04Check the answersfirst week
    • Run the rebuilt tests against the new path and spot-check live answers.
    • Look for silent problems: missing guardrails, tools that no longer fire, a different tone.
  5. 05Learnafter
    • Add whatever you missed to the inventory, then ask why it wasn't there. Usually someone built it on the side and never told anyone.
    • Move any remaining dashboard-only setup into code.
chapter 07

What this could look like: four typical setups

Four made-up setups, so you can see where yours fits and what to do first

01 Visitor 02 ChatKit embed stays 03 Agent Builder off 30 Nov 04 Own server export now
scenario 01High risk
A small firm with a help chat on its website
the setup
A small accounting firm put a help assistant on its website, built in Agent Builder and shown through ChatKit. The contractor who set it up has moved on, and nobody else has the login.
what happens
The chat window still loads, because ChatKit stays. The workflow behind it doesn't. Visitors type a question and nothing useful comes back.
what to do
Export the workflow now as Agents SDK code. Pay someone to stand up a small ChatKit server, or take the chat down before 30 November.
01 App 02 Prompt ID pmpt_… 03 Promptsmodule in git 04 Responses API
scenario 02High risk
A product team whose prompts live in the dashboard
the setup
A product manager at a software company edits prompts in OpenAI's dashboard whenever support complains about an answer. The app only sends an ID, a version number and the customer's details, so the wording never touches the repo.
what happens
When the prompts API shuts, expect requests that carry the ID to fail. The feature breaks, and the current wording may exist nowhere else.
what to do
Copy every prompt's live version into a prompts module in the repo. Give the product manager pull request access instead of dashboard edits.
01 Prompt change 02 OpenAI Evals read-only 03 Promptfoo inCI 04 Release
scenario 03Medium risk
An insurer that tests model changes in Evals
the setup
A data science team runs regression tests in OpenAI Evals before every prompt change, with a model-graded rubric for claim summaries.
what happens
The tests went read-only on 31 October, so nobody can change them there. In December they're gone, just as the GPT-4o migration needs them.
what to do
Download the eval definitions and failed output items now. Rebuild the rubric in Promptfoo and check it against summaries someone has marked by hand.
01 Requests 02 Agent Builder off 30 Nov 03 Workspaceagent review access 04 Ticketing
scenario 04Medium risk
An enterprise with an internal triage agent
the setup
Someone in IT built a workflow in Agent Builder that sorts incoming requests and drafts replies. Staff reach it from an internal page. The company already pays for ChatGPT Enterprise.
what happens
The workflow stops on 30 November. Rebuilding it as a workspace agent is the obvious route, but its connections to the ticketing system need new sign-in and permission setup in ChatGPT.
what to do
Export the code, create the workspace agent from it and test it in Preview. Have the identity team review its connected apps and who it's shared with before you create it.
chapter 08

How Cohash helps

We pull the agents, prompts and tests out of OpenAI's dashboard and into code your team owns. Most of the work is an Agents SDK or ChatKit server build. Then the prompts get a reviewer, and the evals run in CI so nothing merges untested. See our OpenAI API page and the LLMOps and evaluation practice. If you need engineers for the cut-over, hire OpenAI developers, or start with a short assessment.

key takeaways

What to take from this

  1. 01

    Plan for anything still sitting in Agent Builder, saved prompts or Evals on 30 November to be out of reach. ChatKit and the models keep working.

  2. 02

    A ChatKit chat on an Agent Builder workflow needs a new backend. Export the workflow as Agents SDK code this week.

  3. 03

    Copy every saved prompt's live wording into your repo. After the shutdown the ID is all you'll have.

  4. 04

    Evals is read-only now, and OpenAI's guide rebuilds tests by hand. Download definitions and results through the API, then rebuild in Promptfoo or your own harness.

  5. 05

    Recheck model-graded tests after rebuilding them. Scores won't match the old ones exactly.

  6. 06

    Give each migrated agent its own key and review who can edit prompts and agents once they leave the dashboard.

platforms in this noteOpenAI API →
fact-checked November 2026 against vendor and official documentation · where to go next
  1. How Cohash delivers OpenAI API: scope, roles and architecture
  2. Hire vetted OpenAI API engineers
  3. LLMOps and evaluation
  4. Book a 30-minute working session with a senior engineer
01Is ChatGPT affected?

No. This hits developer tools in OpenAI's API platform, and ChatGPT carries on as before. In fact ChatGPT workspace agents are one place OpenAI suggests moving Agent Builder workflows to.

02Does ChatKit stop working on 30 November?

No, ChatKit stays. What stops is Agent Builder, so a ChatKit chat that runs on a hosted Agent Builder workflow loses its backend. You'd connect ChatKit to a server you run instead.

03Can I export my evals?

OpenAI's migration guide doesn't use one. While evals are read-only you can still pull definitions, runs and graded answers through the Evals API. Then you rebuild the tests by hand in Promptfoo or your own harness.

04Our app still sends a saved prompt ID. What happens to it in December?

OpenAI's guide doesn't say what they'll return. Assume they fail. Copy the prompt text into your code before 30 November, because afterwards the ID is all you'll have.

05Do we need ChatGPT Enterprise to get off Agent Builder?

Only if you go the workspace agent route, which needs a Business, Enterprise or Edu workspace. If your developers run the Agents SDK in your own app, you don't need a ChatGPT plan at all.

06Is Promptfoo the only replacement for Evals?

It's the one OpenAI points to. Some teams use their own test harness instead. What matters is that the tests live somewhere you control and run before changes go live.

07There's a vendor's AI chat on our site. Is that our problem?

Possibly. Ask the vendor whether their product runs on Agent Builder or saved prompts, and when they'll have moved. Get the answer in writing.

up next in this track

Keep the thread going.

What shipped, what changed underneath, and what it means for your upgrade.

  1. 01HashiCorp Vault 2.2 explained: TPM login, post-quantum PKI and the October fixes
  2. 02Upgrading to SailPoint IdentityIQ 9.0: what breaks and what to fix first
  3. 03Terraform 1.17 explained: what's new, who it touches and how we'd upgrade
  4. 04BeyondTrust Remote Support zero-day: patch it, then check who got in
  5. 05Patch PHP and Node.js this week: what broke and who's exposed
  6. 06OpenShift support dates through 2027: which clusters run out first and how to plan the upgrades
  7. 07Oracle's October security patches: what to fix first in EBS, PeopleSoft and Access Manager
  8. 08Oracle Java drops four root certificates over eMudhra: patch, then test what breaks
  9. 09Delinea Secret Server auth bypass: why the FIDO2 hotfix isn't enough
  10. 10IBM Verify Access flaws let attackers run code without a login: patch to 11.0.3.2
  11. 11Foundry Workflows retire on December 1. We'd start moving yours to Agent Framework now
  12. 12Vertex AI is retiring text-embedding-005 and three other embedding models: how to re-embed before search breaks
  13. 13dbt drops v1.3 to v1.7 from its platform on January 31, 2027: get pinned jobs onto a release track before they're deleted
  14. 14Brotli CVE-2026-111497 is now on CISA's exploited list, and you probably run more copies than you think
  15. 15Auth0 moved the Rules and Hooks deadline: Hooks stop on 30 April 2027, Rules on 31 January 2028
  16. 16Still on Okta Classic Engine? Three features stop working on March 5, 2027, and two of them block the upgrade
  17. 17Patched GitLab, still exposed: the CI regex bug CISA lists as exploited, and the Ruby step people miss
  18. 18Patched Ivanti Connect Secure in October? Two more exploited bugs, and the AD cleanup
  19. 19Patch roundup, week of Oct 26: upgrade Secret Server today, then work down the list
  20. 20UiPath 2023.10 support has run out and 2024.10 is next. What we'd upgrade first
  21. 21Password Safe 24.3 runs out of support in December, and 26.3 is still one upgrade away
  22. 22Upgrade Entra Connect Sync before April 2027 and move users off Microsoft's SMS codes
  23. 23Chrome drops XSLT on 17 November. What breaks in InterSystems, and the fix for your version
  24. 24Agent Builder, Evals and saved prompts shut on 30 November. Here's what to pull out first
  25. 25BeyondTrust Remote Support and PRA 24.3 lose support in November, and there's no one-step upgrade
all learning tracks →
24.2 ends 26.3.1 out 24.3 ends 27.1 dropsRADIUS Jul 2026 Mar 2027
Security · 13 minBeyondTrust Remote Support and PRA 24.3 lose support in November, and there's no one-step upgrade

24.3 support ends in November, then RADIUS goes in 27.1

read next
next step

Tell us what you're running. We'll tell you what we'd do first.

A 30-minute working session with a senior engineer. No slides.

useful to bring
  • The platform and the version you're on
  • Where you need to get to, and by when
  • What's custom: rules, plugins, integrations
  • Any audit finding or deadline driving it