Anthropic's AI coding agent that reads a project's files, edits code across folders, and runs terminal commands and tests.
Developers run Claude Code from a terminal, desktop app, code editor, or web session to track down bugs and ship multi-file changes. In benchmark testing, it acts as an agent scaffold around Claude models.
Closed Model (Proprietary Model)
#
An AI model whose internal numeric files are kept private on the creator's servers and accessed only through a web app or API.
Models such as Claude Fable 5.2, GPT-6 Astra, and Gemini 4 Carbon run exclusively on Anthropic, OpenAI, or Google cloud hardware. Users send prompts over the internet rather than downloading the model files onto their own computer.
Command Line (Terminal)
#
A text interface where a user or AI types operating-system commands directly instead of clicking buttons or menus.
Developers and server engineers use the command line to install packages, run automated test suites, search folders, and configure Linux servers. Benchmarks like Terminal-Bench 4.0 grade whether an AI can execute multi-step terminal commands without breaking the system.
A saved snapshot of a project's files at one exact moment in time, identified by a short code like af7a0be.
Every time a developer saves a set of changes in Git, it creates a commit. Coding benchmarks rewind a codebase back to the exact commit right before a bug was fixed so the AI starts from the same broken code the human developer faced.
Container (Docker Container)
#
An isolated, disposable virtual workspace on a computer that holds a specific codebase, its software dependencies, and its test suite.
Coding benchmarks run each AI attempt inside a fresh container with internet access turned off. If the AI breaks system files during a test, the container is deleted afterward, and clean-room verifiers apply the final patch inside a separate unmodified container.
The maximum amount of text and images (measured in tokens) an AI model can hold in active working memory during a single conversation.
Everything you paste, every file read from a codebase, and every reply in the current chat shares the context window. A 128,000-token context window holds roughly 1 full-length book (~96,000 words); a 1,000,000-token context window holds roughly 8 full books.
A typed, compiled programming language developed by Microsoft and widely used for enterprise backend services, desktop apps, and games.
SWE-bench Pro includes real multi-file bug-fixing tasks in C# alongside Python, TypeScript, JavaScript, and Go so coding leaderboards test languages used across business software.
A desktop code editor with built-in AI agents that search a full project, edit multiple files, and run terminal commands.
Cursor lets developers pick among models from Anthropic, OpenAI, Google, and other labs to write code or fix bugs across an existing repository.