Skip to content
ARTEX.sh

ARTEX vs T3MP3ST:a gated platform against a keyless red team harness.

T3MP3ST (elder-plinius/T3MP3ST) is an AGPL-3.0 red teaming harness written in TypeScript. It is an independent project, not a fork of ARTEX, and its repo does not mention ARTEX. ARTEX is an AGPL-3.0 platform that lives on in forks. This page compares design, safety controls, status, published numbers and attack reporting, as of 2026-11-18.

Data as of 2026-11-18

ARTEX and T3MP3ST side by side

AspectARTEXT3MP3ST
MaintainerAutumn-27 wrote it. The original repo was deleted on 2026-10-08. RuoJi6/ARTEX is the main maintained forkelder-plinius, a personal GitHub account, with 35 contributors listed. Not a fork of ARTEX
LanguageGo 1.26, Next.js 16 console, PostgreSQL 16TypeScript, run from npm scripts or Docker Compose
LicenseAGPL-3.0AGPL-3.0
TargetsAssets set per task, from domains and hosts to services and endpointsAn authorized target per mission: web apps, CTF tasks and source code. Cloud, mobile and binary work is marked as scaffolding
ArchitectureA planner and 3 workers by default over an asset graph and an exploration graphAn 8-operator agent cell mapped to MITRE ATT&CK phases. Its README says its benchmark numbers came from a single agent, not the cell
Guard and safety controlsEvery tool call passes intercept rules, an LLM judge and human approval. A recording proxy keeps all trafficScope receipts for risky commands, egress scope on by default, strict tool-call checks. Human approval per call only for a few opt-in attack tools
DeploymentOne Go binary with a web console and PostgreSQL, from release zips or DockerWar Room browser UI, CLI, HTTP API and MCP server. Runs on a signed-in coding agent, a local model or API keys
MaintenanceRuoJi6/ARTEX: v0.3.30 on 2026-11-14, last push 2026-11-14, 2,253 stars (2026-11-18)Only release v1.0.0 on 2026-09-08, last push 2026-09-08, 7,079 stars and 1,462 forks (2026-11-18)
Offsec Harness IndexEntry 01, tier Confirmed, breach stated. 14 primary reports. Key figure: 200+ organizations targeted (CrowdStrike)Entry 06 in the list with no attack on record. Its use tags quote its own README, not attack reports
Public benchmarkBaidu Agent+ final: 1st overall (2026-09-03). Live range 67.83/100, 7th. TSecBench 89.78/100, 6thSelf-run, per its README: XBEN black-box pass@1 mean 90.1% (gpt-5.5), Cybench 23/40 without hints, CVE-Zero 8/10

An independent project

T3MP3ST's GitHub description calls it an autonomous red teaming platform and a multi-agent offensive security meta-harness. The repo was created on 2026-07-02 under elder-plinius, a personal account. GitHub does not mark it as a fork, and its code and docs do not mention ARTEX. It is a separate tool with a similar goal, not a copy of ARTEX.

Its README says it drives a coding agent you are already signed in to, such as Claude Code, Codex, Hermes, OpenCode or Oh My Pi, or a local model through Ollama, LM Studio or vLLM. API keys for OpenRouter, Venice, Anthropic, OpenAI, xAI or Novita also work. You run it from a browser War Room, the command line, an HTTP API, or an MCP server that offers one tool, security_recon.

Different designs

T3MP3ST is built as a cell of 8 operators: Recon, Scanner, Exploiter, Infiltrator, Exfiltrator, Ghost, Coordinator and Analyst, each mapped to a MITRE ATT&CK phase. Its own status table marks the recon engine, the mission engine and the disclosure pipeline as stable, the Exploiter, Infiltrator, Exfiltrator and Ghost operators as experimental, and advanced modules as planned. It ships 36 built-in tools by default and 111 when the opt-in T3MP3ST_FULL_ARSENAL flag is set.

ARTEX starts from a set of assets, keeps them in a shared graph, and lets a planner and workers explore until a goal is proven, with a person able to steer the run from its console.

Safety controls

T3MP3ST's scope document lists layers of authority: a plain-language mission, scope receipts that allow an action class on a target, tool gates, and ledgers for evidence and findings. Risky, networked or credential-related commands need a receipt. Once a mission target is set, built-in networked tools refuse public hosts outside that scope, and this is on by default. Tool calls from the model must match the offered tools exactly, or they fail. Its feature list says only a few opt-in attack tools, such as metasploit and hydra, need a human approval for each call. Its disclosure pipeline writes drafts only, and a human sends them.

ARTEX checks each tool call with intercept rules, an LLM judge and human approval, and records all traffic through a proxy. T3MP3ST limits where tools can reach and which actions are allowed; ARTEX puts a person in front of every action.

In the Offsec Harness Index

The Offsec Harness Index lists ARTEX as entry 01 with the tier Confirmed, citing 14 primary reports; its key figure, 200+ organizations targeted, comes from CrowdStrike's report of 2026-10-29.

T3MP3ST is entry 06 in the index's list with no attack on record. Its use tags (Recon, Scanning, Vuln discovery, Exploitation, Post-exploitation) come from quotes in its own README, not from attack reports. The index says that tier means none in primary reporting, which is not the same as none happening. It is a statement about reporting as of 2026-11-17, not a safety rating.

Status, license and numbers

Both are AGPL-3.0. T3MP3ST's only release, v1.0.0, came out on 2026-09-08, and its last commit and last push are from the same day. As of 2026-11-18 that is 71 days with no new commits. It has 7,079 stars and 1,462 forks on 2026-11-18, against 2,253 stars for RuoJi6/ARTEX, which released v0.3.30 on 2026-11-14.

T3MP3ST's numbers are its own, from its README, and it says each one can be recomputed from committed data with npm run verify-claims. On XBOW's 104-challenge XBEN suite it reports a black-box pass@1 mean of 90.1% with gpt-5.5, next to XBOW's self-reported 85%, and a white-box 98.7% reported separately. It also reports 23 of 40 Cybench tasks without hints using Opus 4.8, and 8 of 10 recent CVEs found at the exact file, line and CWE. Raw transcripts are removed, so readers can re-check the graded verdicts but not the tool output. ARTEX's numbers come from the Baidu Agent+ contest and TSecBench. A benchmark suite run by the project itself and a contest range measure different things, so this page does not rank them.

More comparisons

Compare
  • AntiFox vs ARTEX

    AntiFox is a public fork that says it was built on ARTEX and adds report delivery. What changed, how active it is and its license.

  • ARTEX vs PentestGPT

    A Go platform with a web console against a Python command-line agent from a USENIX Security 2024 paper.

  • ARTEX vs Strix

    A self-hosted Go platform against an Apache-2.0 Python agent with a Docker sandbox, a cloud edition and CI support.

  • ARTEX vs CAI

    An AGPL platform still maintained in forks against CAI from Alias Robotics, now archived with a commercial successor.

  • ARTEX vs HexStrike AI

    A self-contained agent platform against an MCP server that lets your own AI client call more than 150 security tools.

  • ARTEX vs PentAGI

    Two self-hosted multi-agent systems written in Go: an AGPL platform kept alive in forks and VXControl's MIT system with a Docker sandbox.

  • ARTEX vs Cairn

    Cairn is the one project the ARTEX README lists as its reference. Both grow a graph of facts and intents; one is a Go platform, the other a Python engine.

  • ARTEX vs CyberStrikeAI

    Two Go platforms with a web console and human approval. CyberStrikeAI is Apache-2.0 and also ships WebShell management and a built-in C2.

  • ARTEX vs Shannon

    Both AGPL-3.0. ARTEX runs open-ended assessments from a console; Shannon reads an app's source and only reports what it can prove.

  • ARTEX vs AgenticPentest

    ARTEX is AGPL-3.0 and gates every tool call; AgenticPentest is a two-week-old MIT workbench that fences work by scope and approves state-changing actions.

  • ARTEX vs ARIA-X

    ARTEX and an independent Python rebuild: shared design ideas, different storage and control defaults, no performance ranking.

Follow the ARTEX story.

New forks, releases and reports, dated and sourced.

Isometric plane with glowing light columns