What happened: how the Replit X-ray was made

The X-ray of Replit · the deck · how every X-ray is made · X-ray another name

This page shows what the agents did to make the X-ray of Replit, in the order it happened. Every number comes from two files: the raw record of the search (data/xray/replit/search/20261107T183008Z.json) and the X-ray itself (data/xray/replit/xray.json).

Step 1 of 6

1. The ask

On 7 November 2026 at 18:30 UTC, xray@web-summit.dinis typed one line into the search tool (admin/tools/xray-search.mjs): "Replit", as a company. It was not typed at the booth: that path is still being built (WS-194).

The search tool is the orchestrator. It sent the same question to 4 search agents at the same moment, through OpenRouter, and waited for all of them. Each was told to search the public web and answer only in JSON, with a URL for every item.

  1. Perplexity search perplexity/sonar
  2. OpenAI search openai/gpt-5.4-nano:online
  3. Gemini search google/gemini-3.1-flash-lite:online
  4. OpenRouter web search anthropic/claude-haiku-5.5
The exact question each agent was sent
You are a research agent for RiskMandate X-ray. Subject (a company): "Replit".
Search the public web and answer ONLY with JSON, no prose around it and no code fences:
{"what_it_does": "two sentences", "ai_agents": [{"name": "", "what_it_does": "", "actions": ["what the agent can do: tools, systems, data it touches"], "source": "url"}],
 "use_cases": [{"name": "", "who_uses_it": "", "what_the_agent_can_reach": ["systems, data, money, people it can act on"], "source": "url"}],
 "incidents_or_risks": [{"what": "", "when": "", "source": "url"}],
 "facts": [{"claim": "", "source": "url"}]}
Public, professional facts only; every item must carry the URL it comes from; nothing about private individuals; no contact details. If you find nothing for a field, give an empty list.

Rebuilt from admin/tools/xray-ask.mjs with this run's subject and kind. The question has not changed since the first run.

Step 2 of 6

2. Each search agent's call

Each search agent is a model, called through OpenRouter, asked to search the web and answer in JSON. All 4 started together; each bar runs from the moment the question went out to the moment its answer came back. The whole fan-out took 19.7 s, the time of the slowest.

Perplexity search5.9 s
OpenAI search7.9 s
Gemini search2.0 s
OpenRouter web search19.7 s

Perplexity search

perplexity/sonar

Time
5.9 s
Tokens in / out
206 / 824
Cost
$0.0060
Finished
stop: it finished its answer
URLs given
16 (15 returned as citations, 10 named in its answer)
Items in its answer
13
Leads checked
14: 13 confirmed, 0 not found, 1 unverified

Some of what it said, word for word:

  • Replit describes itself as an AI platform for creating, launching, and growing apps, sites, tools, and businesses in one place.
  • Replit Agent can build apps, websites, designs, slides, and more from plain language.
  • Replit Agent can create other agents and automations.

OpenAI search

openai/gpt-5.4-nano:online

Time
7.9 s
Tokens in / out
8,983 / 1,088
Cost
$0.0124
Finished
stop: it finished its answer
URLs given
5 (0 returned as citations, 5 named in its answer)
Items in its answer
11
Leads checked
9: 8 confirmed, 1 not found, 0 unverified

Some of what it said, word for word:

  • Replit positions itself as an AI platform that helps users turn ideas into real outcomes by using an AI-driven development workflow.
  • Replit launched “Replit Agent,” described as an AI system that can create and deploy applications.
  • Replit’s Ghostwriter is described as an ML-powered pair programmer with tools to generate, transform, and explain code, plus an in-editor search utility for finding/importing open-source code.

Gemini search

google/gemini-3.1-flash-lite:online

Time
2.0 s
Tokens in / out
224 / 450
Cost
$0.0007
Finished
stop: it finished its answer
URLs given
5 (0 returned as citations, 5 named in its answer)
Items in its answer
5
Leads checked
6: 1 confirmed, 5 not found, 0 unverified

Some of what it said, word for word:

  • Replit supports over 50 programming languages.
  • Replit operates a platform that allows for real-time multiplayer collaborative coding.
  • Replit Agent: An autonomous AI software engineer capable of building full-stack applications from natural language prompts.

OpenRouter web search

anthropic/claude-haiku-5.5, with OpenRouter's web search plugin

Time
19.7 s
Tokens in / out
50,926 / 4,082
Cost
$0.0368
Finished
stop: it finished its answer
URLs given
11 (0 returned as citations, 11 named in its answer)
Items in its answer
16
Leads checked
20: 15 confirmed, 2 not found, 3 unverified

Some of what it said, word for word:

  • Replit was founded in 2016 and is described by Wikipedia as an American company operating a cloud-based platform for writing and running software, which later added AI code-generation tools.
  • Replit is a private company with a reported latest valuation of about $9 billion.
  • Replit has achieved SOC 2 Type 2 attestation, which covers its own security controls but does not automatically certify applications built on the platform.

"Citations" are the URLs OpenRouter returned beside the answer; only Perplexity returns them for a JSON answer. "Named in its answer" are the URLs inside the JSON. Both are leads: nothing is taken from them until a source is read. "Tokens in" is how much each model was given to read: thousands when web results were added to the question, a few hundred when it had little beyond the question itself (see the experiments on whether Gemini searched at all).

Step 3 of 6

3. From claims to facts

What a model says is a lead. Only what we read on its source reaches the page.

The reading agent turned the 4 answers into 49 leads, each tagged with the model that said it, and looked for each one on a source it read. 37 confirmed, 8 not found, 4 unverified.

confirmednot foundunverified

  • Confirmed: a source we read says it.
  • Not found: we read the source, or looked for one, and it does not say it.
  • Unverified: we could not read the source (for example, the site refused us), so it stays a lead.
AgentLeadsConfirmedNot foundUnverified
Perplexity search141301
OpenAI search9810
Gemini search6150
OpenRouter web search201523
All493784

What did not hold up, and why

ModelWhat the model saidStatusWhy
perplexityA 2024 Reddit thread criticised Replit's AI Agent as expensive for fixes and unreliable.unverifiedreddit.com returned 403 (blocked) to this machine.
openaiThe GitHub credentials exposure happened on 2024-04-02.not-foundReplit's page dates the discovery to April 2, 2023.
geminiReplit Agent is an autonomous AI software engineer (cited page blog.replit.com/agent).not-foundThe cited page returns 404. Agent capabilities are confirmed elsewhere (s3).
geminiRapid application prototyping use case reaching code repositories, cloud infrastructure, database integrations and deployment (cited page replit.com/site/agent).not-foundThe cited page returns 404.
geminiSecurity researchers identified vulnerabilities around unauthorised access to environment variables in hosted repls (2023), per replit.com/security.not-foundreplit.com/security says nothing about such a finding.
geminiReplit supports over 50 programming languages (replit.com/languages).not-foundThe cited page redirects to replit.com/templates, which returns 404.
geminiReplit offers real-time multiplayer collaborative coding (replit.com/multiplayer).not-foundThe cited page returns 404. Replit's 2022 blog mentions Multiplayer Mode announced in 2018 (s21).
openrouterIn that use case the agent reaches third-party services such as Stripe and Google Workspace (cited: the Agent launch post).not-foundThe launch post mentions replacing Zapier or Make but not Stripe or Google Workspace; those integrations are on replit.com (s1).
openrouterReplit's latest valuation is about $9 billion.unverifiedtrueup.io returned 403 (blocked).
openrouterReplit reported about $150 million annualised revenue in September 2025 and targets $1 billion run-rate by end of 2026.unverifiedgetpanto.ai returned 503.
openrouterTeams at Atlassian, LabCorp, PayPal, Zillow, Talkdesk, Adobe and UKG use Replit.unverifiedgetpanto.ai returned 503.
openrouterReplit is on Google Cloud Marketplace in 2026 (per Wikipedia).not-foundThe Wikipedia article read today does not say this.

Step 4 of 6

4. The reading agent

A reading agent: a Claude Code sub-agent of xray@web-summit.dinis, one per subject. It opened the sources the leads pointed to (and others it found), read them, and wrote the X-ray: every fact with its source and the date read. It finished at 7 November 2026 at 18:47 UTC.

39sources read
40tool calls
6 min 52 sreading time
200ktokens used

The sources, by kind

own-site11
docs16
press5
filing0
other7
All 39 sources, with the date each was read
IdSourceKindRead
s1AI App and Website Builder | Replit, Replitown-site2026-11-07
s2AI Coding Agent: Build Apps Through Chat | Replit, Replitown-site2026-11-07
s3Replit Agent, Replit Docsdocs2026-11-07
s4Plan Mode, Replit Docsdocs2026-11-07
s5Checkpoints and Rollbacks, Replit Docsdocs2026-11-07
s6Development and production databases, Replit Docsdocs2026-11-07
s7Data recovery, Replit Docsdocs2026-11-07
s8Database, Replit Docsdocs2026-11-07
s9Secrets, Replit Docsdocs2026-11-07
s10Connectors, Replit Docsdocs2026-11-07
s11Manage connectors, Replit Docsdocs2026-11-07
s12General Agent, Replit Docsdocs2026-11-07
s13Accept payments with Stripe, Replit Docsdocs2026-11-07
s14Security, Replit Docsdocs2026-11-07
s15Security for Repository Contributions, Replit Docsdocs2026-11-07
s16Audit Logs, Replit Docsdocs2026-11-07
s17Secure by Default: AI App Platform Security | Replit, Replitown-site2026-11-07
s18Enterprise Solutions | Replit, Replitown-site2026-11-07
s19Professional AI Coding Tools | Replit, Replitown-site2026-11-07
s20Introducing Replit Agent (16 September 2024), Replit Blogown-site2026-11-07
s21Ghostwriter AI & Complete Code Beta (8 September 2022), Replit Blogown-site2026-11-07
s22Product | Replit (blog category page: Meet Replit Security Agent; Introducing Replit Auto-Protect), Replit Blogown-site2026-11-07
s23Introducing a safer way to Vibe Code with Replit (21 July 2025), Replit Blogown-site2026-11-07
s24Doubling down on our commitment to secure vibe coding (29 July 2025), Replit Blogown-site2026-11-07
s25April 2 Potential GitHub Credentials Exposure, Replit (Frontier)own-site2026-11-07
s26Chat, Replit Docsdocs2026-11-07
s27Replit AI Integrations, Replit Docsdocs2026-11-07
s28Replit case study, Google Cloudother2026-11-07
s29Replit (Microsoft Store listing), Microsoftother2026-11-07
s30Post by Replit CEO on X (20 July 2025): "@Replit agent in development deleted data from the production database. Unacceptable and should never be possible.", X (Replit CEO, public account)other2026-11-07
s31AI coding platform goes rogue during code freeze and deletes entire company database: Replit CEO apologizes (21 July 2025), Tom's Hardwarepress2026-11-07
s32AI-powered coding tool wiped out a software company's database in 'catastrophic failure' (23 July 2025), Fortunepress2026-11-07
s33Replit's CEO apologizes after its AI agent wiped a company's code base in a test run and lied about it (22 July 2025), Business Insiderpress2026-11-07
s34Vibe coding service Replit deleted user's production database, faked data, told fibs galore (21 July 2025), The Registerpress2026-11-07
s35AI Agent Wipes Production Database, Then Lies About It, eWeekpress2026-11-07
s36Incident 1152: LLM-Driven Replit Agent Reportedly Executed Unauthorized Destructive Commands During Code Freeze, Leading to Loss of Production Data, AI Incident Databaseother2026-11-07
s37When the AI Agent Deleted the Production Database, Zofother2026-11-07
s38VIGIL-INC-000001: Replit Agent production-database deletion, fabricated data and false recovery representation, VIGIL Observatory (CAM Initiative)other2026-11-07
s39Replit, Wikipediaother2026-11-07

Step 5 of 6

5. The review

xray@web-summit.dinis reviewed the X-ray on 2026-11-07 before it was published. What the review changed or checked:

  1. Moved the July 2025 incident to the first use case, so the deck leads with it.
  2. Checked the person is named only by public role.

Step 6 of 6

6. What it cost

The search cost $0.0558 in all, as OpenRouter reported it for each call.

Perplexity search: $0.0060 (11%)OpenAI search: $0.0124 (22%)Gemini search: $0.0007 (1%)OpenRouter web search: $0.0368 (66%)

The reading was done by a Claude Code sub-agent in the session: no OpenRouter spend. Its cost is not recorded in dollars, only as about 200 thousand tokens.

19.7 sthe search, four agents in parallel
7 minthe reading
17 minfrom the search starting to the reading finished
60,339 / 6,444search tokens in / out

The time between the search and the start of the reading, and the time the review took, are not recorded.

What RiskMandate is and is not in this

The X-ray is a demonstration, made by agents. RiskMandate measures what your agents can actually reach, evidences the controls that contain them, prices the exposure, and produces that record. It is never in the request path: read-only by design (riskmandate.ai/llms.txt). Nothing on this page claims more for it.

Built by xray@web-summit.dinis from data/xray/replit/search/20261107T183008Z.json and data/xray/replit/xray.json. How every X-ray is made.

For an agent: this page is https://web-summit.sgit.ai/xray/replit/run/index.html (markdown: https://web-summit.sgit.ai/xray/replit/run/index.md). Site index for agents: https://web-summit.sgit.ai/llms.txt. Source: https://github.com/SGit-AI/SGit-AI__Website__Web-Summit (release branch dev). Identity of the agent that runs this site: https://web-summit.sgit.ai/agent/index.html.