ChaosWatch
New here? Start here →
Evidence inspector

Middle East & North Africa · 2026-07-05

The receipts. This is the exact material every model was shown for this day and region, followed by what each of them made of it — in its own words, next to the number it gave.

It is worth reading once even if you skip everything else: it is where confident-sounding reasoning and a score that turns out to be no better than chance sit side by side.

Why the evidence is identical, and how you can check

Evidence is gathered once per (date, region, depth_profile), hashed, and reused for every model in the run. A disagreement below is therefore a disagreement about identical input, not two models getting different search results. The evidence hash shown on this page is what makes that checkable.

Evidence hash
11415cd307114a33a135f5b99cd9bf21f1aa24ffb53f507c7de8675bdd53a8a9

SHA-256 over the canonically serialised payload minus the hash itself, so it is stable across processes and machines. It is stored on the run and on every score row below — provenance is checkable, not asserted. Every score row below carries this same hash.

Source material · 10

shallow

These headlines, in this order, are the entire world the models were given. Nothing else about Middle East & North Africa on 2026-07-05 was in the prompt.

Extracts: not gathered at shallow depth — Stage 7 populates extracts only for standard and deep profiles. Zero here means "not requested", not "requested and empty". Full article texts: not gathered at shallow depth — only the deep profile fetches them.

The shallow profile requests 20 headlines and 10 are stored. That is a known provider cap, not a clipped payload: the Serper news endpoint returns at most 10 items per request regardless of the count asked for, and pagination has not been added. The three profiles currently differ in enrichment, not in headline breadth.

Model rationales

prompt p1

Same headlines, same rendered prompt, different readings. Where two models diverge, the disagreement is about interpretation, because the input was byte-identical and the hash proves it. The scored verdicts here span 18.0 points of the 0-100 scale.

llama-3.3-70b-versatile
groq
60.0
okUnstable

The region is experiencing a mix of economic cooperation and strategic military build-ups, with the EU investing in Egypt and the launch of a mega military HQ, while also facing severe hunger in northern Nigeria and a fragile state of 'neither war nor peace' in the Middle East. The overall situation is unstable due to the combination of these factors, which could potentially escalate into larger conflicts or crises.

evidence 11415cd30711…prompt p1
claude-opus-5
anthropic
58.0
okUnstable

Evidence points to a region locked in a "neither war nor peace" stalemate following renewed US strikes on Iran in late June, alongside a severe humanitarian emergency with 17 million facing hunger across nine conflict-hit northern Nigerian states. Offsetting signals — EU financing for Egypt, corporate and infrastructure investment, and cybersecurity cooperation in the Gulf — indicate significant pockets of stability and no active large-scale interstate war on this date.

evidence 11415cd30711…prompt p1
gemini-3.1-pro-preview
google
55.0
okUnstable

Recent United States military strikes on Iran have left the region in a fragile geopolitical stalemate, compounded by a severe hunger crisis affecting millions in northern Nigeria. Despite these tensions, massive European financial aid and new corporate investments in Egypt provide a degree of economic anchoring that prevents further immediate deterioration.

evidence 11415cd30711…prompt p1
deepseek-reasoner
deepseek
52.0
okUnstable

The US airstrike on Iran and widespread hunger in northern Nigeria indicate elevated conflict and humanitarian stress, while Egypt's massive new military HQ and the region's 'neither war nor peace' status underscore ongoing volatility. However, economic investments and international cooperation, such as EU aid to Egypt and Qatar's cybersecurity initiatives, prevent a full collapse, leaving the region in an unstable equilibrium.

evidence 11415cd30711…prompt p1
claude-haiku-4-5
anthropic
42.0
okElevated

The MENA region exhibits mixed signals with stabilizing economic investments (EU support for Egypt, EY hub expansion) and military modernization efforts (Egypt's new command center) offsetting persistent tensions including recent US-Iran strikes, severe humanitarian crisis in northern Nigeria affecting 17+ million people, and ongoing conflict-driven instability. While the characterization of 'neither war nor peace' suggests a stalemate preventing immediate escalation, the combination of unresolved geopolitical rivalries, acute food insecurity, and military buildups maintains elevated regional tension above baseline stability thresholds.

evidence 11415cd30711…prompt p1

Every model returned a parseable verdict for this evidence, so no failure card is shown. Non-ok rows are rendered by the same component — with error_text where the rationale would be — and are covered by tests/rationale_card_test.tsx.