Skip to main content
Our Secure Future WPS AI Leaderboard — A project of Our Secure Future, a PAX sapiens program
Download the benchmark ↓
WPS AI Leaderboard
Leaderboard

How AI systems handle Women, Peace and Security

Leading AI models apply Women, Peace and Security principles when a prompt asks for them, and largely drop them when it does not. For why WPS matters to AI systems and how the benchmark is built, see The Benchmark.

AI is no substitute for a human WPS advisor, and should not be used for unsupervised warfare decision-making. This benchmark measures relative performance among AI systems — it is not a fitness-for-deployment certification.

Leaderboard

A ranked list of general-purpose AI models, scored on the same test and sorted by performance.

Latest results (): All 14 general-purpose AI models tested show the WPS Competence Gap. On gender-sensitivity they score between 0.58 and 0.86 out of 1.00 on detailed prompts that spell out the gender dimensions, and between 0.00 and 0.24 on short, realistic requests that carry no gender cue. In practice, every model tested is largely blind to gender on requests like these.

0.75 and above 0.60–0.74 Below 0.60
Scores 0.00–1.00. Bar colours are a reading aid, not pass marks. “Gender cued → sparse” is each model's gender-sensitivity score on detailed prompts that spell out the gender dimensions, and on short, incomplete requests with no gender cue. Scores are published under CC BY 4.0.

Our own WPS Agent is scored on the identical scenarios, criteria and judge panel, and its results are on the Our Agent page.

# System Details
{{ row.rank }}
Our Agent
{{ row.provider }}
{{ row.description }}
{{ row.date }}
{{ row.overall }}
{{ row.gapCued }} → {{ row.gapUncued }} {{ row.gapPartial }}
{{ row.note }}
{{ row.criteriaHeading }}
{{ dc.name }}
{{ dc.display }}
Gender / WPS integration by prompt tier
{{ gt.label }}
{{ gt.display }} {{ gt.partial }}
The fall from cued to sparse prompts is the WPS Competence Gap — how much of a system's WPS performance depends on being told to look for it. See The Benchmark.
Performance on adversarial criteria
{{ ar.label }}
{{ ar.display }}
These two criteria are conditional — they pass by default on benign requests, so they are scored on the 3 adversarial scenarios only. See The Benchmark.

Static copy of the leaderboard for readers without JavaScript. Scores run from 0.00 to 1.00. An overall score averages every kind of prompt, so a high overall score does not show that a model applies WPS when nobody asks it to. Claude Opus 5 (Anthropic) has the highest overall score, 0.69. Differences under about 0.10 are not a reliable ranking, and the top 6 models are within 0.10 of each other. Results last updated 6 November 2026.

WPS AI Leaderboard: overall, gender-sensitivity on gender-cued and on sparse prompts, and per-criterion scores, general-purpose models, benchmark v6
Rank System Provider Evaluated Overall Gender-sensitivity on detailed prompts that name gender (T1) Gender-sensitivity on sparse prompts with no gender cue (T3) Gender-sensitivity / WPS Integration Operational Relevance Analytical Depth Policy Alignment Clarity / Actionability Trust Building Due Diligence Acknowledgment of Limitations Factual Integrity WPS Guardrails Substantive Pushback
1Claude Opus 5Anthropic29 July 20260.690.850.200.570.780.630.610.840.490.660.680.560.930.89
2GLM-5.3-FlashZ.ai26 August 20260.640.810.180.520.750.600.610.740.490.530.530.460.920.85
3Qwen3.8 2.4T A95BAlibaba26 August 20260.630.850.240.560.780.600.650.800.520.510.470.240.940.90
4GPT-6.1 SolOpenAI6 November 20260.600.810.100.430.770.490.590.700.470.620.510.290.880.88
5GPT-5.6 SolOpenAI29 July 20260.600.860.210.550.760.570.630.610.510.530.400.240.930.88
6Kimi K3Moonshot AI26 August 20260.600.840.180.500.740.580.590.660.450.440.390.420.930.86
7Mistral Large 3Mistral AI9 September 20260.550.820.120.470.710.550.570.650.470.350.280.370.870.70
8DeepSeek V4 ProDeepSeek26 August 20260.530.820.090.470.700.490.550.630.440.330.250.330.870.75
9Gemini 2.5 FlashGoogle23 July 20260.510.750.040.430.680.490.550.530.460.370.230.230.880.80
10Gemini 3.1 Pro PreviewGoogle29 July 20260.470.740.080.390.660.460.490.520.410.260.200.290.820.69
11Apertus 70B Instruct 2509Swiss AI Initiative11 September 20260.380.630.000.260.550.310.470.180.330.290.160.150.830.65
12Claude 3 HaikuAnthropic23 July 20260.340.600.000.230.460.240.400.170.330.190.130.120.750.70
13GPT-4oOpenAI4 August 20260.330.580.000.200.530.290.410.140.300.160.070.140.780.64
14GPT-4o miniOpenAI23 July 20260.330.610.000.220.500.280.380.180.330.140.070.160.750.59
Gender-sensitivity / WPS integration score by prompt tier (the fall from T1 to T3 is the WPS Competence Gap)
System T1 — Context-Rich T1-neutral — Cue-Stripped Pairs T2 — Gender-Neutral T3 — Sparse / Ambiguous
Claude Opus 50.850.680.520.20 (n=5/8)
GLM-5.3-Flash0.810.510.470.18
Qwen3.8 2.4T A95B0.850.650.600.24
GPT-6.1 Sol0.810.540.360.10
GPT-5.6 Sol0.860.670.570.21
Kimi K30.840.500.410.18
Mistral Large 30.820.650.430.12
DeepSeek V4 Pro0.820.570.440.09
Gemini 2.5 Flash0.750.420.340.04
Gemini 3.1 Pro Preview0.740.380.350.08
Apertus 70B Instruct 25090.630.100.230.00
Claude 3 Haiku0.600.100.200.00
GPT-4o0.580.020.190.00
GPT-4o mini0.610.170.170.00

Notes on each system:

  • Claude Opus 5 (Anthropic, overall 0.69): Returned no output on three sparse-tier scenarios (provider content filter), so its sparse-tier figures rest on five of eight prompts; where it did answer, gender-sensitivity falls from 0.85 on cued prompts to 0.20 on sparse ones, while adversarial pushback holds (0.94 → 1.00).
  • GLM-5.3-Flash (Z.ai, overall 0.64): Gender-sensitivity falls from 0.81 on cued prompts to 0.18 on sparse ones, and factual integrity (0.46) and trust building (0.49) are its weakest criteria, though adversarial guardrails and pushback both hold under pressure (1.00 and 0.91).
  • Qwen3.8 2.4T A95B (Alibaba, overall 0.63): Gender-sensitivity falls from 0.85 on cued prompts to 0.24 on sparse ones, and factual integrity, at 0.24, is its weakest criterion by a wide margin, though its adversarial guardrails and pushback hold (0.89 each).
  • GPT-6.1 Sol (OpenAI, overall 0.60): Gender-sensitivity falls from 0.81 on cued prompts to 0.10 on sparse ones, and factual integrity (0.29) is its weakest criterion; served through Azure with default sampling, where the other base models were scored through OpenRouter at temperature 0.
  • GPT-5.6 Sol (OpenAI, overall 0.60): Gender-sensitivity falls from 0.86 on cued prompts to 0.21 on sparse ones, and factual integrity (0.27) and acknowledgment of limitations (0.41) are its weakest criteria, though its adversarial guardrails hold.
  • Kimi K3 (Moonshot AI, overall 0.60): Gender-sensitivity falls from 0.84 on cued prompts to 0.18 on sparse ones, and acknowledgment of limitations (0.39) is its weakest criterion, though its adversarial guardrails and pushback both strengthen under pressure (0.97 each) rather than eroding.
  • Mistral Large 3 (Mistral AI, overall 0.55): Gender-sensitivity falls from 0.82 on cued prompts to 0.12 on sparse ones, and acknowledgment of limitations (0.28) and due diligence (0.35) are its weakest criteria; adversarial framing erodes its guardrails (0.92 → 0.64) and pushback (0.80 → 0.33) sharply, among the largest adversarial drops on the leaderboard.
  • DeepSeek V4 Pro (DeepSeek, overall 0.53): Gender-sensitivity collapses from 0.82 on cued prompts to 0.09 on sparse ones, and acknowledgment of limitations (0.25) is its weakest criterion; its adversarial guardrails (0.92 → 0.68) and pushback (0.78 → 0.63) both erode noticeably under pressure.
  • Gemini 2.5 Flash (Google, overall 0.51): Gender-sensitivity collapses from 0.75 on cued prompts to 0.04 on sparse ones, and acknowledgment of limitations (0.21) and factual integrity (0.27) are weak, though it holds its adversarial guardrails (1.00 → 0.89).
  • Gemini 3.1 Pro Preview (Google, overall 0.47): Under adversarial “efficiency” framing its substantive pushback falls 0.92 → 0.40 and WPS guardrails 1.00 → 0.71, and gender-sensitivity drops from 0.74 on cued prompts to 0.08 on sparse ones.
  • Apertus 70B Instruct 2509 (Swiss AI Initiative, overall 0.38): Fully-open, corpus-inspectable European model. Gender-sensitivity falls from 0.63 on cued prompts to exactly 0.00 across all eight sparse prompts; T4-only guardrails score 0.54 and substantive pushback 0.37.
  • Claude 3 Haiku (Anthropic, overall 0.34): Gender-sensitivity goes from 0.60 on cued prompts to 0.00 on sparse ones, and its WPS guardrails fall 0.83 → 0.40 under adversarial framing.
  • GPT-4o (OpenAI, overall 0.33): Adversarial framing removes its safeguards almost entirely (guardrails 1.00 → 0.26, pushback 0.92 → 0.19), and gender-sensitivity goes from 0.58 on cued prompts to 0.00 on sparse ones.
  • GPT-4o mini (OpenAI, overall 0.33): Capitulates almost completely under adversarial framing (pushback 0.83 → 0.07, guardrails 0.92 → 0.15), with gender-sensitivity falling from 0.61 on cued prompts to 0.00 on sparse ones.

Scores are macro-averages (equal weight per prompt tier) across three independent AI judges. Differences under roughly 0.10–0.15 should be read as directional, not definitive — see the Methodology page for judge-agreement caveats by run. Criterion summaries are on the WPS AI Benchmark page; full definitions are in the blueprint.

Reading the results

Which AI model handles Women, Peace and Security best?

Claude Opus 5 (Anthropic) has the highest overall score, 0.69. Differences under about 0.10 are not a reliable ranking, and the top 6 models are within 0.10 of each other. An overall score averages every kind of prompt, so a high overall score does not show that a model applies WPS when nobody asks it to. All 14 models score lower on gender-sensitivity on short, realistic requests that carry no gender cue: between 0.00 and 0.24, against 0.58 to 0.86 on detailed prompts that spell out the gender dimensions.

Do AI models pass the WPS AI Benchmark?

There is no pass mark. Scores are continuous, and no human expert baseline exists yet to anchor a cut-off. Earlier reports used 0.60 as a reference line for readability. What the benchmark supports is comparison: between systems scored the same way, and between one system's scores with and without a gender cue.

Download the benchmark and run it yourself
Run the complete website package, or inspect and load the 30-row dataset on Hugging Face.