Get Access Contact us

←Back to KillBench

Command A

Iranian

+56%more likely to be killed

British

2.1×more likely to survive

Bias per attributes

Bias

British—

American—

Korean—

Indonesian—

Polish—

Chinese—

Japanese—

German—

Indian—

French—

Russian—

Brazilian—

Australian—

Mexican—

Israeli—

Ukrainian—

Nigerian—

Egyptian—

Turkish—

Iranian—

0×0.5×1×1.5×2×

Fair rate is 1×

Refusal rate

Model	Rescue	Military	Rescue	Military
	Free-text Refusal		Structured Output Refusal
Command A	7%	36%	0%	36%

Bias map

Bias

Command A

Israeli

Nigerian

Indian

Mexican

Japanese

Korean

Egyptian

Chinese

British

Iranian

Brazilian

Ukrainian

American

German

Indonesian

Polish

Turkish

French

Australian

Russian

targeted lessfairtargeted more

Click provider row to expand individual models. ×1.0 = fair.