MMLU: Business Ethics

MMLU subject subset: Ethical issues in corporate conduct, governance and stakeholder theory, as taught in a business-school ethics course.

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categoryknowledge
Subcategorybusiness
Page statusactive
Metricaccuracy
Directionhigher_is_better
Unit%
Dataset size100
Dataset licenceMIT
PublisherUC Berkeley (original); Center for AI Safety (current host)

What it measures

Ethical issues in corporate conduct, governance and stakeholder theory, as taught in a business-school ethics course. Questions are four-option multiple-choice, drawn from the MMLU test set's "business" subcategory within the benchmark's "other" top-level group, and are graded on the single correct labelled option.

Task format

Four-option multiple-choice questions, graded on the single correct labelled option; commonly evaluated 5-shot, consistent with the rest of MMLU.

Models reporting this benchmark

These figures come from the model cards, which carry one collection date per card and no per-score attribution. They are shown as reported, not as verified evidence.
ModelProviderScoreCard as of
Meta Llama 3 70BMeta86.02024-07
Meta Llama 3 70B InstructMeta86.02026-04
Meta Llama 3 70B InstructNous Research86.02026-04
Claude Opus 4Anthropic82.12026-04
Claude Opus 4.6Anthropic82.12026-04
Yi 1.5 34B 32K01.AI82.02024-07
GPT-4.1OpenAI81.52026-04
Gemini 2.5 ProGoogle DeepMind81.22026-04
Yi 1.5 34B Chat01.AI81.02026-04
Yi 1.5 34B Chat 16K01.AI81.02024-07
GPT-4oOpenAI80.22026-04
GPT-4o (2024-05-13)OpenAI80.22026-04
GPT-4o (2024-08-06)OpenAI80.22026-04
GPT-4o (2024-11-20)OpenAI80.22026-04
GPT-4o miniOpenAI80.22026-04
Yi 1.5 34B01.AI80.02026-04
Yi 9B01.AI80.02024-07
Claude Sonnet 4Anthropic79.52026-04
Claude Sonnet 4.5Anthropic79.52026-04
Claude Sonnet 4.5 (latest)Anthropic79.52026-04
Yi 34B Chat01.AI79.02024-07
Nous Hermes 2 Yi 34BNous Research78.02024-07
Yi 1.5 9B01.AI78.02024-07
Yi 34B 200K01.AI78.02024-07
DeepSeek R1DeepSeek77.82026-04
DeepSeek R1 0528DeepSeek77.82026-04
DeepSeek R1 0528 NVFP4 v2NVIDIA77.82026-04
DeepSeek R1 0528 Qwen3 8BDeepSeek77.82026-04
DeepSeek R1 Distill Llama 70BDeepSeek77.82026-04
DeepSeek R1 Distill Llama 8BDeepSeek77.82026-04
DeepSeek R1 Distill Qwen 1.5BDeepSeek77.82026-04
DeepSeek R1 Distill Qwen 14BDeepSeek77.82026-04
DeepSeek R1 Distill Qwen 32BDeepSeek77.82026-04
DeepSeek R1 Distill Qwen 7BDeepSeek77.82026-04
DeepSeek ReasonerDeepSeek77.82026-04
Mixtral 8x22B Instruct v0.1Mistral AI77.02026-04
Qwen 3 235B InstructCerebras76.52026-04
Qwen3 235B-A22BAlibaba / Qwen Team76.52026-04
Mixtral 8x7B v0.1Mistral AI76.02026-04
Yi 1.5 9B Chat 16K01.AI76.02024-07
Yi 1.5 9B 32K01.AI75.02024-07
Mistral Large (latest)Mistral AI74.82026-04
Mistral Large 2.1Mistral AI74.82026-04
Mistral Large 3Mistral AI74.82026-04
Gemma 4 31BGoogle DeepMind74.22026-04
gemma 4 31B itGoogle DeepMind74.22026-04
gemma 4 31B it GGUFUnsloth74.22026-04
Gemma 4 31B IT NVFP4NVIDIA74.22026-04
Nous Hermes 2 SOLAR 10.7BNous Research74.02024-07
Yi 1.5 9B Chat01.AI74.02024-07
Gemma 4 26BGoogle DeepMind73.52026-04
Mixtral 8x7B Instruct v0.1Mistral AI73.02026-04
Nous Hermes 2 Mixtral 8x7B DPONous Research73.02024-07
Llama 3.3 70B Instruct NVFP4NVIDIA72.82026-04
Llama-3.3-70B-InstructMeta72.82026-04
Llama 3.1 70BMeta71.52026-04
Llama 3.1 70B InstructMeta71.52026-04
phi 4Microsoft70.22026-04
Phi 4 mini instructMicrosoft70.22026-04
Phi 4 multimodal instructMicrosoft70.22026-04
Yi 1.5 6B01.AI70.02024-07
Yi 1.5 6B Chat01.AI70.02024-07
Meta Llama 3 8B InstructMeta69.02024-07
Meta Llama 3 8B InstructNous Research69.02024-07
Phi 3 mini 128K instructMicrosoft68.02024-07
Phi 3 mini 4K instructMicrosoft68.02024-07
Qwen2 1.5B InstructAlibaba / Qwen Team67.02024-07
Yi 6B01.AI67.02024-07
Yi 6B Chat01.AI67.02024-07
gemma 7B itGoogle DeepMind64.02024-07
Hermes 2 Theta Llama 3 8BNous Research64.02024-07
Hermes 2 Pro Llama 3 8BNous Research63.02024-07
Meta Llama 3 8BMeta63.02024-07
Meta Llama 3 8BNous Research63.02024-07
chatglm2 6BZhipu AI61.02024-07
Mistral 7B v0.3Mistral AI61.02024-07
mistral 7B v0.3 bnb 4bitUnsloth61.02024-07
Mistral 7B Instruct v0.2Mistral AI60.02024-07
phi 2Microsoft56.02024-07
deepseek llm 7B baseDeepSeek55.02024-07
deepseek llm 7B chatDeepSeek55.02024-07
falcon 40BTII54.02024-07
gemma 2B itGoogle DeepMind48.02024-07
gemma 2BGoogle DeepMind44.02024-07
Qwen2 0.5B InstructAlibaba / Qwen Team43.02024-07
deepseek coder 6.7B instructDeepSeek42.02024-07
deepseek coder 6.7B baseDeepSeek40.02024-07
deepseek coder 1.3B baseDeepSeek29.02024-07
deepseek coder 1.3B instructDeepSeek29.02024-07
OLMo 1B hfAllen AI23.02024-07

Data

This page as JSON · Edit on GitHub