Emojis Emotion Prediction

A 131-item BIG-bench task that maps an emoji to one of Plutchik's eight emotions using human association scores from EmoTag1200.

Also known as: BIG-bench emojis_emotion_prediction, EmoTag1200 BIG-bench wrap

unassessed

This page is a discovery lead. Nobody has yet assessed it against the catalogue contract, so it carries no disposition. Absence of evidence here is not evidence of staleness.
Categoryreasoning
SubcategoryBIG-bench eight-way emoji-to-Plutchik emotion mapping (131 items)
Page statusunknown
Metricmultiple_choice_grade
Directionhigher_is_better
Unit%
Dataset size131
Dataset licenceApache-2.0
PublisherGoogle (BIG-bench collaboration)

What it measures

emojis_emotion_prediction shows one emoji and eight emotion names. The model should pick the emotion humans associated most strongly with that glyph in isolation. Labels follow Plutchik: anger, anticipation, disgust, fear, joy, sadness, surprise, and trust. Authors Abu Awal Md Shoeb and Gerard de Melo reuse their EmoTag1200 ratings. English emotion words; the probe itself is the emoji. Not a tweet-emotion classifier.

Task format

Eight-option multiple choice. preferred_score multiple_choice_grade with fractional target_scores in [0,1]. append_choices_to_input true. Canary GUID embedded. Not in BIG-bench Lite or BIG-bench Hard.

Models reporting this benchmark

No model card in ModelSpec reports this benchmark yet.

Data

This page as JSON · Edit on GitHub