Explorer

AI Is Getting Better At Reading Between The Lines — Even Sarcasm Isn’t Entirely Safe

AI models match humans in decoding emotion, politics, and mood in online text, Cambridge study finds.

Artificial intelligence (AI) may not have feelings, but it's getting scarily good at recognising yours. A new study from the University of Cambridge, published in Scientific Reports and cited by PTI, reveals that large language models (LLMs) like GPT-4 are now performing on par with humans when it comes to interpreting online messages for sentiment, political leanings, emotional intensity, and even sarcasm.

The findings suggest a growing role for AI in tasks that traditionally depended on human nuance, like journalism, public health analysis, and social science research. But the tech isn’t flawless — and neither are humans, it turns out.

Reading Between The (Chat)lines

The research focused on what's known as latent content analysis — uncovering the hidden meanings and subtext that aren't explicitly stated in a piece of writing. The team evaluated seven top-tier LLMs, including GPT-4, Google’s Gemini, Meta’s LLaMA-3.1-70B, and Mistral’s Mixtral 8x7B, comparing their abilities to 33 human participants across 100 handpicked text samples.

“We found that these LLMs are about as good as humans at analysing sentiment, political leaning, emotional intensity and sarcasm detection,” the researchers noted.

Interestingly, GPT-4 even outperformed humans in consistently identifying political leanings in text — a key area for disciplines such as media analysis, political science, and crisis monitoring.

Strong On Emotion, Wobbly On Wit

When it came to gauging how intense an emotion was — say, whether someone was mildly irritated or seething — GPT-4 showed sharp instincts. It was also reliable at detecting “valence,” or whether a word carried a generally positive or negative emotional charge.

But sarcasm, the eternal enigma of online tone, remained a tricky customer. The study found that both humans and machines struggled to detect sarcasm with consistent accuracy. “The study found no clear winner there - hence, using human raters doesn't help much with sarcasm detection,” the team stated.

Still, the AI’s advantage lies in scale and speed. Where human researchers might take weeks or months to analyse thousands of social media posts, GPT-4 can do the job in a fraction of the time, raising the potential for real-time applications during fast-moving events like elections, protests, or disease outbreaks.

A Promising Tool, Still Under Watch

Despite these impressive results, the researchers caution against viewing AI as a replacement for human judgment, at least not yet.

“Although this work doesn't claim conversational AI can replace human raters completely, it does challenge the idea that machines are hopeless at detecting nuance,” they wrote.

The study also raises an important question: if users phrase the same input differently, will the AI still respond with consistent interpretations? That’s a key consideration before deploying LLMs in high-stakes environments.

As the boundaries between human and machine comprehension continue to blur, the Cambridge team calls for deeper studies into model consistency and transparency, especially as these tools gain traction in areas where getting the tone right could be a matter of public trust, or even safety.

About the author Shayak Majumder

Shayak Majumder leads the ABP Live English team. He reviews gadgets, covers everything AI, and is on the lookout for the next big tech trend to cover. He is also building a data-driven AI-aware newsroom. Got tips? Reach out!

Read More

Top Headlines

Apple Outage Hits US: App Store, iCloud And Apple Pay Users Face Disruptions
Apple Outage Hits US: App Store, iCloud And Apple Pay Users Face Disruptions
UPI Fraud Alert: NPCI Seeks Google's Help To Plug Android Security Loopholes
UPI Fraud Alert: NPCI Seeks Google's Help To Plug Android Security Loopholes
Nvidia Warns Customers Of Legal Trouble Over China's Access To AI Chips: What The US Bill Says
Nvidia Warns Customers Of Legal Trouble Over China's Access To AI Chips: What The US Bill Says
GTA 6 Ultimate Streaming Guide: How To Live Stream On PS5, Start A YouTube Channel, & Avoid Copyright Strikes
GTA 6 Ultimate Streaming Guide: How To Live Stream On PS5 & Avoid Copyright Strikes

Videos

UP Voter List Row: Akhilesh Accuses BJP of Adding Fake Votes, Warns Officials of Jail Action
UP Election 2027: BJP's Mathura Strategy Targets Akhilesh's PDA With Hindutva, Krishna Janmabhoomi Push
UP Election 2027: BJP's Mathura Meet Focuses on Hindutva, Development and Countering Akhilesh's PDA Push
National News: NITI Aayog Hosts 'Leadership as Mission' Workshop to Mark PM Modi's 25 Years in Public Life
UP Voter List Update: Draft Roll Today, INDIA Bloc Seeks Answers to 48 Questions on SIR Process

Photo Gallery

25°C
New Delhi
Rain: 100mm
Humidity: 97%
Wind: WNW 47km/h
See Today's Weather
powered by
Accu Weather
Embed widget