Explorer

Election Results 2024

(Source: ECI/ABP News/ABP Majha)

OpenAI Unveils New Tool, CriticGPT, To Find Errors In AI-Generated Code: Report

In a study, CriticGPT demonstrated competence in analysing code and identifying errors that may elude human notice, aiding in the detection of hallucinations.

OpenAI has reportedly designed a new AI model based on ChatGPT-4, CriticGPT. This newly designed AI model will help in identifying the users' errors in code produced by ChatGPT. According to reports, this new AI model is in the trials and it has already improved code review outcomes by a whopping 60 per cent. OpenAI is likely to include CriticGPT into OpenAI's Reinforcement Learning from Human Feedback (RLHF) labeling pipeline. It is expected that the company aims to provide AI trainers with more efficient tools to evaluate complex AI outputs. 

The GPT-4 models powering ChatGPT aim to enhance interactivity and utility through RLHF (Response Learning from Human Feedback). This involves AI trainers evaluating and rating various responses to improve their quality. As ChatGPT's reasoning abilities advance, errors are becoming more subtle, posing challenges for trainers in identifying inaccuracies.

In a study titled 'LLM Critics Aid in Detecting LLM Errors,' CriticGPT demonstrated competence in analysing code and identifying errors that may elude human notice, aiding in the detection of hallucinations. The researchers trained CriticGPT on a dataset containing intentionally inserted bugs in code samples, enabling it to recognise and flag coding errors effectively.

ALSO READ | Detective Dotson Xbox Release Announced By Masala Games — Check Details

What’s More To Come?

Reportedly during experiments of CriticGPT, teams using CriticGPT gave more holistic critiques and identified fewer false positives when compared to the ones who were working alone. LLM Critics Help Catch LLM Bugs reported, “A second trainer preferred the critiques from the Human+CriticGPT team over those from an unassisted reviewer more than 60 per cent of the time, as reported by.”

Critics have raised concerns about CriticGPT's capabilities, noting that it appears to have been trained primarily on brief responses from ChatGPT. This suggests a need for further development to effectively handle longer and more complex tasks. Additionally, a significant challenge that remains is the phenomenon known as 'ChatGPT hallucinating,' where the AI model generates incorrect information and presents it as factual, which CriticGPT has yet to fully address.

Moreover, there are occasional labelling errors made by trainers, and a notable limitation lies in the focus on isolated errors rather than addressing issues that span multiple aspects of a response. This limitation is closely linked with RLHF. As these advanced models become increasingly knowledgeable, there is concern that human trainers may find it challenging to provide meaningful feedback effectively within the CriticGPT framework.

View More
Advertisement
Advertisement
25°C
New Delhi
Rain: 100mm
Humidity: 97%
Wind: WNW 47km/h
See Today's Weather
powered by
Accu Weather
Advertisement

Top Headlines

Cars Set Ablaze, Tear Gas Lobbed As Mosque Survey Leads To Clashes In Sambhal — WATCH
VIDEO: Cars Set Ablaze, Tear Gas Lobbed As Mosque Survey Leads To Clashes In Sambhal
Don't Get Fooled, Warns Tata Memorial As Sidhu Claims Neem, Haldi Cured Wife's Breast Cancer
Don't Get Fooled, Warns Tata Memorial As Sidhu Claims Neem, Haldi Cured Wife's Breast Cancer
UP Bypoll Results 2024: Big Boost To Yogi Adityanath As NDA Bags 7 Seats; SP Wins Karhal, Shishamau
Big Boost To Yogi Adityanath As NDA Bags 7 Seats In UP Bypoll; SP Wins Karhal, Shishamau
Elon Musk Is Now The Richest Person In History. Check Out His Net Worth
Elon Musk Is Now The Richest Person In History. Check Out His Net Worth
Advertisement
ABP Premium

Videos

Election Celebration Turns into Near-Tragedy as MLA Shivaji Patil Escapes Safe in Shocking IncidentJharkhand Election Results: Where BJP Missed the Mark and How Hemant Soren Turned the Tide?Maharashtra Election Results 2024: How Many Seats Did MVA Party Win? | ABP NewsControversial Article in 'Saamana' Questions Maharashtra Election Results, Sparks Political Stir

Photo Gallery

Embed widget