AI Chatbot ChatGPT Fails UPSC Prelims Exams: Report

UPSC is generally considered the most challenging examination in India. Proving the same, even ChatGPT could not pass the UPSC exam.

ChatGPT could only answer 54 out of 100 questions.

Since its launch in November, 2022, ChatGPT, an AI chatbot gained immense popularity for its incredible performance in various fields. ChatGPT may have aced the Master of Business Administration (MBA) programme at the prestigious University of Pennsylvania's Wharton School but it failed the UPSC Civil Services Prelims exam.

Analytics India Magazine tested the chatbot in one of the toughest exams, UPSC. However, it failed the exam. Chatbot could only answer 54 out of 100 questions from Question Paper 1, Set A, of the UPSC Prelims 2022.

The magazine noted that the AI chatbot failed to meet the 87.54% cut-off for general category students in the 2021 UPSC Prelims exam. The exam questions covered various topics, including geography, economics, history, ecology, science, current affairs, social development, and polity.

The Analytics India Magazine stated that ChatGPT's knowledge is restricted to September 2021, which means that it cannot answer questions related to current events. However, the chatbot provided incorrect responses to subjects like Economy and Geography, which do not necessarily have a time-specific nature.

Furthermore, in certain multiple-choice questions, the chatbot introduced an additional option that was not present in the original question and marked it as "None of the above."

Recently, ChatGPT has been prohibited by numerous institutions. The AI-powered tool gained attention for its witty comments, prompt assistance, and aid to students in their academic assignments. As the Central Board of Secondary Education (CBSE) Board Exams are currently going on, the Board has released a set of exam instructions including prohibiting the use of Artificial Intelligence-based ChatGPT.

About UPSC CSE Exam

The Civil Services Examination or UPSC CSE is a national competitive examination in India conducted by the Union Public Service Commission for recruitment to higher Civil Services of the Government of India, including the Indian Administrative Service, Indian Foreign Service, and Indian Police Service. UPSC conducts the exam every year and around 7-8 lakh aspirants register for the exam.