In recent months, we have seen a surge of excitement in the world of Artificial Intelligence<\/strong> (AI). Each new model, boasting impressive capabilities and groundbreaking features, generates buzz across social networks<\/strong> and specialized communities. However, a strange phenomenon is unfolding: as the initial excitement fades, users who once relied on these tools begin to express disappointment<\/strong>. What was once seamless, efficient, and dependable now seems to falter as the models exhibit signs of degradation<\/strong>.<\/p>\n One prime example is Gemini 2.5 PRO<\/strong>, which, upon its launch, was met with widespread acclaim for its speed, affordability, and large context window. Users hailed it as a “beast in programming.” Yet, within weeks, discontent emerged, primarily voiced on platforms like Reddit<\/strong>. Users described the model as \u201cunusable\u201d and criticized its output for producing \u201cabsolute nonsense.\u201d A July user reported a conversation in which the assistant repeatedly acknowledged its errors, leading to confusion and frustration. Others lamented that the assistant would cut off responses abruptly, leaving users with incomplete answers.<\/p>\n As AI models gain traction, they often enter a cycle<\/strong> where early enthusiasm turns to skepticism. These models, including Google\u2019s Gemini, were celebrated for their innovations but quickly faced backlash as their performance began to wane. Users highlight a significant decline in quality, noting that exchanges that once flowed easily became awkwardly incomplete and error-prone. <\/p>\n Interestingly, Claude<\/strong>, another well-regarded AI, has also faced similar criticisms. Users noted a dip in its performance comparable to that of Gemini, particularly with its Claude Code<\/strong> variant. It appears to be a systemic issue affecting even the most robust AI tools. <\/p>\n The root of this degradation seems to be a matter of resource allocation<\/strong> and model scaling. Users voicing their suspicions have noted what they call \u201ccut models.\u201d One user on Hacker News<\/strong> speculated that as the demand skyrockets, companies might resort to \u201cdistilled versions\u201d of their AI models. These lighter versions sacrifice quality, leading to a diminished user experience.<\/p>\n Ian Nuttal, a prominent developer, has expressed frustration over Claude\u2019s performance, stressing that he would invest in a dedicated version that wouldn\u2019t suffer during peak usage. Alex Finn, another developer, echoed this sentiment, highlighting that similar issues have plagued his experience with various AI programming tools.<\/p>\n The sensation that AI models are becoming less effective is not merely anecdotal. In March 2023, users of GPT-4<\/strong> began to express concerns that the model had \u201cbecome silly.\u201d While OpenAI responded to these criticisms by asserting that newer versions were inherently smarter, research from experts at Berkeley<\/strong> and Stanford<\/strong> painted a different picture. Their academic paper revealed a \u201cspectacular precision drop\u201d in GPT-4’s capabilities from March to June. The likelihood of generating executable code, for instance, plummeted from 52% to 10%<\/strong> in that timeframe.<\/p>\n Additional studies at the end of 2023 corroborated these findings, showing a notable decline in quality between the December and May models. As the gap between user expectations and actual performance widens, it raises questions about the current state and future trajectory of AI.<\/p>\n Even major players like OpenAI<\/strong> and Anthropic<\/strong> are acknowledging the problems within their leading models. In December 2023, OpenAI conceded that they had received feedback about their assistant becoming increasingly vague and unpredictable. They clarified that no updates had been made to the model and recognized the issues surrounding it.<\/p>\n Conversely, Anthropic<\/strong> admitted to challenges with Claude Code, reporting slower response times amid user complaints. Those who once enjoyed seamless interactions found themselves stymied, unable to progress with previously straightforward tasks.<\/p>\n The user experience with AI tools is undoubtedly evolving, but not in a direction that fosters confidence. As excitement gives way to disappointment<\/strong>, it prompts users to devise creative solutions to improve performance. Some have found success through unconventional methods such as offering tips or humorously explaining their limitations, like lacking fingers to type code.<\/p>\n While the promise of AI remains potent, the current wave of dissatisfaction underscores the importance of quality and reliability in these models. As tech continues to advance, so too must the development and maintenance of AI systems, ensuring they meet the needs and expectations of the users they serve. Only then can we hope to restore the magic that AI once held for its community of enthusiasts and developers alike.<\/p>\nThe Rise of \u201cSuper Broken\u201d Models<\/h3>\n
The Mystery of Model Degradation<\/h3>\n
Hard Data Behind User Sentiment<\/h3>\n
Admitting the Issues<\/h3>\n
The User Experience: An Ongoing Journey<\/h3>\n