bloop | Evaluating LLMs on COBOL
Modernising legacy code with AI
Source: bloop.ai
Stay updated with breaking news from Humaneval Python. Get real-time updates on events, politics, business, and more. Visit us for reliable news and exclusive interviews.
A new study describes how some GPT-4 capabilities have degraded, though users could simply be figuring out the AI isn’t all that smart.
ChatGPT is changing, though so far it’s been incredibly hard to say how or why. Users have widely complained that the GPT-4 language model powering the paid version of OpenAI’s chatbot has been degrading over time, spitting out false answers and declining to follow through on prompts it once happily abided. New research shows that, indeed, the AI has experienced some rather thorough changes, though maybe not in the ways users expect.