AI can fix bugs—but can’t find them: OpenAI’s study highlights limits of LLMs in software engineering
February 19, 2025
Large language models (LLMs) may have changed software development, but enterprises will need to think twice about entirely replacing human software engineers with LLMs, despite OpenAI CEO Sam Altman’s claim that models can replace “low-level” engineers. In a new paper, OpenAI researchers detail how they developed an LLMs benchmark called SWE-Lancer to test how much foundation models can…