AI's ability to complete open-ended AI technical tasks is rapidly improving

"Open-ended" tasks are those where the human engineer isn't sure what the answer should look like. Over the course of 8 months, Anthropic's models went from an autonomous success rate of ~20% to ~75% on open-ended technical tasks from Anthropic staff.