Researchers tracked 112 professional developers using AI agents on the job and found they plan tasks, review every diff, and limit agent scope rather than handing off vague prompts. In trials, AI slowed senior devs by 19% and produced merged PRs only 8% of the time, revealing a 92% failure rate when agents ran unsupervised.

Engineers face difficulties in transitioning from deterministic programming to probabilistic agent engineering, as they often struggle to trust the adaptive capabilities of AI agents. Traditional practices, such as strict typing and error handling, clash with the need for flexibility and context-aware interactions in agent systems. Emphasizing the importance of semantic understanding and behavior evaluation, engineers are encouraged to embrace a new approach that balances trust and oversight.