Prompting is a management skill now
Why the people who delegate well to juniors delegate well to models, and what that means for hiring.
Two weeks of screen recordings, one honest tally: where the agent earned its keep and where it quietly wasted an afternoon.
We gave a computer-using agent two weeks of real work — expense reconciliation, a device-refresh spreadsheet, and the weekly report nobody enjoys writing — and recorded every session.
The interesting part was not the failures. It was how often the agent got 80% of the way there and then needed a decision only a person could make: which of two inconsistent numbers to trust, whether a refund was worth chasing, when to stop.
Three patterns showed up often enough to name:
Cheaper than an afternoon of my time, more expensive than I expected, and the variance between tasks was wider than the average is useful for.
We close with the week in news: two model releases worth caring about, one procurement story that will matter more than either, and a governance draft that is quietly sensible.
The model was fine. The workflow around it was the problem.
Why the people who delegate well to juniors delegate well to models, and what that means for hiring.
Everyone agrees you need evals. Nobody agrees whose job it is. We work through a real one, badly, then better.