🚨🚨 NEW RESEARCH ALERT! 🚨🚨
Excited to release new WP with lab colleagues @kennywongchamch@krisgulati and #MinMinFong.
This paper asks a simple question: how do we rank models on real work tasks when they are coaching rather than when they're playing?
Answer: the best
Honestly, I’m surprised I haven’t seen a paper showing the impact of employee-level LLM managerial assistance yet.
The Econ literature shows strong effects for management training in general. Anecdotally people use LLMs for this anyway.