The Allens AI Australian law benchmark

The Allens AI Australian law benchmark is an annual assessment of how effectively generative AI tools can deliver reliable legal guidance. The benchmark explores the capabilities and limitations of these models, offering valuable insights for legal leaders and practitioners. Building on our 2024 findings, this year's report highlights notable advancements as well as persistent challenges in applying generative AI tools to legal work. Our benchmark is prepared using expert lawyer reviews (rather than automated methods) with a focus on the nuanced considerations commercial litigators, general counsel and all practicing lawyers face when integrating new technologies into their practice.

By Miriam Stiel, Tommy Chen, Anthony Tridgell, Alisha Arora and Paul Mersiades, with special thanks to Peter Church at Linklaters LLP.

30 May 2025