The Allens AI Australian law benchmark

By Miriam Stiel, Tommy Chen, Anthony Tridgell
3 June 2025

The Allens AI Australian law benchmark is an annual assessment of how effectively generative AI tools can deliver reliable legal guidance. The benchmark explores the capabilities and limitations of market leading large language models, offering valuable insights for legal leaders and practitioners. Building on our 2024 findings, this year's report highlights notable advancements as well as persistent challenges in applying generative AI tools to legal work. Our benchmark is prepared using expert lawyer reviews (rather than automated methods) with a focus on the nuanced considerations commercial litigators, general counsel and all practising lawyers face when integrating new technologies into their work.