Legal professionals are adopting AI at speed, but few can explain why they are using the models they chose or what those models actually cost per query.
Firms are competing to showcase cutting-edge AI capabilities without understanding the underlying economics driving their technology spend each month.
The problem is manageable while AI is priced as a flat-rate seat license, leaving the compute bill as someone else’s financial concern.
But consumption pricing is coming, and when it arrives, every question a lawyer asks an AI assistant will generate its own line item on an invoice.
Nobody inside most firms today can tell you whether that line item will cost a penny or 70 cents, and that uncertainty represents a significant financial risk.
NetDocuments CEO Josh Baxter framed the issue directly in announcing the company’s new benchmark product, warning that the industry is oscillating between “spending without limits and cutting without strategy.”
NetDocuments has published the Legal Context Engineering Benchmark ahead of ILTACON, offering firms a structured way to measure what their AI systems actually deliver for the money spent.
The benchmark is built around a straightforward proposition: three things determine whether a legal AI agent works, specifically the model, the harness built around it, and the context it can access while working.
Existing benchmarks in the legal technology market offer only an incomplete picture of how these three variables interact under real working conditions.
The NetDocuments benchmark addresses this gap by freezing the model and harness variables, then running 300 identical questions across 10 real legal matters on two separate occasions.
The first run relies only on standard search and retrieval, while the second run operates with the Legal Context Graph switched on, allowing direct comparison of outcomes.
By holding the model and harness constant, the benchmark isolates the contribution of context, producing data that firms can use to make informed decisions about AI investment.
The launch comes at a moment when law firms face growing pressure from clients to demonstrate responsible technology spending rather than simply signalling innovation credentials.
Understanding the cost of obtaining a correct answer from AI is fast becoming a practical business question, not merely a technical one for IT departments to consider.
NetDocuments is positioning the benchmark as a tool that brings financial discipline to AI adoption, giving firms a framework before consumption pricing forces the issue.