Hardware.
For a specialised compact model at practice scale, a single modern GPU with headroom for key-value cache at realistic document lengths.
MKC2 results ↗For a practice, the question is not whether a model is capable. It is whether client material has to leave the building for the model to read it.
01 / DEFINITION
The short answer first.Private legal AI is the deployment of AI models on infrastructure a practice controls, so that privileged and confidential client material is never transmitted to a third-party inference service. Prompts, documents and outputs remain inside the practice's own boundary.
The argument is simpler here than in most industries. Client material is confidential by default, and the strongest statement a practice can make about it is that it did not leave. That is a property of the architecture rather than of a contract, and it is verifiable: a reviewer can enumerate the network destinations the inference path can reach.
MKC2 was built this way. It runs entirely offline, reviewing AI-generated legal drafting and the actions of legal AI agents without any external inference call. See MKC2.
WORKED EXAMPLE
A firm wants an assistant to locate inconsistent dates across a draft and an exhibit. Keeping inference inside the firm's environment addresses an important processing boundary, but it does not decide which matters a user can open, where extracted passages are logged or who can export the result. Begin with a fictional matter and trace one document through the complete review route.
Give an authorised reviewer a draft and two exhibits containing similar dates. Ask the system to identify the discrepancy and quote the passages. Then run a related question as a reviewer assigned to another matter. Both the document and its derived artefacts need the matter restriction. An embedding, cached answer or saved work product can reveal the same detail as the original file.
Test the reappearance of a previously authorised session after access is withdrawn. Confirm that the application checks current permissions before retrieval and again before export. Keep the audit record useful to administrators without copying the confidential passages into a broadly accessible log.
Finally rehearse a correction. The attorney should be able to mark the discrepancy immaterial, record the reason and preserve the originally proposed finding for later review. A private system is most useful when its boundaries and review history remain demonstrable through ordinary operation, staff changes and recovery from a backup.
02 / WHAT A PRACTICE ACTUALLY NEEDS
| Component | Requirement specific to legal work |
|---|---|
| Inference | Local execution, no external calls, pinned version |
| Retrieval | Matter-level and client-level access filtering at query time |
| Conflicts and walls | Hard separation that a query filter cannot accidentally omit |
| Provenance | Every retrieved passage traceable to a document and version |
| Authority | Review-only by default; no action on a live matter |
| Records | What was asked, what was retrieved, what was produced |
Matter-level access control is the requirement that most often forces an index rebuild. Retrieval has to be filtered by the requesting person's entitlement to that matter, applied before relevance scoring, with permission changes taking effect immediately. An index that reflects last night's permissions is enforcing last night's ethical walls. See RAG access control.
Where the separation is a hard boundary rather than a preference, partitioned indexes are stronger than filters, because isolation becomes structural rather than dependent on a filter being applied correctly on every query path.
03 / WHAT IT COSTS TO RUN
For a specialised compact model at practice scale, a single modern GPU with headroom for key-value cache at realistic document lengths.
Capacity monitoring, driver and firmware compatibility, a controlled update route for an isolated network, and someone available for hardware failure.
A held-out set drawn from the practice's own material, with the standard written by the practitioners who own the work.
A queue ordered by calibrated confidence, and a recorded disposition for every flag, which is what eventually measures the system on live work.
Step three is the one that determines whether the deployment is trusted. Vendor figures on public datasets say little about performance on one practice's documents, vocabulary and definition of a defect. Building the set is the work that converts an interesting system into one practitioners rely on, and it belongs to the practitioners rather than to engineering. See legal AI evaluation.
Step four is the route to evidence nobody currently has. Privilege AI states plainly that no attorney dispositions have been recorded for MKC2, so its published figures describe held-out evaluation rather than agreement on live matters. A disposition record is how that gap closes.
04 / WHAT PRIVATE DEPLOYMENT DOES NOT SETTLE
A local system with an unpermissioned index still lets anyone read every matter. Private and access-controlled are different properties.
Competence, confidentiality and supervision rest with the practice. A system can support them; it cannot discharge them.
Citations and propositions still require checking. The system's job is to direct that checking, not to remove it.
Rules of professional conduct and any client-specific undertakings differ by jurisdiction and engagement, and are a matter for the practice. What a technology supplier can legitimately offer is a system whose data boundary, measured performance and authority limits are precise enough to be assessed against those rules — which is the standard Privilege AI holds its own published work to.
05 / QUESTIONS
No. Open-weight models fine-tuned for specific tasks run on local hardware, and a well-chosen specialised model can outperform a larger general one on that task. MKC2 runs entirely offline.
It is a meaningful assurance about provider behaviour, not a change in where processing happens. Whether that distinction matters is a judgement for the practice, and for material that is confidential by default it usually decides the architecture on its own.
For a specialised compact model with moderate concurrency, a single modern GPU with enough memory for weights plus cache at realistic document lengths. The sizing arithmetic is in private AI infrastructure.
As hard filters applied at query time from the authoritative source, and preferably as partitioned indexes so the isolation is structural. A nightly permission synchronisation is not adequate for a boundary that exists to prevent a specific person seeing a specific matter.
That is one of its advantages. Every component is inside the practice's boundary: the model version, the index, the retrieval logs and the review dispositions are all available for inspection, which is rarely true of a hosted service.
WORK WITH PRIVILEGE AI
Keep privileged material inside.
We build AI for legal work that runs inside your practice's own environment.
Specialised for the task.
Models are developed for the legal work you need done.
Clear limits.
We state what the system can and cannot do, so it can be assessed properly.
Talk with Privilege AI
Tell us where matter material may be processed, who can review the output and which data must remain inside your environment.
CONTACT PRIVILEGE AI
Tell us where matter material may be processed, who can review the output and which data must remain inside your environment.
Privilege AI builds specialised models and private inference for work where confidentiality is the default.