FlatClaw, Private AI Platform
All use case spotlights
Analytics & ReportingKnowledge SearchHealthcare

Sleep-therapy provider

≈ $60M revenue (approx.) · 40 clinics · one clinical reporting app

Natural-language clinical reports

Clinicians ask for patient cohorts in plain English and a constrained pipeline turns the question into validated filters, never free-form database queries, on a private GPU that costs a fraction of the hosted model it replaced.

Organization
Sleep-therapy provider with a clinical reporting application
Question
Could a small open model replace the hosted model in a constrained parser?
Runs on
A single cloud project with an inexpensive GPU
Scope
Natural-language report queries, validated before execution
The situation

Where they started.

Clinicians wanted to ask for cohorts in plain English: patients within a range of adherence, a number of days, a device condition. The existing parser used a hosted frontier model, which meant every question left the provider's environment and cost money per call. The team needed to know whether a private model could match it before committing.

What FlatClaw does

What was built.

  • A constrained-intent pipeline: the model emits a fixed schema that is checked against an allowlist of fields before anything runs; never free-form database queries.
  • A small open-weight model served on an inexpensive GPU inside the same cloud project as the application, so inference never crosses the boundary.
  • A provider seam that lets the application switch between the hosted model and the private one with an environment variable.
  • The provider's own benchmark questions replayed against both to settle the question with evidence.
Results

What changed.

  • The open model reproduced the hosted model's answers on nine of ten benchmark questions; the tenth was unverifiable in the original logs.
  • Every query valid against the schema; no invented fields.
  • Inference at a fraction of the hosted model's cost, and the GPU can be paused when idle.
  • A dress rehearsal for larger private deployments on the same pattern.
Why private

Clinical data belongs inside the provider's boundary. Keeping the parser's model in the same project made the privacy claim mechanical rather than contractual.

Runs on

A single cloud project, private inference endpoint

The stack

Components involved.

Constrained-intent parserOpen-weight model on a small GPUSchema and field allowlistDjango application in the same projectPrivate inference endpoint
Your workflow

Have one like it?

Every spotlight started as a conversation about a process nobody liked doing, under a data-locality constraint.