Where AI Can Assist in a Human-Service Workflow — and Where It Should Not

The question is rarely whether to use AI

In most organizations the tools are already present in some form — in a documentation product, an inbox, a scheduling system, or a staff member's browser. The useful question is narrower: for which specific steps of which specific workflow, under what review, with what record of who is accountable.

Framing it that way moves the conversation from a general position on technology to a set of decisions that operational and clinical leaders are already equipped to make.

Three categories that hold up in practice

• Assist — reorganizing, summarizing, drafting, extracting, formatting, or surfacing something a person will read next. The output is an input to human work.
• Review — flagging, comparing against a standard, or prioritizing a queue. The output changes what a person looks at first, so calibration and monitoring matter.
• Decide — anything that determines eligibility, acuity, level of care, risk disposition, discipline, or benefit. This stays with an accountable person and should not be delegated to a model.

What makes an assist point a good candidate

• The task is high-volume and repetitive relative to its consequence.
• A competent person can verify the output quickly, without reconstructing it from scratch.
• Errors are visible rather than silent, and are caught before they reach a person receiving services.
• The step does not require information the organization should not be putting into the tool.

What makes a step unsuitable

• The output would be acted on without anyone reading it.
• Verification would cost more than doing the task directly.
• The step encodes a judgment that a licensed or otherwise accountable role is required to make.
• The failure mode is quiet — a plausible, well-formed output that is wrong in a way no one downstream would notice.

Write the boundary down before the pilot

The scope of use, the required review, the escalation path when the output looks wrong, and the named owner should exist as a short written statement before anything is turned on. It does not need to be a long policy. It needs to be specific enough that a new staff member could read it and know what they are and are not permitted to do.

That statement is also what makes later evaluation possible. Without it, there is no agreed standard against which the workflow can be reviewed.