Skilled nursing product in development

Ease currently serves behavioral health organizations and is planning a skilled nursing product. Discuss planned scope and availability.

SNF clinical and purchasing steering groups

SNF Software Pilots: Design a Comparison That Can Change the Buying Decision

Design an SNF software pilot with matched workflows, baseline and comparison periods, safety measures, explicit limits and stop-or-extend decisions.

Quick answer

An SNF software pilot should test a defined purchasing claim with comparable work, a documented baseline, and a credible account of what would have happened without the change. Track safety and work transferred to others alongside efficiency. Decide in advance what would stop the pilot, justify extension or support limited acceptance; a small pilot cannot prove the absence of uncommon harm.

Write a claim that could fail

A pilot question such as “Do staff like the system?” cannot decide whether a facility should purchase an assessment-documentation workflow. Use a testable claim: the configured workflow reduces active completion effort for comparable jobs without increasing missing required information, corrections or delayed handoffs.

Define the intervention precisely: build, templates, roles, devices, training, support and connected systems. If staff receive additional clerical help during the pilot, that help belongs in the intervention description and cost. Otherwise a result attributed to software may depend on a temporary staffing arrangement.

AHRQ's Health IT Evaluation Toolkit overview describes developing an evaluation plan around goals, stakeholder needs and feasible measures. The pilot charter below is an original SNF procurement method, not an agency-prescribed study protocol.

Match the unit of comparison to the question

Select a primary unit, such as a completed documentation job or an admission packet. Define its start, usable finish, eligible population and exception categories. Track staff and shift identifiers using approved study codes so repeated observations can be recognized.

Choose a baseline period before deployment and, where feasible, a concurrent comparison workflow not yet receiving the intervention. Match relevant task types, shift mix, resident complexity, staff experience and device conditions. Record changes to staffing, census, policy and documentation requirements in both periods.

AHRQ's September 2021 comparison-group guidance discusses randomization and selecting similar comparison practices when randomization is infeasible. Its setting is primary care transformation, not SNF software validation. The transferable evaluation principle is to make the alternative explanation for an observed change explicit; it does not make two nursing units automatically comparable.

For an independent facility, a second comparable workflow or staggered, approved deployment may offer useful context. If no credible comparator is available, say the pilot demonstrates feasibility and local change, with limited attribution. Do not create a nominal control group that differs on the factors driving the result.

Publish a compact charter before collecting results

Charter field Worked design choice
Purchase question Does the configured documentation path reduce effort with usable output?
Primary measure Active minutes per eligible completed job, with linked rework
Comparison Baseline and follow-up in pilot and comparison groups
Coverage Relevant shifts, ordinary roles, routine and exception jobs
Balance measures Content omissions, clarification work, delayed handoff and coaching effort
Safety review Resident-identity errors and essential-information failures reviewed independently
Decision Stop, repair/retest, extend for named missing evidence, or accept bounded scope

These are illustrative choices, not validated thresholds. Clinical, records, privacy and operational owners set the actual safeguards. Obtain the facility's determination about any additional evaluation or research review needed before collecting information; the purchase label alone does not settle that question.

Interpret the fictional result with the comparator intact

Every number below is invented. Assume the same task definition and fixed task mix in both periods, with adequate local review of the underlying observations.

Group Baseline active minutes per job Follow-up active minutes per job Change
Pilot 10 7 −3
Comparison 9 8 −1

The pilot improved by three minutes, while comparable work improved by one minute without the pilot. The illustrative difference in changes is (7 − 10) − (8 − 9) = −2 minutes per job. It is a descriptive comparison, not proof of causation or a statistically established effect.

Investigate why the comparison group improved. Both groups may have received a simplified documentation policy; shared staff may have carried pilot practices into the comparison group. Such spillover changes what the result means. Record it instead of discarding the comparator because it weakens the apparent benefit.

Suppose 60 pilot jobs were scheduled, 54 observed and 48 completed without assistance. Report coverage as 54/60 and independent completion as 48/54 observed jobs. Identify the six unobserved jobs. If all were overnight exceptions, the pilot's result does not support that operating scope.

Make safety and transferred work visible

Review omissions and clarification requests with denominators and a consistent follow-up window. A faster job that creates ten minutes of next-shift reconciliation has not demonstrated less total work. Separate normal operating effort from temporary coaching and technical repair; neither disappears because the pilot budget paid for it.

The 2025 SAFER System Management guide addresses configuration, validation and testing of technical components. It provides safety context; it does not certify this pilot or supply a universal stop threshold.

Define an immediate escalation path for wrong-resident information, loss of essential access or other locally designated critical failures. Preserve the affected evidence and use the approved continuity process. A favorable average cannot close those findings. Conversely, zero observed events in a small exposure does not establish a rare-event rate of zero.

End with a purchase disposition, not an indefinite experiment

Accept only the configuration, workflow and population actually supported. For unresolved findings, state whether a repair and repeat test can answer the question or whether the proposed operating model must change.

An extension should name the missing evidence, additional observation plan, safeguards, staffing cost and decision date. If the night shift was absent, adding more day-shift jobs does not repair coverage. If support effort makes the arrangement unaffordable, collect its cost rather than simply prolonging the trial.

Keep rollout sequencing and launch-support staffing in the separate implementation plan. This pilot's deliverable is an interpretable evaluation: what changed, what might explain it, which safety questions remain, and how those facts affect the buying decision.

Questions & answers

Is a before-and-after comparison enough?

It can show local change but cannot by itself separate software effects from staffing, resident mix, seasonal workload or other changes. Document these limitations and use comparable concurrent work when feasible.

When should a pilot be extended?

Extend only to answer a defined unresolved question, such as an untested night shift or insufficient exception cases. Specify the additional observations, time, safeguards and decision date before continuing.

Does no observed harm prove safety?

No. A small pilot has limited exposure and may miss uncommon events. Review critical failure scenarios, incident signals and ongoing monitoring separately from the measured efficiency result.

Primary sources

Use the cited source and its applicable version when making a facility-specific decision. These guides explain operational evaluation methods; they are not individualized clinical, coding, or legal advice.