How do I use the D.4 method kit?

The D.4 method kit was developed based on the findings from expert interviews, literature research and pilot studies obtained during the project. The main dimensions for localising the various tools are, on the one hand, a generic view of a hospital's inpatient process (planning stay - admission/admission - treatment - transfer/discharge) and, on the other hand, the three KPIs of efficiency, quality and satisfaction. This matrix currently contains 12 criteria or tools for analysing benefits, consisting of instructions and corresponding templates. The instructions contain a brief description of the respective tool or criterion, calculation principles, a description of the procedure, necessary resources, aids and tips and tricks. The templates are designed to provide a basic structure for carrying out and analysing benefit quantifications, but can be adapted to the individual context of the respective user. The method kit thus offers tools and approaches that can be used flexibly. The criteria and instructions listed serve as orientation and examples, but are not exhaustive. Check and adapt them to your specific situation and institution.

The D.4 method kit was developed to systematically analyse the benefits of digital health tools and make them measurable. It focuses on digital technologies that fall into the Tier A category of the NICE Evidence Standards Framework (ESF). This category includes digital health solutions that aim to increase process efficiency, save costs or free up staff time without having a direct impact on patients, health or care/treatment. It is important to note that the toolkit is not suitable for the evaluation of digital health tools that fall into other categories of the NICE ESF, particularly those with a direct impact on patient care. The use of the toolkit should therefore be limited to appropriate tools to ensure valid and relevant results.

The method kit can be used by both a hospital and a digital health tool provider.

As a hospital:
The D.4 method kit is used in hospitals in a step-by-step and practical manner. Using the example of the introduction of a tool for online appointment allocation (as a replacement for making appointments by telephone), the following procedure applies:

1. Identify the process: Select the specific process step that the tool relates to - e.g. "planning a stay".
2. Determine the relevant dimension: Decide which aspect you want to measure: Efficiency, quality or satisfaction. → In the example: Efficiency (focus on time and cost savings).
3. Select suitable instructions: Select the appropriate evaluation template from the selected dimension. → In the example: "Calculation of administrative process costs patient registration".
4. Customise instructions and templates: Transfer the selected instructions to your environment. Use the "Process observation" and "Evaluation of process observation" templates and adapt them to your specific processes.
5. Start implementation: As soon as the tools have been customised, you can start collecting, evaluating and assessing the benefits.

As a digital health tool provider:
The D.4 method kit supports digital health tool providers in demonstrating the benefits of their product in a structured way and targeting hospitals. The procedure includes:

1. Identify relevant process steps: Determine where in the hospital process your tool specifically comes into play.
2. Create a data basis: Use existing data or collect new data together with a hospital using the method kit.
3. Develop calculation logic: Develop a benefit calculation tailored to your tool - as the basis for a fast assessment tool.
4. Test the tool: Test your benefit assessment in practice.
5. Forecast benefits: Use your fast assessment tool in discussions with healthcare providers to quickly and clearly demonstrate the potential added value.

Example: The fast assessment tool from heyPatient, developed as part of the SHIFT-D.4 sub-project.

Depending on the user group, the following recommendations can be derived for the use of the method kit:

As a hospital:

• Start with a clearly defined process step: choose a narrowly defined, practice-relevant area (e.g. "planning stay") in order to visualise concrete potential.
• Focus on a relevant evaluation perspective: for example, opt for efficiency if you want to save resources or time - instead of evaluating several dimensions at the same time.
• Use the templates in the method kit, but adapt them: The instructions (e.g. "Calculation of administrative process costs") are examples - they should be tailored to your actual processes and terms.
• Create interdisciplinary collaboration: Involve IT, administration, nursing and medical professionals together - this improves data quality and acceptance.

As a digital health tool provider:

• Choose the specific process that your tool addresses: clearly define where your tool intervenes in the hospital process - this makes it easier to communicate the benefits.
• Create a reliable data basis: Work together with a hospital or use existing data to quantify real potential.
• Create a simple fast assessment tool: Develop a standardised calculation logic with which you can quickly present your benefits (e.g. time savings) - like the heyPatient example.
• Test your fast assessment tool before using it: This will ensure that it is comprehensible, convincing and realistic - ideally using real process data.
• Use the tool strategically in customer meetings: Use it as a basis for discussions with hospitals to make concrete, data-based value propositions from the outset.
• Use a common language with hospitals: By using the method kit, you speak the same methodological language as potential healthcare providers - this facilitates cooperation.