Skip to main content

Your web browser is out-of-date. For the best experience, please update to a modern browser like Chrome, Edge, Safari or Mozilla Firefox.

Evaluation planning for psychological health and safety

Key takeaways

  • Define your evaluation goals before taking action so you can measure whether your efforts improved psychological health and safety and used resources effectively. 
  • Track both short-term and long-term outcomes using practical measures, feedback and data to understand what’s changing over time. 
  • Review results regularly and use what you learn to adjust, strengthen or stop actions so your approach keeps improving. 

Before implementing your planned actions for improving psychological health and safety (PHS), it’s important to decide upon your evaluation strategy.  

The following is adapted from Guarding Minds at Work.

Some evaluation questions to consider are: “How will we know whether these actions achieved our intended outcomes?” Or “How will we know whether our investment in time, effort and money was worthwhile?” 

Effective evaluation is:

  • Practical –clearly relevant to your intended outcomes, straightforward, measurable, easy to implement, and cost-effective
  • Flexible – adaptable to your workplace and its available resources
  • Continuous – uses an ongoing quality improvement approach where employee feedback is provided over time and used to modify and improve interventions

Step 1: Decide the purposes of the evaluation

There are many reasons for doing an evaluation, including a commitment to:

  • Accountability – demonstrating to leadership or a funding body that promised results were obtained and resources used appropriately
  • Quality improvement – an ongoing process of enhancing the excellence of services or products
  • Examination of specific outcomes – tracking the progress of specific changes identified as priorities for the organization
  • Cost-effectiveness – conducting a comprehensive analysis of outcomes in relation to the resources needed to accomplish them
  • Uptake – determining the extent to which employees or other target groups participate in the planned actions
  • Fidelity – determining whether actions were implemented consistent with the plan
  • Sustainability – forecasting the degree to which the actions can be maintained over the long term

Identify the purposes and methods of evaluation before initiating the action so you will have a clear and useful answer to the question of whether it worked as planned.

Step 2: Identify key informants

Key informants are those who will provide evaluation data for each action. These key informants might include senior leaders, human resources, health and safety committee members, employees, benefit providers, supervisory staff with responsibility for carrying out the planned action, union representatives, and occupational health and safety staff.  

The role of your health and safety committee

Occupational health and safety (OHS) legislation includes mandates that employers and employees share responsibility for workplace health and safety. Your health and safety committee members play an important role as key informants.  

OHS identifies psychological well-being as a part of overall health, which implies that psychosocial hazards at work which can present a risk to employee health are included as workplace hazards. It’s part of any health and safety committee’s duty to identify, assess, and recommend controls to protect against psychosocial harms.  

You want to ensure members of the committee are engaged in evaluating psychosocial hazards. The committee members’ roles will focus on:  

  • Engaging and reviewing - Review evaluation plans, methods, and anonymized data to ensure the process is valid and comprehensive. 
  • Recommending solutions - Use the evaluation results to recommend specific, measurable, and systemic solutions to the employer. 
  • Supporting work refusal - Ensure the evaluation framework supports the right of workers to refuse unsafe work if psychosocial hazards are extreme and unaddressed. 
  • Ensuring legislative compliance - Monitor the evaluation to ensure it meets due diligence requirements, focusing on eliminating or reducing hazards at the source. 

There are boundaries for the health and safety committee. These include:  

  • Focusing on evaluating the systems and the work environment - For example, members of the health and safety committee would measure hazards within workload management and organizational culture, but they shouldn’t be a part of clinical evaluation, provide mental health diagnoses, or assess the personal health status of individual employees.  
  • Ensuring confidentiality is protected throughout the evaluation process - They can do this by making sure data is aggregated and anonymized to protect employee privacy under provincial or territorial privacy laws and OHS legislation. The health and safety committee’s focus should be on organizational trends, not individual cases. 

Step 3: Make a list of short-term and long-term outcomes to measure

Change can take time. If you focus only on long-term outcomes, you may become discouraged. In addition to setting your long-term goals, identify desired short-term outcomes, which provide rapid feedback and are typically easier to measure. 

Short-term measurements and approaches could include:

  • Participation – simply measure how many people take part in your action.
  • Behaviour changes – note how many times participants are doing things differently. In this case, be specific in advance about the change you are looking for and how you will have participants or their leaders report this activity to you.
  • Absenteeism – track the number of days off before and after the action. Note that if the discussion was about mental health, an increase in absenteeism may represent people finally seeking out treatment for their condition. Look for ways to maintain confidentiality while tracking the reason for absence.
  • Complaints, conflict, or grievances – track the number reported before and after the action. Note that in some cases, these may increase first as employees understand what appropriate behaviour is, so a short-term increase can represent a positive as well.
  • Awareness – survey employees to determine the level of awareness about whatever you are covering such as resources or policies, and do it again after the action has been implemented.
  • Policy or process change – identify any changes made to existing policy or process as a result of your action.
  • Participant evaluation – asking specific questions related to the experience of the action and intentions going forward to implement change can be very useful data.
  • Supervisor evaluation – ask the supervisors of participants direct questions about changes in participant behaviour before the action is implemented and, in the days, weeks, or months following the action.
  • Focus groups – bring together participants to get feedback about how the action has impacted them.
  • Stress Satisfaction Scan – this 6-question survey can be administered before and after the action to measure how employees feel about work.

Long-term measurements provide enough time for sustainable change to happen and could include any of the above or either of the following:

  • Re-survey – Readministering the survey can help you compare baseline data to current measurements after 1 or 2 years. This is one cost-effective way to measure some of the results.
    • Timelines will be unique to each workplace, but an example could be:  
      • Year 1 – Commitment and planning  
      • Year 2 – Implementation of the plan  
      • Year 3 – Evaluation of outcomes  
      • Year 4 – Cycle begins again with continuation of successful strategies and the addition of corrective or improvement actions
    • Remember that change takes time. Many strategies may take 2 or 3 years to have measurable results.    
    • Measures set during the planning stage should be reviewed, including:  
      • Achievements  
      • Challenges  
      • Quality of work  
      • Productivity  
      • Worker satisfaction  
      • Customer or client satisfaction  
      • Input, feedback and engagement  
      • Accountability measures for long-term outcomes  
    • Also consider:  
      • What’s working well, so it can be sustained  
      • Corrective actions that could improve results  
      • Developing a list of possible next steps  
      • Celebrating successes  
  • Data analysis – several relevant sources of data are suggested for each psychosocial factor in the organizational review. This data could be analyzed before action is taken and 13 or more months later. 13 months allows enough time to compare data from the same time period as when the action was first implemented.

Step 4: Use short-term evaluation results to modify

The short-term evaluation results can be used to make adjustments to the action. You may even want to launch a pilot to determine what is working well and perhaps should be enhanced or expanded. And those elements that don’t seem to be reaching their objectives could be changed or dropped. Identifying challenges to success early on allows you to take corrective action that can positively influence your long-term results. 

If the short-term outcomes look positive, communicating this can improve overall morale and commitment to your process of improving PHS. 

Step 5: Collect long-term outcome results

After a few cycles of short-term outcome evaluation and action improvement, it’s a good idea to review your long-term evaluation strategy. Are you still on track to measure what is important to the success of this action or do you need to make some adjustments to the data collected?

Ensure the data collection process is working. 

Step 6: Analyze results

Think critically about the evaluation results you have collected and develop a report. This report can be in the form of a slide presentation, video, podcast or publication, but make it easy for all to access and understand. Be transparent about whether your intended outcomes were achieved, and include both challenges and successes. 

Step 7: Present your results and decide next steps

The purpose of evaluation is for continual improvement. Present your results to both employer and employees for feedback about what went well and what could be done differently. Make your decision about whether to refine, continue or discontinue the action in collaboration with others.

Change takes time and effort. Good evaluation processes help you measure and improve effectiveness. Remember to celebrate successes along the way! 

What’s next?

  • Prioritize and choose evidence-based actions most likely to improve psychological health and safety in your work environment. Use this Creating change process to help you think through the options and guide your decision making.
  • Consider these evidence-based actions that can improve each psychosocial factor. In most cases, you'll find free resources to help you move forward with or without funding.