Incident Management takes time, and incidents need responders that are trained and experienced.
Slack uses self-service training and live courses based on prepared content as part of their incident management program.
The missing piece in training staff on incident response is the availability of practical experience before joining a real incident.
Slack developed the Incident Lunch exercise which teaches incident response through constraints, role-playing, time-pressure, and fun.
In this exercise, participants are assigned roles and must obtain lunch for everyone in the room using incident response practices.
The exercise, now available for any employee to join, has minimal resource requirements and can be run on a regular basis.
Chaos Cards were added to the exercise to add an element of unpredictability and realism to the situation.
The Incident Lunch exercise works well for both the team running it and participating staff, as it requires minimal preparation and involves non-technical staff as well.
The exercise can reveal the predisposed skill set of participants which can be useful for internal recruitment or building up ICs who seek more experience.
The only major limitation of the exercise is that it can only be run in person and not remotely. Alternate versions could be developed for hybrid or remote work environments.