How Effective are Tabletop Role-Playing (Serious) Games in Understanding and Validating the Predictive Capabilities of Disaster Response Agent-based Models?

Authors

  • Nimisingha Jacob Amakama Laboratory for the Science of Risks (LSR), IMT Mines Ales, France
  • Gilles Dusserre Laboratory for the Science of Risks (LSR), IMT Mines Ales, France
  • Axelle Cadiere CHROME, University of Nimes, France
  • R. Wade Schuette Shewnexti LLC, USA
  • Gregory Zacharewicz Laboratory for the Science of Risks (LSR), IMT Mines Ales, France

DOI:

https://doi.org/10.54536/ajmri.v3i4.2937

Keywords:

Agent-based models, Disaster response, Tabletop exercise, Role-playing games, Validation

Abstract

Tabletop Role-Playing Games (TRPGs) for disaster response management are collaborative exercises in which participants take on the roles of characters, guided by a “Game Master.” TRPG are useful tools for training, improving the preparedness of emergency responders, and understanding/validating Agent-Based Models (ABMs). This study evaluates the knowledge of participants and assessed the effectiveness of utilizing TRPG in validating a NetLogo model. Medical doctors and master’s students were divided into two groups, who participated in the exercise based on defined disaster response strategies. The central components of the ABM were transformed into a Disaster Response Tabletop Role-Playing Game (DRTRPG). Medical doctors and master’s degree students were assigned to two groups in the exercise that is based on defined disaster response strategies. Multichoice pre- and post-assessment tests were used to evaluate each group’s knowledge, while a performance scoring matrix was used to generate data from in-game activity. Data was analyzed using Pandas and MS Excel data analytical tools. Pre and post-assessment test results (n = 8) showed an 11.5% and 3.1% increase in knowledge for medical doctors and students on disaster and healthcare decision-making, respectively. Visual comparison between the ABM and DRTRPG results reveals partial model validity. However, statistical comparison shows a clear variation in the outcomes. The “Alternate” policy strategy resulted in better disaster response outcomes. The design and implementation of the DRTRPG resulted in a collaborative understanding and communication of the ABMS model with promising results. However, there are significant statistical differences between both methodologies, highlighting the challenge of validating the predictive capabilities of ABMS using RPGs.

Downloads

Download data is not yet available.

References

Ademiluyi, F., Amadi, S., & Amakama, N. (2010). Adsorption and Treatment of Organic Contaminants using Activated Carbon from Waste Nigerian Bamboo. Journal of Applied Science & Environmental Management, 13(3). https://doi.org/10.4314/jasem.v13i3.55351

Alejandria, L. N., Bajenting, J. M. S., Pacatan, M. a. L. D., & Diquito, T. J. A. (2023). The use of educational board game as a supplemental tool in learning periodic table of elements among senior high school students. American Journal of Education and Technology, 2(1), 60–67. https://doi.org/10.54536/ajet.v2i1.1292

Alonso-Fernández, C., Freire, M., Martínez-Ortiz, I., & Fernández-Manjón, B. (2021). Improving evidence-based assessment of players using serious games. Telematics and Informatics, 60, 101583. https://doi.org/10.1016/j.tele.2021.101583

Alonso‐Fernández, C., Martínez‐Ortiz, I., Caballero, R., Freire, M., & Fernández‐Manjón, B. (2019). Predicting students’ knowledge after playing a serious game based on learning analytics data: A case study. Journal of Computer Assisted Learning, 36(3), 350–358. https://doi.org/10.1111/jcal.12405

Amakama, N. J., Dusserre, G., Cadiere, A., & Schuette, R. W. (2023a, September 5). Assessing the impact of wait times on patient mortality outcomes in a hypothetical oil and gas industry disaster scenario: An Agent-Based Modeling Approach using NetLogo. https://imt-mines-ales.hal.science/hal-04199308

Amakama, N. J., Dusserre, G., Cadiere, A., Schuette, R. W., Zacharewicz, G., & Ahmed, N. (2023b, September 11). An Evaluation of the Effect of Ambulance Strategy on Patient Mortality Outcome from Hospital Systems: a Simulation Study in the Context of Industrial Disaster Response. https://imt-mines-ales.hal.science/hal-04208574

Anand, N., Meijer, D., Van Duin, J., Tavasszy, L., & Meijer, S. (2016). Validation of an agent-based model using a participatory simulation gaming approach: The case of city logistics. Transportation Research. Part C, Emerging Technologies, 71, 489–499. https://doi.org/10.1016/j.trc.2016.08.002

Antelmi, A., Cordasco, G., D’Ambrosio, G., De Vinco, D., & Spagnuolo, C. (2022). Experimenting with Agent-Based Model Simulation Tools. Applied Sciences, 13(1), 13. https://doi.org/10.3390/app13010013

Bowman, S. L. (2010). The functions of role-playing games: How participants create community, solve problems and explore identity. McFarland.

Cheng, P. H., Yeh, T. K., Chao, Y. K., Lin, J., & Chang, C. Y. (2020). Design ideas for an Issue-Situation-Based board game involving multirole scenarios. Sustainability, 12(5), 2139. https://doi.org/10.3390/su12052139

D’Aquino, P., & Bah, A. (2014). Multi-level participatory design of land use policies in African drylands: A method to embed adaptability skills of drylands societies in a policy framework. Journal of Environmental Management, 132, 207–219. https://doi.org/10.1016/j.jenvman.2013.11.011

De Rouck, R., Benhassine, M., Debacker, M., Dugauquier, C., Dhondt, E., Van Utterbeeck, F., & Hubloue, I. (2023). Creating realistic nerve agent victim profiles for computer simulation of medical CBRN disaster response. Frontiers in Public Health, 11. https://doi.org/10.3389/fpubh.2023.1167706

Deinkuro, N. S., Knapp, C. W., Raimi, M. O., & Nimlang, N. H. (2021). Environmental Fate of Toxic Volatile Organics from Oil Spills in the Niger Delta Region, Nigeria. International Journal of Environment, Engineering and Education, 3(3), 89–101. https://doi.org/10.55151/ijeedu.v3i3.64

Dubois, E., Barreteau, O., & Souchere, V. (2013). An Agent-Based model to explore game setting effects on attitude change during a role-playing game session. JASSS, 16(1). https://doi.org/10.18564/jasss.2065

Fleming, K., Abad, J., Booth, L., Schueller, L., Baills, A., Scolobig, A., Petrovic, B., Zuccaro, G., & Leone, M. (2020). The use of serious games in engaging stakeholders for disaster risk reduction, management and climate change adaption information elicitation. International Journal of Disaster Risk Reduction, 49, 101669. https://doi.org/10.1016/j.ijdrr.2020.101669

Gore, R. J., Lynch, C. J., & Kavak, H. (2016). Applying statistical debugging for enhanced trace validation of agent-based models. Simulation, 93(4), 273–284. https://doi.org/10.1177/0037549716659707

Guiamalodin, N. M., Culele, R. G. A., Silguerra, J., & Diquito, T. J. A. (2024). Unfolding the Experiences and Preparedness Mechanism of Senior Citizens in the Wake of Disaster: Towards a Disaster Resilient Community. American Journal of Society and Law, 3(1), 1–13. https://doi.org/10.54536/ajsl.v3i1.2299

Guyot, P., Drogoul, A., & Honiden, S. (2007). Multi-Agent participatory simulations between experimental economics and Role-Playing games. In Agent-based social systems (pp. 11–19). https://doi.org/10.1007/978-4-431-71307- 4_2

Guzdial, M., Acharya, D., Kreminski, M., Cook, M., Eladhari, M., Liapis, A., & Sullivan, A. (2020). Tabletop Roleplaying Games as Procedural Content Generators. International Conference on the Foundations of Digital Games. https://doi.org/10.1145/3402942.3409605

Hosseini, M. M., Hosseini, T. M., Qayumi, K., & Baeradeh, N. (2022). Game-based vs. Case-based Training for Increasing Knowledge and Behavioral Fluency of Nurse Students Regarding Crisis and Disaster Management; a Quasi- Experimental Study. DOAJ (DOAJ: Directory of Open Access Journals), 10(1), e77. https://doi.org/10.22037/aaem.v10i1.1739

Husna, C., Kamil, H., Yahya, M., Tahlil, T., & Darmawati, D. (2020). Does tabletop exercise enhance knowledge and attitude in preparing disaster drills? Nurse Media : Journal of Nursing/Nurse Media Journal of Nursing, 10(2), 182–190. https://doi.org/10.14710/nmjn.v10i2.29117

Introduction to Agent-Based modeling. (2019). In SAGE Publications Ltd eBooks (pp. 14–34). https://doi.org/10.4135/9781529793543.n2

Kwadwo, W., & Morkla, T. D. (2024). Occupational health and safety challenges faced national disaster management personnel. American Journal of Arts and Human Science, 3(1), 19–23. https://doi.org/10.54536/ajahs.v3i1.2406

Ligtenberg, A., Van Lammeren, R. J., Bregt, A. K., & Beulens, A. J. (2010). Validation of an agent-based model for spatial planning: A role-playing approach. Computers, Environment and Urban Systems, 34(5), 424–434. https://doi.org/10.1016/j.compenvurbsys.2010.04.005

Linehan, C., Lawson, S., & Doughty, M. (2009). Tabletop prototyping of serious games for “Soft skills” training. 2009 Conference in Games and Virtual Worlds for Serious Applications, 182–185. https://doi.org/10.1109/vs- games.2009.9

Liu, C., Zhu, E., Zhang, Q., & Wei, X. (2021). Exploring the effects of computational costs in extensive games via modeling and simulation. International Journal of Intelligent Systems, 36(8), 4065–4087. https://doi.org/10.1002/int.22450

Liu, Y., Fang, A., Moriarty, G., Kraut, R., & Zhu, H. (2023). Agent-based simulation for online mental health matching. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2303.11272

Macal, C. M. (2016). Everything you need to know about agent-based modelling and simulation. Journal of Simulation, 10(2), 144–156. https://doi.org/10.1057/jos.2016.7

Mariano, D. J. K., & De Maria Albuquerque Alves, C. (2020). The application of role-playing games and agent-based modelling to the collaborative water management in peri-urban communities. RBRH, 25. https://doi.org/10.1590/2318-0331.252020190100

Marks, R. E. (2007). Validating Simulation Models: A general framework and four applied examples. Computational Economics, 30(3), 265–290. https://doi.org/10.1007/s10614-007-9101-7

McCourt, E., & Watson, K. (2023). Creating a disaster ready pharmacy workforce: Evaluation of a Disaster tabletop exercise. Prehospital and Disaster Medicine, 38(S1), s106–s107. https://doi.org/10.1017/s1049023x2300290x

McDonald, G. W., & Osgood, N. D. (2023). Agent-Based Modeling and its Tradeoffs: An Introduction & Examples. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2304.08497

Meijer, S., Hofstede, G. J., Beers, G., & Omta, S. W. F. (2006). Trust and Tracing game: learning about transactions and embeddedness in a trade network. Production Planning & Control, 17(6), 569–583. https://doi.org/10.1080/09537280600866629

Ogie, R., O’Brien, S., & Federici, F. (2022). Towards using agent-based modelling for collaborative translation of crisis information: A systematic literature review to identify the underlying attributes, behaviours, interactions, and environment of agents. International Journal of Disaster Risk Reduction, 68, 102717. https://doi.org/10.1016/j.ijdrr.2021.102717

Olalekan, M. R., Albert, O., Iyingiala, A. A., Sanchez, D. N., Telu, M. (2022). An environmental/scientific report into the crude oil spillage incidence in Tein community, Biseni, Bayelsa state Nigeria. J Environ Chem Toxicol. 2022; 6(4), 01-06., doi:10.37532/pulject.2022.6(4);01-06.

Olalekan, R. M., Omidiji, A. O., Nimisngha, D., Odipe, O. E., & Olalekan, A. S. (2018). Health Risk Assessment on Heavy Metals Ingestion through Groundwater Drinking Pathway for Residents in an Oil and Gas Producing Area of Rivers State, Nigeria. Open Journal of Yangtze Oil and Gas, 03(03), 191–206. https://doi.org/10.4236/ojogas.2018.33017

Onggo, B. S., & Karatas, M. (2016). Test-driven simulation modelling: A case study using agent-based maritime search- operation simulation. European Journal of Operational Research, 254(2), 517–531. https://doi.org/10.1016/j.ejor.2016.03.050

Pasinetti, N. J., Alvarado, Y., Fernández, J., Guerrero, R. A., & Rodríguez, G. (2015). A serious game about recycling rules. XXI Congreso Argentino De Ciencias De La Computación (Junín, 2015). http://sedici.unlp.edu.ar/bitstream/handle/10915/50227/Documento_completo.pdf?sequence=1

Pira, M. L., Marcucci, E., & Gatta, V. (2017). Role-playing games as a mean to validate agent-based models: an application to stakeholder-driven urban freight transport policy-making. Transportation Research Procedia, 27, 404–411. https://doi.org/10.1016/j.trpro.2017.12.060

Poděbradská, M., Noel, M., Bathke, D. J., Haigh, T. R., & Hayes, M. J. (2020). Ready for drought? A Community Resilience Role-Playing game. Water, 12(9), 2490. https://doi.org/10.3390/w12092490

Raimi, M. O., Iyingiala, A., Sawyerr, O. H., Saliu, A. O., Ebuete, A. W., Emberru, R. E., Sanchez, N. D., & Osungbemiro,

Raimi, M. O., Iyingiala, A. A., Sawyerr, O. H., Saliu, A. O., Ebuete, A. W., Emberru, R. E., ... & Osungbemiro, W. B. (2022). Leaving no one behind: impact of soil pollution on biodiversity in the global south: a global call for action. In Biodiversity in Africa: potentials, threats and conservation (pp. 205-237). Singapore: Springer Nature Singapore.

Raimi, M. O., Adindu, I. B., Udensi, E. O., Funmilayo, A. A., Opufou, T., Deinkuro, N. S., Adekunle, A. P., & Adeniji,

Raimi, M. O., Adindu, I. B., Udensi, E. O., Funmilayo, A. A., Opufou, T., Deinkuro, N. S., ... & Adeniji, A. O. (2020). Health impact assessment: expanding public policy tools for promoting sustainable development goals (SDGs) in Nigeria. EC Emergency Medicine and Critical Care.

Raimi, M. O., Ayibatonbira, A. A., Anu, B., Odipe, O. E., & Deinkuro, N. S. (2019). ‘Digging Deeper’Evidence on Water Crisis and Its Solution in Nigeria for Bayelsa State: A Study of Current Scenario. Int J Hydro, 3(4), 244-257.

Ramchurn, S. D., Huynh, T. D., Wu, F., Ikuno, Y., Flann, J., Moreau, L., Fischer, J. E., Jiang, W., Rodden, T., Simpson, E., Reece, S., Roberts, S., & Jennings, N. R. (2016). A Disaster Response System based on Human-Agent Collectives.Journal of Artificial Intelligence Research, 57, 661–708. https://doi.org/10.1613/jair.5098

Robinson, D. T., Brown, D. G., Parker, D. C., Schreinemachers, P., Janssen, M. A., Huigen, M., Wittmer, H., Gotts, N., Promburom, P., Irwin, E., Berger, T., Gatzweiler, F., & Barnaud, C. (2007). Comparison of empirical methods for building agent-based models in land use science. Journal of Land Use Science, 2(1), 31–55. https://doi.org/10.1080/17474230701201349

Rye, S., & Aktas, E. (2022). Serious Games as a validation tool for PREDIS: a decision support system for disaster management. International Journal of Environmental Research and Public Health/International Journal of Environmental Research and Public Health, 19(24), 16584. https://doi.org/10.3390/ijerph192416584

Sakai, K., Shimizu, H., Toyoda, Y., & Kanegae, H. (2019). A study on gaming of participatory Evacuation planning in Tourist areas using agent simulation. In Translational systems sciences (pp. 247–256). https://doi.org/10.1007/978-981-13-8039-6_23

Sanchez, D. N., Knapp, C. W., Olalekan, R. M., & Nanalok, N. H. (2021). Oil spills in the Niger Delta Region, Nigeria: Environmental fate of toxic volatile organics. Research Square (Research Square). https://doi.org/10.21203/rs.3.rs-654453/v1

Simões-Marques, M., Moreno, D., & Correia, A. (2020). Developing a serious game to support disaster management preparedness - a design thinking approach. In Advances in intelligent systems and computing (pp. 108–115). https://doi.org/10.1007/978-3-030-51369-6_15

Squazzoni, F., Polhill, J. G., Edmonds, B., Ahrweiler, P., Antosz, P., Scholz, G., Chappin, É. J. L., Borit, M., Verhagen, H., Giardini, F., & Gilbert, N. (2020). Computational models that matter during a global pandemic outbreak: a call to action. JASSS, 23(2). https://doi.org/10.18564/jasss.4298

Suguitan, L., & Natividad, E. (2022). Localized Game-Based Learning Activity Sheets in Mathematics 7. American Journal of Multidisciplinary Research and Innovation, 1(4), 210–227. https://doi.org/10.54536/ajmri.v1i4.723

Suleman, I., Pomalango, Z. B., & Slamet, H. (2022). Disaster exercise tabletop media improves knowledge of health personnel about disaster management. Jambura Journal of Health Sciences and Research, 5(1), 90–99. https://doi.org/10.35971/jjhsr.v5i1.16633

Tanguid, S. B. J., & Tanguid, R. V. (2023). Disaster resilience and capability in the maintenance of public order during disaster of Calamity-Prone municipalities in Oriental Mindoro, Philippines. American Journal of Multidisciplinary Research and Innovation, 2(5), 83–88. https://doi.org/10.54536/ajmri.v2i5.2058

Takadama, K., Kawai, T., & Koyama, Y. (2008). Micro-and macro-level validation in agent-based simulation: Reproduction of human-like behaviors and thinking in a sequential bargaining game. Journal of Artificial Societies and Social Simulation, 11(2), 9.

Terti, G., Ruin, I., Kalas, M., Láng, I., Alonso, A. C. I., Sabbatini, T., & Lorini, V. (2019). ANYCaRE: a role-playing game to investigate crisis decision-making and communication challenges in weather-related hazards. Natural Hazards and Earth System Sciences, 19(3), 507–533. https://doi.org/10.5194/nhess-19-507-2019

Utomo, D. S., Onggo, B. S. S., Eldridge, S., Daud, A. R., & Tejaningsih, S. (2021). Eliciting agents’ behaviour and model validation using role playing game in agent-based dairy supply chain model. Journal of the Operational Research Society, 73(12), 2670–2693. https://doi.org/10.1080/01605682.2021.2013137

Villamor, G. B., Van Noordwijk, M., & Troitzsch, K. G. (2023). Triangulating agent-based models, role-playing games, and a stakeholder-centric approach to change scenarios. Current Opinion in Environmental Sustainability, 64, 101323. https://doi.org/10.1016/j.cosust.2023.101323

Downloads

Published

2024-07-03

How to Cite

Amakama, N. J., Dusserre, G., Cadiere, A., Schuette , R. W., & Zacharewicz , G. (2024). How Effective are Tabletop Role-Playing (Serious) Games in Understanding and Validating the Predictive Capabilities of Disaster Response Agent-based Models?. American Journal of Multidisciplinary Research and Innovation, 3(4), 49–61. https://doi.org/10.54536/ajmri.v3i4.2937