Uji Coba Metode A/B Testing dalam Proses Desain (Objek Eksperimen: Visual Tampilan Permainan Digital Acaraki)

  • Brian Alvin Hananto Universitas Pelita Harapan
  • Ellis Melini Universitas Pelita Harapan
  • Alfiansyah Zulkarnain Universitas Pelita Harapan
  • Jesslyn Kotandi Universitas Pelita Harapan
Keywords: A/B Testing, Permainan, Affordance, Desain

Abstract

Metode A/B testing merupakan sebuah metode evaluasi desain yang kerap digunakan, khususnya dalam perancangan untuk medium digital, seperti pada website ataupun aplikasi digital. Penulis ingin melihat lebih jauh apakah hasil evaluasi dari A/B testing koheren dan selaras dengan desain yang dihasilkan secara iteratif dengan pertimbangan-pertimbangan teoritis. Dalam penelitian ini, penulis menggunakan obyek eksperimen dari perancangan permainan digital Acaraki: The Java Herbalist, yang merupakan permainan boardgame berbentuk fisik. Salah satu pertimbangan teoritis yang digunakan dalam perancangan adalah affordance. Dalam Iterasi desain yang dihasilkan, disiapkan dua opsi berbeda untuk keperluan A/B testing, yang kemudian diujikan kepada 64 responden. Dari sepuluh eksperimen yang dilakukan, 60% desain akhir sesuai dengan hasil A/B testing. Dari penelitian ini, penulis melihat bahwa metode A/B testing merupakan sebuah metode evaluasi yang sesuai untuk menguji karya desain, namun prakteknya perlu memperhatikan faktor-faktor seperti waktu dan juga kriteria dari responden yang berpartisipasi dalam A/B testing.

References

A/B Testing. (n.d.). Optimizely.Com. Retrieved March 24, 2022, from https://www.optimizely.com/optimization-glossary/ab-testing/
Acaraki: The Java Herbalist. (n.d.). Playday.Id. Retrieved March 23, 2022, from https://www.playday.id/boardgame/17/acaraki-the-java-herbalist

Bhat, N., Farias, V. F., Moallemi, C. C., & Sinha, D. (2020). Near-Optimal A-B Testing. Management Science, 66(10), 4477–4495. https://doi.org/10.1287/mnsc.2019.3424

Brown, D. C., & Blessing, L. (2005). The Relationship Between Function and Affordance. Proceedings of the ASME 2005 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 155–160. https://doi.org/https://doi.org/10.1115/DETC2005-85017

Chen, N., Liu, M., & Xu, Y. (2019). How A/B Tests Could Go Wrong: Automatic Diagnosis of Invalid Online Experiments. Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, 501–509. https://doi.org/10.1145/3289600.3291000

Deng, A., Lu, J., & Litz, J. (2017). Trustworthy Analysis of Online A/B Tests: Pitfalls, Challenges and Solutions. Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, 641–649. https://doi.org/10.1145/3018661.3018677

Dwivedi, A. (2017). Affordance in user interface design. UX Collective. https://uxdesign.cc/affordance-in-user-interface-design-3b4b0b361143

Esteller-Cucala, M., Fernandez, V., & Villuendas, D. (2020). Evaluating Personalization: The AB Testing Pitfalls Companies Might Not Be Aware of—A Spotlight on the Automotive Sector Websites. Frontiers in Artificial Intelligence, 3. https://doi.org/10.3389/frai.2020.00020

Firmenich, S., Garrido, A., Grigera, J., Rivero, J. M., & Rossi, G. (2019). Usability improvement through A/B testing and refactoring. Software Quality Journal, 27(1), 203–240. https://doi.org/10.1007/s11219-018-9413-y

Jenkins, W. (2014, February 5). A/B Testing and the Benefits of an Experimentation Culture. Harvard Business Review. https://hbr.org/2014/02/ab-testing-and-the-benefits-of-an-experimentation-culture

Kamalbasha, S., & Eugster, M. J. A. (2021). Bayesian A/B Testing for Business Decisions. In P. Haber, T. Lampoltshammer, M. Mayr, & K. Plankensteiner (Eds.), Data Science – Analytics and Applications (pp. 50–57). Springer Fachmedien Wiesbaden.

Kotandi, J., & Hananto, B. A. (2020). Eksplorasi Visual untuk Perancangan Permainan papan “Acaraki: The Java Herbalist” dalam Bentuk Aplikasi Permainan Mobile. Prosiding Konferensi Mahasiswa Desain Komunikasi Visual, 465–471. https://ojs.uph.edu/index.php/KOMA-DKV/article/view/3063

Maier, J. R. A., & Fadel, G. M. (2009). Affordance based design: a relational theory for design. Research in Engineering Design, 20(1), 13–27. https://doi.org/10.1007/s00163-008-0060-3

Martin, B., & Hanington, B. (2012). Universal Methods of Design: 100 Ways to Research Complex Problems, Develop Innovative Ideas, and Design Effective Solutions. Rockport Publisher.

Nathania, S., Hananto, B. A., & Djoko, C. (2021). Studi Translasi Permainan Kartu Edukasi Wilah Menjadi Permainan Berbasis Digital. Prosiding Konferensi Mahasiswa Desain Komunikasi Visual, 425–432. https://ojs.uph.edu/index.php/KOMA-DKV/article/view/4382

Norman, D. A. (2013). The Design of Everyday Things (Revised an). Basic Books.

Pettit, N. (2014). What are Affordances in Web Design? Teamtreehouse. https://blog.teamtreehouse.com/affordances-web-design

Simpsons, J. (2020, March 12). A/B Testing: The Benefits And How To Use It Efficiently. Forbes.Com. https://www.forbes.com/sites/forbesagencycouncil/2020/03/12/ab-testing-the-benefits-and-how-to-use-it-efficiently/?sh=6bfb0b3a786d

Siswadi, A. (2018, September 21). 24 Board Game Lokal Dipamerkan di Popcon Asia dan Pameran Jerman. Tekno.Tempo.Co. https://tekno.tempo.co/read/1128582/24-board-game-lokal-dipamerkan-di-popcon-asia-dan-pameran-jerman

Studio, T. (2018). UX Design Glossary: How to Use Affordances in User Interfaces. UX Planet. https://uxplanet.org/ux-design-glossary-how-to-use-affordances-in-user-interfaces-393c8e9686e4

Sudaryono. (2019). Metodologi Penelitian: Kuantitatif, Kualitatif, dan Mix Method (2nd ed.). Rajawali Pers.

Vyas, D., Chisalita, C. M., & van der Veer, G. C. (2006). Affordance in Interaction. Proceedings of the 13th Eurpoean Conference on Cognitive Ergonomics: Trust and Control in Complex Socio-Technical Systems, 92–99. https://doi.org/10.1145/1274892.1274907

W. Lidwell, K. H. and J. B. (2010). Universal Principles of Design. Rockport Publisher. https://doi.org/10.1007/s11423-007-9036-7

What are Affordances? (n.d.). Interaction Design Foundation. Retrieved January 29, 2019, from https://www.interaction-design.org/literature/topics/affordances

What is A/B testing? (n.d.). Vwo.Com. Retrieved March 24, 2022, from https://vwo.com/ab-testing/
Published
2022-05-29
How to Cite
Hananto, B., Melini, E., Zulkarnain, A., & Kotandi, J. (2022). Uji Coba Metode A/B Testing dalam Proses Desain (Objek Eksperimen: Visual Tampilan Permainan Digital Acaraki). Gestalt : Jurnal Desain Komunikasi Visual, 4(1), 1-16. https://doi.org/10.33005/gestalt.v4i1.109

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.