Connectionists: IEEE Transactions on Games - Special Issue on Human-Centred AI in Game Evaluation

[Diego Perez Liebana]

Dear all,


Apologies for cross-posting. We are looking for submissions for a new Special Issue for IEEE Transactions on Games: Human-Centred AI in Game Evaluation.


This issue aims to collect works on evaluating and characterizing games and player experience, be this by means of AI players, human evaluation, or a mix of both. Please see the full call for papers and instructions to submit in this link: https://transactions.games/special-issue/special-issue-on-human-centred-ai-in-game-evaluation, and also below.


The deadline for submissions is October 1st, 2023.


=== Call for Papers ===
Most games are consciously designed with a specific experience or vision in mind. Games are commonly designed for entertainment and competition purposes, but self-expression, social critique, targeted learning, knowledge discovery as well as physical and mental health are also valid design objectives. Determining whether an objective is fulfilled is often quite difficult due to the complexity of modern games and the variability of human responses. For this reason, games are commonly playtested before being published. However, playtests are expensive and time-consuming and not all aspects of the game can be evaluated to the full extent before it is published.

There is thus a need for more concentrated and systematic work on evaluating/characterising games, its artefacts as well as player experience. Researchers have proposed approaches intended to assist game designers using methods from the field of artificial and computational intelligence (AI and CI, respectively). Still, to our knowledge, there is a surprising lack of generality and validation regarding these methods, even in scientific publications on game design. No central repository for methods currently exists. In this special issue, we want to focus on human-centered AI approaches aiming for a more holistic and systematic approach to game evaluation. We thus seek submissions on related topics for this special issue.

The following is a non-comprehensive list of suggested topics:

  *   Uses of AI agents to evaluate game content
  *   Measures for game evaluation
  *   Game evaluation and play-testing for AR/VR
  *   Relationship between AI agents and player experience
  *   Automatic analysis of play-traces
  *   Mixed-Initiative gameplay evaluation
  *   Player modelling for game evaluation
  *   Automatic evaluation for new game genres
  *   Validation of automatic evaluation methods using human data
  *   Generality of automatic evaluation methods
  *   Differences between different evaluation methods (tested with AI or humans, qualitative vs. quantitative, objective vs subjective measures, etc.)
  *   Evaluation measures and their relationship to business and research goals
  *   Playtesting standards in industry
  *   Correlation between objective and subjective measures
  *   Ethics, privacy and legal aspects of using player data
  *   Evaluation of generated content


Best wishes,

Diego Pérez Liébana

Senior Lecturer in Computer Games and Artificial Intelligence
Programme Director of the MSc Artificial Intelligence
School of Electronic Engineering and Computer Science
Queen Mary University of London
67-75 New Road, E1 1HH, London, UK
Office: Whitechapel Campus, Empire House (DERI), second floor.
email: diego.perez at qmul.ac.uk<mailto:diego.perez at qmul.ac.uk><mailto:dperez at essex.ac.uk>
web: http://www.diego-perez.net<http://www.diego-perez.net/>

Email notices:
1) You may have seen that I sometimes write emails outside (your) working hours. Please don't take this as an indication that I require an immediate response - we simply may be working at different times.
2) Because of the daily high load of emails, I may take some time to reply to you. If it's important, I may take even more time, because I want to provide an adequate response. If it's urgent, I'll try to reply quickly and maybe just with a very short email. No disrespect, just trying to be efficient - I'd understand if you did the same.

[cid:04b0ca46-ee63-4db4-9a26-b11812471dab]
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20230704/e372a6cb/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Outlook-3wkc2gn0.png
Type: image/png
Size: 12762 bytes
Desc: Outlook-3wkc2gn0.png
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20230704/e372a6cb/attachment.png>