Emotional and Cognitive State Tracking Dataset (ETICS)

The ETICS dataset was collected from 21 participants. It consists of three .csv files for each individualization level from the second part of the test and, correspondingly – 3 files for the third part (with task adaptation). These files consist of the following features:

  • Timestamp/ Stimuli/ Answer (User Response)/Performance/ Speed/ Reaction time - from the application manager;
  • Timestamp / Arousal/ Valence/ Attention/ Angry/ Disgust/ Fear/ Happy/ Neutral/ Sad/ Surprise – from MorphCast platform;
  • Data fusion of the above, matched by timestamp in the moment of user response.

In addition, synchronized high-resolution video (with audio) from the PC camera, capturing the face (and face expressions) of the user and screen capture video from the application (the stimuli of the cognitive test), are recorded in .mp4 file format.

The ETICS dataset is available for Download.

Please cite the ETICS dataset as:

M. Markov, Y. Kalinin, V. Markova, T. Ganchev (2023). "Towards implementation of emotional intelligence in human-machine collaborative systems", Special Issue on "Application of Artificial Intelligence in the New Era of Communication Networks", Electronics 202312(18), 3852; DOI: https://doi.org/10.3390/electronics12183852.

 

Integrated Measurement of Performance and Contextual Task-related effects dataset (IMPACT)

The IMPACT dataset facilitates research on contextual dynamics within human-machine collaboration (HMC) systems. The dataset contains 15-minute recordings of 13 male and 5 female volunteers and include task stimuli, user responses, reaction times, emotional states, and attention levels, all synchronized via timestamps and recorded in .csv and .mp4 formats.

The IMPACT dataset supports the development of adaptive human-machine collaboration systems integrating individual user perceptions with objective context monitoring.

The IMPACT dataset can be requested from Prof. Todor Ganchev (Този имейл адрес е защитен от спам ботове. Трябва да имате пусната JavaScript поддръжка, за да го видите.)

Please cite the IMPACT dataset as:

Markov M., Kalinin Y., Markova V. (2024). IMPACT: A dataset for Integrated Measurement of Performance and Contextual Task-related effects. The International Conference on Electronics, Engineering Physics and Earth Science (EEPES-2024), June 19-21, 2024, Kavala, Greece, to appear in MDPI Engineering Proceedings, ISSN: 2673-4591, 2024.

 

Software Tools & Demonstrators 

Some parts of the software tools and the adaptive interface demonstrators created within the iHMI RTD activities are provided free of charge to researchers working on the topic of intelligent human-machine interfaces. If interested, please contact Prof. Todor Ganchev (Този имейл адрес е защитен от спам ботове. Трябва да имате пусната JavaScript поддръжка, за да го видите.).