Augmenting Humans @ Neurolive

Paprticipating in a Liveness Symposium

Augmenting Humans

Very happy to be invited as one of the panelists presenting in a three-day online symposium on Liveness organised by the Neurolive EU Project. The symposium brings together artists, humanities scholars and cognitive neuroscientists to explore how liveness is conceptualised, measured and practiced across the arts and the sciences.

I’m speaking on the 24th, here’s the abstract of my talk and my slides (carefull ~17 Mb pdf)

Abstract: In my research, I combine design and technology to augment human senses, looking for novel interaction paradigms. Engineering and computing have often been used to mimic or surpass some human abilities (for example autonomous driving, playing Go). Such efforts appear to put humans and computers in a competitive relationship, as emphasized in AI vs. Human game competitions. Once fantastic fear of AIs “replacing” human workers is now taken much more seriously and discussed in the public sphere. My research proposes a different approach to the human-computer relationship by applying a cooperative and empowering framework, using wearable computing to actively augment human capabilities.

Compared to a computer, our mind has ebb and flow and is affected by various factors, some of which we do not even realize. At the beginning of my talk, I will discuss how unobtrusive smart glasses and similar technologies can be used to quantify these factors (e.g. fatigue, stress, alertness) in real-life scenarios. In the second part, I will discuss unobtrusive interaction and actuation technologies to augment humans. We discuss application scenarios of capturing inter-personal synchrony between audience and performers as well as potential body schema extension technologies.

Boiling Mind Website

Boiling Mind 2019

Boiling Mind 2020

(will be replaced with higher quality videos)

Bellow are some of the papers mentioned in the talk (in reverse/random order :) ):

Boiling Mind: Amplifying the Audience-Performer Connection through Sonification and Visualization of Heart and Electrodermal Activities. Sugawa, Moe and Furukawa, Taichi and Chernyshov, George and Hynds, Danny and Han, Jiawen and Padovani, Marcelo and Zheng, Dingding and Marky, Karola and Kunze, Kai and Minamizawa, Kouta. Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction. 2021. Bibtex.

Zhuoqi Fu, Jiawen Han, George Chernyshov, Moe Sugawa, Dingding Zheng,Danny Hynds, Taichi Furukawa, Marcelo Padovani, Kouta Minamizawa,Karola Marky, Jamie A Ward, and Kai Kunze. 2021. Boiling Mind - A Dataset of Physiological Signals during an Exploratory Dance Performance. In Proceedings of AugmentedHumans Conference (AHS’21).ACM, New York, NY, USA, 2021. Prerpint Link

Shape Memory Alloy Wire Actuators for Soft, Wearable Haptic Devices. Chernyshov, George and Tag, Benjamin and Caremel, Cedric and Cao, Feier and Liu, Gemma and Kunze, Kai. Proceedings of the 2018 ACM International Symposium on Wearable Computers. 2018. Bibtex.

Continuous alertness assessments: Using EOG glasses to unobtrusively monitor fatigue levels In-The-Wild. Tag, Benjamin and Vargo, Andrew W and Gupta, Aman and Chernyshov, George and Kunze, Kai and Dingler, Tilman. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 2019. Bibtex.

Does context matter?-A quantitative evaluation in a real world maintenance scenario. Kunze, Kai and Wagner, Florian and Kartal, Ersun and Morales Kluge, Ernesto and Lukowicz, Paul. Pervasive Computing. 2009. Bibtex.