ACM Publications

research-article
OpenEarable ExG: Open-Source Hardware for Ear-Based Biopotential Sensing Applications
- Philipp Lepold
  Karlsruhe Institute of Technology, Karlsruhe, Germany
  ,
- Tobias Röddiger
  Karlsruhe Institute of Technology, Karlsruhe, Germany
  ,
- Tobias King
  Karlsruhe Institute of Technology, Karlsruhe, Germany
  ,
- Kai Kunze
  Keio Media Design, Yokohama, Japan
  ,
- Christoph Maurer
  University of Freiburg, Freiburg im Breisgau, Germany
  ,
- Michael Beigl
  Karlsruhe Institute of Technology, Karlsruhe, Germany
October 2024pp 916-920 https://doi.org/10.1145/3675094.3678480

While traditional earphones primarily offer private audio spaces, so-called "earables" emerged to offer a variety of sensing capabilities. Pioneering platforms like OpenEarable have introduced novel sensing platforms targeted at the ears, incorporating ...
extended-abstract
mobiCHAI - 1st International Workshop on Mobile Cognition-Altering Technologies (CAT) using Human-Centered AI
- Passant ElAgroudy
  German Research Centre for Artificial Intelligence (DFKI), Germany and Embedded Intelligence, RPTU, Germany
  ,
- Agnes Gruenerbl
  DKFI, Embedded Intelligence, Germany and Embedded Intelligence, RPTU, Germany
  ,
- Giulia Barbareschi
  Keio Graduate School of Media Design, Keio University, Japan
  ,
- Jan Spilski
  Center for Cognitive Science, RPTU Kaiserslautern-Landau, Germany
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
  ,
- Thomas Lachmann
  Center for Cognitive Science, RPTU University of Kaiserslautern-Landau, Germany
  ,
- Paul Lukowicz
  DFKI, Germany and Embedded Intelligence, RPTU, Germany
September 2024pp 1-5 https://doi.org/10.1145/3640471.3680462

The quest for enhanced cognition has been a driving force behind human advancement, fostering innovation and personal fulfillment. Cognition Altering Technologies (CAT) holds immense promise in elevating the quality of life across diverse domains ...
research-article
"Speech is Silver, Silence is Golden " Analyzing Micro-communication Strategies between Visually Impaired Runners and their Guides
- Giulia Barbareschi
  Keio Graduate School of Media Design, Keio University, Japan
  ,
- Tarika Kumar
  Imperial College London, United Kingdom and Keio Graduate School of Media Design, Japan
  ,
- Christopher Changmok Kim
  KMD, Keio University, Japan
  ,
- George Chernyshov
  KMD, Keio University, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
May 2024pp 1-16 https://doi.org/10.1145/3613904.3642388

Running and jogging are popular activities for many visually impaired individuals thanks to the relatively low entry barriers. Research in HCI and beyond has focused primarily on leveraging technology to enable visually impaired people to run ...
research-article
Innermost Echoes: Integrating Real-Time Physiology into Live Music Performances
- Danny Hynds
  Keio University Graduate School of Media Design, Japan
  ,
- George Chernyshov
  Keio University Graduate School of Media Design, Japan
  ,
- Dingding Zheng
  Keio University Graduate School of Media Design, Japan
  ,
- Aoi Uyama
  Keio University Graduate School of Media Design, Japan
  ,
- Juling Li
  Keio University Graduate School of Media Design, Japan
  ,
- Kozue Matsumoto
  California Institute of the Arts, United States
  ,
- Michael Pogorzhelskiy
  Keio University Graduate School of Media Design, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
  ,
- Jamie A Ward
  Computing, Goldsmiths, University of London, United Kingdom
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design, Japan
February 2024pp 1-12 https://doi.org/10.1145/3623509.3633356

In this paper, we propose a method for utilizing musical artifacts and physiological data as a means for creating a new form of live music experience that is rooted in the physiology of the performers and audience members. By utilizing physiological data ...
research-article
Exploring Digital Embodiment in Wheelchair Dance with Generative AI
- Yurui Xie
  Keio University Graduate School of Media Design, Japan
  ,
- Giulia Barbareschi
  Keio University Graduate School of Media Design, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
  ,
- Masa Inakage
  Keio University Graduate School of Media Design, Japan
November 2023pp 224-227 https://doi.org/10.1145/3627050.3631576

In the era of blurring boundaries between technology and humans, the idea of posthumanism in the arts offers opportunities to overcome human natural limitations through the integration of artificial agents that can enhance performance and creativity. ...
research-article
iOT device design for rapid detection of Alzheimer inducing P. gingivalis bacteria
- Ewa Szyszka
  Keio University, Japan
  ,
- Yiejun Yi
  Grace International Academy, Republic of Korea
  ,
- Yekyung Lee
  Grace International Academy, Republic of Korea
  ,
- Katrina Lee
  Grace International Academy, Republic of Korea
  ,
- Kai Kunze
  Keio University, Japan
November 2023pp 219-223 https://doi.org/10.1145/3627050.3631572

Regular monitoring of cognitive health to detect early signs of decline is essential for the diagnosis of Alzheimer and other forms of dementia. However, cognitive testing is usually carried out in healthcare settings by physicians and other ...
research-article
Soma Express Kit: Understanding the Somaesthetic Experience of People with Visual Impairment: Soma Express Kit
- Michi Kanda
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
November 2023pp 232-235 https://doi.org/10.1145/3627050.3631571

This paper introduces the concept of Soma Express Kit, a novel toolkit that capitalises on heightened somatosensory capacities of people with visual impairments (PVI). Rooted in somaesthetic interaction design, it aims to create collaborative ...
short-paper
Ubicomp Tutorial - UbiCHAI - Experimental Methodologies for Cognitive Human Augmentation
- Agnes Grünerbl
  Embedded Intelligence, RPTU, Germany and DKFI, Germany
  ,
- Kai Kunze
  KMD, Keio University, Japan
  ,
- Thomas Lachmann
  RPTU, Germany
  ,
- Jamie A. Ward
  Computing, Goldsmiths University of London, United Kingdom and Institute of Cognitive Neuroscience, University College London, United Kingdom
  ,
- Paul Lukowicz
  RPTU, Germany and DFKI, Germany
October 2023pp 762-764 https://doi.org/10.1145/3594739.3605103

A central research goal of Ubicomp has always been the development of systems and methods that seamlessly support humans in accomplishing complex tasks in everyday life. In the wake of rapid advances in artificial intelligence (AI), topics such as "Human-...
research-article
Movement Quality Visualization for Wheelchair Dance
- Yurui Xie
  Keio University Graduate School of Media Design, Keio University, Hiyoshi Kohoku-ku, Yokohama-city Kanagawa, Japan, Yokohama, Japan
  ,
- Giulia Barbareschi
  Keio University Graduate School of Media Design, Keio University, Hiyoshi Kohoku-ku, Yokohama-city Kanagawa, Japan, Yokohama, Japan
  ,
- Ayesha Nabila
  Keio University Graduate School of Media Design, Keio University, Hiyoshi Kohoku-ku, Yokohama-city Kanagawa, Japan, Yokohama, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Keio University, Hiyoshi Kohoku-ku, Yokohama-city Kanagawa, Japan, Yokohama, Japan
  ,
- Masa Inakage
  Keio University Graduate School of Media Design, Keio University, Hiyoshi Kohoku-ku, Yokohama-city Kanagawa, Japan, Yokohama, Japan
August 2023pp 1-12 https://doi.org/10.1145/3597628

Wheelchair dance is an important form of disability art that is still subject to significant levels of ableism and art exclusion. Wheelchair dancers face challenges finding teachers and choreographers who can accommodate their needs, documenting and ...
wip
First Bite/Chew: distinguish different types of food by first biting/chewing and the corresponding hand movement
- Junyu Chen
  Graduate School of Media Design, Keio University, Japan and Graduate School of Information Science and Technology, The University of Tokyo, Japan
  ,
- Xiongqi Wang
  Graduate School of Media Design, Keio University, Japan
  ,
- Juling Li
  Graduate School of Media Design, Keio University, Japan
  ,
- George Chernyshov
  Graduate School of Media Design, Keio University, Japan
  ,
- Yifei Huang
  The University of Tokyo, Japan
  ,
- Kai Kunze
  Graduate School of Media Design, Keio University, Japan
  ,
- Jing Huang
  Graduate School of Media Design, Keio University, Japan
  ,
- Thad Starner
  School of Interactive Computing, Georgia Institute of Technology, United States
  ,
- Qing Zhang
  Graduate School of Media Design, Keio University, Japan and The University of Tokyo, Japan
April 2023pp 1-7 https://doi.org/10.1145/3544549.3585845

Imbalanced food intake contributes to various diseases, such as obesity, diabetes, high blood pressure, high cholesterol, heart disease, and type-2 diabetes. At the same time, food intake monitoring systems play a significant role in the treatment. Most ...
wip
Detecting an Offset-Adjusted Similarity Score based on Duchenne Smiles
- Maximilian Henneberg
  Technical University of Munich, Germany
  ,
- Chloe Eghtebas
  Research Group Augmented Reality, TUM, Germany
  ,
- Oliver De Candido
  Technical University of Munich, Germany
  ,
- Kai Kunze
  KMD, Keio University, Japan
  ,
- Jamie A Ward
  Computing, Goldsmiths University of London, United Kingdom
April 2023pp 1-5 https://doi.org/10.1145/3544549.3585709

Detecting interpersonal synchrony in the wild through ubiquitous wearable sensing invites promising new social insights as well as the possibility of new interactions between humans-humans and humans-agents. We present the Offset-Adjusted SImilarity ...
wip
Towards Embodying Emotions in Play with Neurodivergent Children using Haptic Technologies
- Yulan Ju
  Graduate school of Media Design, Keio University, Japan
  ,
- Mina Shibasaki
  Graduate of media design, Keio University, Japan
  ,
- Christopher Changmok Kim
  Graduate school of Media Design, Keio University, Japan
  ,
- Kai Kunze
  Graduate school of Media Design, Keio University, Japan
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design, Japan
April 2023pp 1-7 https://doi.org/10.1145/3544549.3585613

As neurodivergent cases in children are steadily increasing, we are also seeing increased awareness regarding personalized neurological development and efforts towards social inclusion. Children struggling with these conditions should engage in ...
research-article
“I am both here and there” Parallel Control of Multiple Robotic Avatars by Disabled Workers in a Café
- Giulia Barbareschi
  Keio University Graduate School of Media Design, Keio University, Japan
  ,
- Midori Kawaguchi
  Keio University Graduate School of Media Design, Japan
  ,
- Hiroaki Kato
  Ory Laboratory, Japan
  ,
- Masato Nagahiro
  OriHime Pilots, Japan
  ,
- Kazuaki Takeuchi
  Ory Laboratory, Japan
  ,
- Yoshifumi Shiiba
  Ory Laboratory, Japan
  ,
- Shunichi Kasahara
  Sony Computer Science Laboratories, Inc., Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Keio University, Japan
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design, Japan
April 2023pp 1-17 https://doi.org/10.1145/3544548.3581124

Robotic avatars can help disabled people extend their reach in interacting with the world. Technological advances make it possible for individuals to embody multiple avatars simultaneously. However, existing studies have been limited to laboratory ...
demonstration
Phantom Undulations: Remote Physiological Sensing in Abstract Installation Works
- Danny Hynds
  Graduate School of Media Design, Keio University, Japan
  ,
- Dingding Zheng
  Graduate School of Media Design, Keio University, Japan
  ,
- Yilin Zhang
  Graduate School of Media Design, Keio University, Japan
  ,
- Hua Ma
  Graduate School of Media Design, Keio University, Japan
  ,
- Kirill Ragozin
  Graduate School of Media Design, Keio University, Japan
  ,
- George Chernyshov
  Graduate School of Media Design, Keio University, Japan
  ,
- Jamie A. Ward
  Goldsmiths, University of London, United Kingdom
  ,
- Tatsuya Saito
  Graduate School of Media Design, Keio University, Japan
  ,
- Kai Kunze
  Graduate School of Media Design, Keio University, Japan
  ,
- Kouta Minamizawa
  Graduate School of Media Design, Keio University, Japan
March 2023pp 367-370 https://doi.org/10.1145/3582700.3583710

Phantom Undulations is a mixed-media work in which an artist’s physiological data is being used remotely to manipulate the sounds and visuals of an abstract artifact in a gallery setting. This work relies heavily on the concept of showing the artist’s ...
poster
Towards Enhancing a Recorded Concert Experience in Virtual Reality by Visualizing the Physiological Data of the Audience
- Xiaru Meng
  Keio University Graduate School of Media Design, Japan
  ,
- Yan He
  Keio University Graduate School of Media Design, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
March 2023pp 330-333 https://doi.org/10.1145/3582700.3583709

This work is a first attempt to visualize the social atmosphere of a audience in a VR experience using their recorded the physiological state, and then presents them to another group of audience members, aiming at a transformative perception from ...
poster
First Bite/Chew: distinguish typical allergic food by two IMUs
- Juling Li
  Keio University, Graduate Schoo of Media Design, Japan
  ,
- Xiongqi Wang
  Keio University, Graduate Schoo of Media Design, Japan
  ,
- Junyu Chen
  The University of Tokyo, Graduate School of Information Science and Technology, Japan and Keio University, Graduate Schoo of Media Design, Japan
  ,
- Thad Starner
  Georgia Institute of Technology, USA
  ,
- George Chernyshov
  Keio University, Graduate Schoo of Media Design, Japan
  ,
- Jing Huang
  Keio University, graduate school of media design, Japan
  ,
- Yifei Huang
  The University of Tokyo, Japan
  ,
- Kai Kunze
  Keio University, Graduate Schoo of Media Design, Japan
  ,
- Qing Zhang
  Keio University, Graduate Schoo of Media Design, Japan
March 2023pp 326-329 https://doi.org/10.1145/3582700.3583708

Eating or overtaking allergic foods may cause fatal symptoms or even death for people with food allergies. Most current food intake tracking methods are camera-based, on-body sensor-based, microphone based, and self-reported. However, challenges that ...
research-article
Exploring the Design Space of Assistive Augmentation
- Suranga Chandima Nanayakkara
  Augmented Human Lab, Department of Information Systems & Analytics, National University of Singapore, Singapore
  ,
- Masahiko Inami
  Information Somatics Laboratory, University of Tokyo, Japan
  ,
- Florian Mueller
  Exertion Games Lab, Monash University, Australia
  ,
- Jochen Huber
  Furtwangen University, Germany
  ,
- Chitralekha Gupta
  Augmented Human Lab, Department of Information Systems & Analytics, National University of Singapore, Singapore
  ,
- Christophe Jouffrais
  Centre National de la Recherche Scientifique (CNRS), France
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Rakesh Patibanda
  Exertion Games Lab, Monash University, Australia
  ,
- Samantha W T Chan
  Fluid Interfaces Group, MIT Media Lab, Massachusetts Institute of Technology, USA
  ,
- Moritz Alexander Messerschmidt
  Augmented Human Lab, University of Auckland, New Zealand
March 2023pp 371-373 https://doi.org/10.1145/3582700.3582729

Assistive Augmentation, the intersection of human-computer interaction, assistive technologies and human augmentation, was broadly discussed at the CHI’14 workshop and subsequently published as an edited volume on Springer Cognitive Science and ...
research-article
Affective Umbrella – A Wearable System to Visualize Heart and Electrodermal Activity, towards Emotion Regulation through Somaesthetic Appreciation
- Kanyu Chen
  Keio University, Japan
  ,
- Jiawen Han
  Keio University, Japan
  ,
- Holger Baldauf
  Keio University, Germany
  ,
- Ziyue Wang
  Keio University, Japan
  ,
- Dunya Chen
  Keio University, Japan
  ,
- Akira Kato
  Keio University, Japan
  ,
- Jamie A Ward
  Goldmiths, University of London, United Kingdom
  ,
- Kai Kunze
  Keio University, Japan
March 2023pp 231-242 https://doi.org/10.1145/3582700.3582727

In this paper, we introduce Affective Umbrella, a novel system to record, analyze and visualize physiological data in real time via an umbrella handle. We implement a biofeedback loop design in the system that triggers visualization changes to reflect ...
research-article
Linking Audience Physiology to Choreography
- Jiawen Han
  Keio University, Hiyoshi Kohokuku, Japan
  ,
- George Chernyshov
  Keio University, Hiyoshi Kohokuku, Japan
  ,
- Moe Sugawa
  Keio University, Hiyoshi Kohokuku, Japan
  ,
- Dingding Zheng
  Keio University, Hiyoshi Kohokuku, Japan
  ,
- Danny Hynds
  Keio University, Hiyoshi Kohokuku, Japan
  ,
- Taichi Furukawa
  Keio University, Hiyoshi Kohokuku, Japan
  ,
- Marcelo Padovani Macieira
  Keio University, Hiyoshi Kohokuku, Japan
  ,
- Karola Marky
  Leibniz University Hannover, University of Glasgow, Hannover, Germany
  ,
- Kouta Minamizawa
  Keio University, Hiyoshi Kohokuku, Japan
  ,
- Jamie A. Ward
  Goldsmiths, University of London, New Cross, London, United Kingdom
  ,
- Kai Kunze
  Keio University, Hiyoshi Kohokuku, Japan
March 2023pp 1-32 https://doi.org/10.1145/3557887

The use of wearable sensor technology opens up exciting avenues for both art and HCI research, providing new ways to explore the invisible link between audience and performer. To be effective, such work requires close collaboration between performers and ...
editorial
Augmented Humans: Cyborg visions of the future
- Katia Vega
  University of California, Davis
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
January 2023pp 8-9 https://doi.org/10.1145/3571293
other
Inner self drawing machine
- Qing Zhang
  Keio University Graduate School of Media Design, Yokohama, Kanagawa, Japan
  ,
- Fan Xie
  Institute of Industrial Science, The University of Tokyo, Tokyo, Japan
  ,
- Yifei Huang
  Institute of Industrial Science, The University of Tokyo, Tokyo, Japan
  ,
- Yun Suen Pai
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- George Chernyshov
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Jing Huang
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Xiongqi Wang
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Jamie A Ward
  Department of Computing, Goldsmiths University of London, London, United Kingdom
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
December 2022pp 1-1 https://doi.org/10.1145/3550470.3558429

Besides men and women, people can be neither man nor woman, fluid identity, transgender, and agender. Not only that, in terms of sexual orientation, besides heterosexuals, there are homosexuals, bisexuals, pansexuals, and asexuals as well. However, ...
demonstration
Experience Visual Impairment via Optical See-through Smart Glasses
- Qing Zhang
  Graduate School of Media Design, Keio University, Japan
  ,
- Xiongqi Wang
  Graduate School of Media Design, Keio University, Japan
  ,
- Thad Starner
  Schoolof Interactive Computing, Georgia Institute of Technology, UnitedStates
  ,
- Yifei Huang
  Institute of Industrial Science, The University of Tokyo, Japan
  ,
- George Chernyshov
  Graduate School of Media Design, Keio University, Japan
  ,
- Giulia Barbareschi
  Graduate School of Media Design, Keio University, Japan
  ,
- Yun Suen Pai
  Graduate School of Media Design, Keio University, Japan
  ,
- Jing Huang
  Graduate School of MediaDesign, Keio University, Japan
  ,
- Junichi Yamaoka
  Graduate School of Media Design, Keio University, Japan
  ,
- Jamie Ward
  Computing, Gold smiths University of London, UnitedKingdom
  ,
- Kai Kunze
  Graduate School of MediaDesign, Japan
October 2022pp 1-2 https://doi.org/10.1145/3526114.3558617

As the population ages, many will acquire visual impairments. To improve design for these users, it is essential to build awareness of their perspective during everyday routines. Although several visual impairment simulation toolkits exist in both ...
research-article
Seeing our Blind Spots: Smart Glasses-based Simulation to Increase Design Students’ Awareness of Visual Impairment
- Qing Zhang
  Graduate School of Media Design, Keio University, Japan
  ,
- Giulia Barbareschi
  Graduate School of Media Design, Keio University, Japan
  ,
- Yifei Huang
  Institute of Industrial Science, The University of Tokyo, Japan
  ,
- Juling Li
  Graduate School of Media Design, Keio University, Japan
  ,
- Yun Suen Pai
  Graduate School of Media Design, Keio University, Japan
  ,
- Jamie Ward
  Computing, Goldsmiths University of London, United Kingdom
  ,
- Kai Kunze
  Graduate School of Media Design, Keio University, Japan
October 2022pp 1-14 https://doi.org/10.1145/3526113.3545687

As the population ages, many will acquire visual impairments. To improve design for these users, it is essential to build awareness of their perspective during everyday routines, especially for design students.

Although several visual impairment ...
research-article
“Nah, it’s just annoying!” A Deep Dive into User Perceptions of Two-Factor Authentication
- Karola Marky
  University of Glasgow, Scotland, Technical University of Darmstadt, Germany, Keio University, Japan
  ,
- Kirill Ragozin
  Keio University, Kohoku-ku Yokohama, Japan
  ,
- George Chernyshov
  Keio University, Kohoku-ku Yokohama, Japan
  ,
- Andrii Matviienko
  Technical University of Darmstadt, Darmstadt, Germany
  ,
- Martin Schmitz
  Technical University of Darmstadt, Darmstadt, Germany
  ,
- Max Mühlhäuser
  Technical University of Darmstadt, Darmstadt, Germany
  ,
- Chloe Eghtebas
  Technical University of Munich, Garching bei München, Germany
  ,
- Kai Kunze
  Keio University, Kohoku-ku Yokohama, Japan
October 2022pp 1-32 https://doi.org/10.1145/3503514

Two-factor authentication (2FA) is a recommended or imposed authentication mechanism for valuable online assets. However, 2FA mechanisms usually exhibit user experience issues that create user friction and even lead to poor acceptance, hampering the wider ...
research-article
Frisson Waves: Exploring Automatic Detection, Triggering and Sharing of Aesthetic Chills in Music Performances
- Yan He
  Keio University Graduate School of Media Design, Japan
  ,
- George Chernyshov
  Keio University Graduate School of Media Design, Japan
  ,
- Jiawen Han
  Keio University Graduate School of Media Design, Japan
  ,
- Dingding Zheng
  Keio University Graduate School of Media Design, Japan
  ,
- Ragnar Thomsen
  Keio University Graduate School of Media Design, Japan
  ,
- Danny Hynds
  Keio University Graduate School of Media Design, Japan
  ,
- Muyu Liu
  Cleveland Institute of Music, United States
  ,
- Yuehui Yang
  Keio University Graduate School of Media Design, Japan
  ,
- Yulan Ju
  Keio University Graduate School of Media Design, Japan
  ,
- Yun Suen Pai
  Keio University Graduate School of Media Design, Japan
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
  ,
- Jamie A. Ward
  Goldsmiths, University of London, United Kingdom
September 2022pp 1-23 https://doi.org/10.1145/3550324

Frisson is the feeling and experience of physical reactions such as shivers, tingling skin, and goosebumps. Using entrainment through facilitating interpersonal transmissions of embodied sensations, we present "Frisson Waves" with the aim to enhance live ...
abstract
ImageFlowing-Enhance Emotional Expression by Reproducing the Vital Signs of the Photographer
- Qianqian Mu
  KMD, Keio University Graduate School of Media Design, Japan
  ,
- George Chernyshov
  KMD, Keio University Graduate School of Media Design, Japan
  ,
- Ziyue Wang
  KMD, Keio University Graduate School of Media Design, Japan
  ,
- Danny Hynds
  KMD, Keio University Graduate School of Media Design, Japan
  ,
- Dingding Zheng
  KMD, Keio University Graduate School of Media Design, Japan
  ,
- Kouta Minamizawa
  KMD, Keio University Graduate School of Media Design, Japan
  ,
- Dunya Chen
  KMD, Keio University Graduate School of Media Design, Japan
  ,
- Atsuro Ueki
  KMD, Keio University Graduate School of Media Design, Japan
  ,
- Masa Inakage
  KMD, Keio University Graduate School of Media Design, Japan
  ,
- Kai Kunze
  KMD, Keio University Graduate School of Media Design, Japan
July 2022pp 1-2 https://doi.org/10.1145/3532721.3535565

ImageFlowing is a ‘living’ photograph that reproduces the biometric signs of the photographer. Viewers can feel how the photographer felt through photographer’s breathing, heartbeats and skin temperature. We extend a two-dimensional picture into a multi-...
panel
What We Talk About When We Talk About Human-Computer Integration
- Nathan Arthur Semertzidis
  Exertion Games Lab, Monash University, Australia
  ,
- Zoe Xiao Fang
  Exertion Games Lab, Monash University, Australia
  ,
- Pedro Lopes
  University of Chicago, United States
  ,
- Kai Kunze
  Keio Media Design, Keio University, Japan
  ,
- Paul Pangaro
  Human-Computer Interaction Institute, Carnegie Mellon University, United States
  ,
- Florian Floyd Mueller
  Exertion Games Lab, Monash University, Australia
  ,
- Pattie Maes
  MIT Media Lab, United States
April 2022pp 1-4 https://doi.org/10.1145/3491101.3516509

In 2017, a CHI panel titled “Integration vs Powerful tools” debated whether our relationship with digital technology had begun to shift from interaction to integration. Today, Human-Computer integration developed into an emerging paradigm, rapidly ...
extended-abstract
Toolkits & Wearables: Developing Toolkits for Exploring Wearable Designs
- Caglar Genc
  University of Lapland, Finland
  ,
- Oguz 'Oz Buruk
  Gamification Group, Faculty of Information Technology and Communications, Tampere University, Finland
  ,
- Shiva Jabari
  Gamification Group, Faculty of Information Technology and Communications, Tampere University, Finland
  ,
- Lee Jones
  Creative Interactions Lab, Carleton University, Canada
  ,
- Kirill Ragozin
  Media Design / Geist, Keio University, Japan
  ,
- Kate Hartman
  OCAD University, Canada
  ,
- Johanna Virkki
  Tampere University, Finland
  ,
- Kai Kunze
  KMD, Keio University, Japan
  ,
- Oskar Juhlin
  Department of Computing and Systems Sciences, Stockholm University, Sweden
  ,
- Jonna Häkkilä
  University of Lapland, Finland
April 2022pp 1-5 https://doi.org/10.1145/3491101.3503715

Designing wearables is a complex task that includes many layers, such as wearability, interactivity, functionality, social and cultural considerations. For decades now, prototyping toolkits are proposed to aid diverse types of audiences in exploring ...
wip
GazeSync: Eye Movement Transfer Using an Optical Eye Tracker and Monochrome Liquid Crystal Displays
- Qing Zhang
  Keio University, Japan
  ,
- Yifei Huang
  Institute of Industrial Science, The University of Tokyo, Japan
  ,
- George Chernyshov
  Graduate School of Media Design, Keio University, Japan
  ,
- Juling Li
  Graduate School of Media Design, Keio University, Japan
  ,
- Yun Suen Pai
  Graduate School of Media Design, Keio University, Japan
  ,
- Kai Kunze
  Graduate School of Media Design, Keio University, Japan
March 2022pp 54-57 https://doi.org/10.1145/3490100.3516469

Can we see the world through the eyes of somebody else? We present an early work to transfer eye gaze from one person to another. Imagine you can follow the eye gaze of an instructor while explaining a complex work step, or you can experience a painting ...
wip
ThermalDrive - Towards Situation Awareness over Thermal Feedback in Automated Driving Scenarios
- Xiaru Meng
  Keio Media Design, Keio University, Japan
  ,
- Jiawen Han
  Keio Media Design, Keio University, Japan
  ,
- George Chernyshov
  Keio Media Design, Keio University, Japan
  ,
- Kirill Ragozin
  Keio Media Design, Keio University, Japan
  ,
- Kai Kunze
  Keio Media Design, Keio University, Japan
March 2022pp 101-104 https://doi.org/10.1145/3490100.3516453

We present ThermalDrive, a thermal interface that provided situational awareness information using thermal feedback on the face of the driver. A prototype is built to simulate the autonomous driving and the thermal interface in virtual reality. We ...
poster
Towards Applying Pneumatic Gel Muscles to Augment Plantar Flexor Muscle Stretching for Children with Cerebral Palsy
- Zilan Chen
  Keio Media Design, Japan
  ,
- Sujuan Wang
  Department of Rehabilitation, Childrens Hospital of Fudan University, China
  ,
- Swagata Das
  Hiroshima University, Japan
  ,
- Yuichi Kurita
  Hiroshima University, Japan
  ,
- Takashi Goto
  Hamburg University of Applied Science, Germany
  ,
- Chun Zhai
  Department of Rehabilitation, Childrens Hospital of Fudan University, China
  ,
- Lei Xu
  Department of Rehabilitation, Childrens Hospital of Fudan University, China
  ,
- Kai Kunze
  Keio University, Japan
March 2022pp 337-340 https://doi.org/10.1145/3519391.3524179

Many children in the world suffer from cerebral palsy (CP), which is the leading cause of children’s disabilities, affecting their body movement and muscle coordination [18]. At present, the rehabilitation training of children with cerebral palsy has ...
poster
Towards Underwater Augmented Reality Interfaces to Improve the Navigation Experience
- Ewa Anna Szyszka
  Keio Media Design, Keio University, Japan
  ,
- Kai Kunze
  Keio Media Design, Keio University, Japan
March 2022pp 291-293 https://doi.org/10.1145/3519391.3524175

In this paper, we present initial work towards evaluating augmented reality interfaces to enhance underwater navigation. We propose a conceptual framework that combines real-time GPS coordinates fetched from an Aqua-Fi module with computer vision ...
poster
Embodied Noise – Towards Augmenting the Dart-Throwing Practice over a Sleeve with Randomized Haptic Actuation
- Takuro Nakao
  Keio University, Japan
  ,
- Keitaro Tsuchiya
  Keio University, Japan
  ,
- Shinya Shimizu
  NTT Media Intelligence Laboratory, Japan
  ,
- Megumi Isogai
  NTT Media Intelligence Laboratory, Japan
  ,
- Kai Kunze
  Keio University, Japan
March 2022pp 330-333 https://doi.org/10.1145/3519391.3524036

Effective training lives from a large degree of variation according to physiological research principles of deliberate practice. In this paper, we introduce a novel way of training by adding kinetic noise (randomized haptic vibrations) to the training ...
short-paper
EyeMove - Towards Mobile Authentication using EOG Glasses
- Kirill Ragozin
  Keio University, Japan
  ,
- Karola Marky
  University of Glasgow, Germany
  ,
- Jie Lu
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
March 2022pp 10-14 https://doi.org/10.1145/3519391.3519411

Existing approaches for mobile authentication are prone to shoulder-surfing and side-channel attacks. Using gazes for authentication has been demonstrated to be more resistant to these attacks. Yet, existing solutions rely on eye-tracking by the device’...
wip
Emolleia – Wearable Kinetic Flower Display for Expressing Emotions
- Yifan Zhuang
  Graduate School of Media Design, Keio University, Japan
  ,
- Keitaro Tsuchiya
  Graduate School of Media Design, Keio University, Japan
  ,
- Takuro Nakao
  Graduate School of Media Design, Keio University, Japan
  ,
- Jiawen Han
  Graduate School of Media Design, Keio University, Japan
  ,
- Megumi Isoga
  Media Intelligence Laboratories, NTT, Japan
  ,
- Shinya Shimizu
  Media Intelligence Laboratories, NTT, Japan
  ,
- Kai Kunze
  Graduate School of Media Design, Keio University, Japan
February 2022pp 1-6 https://doi.org/10.1145/3490149.3505581

What we wear (our clothes and wearable accessories) can represent our mood at the moment. We developed Emolleia to explore how to make aesthetic wears more expressive to become a novel form of non-verbal communication to express our emotional feelings. ...
wip
Ethereal Phenomena - Interactive Art, Meditation, and Breathing Biofeedback: From Mind and Body Wellness Towards Self-Transcendence
- Silvana Malaver Turbay
  Graduate School of Media Design, Keio University, Japan
  ,
- Igor Igorevich Segrovets
  Department of Mechanical Engineering, Tokyo Institute of Technology, Japan
  ,
- George Chernyshov
  Graduate School of Media Design, Keio University, Japan
  ,
- Jiawen Han
  Graduate School of Media Design, Keio University, Japan
  ,
- Christopher Changmok Kim
  Graduate School of Media Design, Keio University, Japan
  ,
- Kai Kunze
  Graduate School of Media Design, Keio University, Japan
February 2022pp 1-6 https://doi.org/10.1145/3490149.3505567

Ethereal Phenomena is an interactive installation in which a user meditates in front of a digital illustration based on Tibetan thangka art that reacts to the way they breathe. The biofeedback of the breath makes the artwork an extension of the user’s ...
other
Ethereal Phenomena
- Silvana Malaver
  Keio University Graduate School of Media Design, Japan
  ,
- Natalia Barragán Nieto
  Universidad de los Andes, Colombia
  ,
- Igor Igorevich Segrovets
  Tokyo Institute of Technology, Japan
  ,
- Carlos Rizzi
  Sabana Records, Colombia
  ,
- George Chernyshov
  Keio University Graduate School of Media Design, Japan
  ,
- Christopher Changmok Kim
  Keio University Graduate School of Media Design, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
December 2021pp 1-1 https://doi.org/10.1145/3476123.3487870

"Ethereal Phenomena" is an illustration based on Tibetan thangka art that reacts to the breath.

Breathing is the only visceral function of the body that we are able to control. It reflects and influences all aspects of our perception and emotion. It is ...
poster
BridgedReality: A Toolkit Connecting Physical and Virtual Spaces through Live Holographic Point Cloud Interaction
- Mark Armstrong
  Keio University Graduate School of Media Design, Japan
  ,
- Lawrence Quest
  Keio University Graduate School of Media Design, Japan
  ,
- Yun Suen Pai
  Keio University Graduate School of Media Design, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design, Japan
December 2021pp 1-3 https://doi.org/10.1145/3476124.3488656

The recent emergence of point cloud streaming technologies has spawned new ways to digitally perceive and manipulate live data of users and spaces. The graphical rendering limitations prevent state-of-the-art interaction techniques from achieving ...
abstract
Frisson Waves: Sharing Frisson to Create Collective Empathetic Experiences for Music Performances
- Yan He
  Keio University Graduate School of Media Design, Japan
  ,
- George Chernyshov
  Keio University Graduate School of Media Design, Japan
  ,
- Dingding Zheng
  Keio University Graduate School of Media Design, Japan
  ,
- Jiawen Han
  Keio University Graduate School of Media Design, Japan
  ,
- Ragnar Thomsen
  Keio University Graduate School of Media Design, Japan
  ,
- Danny Hynds
  Keio University Graduate School of Media Design, Japan
  ,
- Yuehui Yang
  Keio University Graduate School of Media Design, Japan
  ,
- Yun Suen Pai
  Keio University Graduate School of Media Design, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design, Japan
December 2021pp 1-2 https://doi.org/10.1145/3476122.3484847

Frisson is a feeling and a mental experience of body reactions such as shivers, tingling skin, and goosebumps. However, this sensation is not shareable naturally with others and is rarely used in live performances. We propose Frisson Waves, a real-time ...
research-article
Using Smart Eyewear to Sense Electrodermal Activity While Reading
- Christopher Changmok Kim
  Keio University, Japan
  ,
- Jiawen Han
  Keio University, Japan
  ,
- Dingding Zheng
  Keio University, Japan
  ,
- George Chernyshov
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
September 2021pp 472-475 https://doi.org/10.1145/3460418.3479356

In this paper, we present the use of smart eyewear as reading glasses and as non-intrusive sensing devices that can measure the electrodermal activity (EDA) of readers of fiction in real-time using electrodes on the forehead. EDA has seen extensive use ...
poster
Poster: A Participatory Workshop to Design Vibrothermal Haptics of a Smart Fidget Surface for Remote Workers
- Yuyu Lee
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
September 2021pp 46-47 https://doi.org/10.1145/3460418.3479279

In this paper, we describe our progress on designing a passive fidgeting material for remote work scenarios. We focus on vibrotactile feedback and present the insights of a remote workshop with 6 participants exploring materials with haptic feedback. ...
research-article
Eyewear 2021 The Forth Workshop on Eyewear Computing – Augmenting Social Situations and Democratizing Tools
- Kirill Ragozin
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Teresa Hirzle
  Ulm University, Germany
  ,
- Benjamin Tag
  University of Melbourne, Australia
  ,
- Yuji Uema
  JINS Inc., Japan
  ,
- Enrico Rukzio
  University of Ulm, Germany
  ,
- Jamie A Ward
  Goldsmiths University of London, United Kingdom
September 2021pp 458-461 https://doi.org/10.1145/3460418.3479267

Head-worn sensing, especially embedded in augmented and virtual reality (AR/VR) head-mounted displays and smart glasses is currently increasingly moving away from niche applications and small-scale research prototypes to large-scale consumer adoption (...
short-paper
Tunnel Vision – Dynamic Peripheral Vision Blocking Glasses for Reducing Motion Sickness Symptoms
- Qing Zhang
  Keio University, Japan
  ,
- Hiroo Yamamura
  Media design, Japan
  ,
- Holger Baldauf
  Keio University, Japan
  ,
- Dingding Zheng
  Keio University, Japan
  ,
- Kanyu Chen
  Keio University, Japan
  ,
- Junichi Yamaoka
  Keio University, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
September 2021pp 48-52 https://doi.org/10.1145/3460421.3478824

Motion sickness affects roughly a third of all people. Narrowing the field of view (FOV) can help to reduce motion sickness symptoms. In this paper, we present Tunnel Vision, a type of smart glasses that can dynamically block a wearer’s peripheral ...
research-article
Investigating Usability and User Experience of Individually Verifiable Internet Voting Schemes
- Karola Marky
  Technical University of Darmstadt, University of Glasgow, Lilybank Gardens, Glasgow, United Kingdom
  ,
- Marie-Laure Zollinger
  University of Luxembourg, Esch-sur-Alzette, Luxembourg
  ,
- Peter Roenne
  University of Luxembourg, Esch-sur-Alzette, Luxembourg
  ,
- Peter Y. A. Ryan
  University of Luxembourg, Esch-sur-Alzette, Luxembourg
  ,
- Tim Grube
  Technical University of Darmstadt, Darmstadt, Germany
  ,
- Kai Kunze
  Keio University, Kohoku-ku, Yokohama, Japan
September 2021pp 1-36 https://doi.org/10.1145/3459604

Internet voting can afford more inclusive and inexpensive elections. The flip side is that the integrity of the election can be compromised by adversarial attacks and malfunctioning voting infrastructure. Individual verifiability aims to protect against ...
poster
Affective Umbrella – Towards a Novel Sensor Integrated Multimedia Platform Using Electrodermal and Heart Activity in an Umbrella Handle
- Kanyu Chen
  Keio University, Japan
  ,
- Jiawen Han
  Keio University, Japan
  ,
- George Chernyshov
  Keio University, Japan
  ,
- Christopher Kim
  Keio University, Japan
  ,
- Ismael Rasa
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
May 2021pp 208-210 https://doi.org/10.1145/3490632.3497835

We present our first steps towards an umbrella-based novel multimedia platform using physiological data as an integrated feedback loop. In this paper, we demonstrate the viability of using an umbrella handle as a form factor to measure electrodermal ...
poster
Exploring Collective Physiology Sharing as Social Cues to Support Engagement in Online Learning
- Jiawen Han
  Keio University Graduate School of Media Design, Japan
  ,
- Chi-Lan Yang
  The University of Tokyo, Japan
  ,
- George Chernyshov
  Keio University Graduate School of Media Design, Japan
  ,
- Zhuoqi Fu
  Keio University Graduate School of Media Design, Japan
  ,
- Reiya Horii
  Keio University Graduate School of Media Design, Japan
  ,
- Takuji Narumi
  The University of Tokyo, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
May 2021pp 192-194 https://doi.org/10.1145/3490632.3497827

Insufficient social cues between distributed learners in online learning could result in lack of engagement and social bonds. With the development of wearable sensing, sharing physiological data can be used to enhance mutual understanding and ...
research-article
ThermoQuest - A Wearable Head Mounted Display to Augment Realities with Thermal Feedback
- Kirill Ragozin
  Keio University, Japan
  ,
- Xiaru Meng
  Keio University, Japan
  ,
- Roshan Lalintha Peiris
  Rochester Institute of Technology, United States
  ,
- Katrin Wolf
  Beuth University of Applied Sciences Berlin, Germany
  ,
- George Chernyshov
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
May 2021pp 62-66 https://doi.org/10.1145/3490632.3490649

We present ThermoQuest, a self-contained wearable head-mounted display system for enhancing Virtual Reality experiences with temperature feedback. It’s constructed with commodity hardware elements, featuring 6 Peltier elements on the rim of the headset ...
poster
JINSense: Repurposing Electrooculography Sensors on Smart Glass for Midair Gesture and Context Sensing
- Hui-Shyong Yeo
  School of Computer Science University of St Andrews, United Kingdom
  ,
- Juyoung Lee
  Graduate School of Culture Technology KAIST, Korea, Republic of
  ,
- Woontack Woo
  Graduate School of Culture Technology KAIST, Korea, Republic of
  ,
- Hideki Koike
  School of Computing Tokyo Institute of Technology, Japan
  ,
- Aaron J Quigley
  Computer Science and Engineering UNSW, Australia
  ,
- Kai Kunze
  KMD Keio University, Japan
May 2021pp 1-6 https://doi.org/10.1145/3411763.3451741

In this work, we explore a new sensing technique for smart eyewear equipped with Electrooculography (EOG) sensors. We repurpose the EOG sensors embedded in a JINS MEME smart eyewear, originally designed to detect eye movement, to detect midair hand ...
poster
Haptic Empathy: Conveying Emotional Meaning through Vibrotactile Feedback
- Yulan Ju
  Graduate school of Media Design Keio University, Japan
  ,
- Dingding Zheng
  KMD Keio University, Japan
  ,
- Danny Hynds
  Embodied Media Lab Keio University Graduate School of Media Design, Japan
  ,
- George Chernyshov
  KMD Keio University, Japan
  ,
- Kai Kunze
  KMD Keio University, Japan
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design, Japan
May 2021pp 1-7 https://doi.org/10.1145/3411763.3451640

Touch plays an essential role in communicating emotions and intensifying interpersonal communication[4]. A lot of research focuses on how to create or improve haptic interfaces looking into challenges and possibilities that the haptic technology can ...
extended-abstract
SIGHInt: Special Interest Group for Human-Computer Integration
- Nathan Arthur Semertzidis
  Exertion Games Lab Monash University, Australia
  ,
- Michaela Vranic-Peters
  Exertion Games Lab Monash University, Australia
  ,
- Xiao Fang
  Exertion Games Lab Monash University, Australia
  ,
- Xinyi Wang
  Exertion Game Lab Monash University, Australia
  ,
- Rakesh Patibanda
  Exertion Games Lab Monash University, Australia
  ,
- Josh Andres
  Exertion Games Lab Monash University, Australia
  ,
- Paul Strohmeier
  Saarland Informatics Campus Saarland University, Germany
  ,
- Kai Kunze
  KMD Keio University, Japan
  ,
- Pedro Lopes
  University of Chicago, United States
  ,
- Fabio Zambetta
  RMIT University, Australia
  ,
- Florian Floyd Mueller
  Exertion Games Lab Monash University, Australia
May 2021pp 1-3 https://doi.org/10.1145/3411763.3450400

Human-Computer Integration (HInt) is a growing paradigm within HCI which seeks to understand how humans can, and already are, merging with computational machines. HInt’s recent inception and evolution has seen much discussion in a variety of symposiums, ...
extended-abstract
Body As Starting Point 4: Inbodied Interaction Design for Health Ownership.
- m.c. schraefel
  University of Southampton, United Kingdom
  ,
- Josh Andrés
  IBM Research, Australia
  ,
- Aaron Tabor
  University of New Brunswick, Canada
  ,
- Scott Bateman
  University of New Brunswick, Canada
  ,
- Abby Wanyu Liu
  IRCAM-CNRS Sorbonne Univerité, France
  ,
- Mike Jones
  Bringham Young University, USA
  ,
- Kai Kunze
  Keio University (KMD), Japan
  ,
- Elizabeth Murnane
  Dartmouth College, USA
  ,
- Steeven Villa
  LMU Munich, Germany
May 2021pp 1-5 https://doi.org/10.1145/3411763.3441335

This Fourth Body as a Starting Point workshop investigates how to design interactive health technologies that assist users in developing insourcing abilities and then assist users in letting go of the same technology—in other words, supporting a ...
extended-abstract
Immersive Inclusivity at CHI: Design and Creation of Inclusive User Interactions Through Immersive Media
- Bektur Ryskeldiev
  University of Tsukuba and Mercari R4D, Japan
  ,
- Yoichi Ochiai
  University of Tsukuba, Japan
  ,
- Koki Kusano
  Merpay and Mercari R4D, Japan
  ,
- Jie Li
  CWI, Netherlands
  ,
- Yamen Saraiji
  Avatarin Inc, Japan
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Mark Billinghurst
  University of Auckland, New Zealand
  ,
- Suranga Nanayakkara
  University of Auckland, New Zealand
  ,
- Yusuke Sugano
  University of Tokyo, Japan
  ,
- Tatsuya Honda
  Fujitsu Limited, Japan
May 2021pp 1-4 https://doi.org/10.1145/3411763.3441322

Immersive media is becoming increasingly common in day-to-day scenarios: from extended reality systems to multimodal interfaces. Such ubiquity opens an opportunity for building more inclusive environments for users with disabilities (permanent, ...
poster
Boiling Mind - A Dataset of Physiological Signals during an Exploratory Dance Performance
- Zhuoqi Fu
  Keio University, Japan
  ,
- Jiawen Han
  Keio University, Japan
  ,
- Dingding Zheng
  Keio University, Japan
  ,
- Moe Sugawa
  Keio University, Japan
  ,
- Taichi Furukawa
  Keio University, Japan
  ,
- Chernyshov George
  Keio University, Japan
  ,
- Hynds Danny
  Keio University, Japan
  ,
- Padovani Marcelo
  Keio University, Japan
  ,
- Marky Karola
  Technische Universität Darmstadt, Germany
  ,
- Kouta Minamizawa
  Keio University, Japan
  ,
- Jamie A Ward
  Goldsmiths University of London, United Kingdom
  ,
- Kai Kunze
  Keio University, Japan
February 2021pp 301-303 https://doi.org/10.1145/3458709.3459006

The relationship between audience and performers is crucial to what makes live events so special. The aim of this work is to develop a new approach amplifying the link between audiences and performers. Specifically, we explore the use of wearable ...
research-article
HemodynamicVR - Adapting the User’s Field Of View during Virtual Reality Locomotion Tasks to Reduce Cybersickness using Wearable Functional Near-Infrared Spectroscopy
- Hiroo Yamamura
  Keio University, Japan
  ,
- Holger Baldauf
  Keio University, Germany
  ,
- Kai Kunze
  Keio University, Japan
February 2021pp 223-227 https://doi.org/10.1145/3458709.3458994

We present HemodynamicVR, a virtual reality headset combined with functional near-infrared spectroscopy (fNIRS). We believe that sensing brain activity will enable novel interactions in virtual reality. In this paper, we assess a user’s cybersickness ...
poster
Tranquillity at Home: Designing Plant-mediated Interaction for Fatigue Assessment
- Michi Kanda
  Keio Media Design, Japan
  ,
- Kai Kunze
  Keio Media Design, Japan
February 2021pp 292-294 https://doi.org/10.1145/3458709.3458978

This paper presents a human-plant interaction system that helps observe daily mental fatigue levels by enabling the synchronisation of human eye blink data with plant health. We want to facilitate introspection on our subjective well-being by ...
research-article
Boiling Mind: Amplifying the Audience-Performer Connection through Sonification and Visualization of Heart and Electrodermal Activities
- Moe Sugawa
  Keio university of Media design graduate School, Japan
  ,
- Taichi Furukawa
  Keio University Graduate School of Media Design, Japan
  ,
- George Chernyshov
  KMD Keio University, Japan
  ,
- Danny Hynds
  KMD Keio University, Japan
  ,
- Jiawen Han
  KMD Keio University, Japan
  ,
- Marcelo Padovani
  Keio University Graduate School of Media Design, Japan
  ,
- Dingding Zheng
  KMD Keio University, Japan
  ,
- Karola Marky
  Telecooperation Lab Technische Universität Darmstadt, Germany
  ,
- Kai Kunze
  KMD Keio University, Japan
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design, Japan
February 2021pp 1-10 https://doi.org/10.1145/3430524.3440653

In stage performances, an invisible wall in front of the stage often weakens the connections between the audience and performers. To amplify this performative connection, we present the concept ”Boiling Mind”. Our design concept is based on streaming ...
short-paper
FingerFlex: Shape Memory Alloy-based Actuation on Fingers for Kinesthetic Haptic Feedback
- Takuro Nakao
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Megumi Isogai
  NTT Media Intelligence Laboratory, Japan
  ,
- Shinya Shimizu
  NTT Media Intelligence Laboratory, Japan
  ,
- Yun Suen Pai
  Auckland Bioengineering Institute, New Zealand
November 2020pp 240-244 https://doi.org/10.1145/3428361.3428404

The tactile and kinesthetic sensation of pushing a button is usually lost when interacting with modern devices like touchscreens and/or virtual reality platforms. We present FingerFlex, a standalone glove wearable actuating the metacarpophalangeal ...
research-article
Multiplex Vision: Understanding Information Transfer and F-Formation With Extended 2-Way FOV
- Mark Armstrong
  Keio Media Design, Japan
  ,
- Keitaro Tsuchiya
  Keio University Graduate School of Media Design 4-1-1Hiyoshi, Japan
  ,
- Feng Liang
  INNOCC Ignition Point Inc., Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Japan
  ,
- Yun Suen Pai
  Empathic Computing Laboratory Auckland Bioengineering Institute University of Auckland, New Zealand
November 2020pp 1-9 https://doi.org/10.1145/3385956.3418954

Research in sociology shows that effective conversation relates to people’s spatial and orientational relationship, namely the proxemics (distance, eye contact, synchrony) and the F-formation (orientation and arrangement). In this work, we introduce ...
research-article
Visuomotor Influence of Attached Robotic Neck Augmentation
- Lichao Shen
  Keio University, Graduate School of Media Design, Japan
  ,
- MHD Yamen Saraiji
  Keio University, Graduate School of Media Design, Japan
  ,
- Kai Kunze
  Keio University, Graduate School of Media Design, Japan
  ,
- Kouta Minamizawa
  Keio University, Graduate School of Media Design, Japan
  ,
- Roshan Lalintha Peiris
  Keio University, Graduate School of Media Design, United States
October 2020pp 1-10 https://doi.org/10.1145/3385959.3418460

The combination of eye and head movements plays a major part in our visual process. The neck provides mobility for the head motion and also limits the range of visual motion in space. In this paper, a robotic neck augmentation system is designed to ...
research-article
”I don’t know how to protect myself”: Understanding Privacy Perceptions Resulting from the Presence of Bystanders in Smart Environments
- Karola Marky
  Technical University of Darmstadt, Germany
  ,
- Alexandra Voit
  University of Stuttgart, Germany
  ,
- Alina Stöver
  Technical University of Darmstadt, Germany
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Svenja Schröder
  University of Vienna, Austria
  ,
- Max Mühlhäuser
  Technical University of Darmstadt, Germany
October 2020pp 1-11 https://doi.org/10.1145/3419249.3420164

IoT devices no longer affect single users only because others like visitors or family members - denoted as bystanders - might be in the device’s vicinity. Thus, data about bystanders can be collected by IoT devices and bystanders can observe what IoT ...
poster
Bubble Visualization Overlay in Online Communication for Increased Speed Awareness and Better Turn Taking
- Reiya Horii
  Keio University, Yokohama, Tokyo, Japan
  ,
- Yurike Chandra
  Keio University, Yokohama, Tokyo, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Tokyo, Japan
  ,
- Kouta Minamizawa
  Keio University, Yokohama, Tokyo, Japan
October 2020pp 59-61 https://doi.org/10.1145/3379350.3416185

In this paper, we explore the use of a real-time speech visualization overlay to help native English speakers (NES) reflect on their speech speed and allow them to understand how English as a Foreign Language speakers (EFLS) perceive their speech. Our ...
poster
Pleasant Locomotion -- Towards Reducing Cybersickness using fNIRS during Walking Events in VR
- Hiroo Yamamura
  Keio University, Yokohama, Japan
  ,
- Holger Baldauf
  Keio University, Yokohama, Japan
  ,
- Kai Kunze
  Keio University, Tokyo, Japan
October 2020pp 56-58 https://doi.org/10.1145/3379350.3416184

Moving in virtual reality without causing cybersickness is still an unsolved and difficult problem, especially if the virtual space is much larger than the real space and the virtual reality environment asks for quick movements. Many methods to reduce ...
poster
Sleepy watch: towards predicting daytime sleepiness based on body temperature
- Jie Bao
  Keio University Graduate School of Media Design
  ,
- Jiawen Han
  Keio University Graduate School of Media Design
  ,
- Akira Kato
  Keio University Graduate School of Media Design
  ,
- Kai Kunze
  Keio University Graduate School of Media Design
September 2020pp 9-12 https://doi.org/10.1145/3410530.3414415

Daytime sleepiness, the difficulty to maintain an alert waking state during the day, is a serious problem causing vehicle accidents and adverse effects on well-being, health, and productivity. Our research aims at predicting daytime sleepiness using ...
abstract
Sophroneo: Fear not. A VR Horror Game with Thermal Feedback and Physiological Signal Loop.
- Kirill Ragozin
  Keio Media Design, Japan
  ,
- George Chernyshov
  Keio Media Design, Japan
  ,
- Dingding Zheng
  Keio Media Design, Japan
  ,
- Danny Hynds
  Keio Media Design, Japan
  ,
- Jianing Zhao
  Kunming, Yunnan, China
  ,
- Kouta Minamizawa
  Keio Media Design, Japan
  ,
- Kai Kunze
  Keio Media Design, Japan
August 2020pp 1-2 https://doi.org/10.1145/3388536.3407894

We present ”Sophroneo: Fear not”, a VR horror experience with thermal feedback interface. To emphasize the supernatural side of the experience we introduce several innovative approaches, such as long intense cold feedback, liminal audio and ...
abstract
MazeRunVR: An Open Benchmark for VR Locomotion Performance, Preference and Sickness in the Wild
- Kirill Ragozin
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Karola Marky
  Technische Universität Darmstadt & Keio University, Darmstadt, Germany
  ,
- Yun Suen Pai
  University of Auckland, Auckland, New Zealand
April 2020pp 1-8 https://doi.org/10.1145/3334480.3383035

Locomotion in virtual reality (VR) is one of the biggest problems for large scale adoption of VR applications. Yet, to our knowledge, there are few studies conducted in-the-wild to understand performance metrics and general user preference for different ...
abstract
All in One! User Perceptions on Centralized IoT Privacy Settings
- Karola Marky
  Technische Universität Darmstadt & Keio University, Darmstadt, Germany
  ,
- Verena Zimmermann
  Technische Universität Darmstadt, Darmstadt, Germany
  ,
- Alina Stöver
  Technische Universität Darmstadt, Darmstadt, Germany
  ,
- Philipp Hoffmann
  Technische Universität Darmstadt, Darmstadt, Germany
  ,
- Kai Kunze
  Keio University, Tokyo, Japan
  ,
- Max Mühlhäuser
  Technische Universität Darmstadt, Darmstadt, Germany
April 2020pp 1-8 https://doi.org/10.1145/3334480.3383016

IoT devices deliver their functionality by accessing data. Users decide which data they are willing to share via privacy settings interfaces that are typically on the device, or in the app controlling it. Thus, users have to interact with each device or ...
abstract
Collaborative Learning & Co-Creation in XR
- Anna Vasilchenko
  Newcastle University, Newcastle, United Kingdom
  ,
- Jie Li
  Centrum Wiskunde & Informatica, Amsterdam, Netherlands
  ,
- Bektur Ryskeldiev
  University of Tsukuba, Tsukuba, Ibaraki, Japan
  ,
- Sayan Sarcar
  University of Tsukuba, Tsukuba, Ibaraki, Japan
  ,
- Yoichi Ochiai
  University of Tsukuba, Tsukuba, Ibaraki, Japan
  ,
- Kai Kunze
  Keio University, Tokyo, Japan
  ,
- Iulian Radu
  Harvard University, Cambridge, MA, USA
April 2020pp 1-4 https://doi.org/10.1145/3334480.3381056

In this SIG, we aim at gathering researchers and practitioners to reflect on using XR technologies to support collaborative learning and co-creation, and to foster a joint force by connecting the Learning and Education community and the XR community at ...
abstract
Motor Memory in HCI
- Rakesh Patibanda
  Monash University, Melbourne, VIC, Australia
  ,
- Nathan Arthur Semertzidis
  Monash University, Melbourne, VIC, Australia
  ,
- Michaela Vranic-Peters
  RMIT University & University of Melbourne, Melbourne, VIC, Australia
  ,
- Joseph Nathan La Delfa
  RMIT University, Melbourne, VIC, Australia
  ,
- Josh Andres
  IBM Research Australia & Monash University, Melbourne, VIC, Australia
  ,
- Mehmet Aydin Baytaş
  Koç University, Istanbul, Turkey
  ,
- Anna Lisa Martin-Niedecken
  Zurich University of the Arts, Zurich, Switzerland
  ,
- Paul Strohmeier
  Saarland University, Saarbrücken, Germany
  ,
- Bruno Fruchard
  Saarland Informatics Campus, Saarbrücken, Germany
  ,
- Sang-won Leigh
  Georgia Institute of Technology, Atlanta, GA, USA
  ,
- Elisa D. Mekler
  Aalto University, Espoo, Finland
  ,
- Suranga Nanayakkara
  The University of Auckland, Auckland, New Zealand
  ,
- Josef Wiemeyer
  Technische Universität Darmstadt, Darmstadt, Germany
  ,
- Nadia Berthouze
  University College London, London, United Kingdom
  ,
- Kai Kunze
  Keio University, Tokyo, Japan
  ,
- Thanassis Rikakis
  Virginia Institute of Technology, Blacksburg, VA, USA
  ,
- Aisling Kelliher
  Virginia Institute of Technology, Blacksburg, VA, USA
  ,
- Kevin Warwick
  Coventry University, Coventry, United Kingdom
  ,
- Elise van den Hoven
  University of Technology Sydney & Eindhoven University of Technology, Sydney, Australia
  ,
- Florian Floyd Mueller
  Monash University, Melbourne, VIC, Australia
  ,
- Steve Mann
  University of Toronto, Toronto, ON, Canada
April 2020pp 1-8 https://doi.org/10.1145/3334480.3375163

There is mounting evidence acknowledging that embodiment is foundational to cognition. In HCI, this understanding has been incorporated in concepts like embodied interaction, bodily play, and natural user-interfaces. However, while embodied cognition ...
research-article
Next Steps for Human-Computer Integration
- Florian Floyd Mueller
  Monash University, Melbourne, VIC, Australia
  ,
- Pedro Lopes
  University of Chicago, Chicago, IL, USA
  ,
- Paul Strohmeier
  University of Copenhagen & Saarland University, Copenhagen, Denmark
  ,
- Wendy Ju
  Cornell Tech, New York, NY, USA
  ,
- Caitlyn Seim
  Stanford University, Stanford, CA, USA
  ,
- Martin Weigel
  Honda Research Institute Europe, Offenbach am Main, Germany
  ,
- Suranga Nanayakkara
  University of Auckland, Auckland, New Zealand
  ,
- Marianna Obrist
  University of Sussex, Brighton, United Kingdom
  ,
- Zhuying Li
  Monash University, Melbourne, VIC, Australia
  ,
- Joseph Delfa
  Monash University, Melbourne, VIC, Australia
  ,
- Jun Nishida
  University of Chicago, Chicago, IL, USA
  ,
- Elizabeth M. Gerber
  Northwestern University, Evanston, IL, USA
  ,
- Dag Svanaes
  NTNU, Norwegian University of Scienc, Norway
  ,
- Jonathan Grudin
  Microsoft, Redmond, WA, USA
  ,
- Stefan Greuter
  Deakin University, Melbourne, VIC, Australia
  ,
- Kai Kunze
  Keio University, Tokyo, Japan
  ,
- Thomas Erickson
  Unaffiliated, Minneapolis, MN, USA
  ,
- Steven Greenspan
  CA Technologies, Philadelphia, PA, USA
  ,
- Masahiko Inami
  University of Tokyo, Tokyo, Japan
  ,
- Joe Marshall
  University of Nottingham, Nottingham, Nottinghamshire, United Kingdom
  ,
- Harald Reiterer
  University of Konstanz, Konstanz, Germany
  ,
- Katrin Wolf
  Hamburg University of Applied Sciences, Hamburg, Germany
  ,
- Jochen Meyer
  OFFIS - Institute for Information Technology, Oldenburg, Germany
  ,
- Thecla Schiphorst
  Simon Fraser University, Vancouver, BC, Canada
  ,
- Dakuo Wang
  IBM Research, Cambridge, MA, USA
  ,
- Pattie Maes
  Massachusetts Institute of Technology, Cambridge, MA, USA
April 2020pp 1-15 https://doi.org/10.1145/3313831.3376242

Human-Computer Integration (HInt) is an emerging paradigm in which computational and human systems are closely interwoven. Integrating computers with the human body is not new. however, we believe that with rapid technological advancements, increasing ...
research-article
3D-Auth: Two-Factor Authentication with Personalized 3D-Printed Items
- Karola Marky
  Technische Universität Darmstadt & Keio University, Darmstadt, Germany
  ,
- Martin Schmitz
  Technische Universität Darmstadt, Darmstadt, Germany
  ,
- Verena Zimmermann
  Technische Universität Darmstadt, Darmstadt, Germany
  ,
- Martin Herbers
  Technische Universität Darmstadt, Darmstadt, Germany
  ,
- Kai Kunze
  Keio University, Tokyo, Japan
  ,
- Max Mühlhäuser
  Technische Universität Darmstadt, Darmstadt, Germany
April 2020pp 1-12 https://doi.org/10.1145/3313831.3376189

Two-factor authentication is a widely recommended security mechanism and already offered for different services. However, known methods and physical realizations exhibit considerable usability and customization issues. In this paper, we propose 3D-Auth, ...
poster
Understanding Face Gestures with a User-Centered Approach Using Personal Computer Applications as an Example
- Yenchin Lai
  The University of Bremen
  ,
- Benjamin Tag
  The University of Melbourne
  ,
- Kai Kunze
  Keio University
  ,
- Rainer Malaka
  The University of Bremen
March 2020pp 1-3 https://doi.org/10.1145/3384657.3385333

While face gesture input has been proposed by researchers, the issue of practical gestures remains unsolved. We present the first comprehensive investigation of user-defined face gestures as an augmented input modality. Based on a focus group discussion,...
research-article
OmniView: An Exploratory Study of 360 Degree Vision using Dynamic Distortion based on Direction of Interest
- Feng Liang
  Ignition Point, Inc., Tokyo, Japan
  ,
- Stevanus Kevin
  Keio University, Tokyo, Japan
  ,
- Holger Baldauf
  Keio University, Tokyo, Japan
  ,
- Kai Kunze
  Keio University, Tokyo, Japan
  ,
- Yun Suen Pai
  The University of Auckland, Auckland, New Zealand
March 2020pp 1-10 https://doi.org/10.1145/3384657.3384796

The possibility of providing humans with a 360 field of view (FOV) is an area that has fascinated researchers for some time. We introduce OmniView, an exploratory study to determine an optimized 360 FOV vision using dynamic distortion methods for ...
research-article
GenVibe: Exploration of Interactive Generation of Personal Vibrotactile Patterns
- Erik Pescara
  Karlsruhe Institute of Technology, Karlsruhe, Germany
  ,
- Florian Dreschner
  Karlsruhe Institute of Technology, Karlsruhe, Germany
  ,
- Karola Marky
  Telecooperation Lab, TU, Darmstadt, Germany
  ,
- Kai Kunze
  Keio University, KMD, Yokohama, Japan
  ,
- Michael Beigl
  Karlsruhe Institute of Technology, Karlsruhe, Germany
March 2020pp 1-9 https://doi.org/10.1145/3384657.3384794

Research about vibrotactile patterns is traditionally conducted with patterns handcrafted by experts which are then subsequently evaluated in general user studies. The current empirical approach to designing vibrotactile patterns mostly utilizes expert ...
research-article
Eye-based Interaction Using Embedded Optical Sensors on an Eyewear Device for Facial Expression Recognition
- Katsutoshi Masai
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Kai Kunze
  Keio Media Design Yokohama, Kanagawa, Japan
  ,
- Maki Sugimoto
  Keio University, Yokohama, Kanagawa, Japan
March 2020pp 1-10 https://doi.org/10.1145/3384657.3384787

Non-verbal information is essential to understand intentions and emotions and to facilitate social interaction between humans and between humans and computers. One reliable source of such information is the eyes. We investigated the eye-based ...
research-article
Accelerating Skill Acquisition of Two-Handed Drumming using Pneumatic Artificial Muscles
- Takashi Goto
  Hamburg University of Applied Sciences, Hamburg, Germany
  ,
- Swagata Das
  Hiroshima University, Hiroshima, Japan
  ,
- Katrin Wolf
  Beuth University of Applied Sciences, Berlin, Germany
  ,
- Pedro Lopes
  University of Chicago, Chicago, United States
  ,
- Yuichi Kurita
  Hiroshima University, Hiroshima, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
March 2020pp 1-9 https://doi.org/10.1145/3384657.3384780

While computers excel at augmenting user's cognitive abilities, only recently we started utilizing their full potential to enhance our physical abilities. More and more wearable force-feedback devices have been developed based on exoskeletons, ...
research-article
AromaCue - A Scent Toolkit To Cope with Stress using the 4-7-8 Breathing Method
- Zilan Lin
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Atsuro Ueki
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Masa Inakage
  Keio University, Yokohama, Kanagawa, Japan
February 2020pp 265-272 https://doi.org/10.1145/3374920.3374940

In this paper, we present AromaCue, an initial design for a scent-based toolkit to cope with stressful situations using scent conditioning. The AromaCue toolkit consists of two parts: a breath training device using multiple stimuli and a wearable scent-...
research-article
Experimental Supplements from Mobile Tools for Cognitive Introspection Towards Cognitive Augmentation
- Olivier Augereau
  Osaka Prefecture University, Osaka, Japan
  ,
- Kai Kunze
  Keio University, Tokyo, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Osaka, Japan
November 2019pp 22-24 https://doi.org/10.1145/3372300.3372305

In an increasingly interconnected world with more and more technology surrounding us, more and more people end up with psychological and mental health issues. Mobile Computing technologies is often introduced into society without knowing about impact ...
abstract
PanoFlex: Adaptive Panoramic Vision to Accommodate 360° Field-of-View for Humans
- Feng Liang
  Ignition Point, Inc.
  ,
- Stevanus Kevin
  Keio University
  ,
- Kai Kunze
  Keio University
  ,
- Yun Suen Pai
  ECL, The University of Auckland
November 2019pp 1-2 https://doi.org/10.1145/3359996.3364767

We propose PanoFlex, an adaptive method for projecting panoramic vision using a dynamic distortion method based on eye gaze. We stream real-time video from a 360° camera and project the view on a plane to the user. The user controls the distortion of ...
demonstration
EOG Glasses: an Eyewear Platform for Cognitive and Social Interaction Assessments in the Wild
- George Chernyshov
  Keio Media Design, Japan
  ,
- Kirill Ragozin
  Keio University, Tokyo, Japan
  ,
- Benjamin Tag
  Keio University, Tokyo, Japan
  ,
- Kai Kunze
  Keio Media, Design, Japan
October 2019pp 1-5 https://doi.org/10.1145/3338286.3344418

In this work we present the smart eyewear demo setup consisting of the software platform for cognitive and social interaction assessments in the wild, with several application cases and a demonstration of activity recognition in real-time. The platform ...
demonstration
Watch Spaces: A Spatial User Interface for Smart Watches
- Keitaro Tsuchiya
  Keio University Graduate School of Media Design, Yokohama, Kanagawa, Japan
  ,
- Kaiyuan Lin
  Keio University Graduate School of Media Design, Yokohama, Kanagawa, Japan
  ,
- Takuro Nakao
  Keio University Graduate School of Media Design, Yokohama, Kanagawa, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Kanagawa, Japan
October 2019pp 1-6 https://doi.org/10.1145/3338286.3344412

We present a platform to prototype spatial user interfaces for smart watches relative to the user's body. We show the general feasibility and present 2 applications. The first application scenario enable users "pin" applications in the air around them ...
research-article
Private Reader: Using Eye Tracking to Improve Reading Privacy in Public Spaces
- Kirill Ragozin
  Keio University, Japan
  ,
- Yun Suen Pai
  Keio University, Japan
  ,
- Olivier Augereau
  Osaka Prefecture University, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Japan
  ,
- Jochen Kerdels
  University of Hagen, Germany
  ,
- Kai Kunze
  Keio University, Japan
October 2019pp 1-6 https://doi.org/10.1145/3338286.3340129

Reading in public spaces can often be tricky if we wish to keep the contents away from the prying eye. We propose Private Reader, an eye-tracking approach towards maintaining privacy while reading by rendering only the portion of text that is gazed by ...
short-paper
Blink as you sync: uncovering eye and nod synchrony in conversation using wearable sensing
- Aman Gupta
  Keio University, Yokohama, Japan
  ,
- Finn L Strivens
  Keio University, Yokohama, Japan
  ,
- Benjamin Tag
  Keio University, Yokohama, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Jamie A Ward
  Goldsmiths University of London, London, United Kingdom
September 2019pp 66-71 https://doi.org/10.1145/3341163.3347736

We tend to synchronize our movements to the person we are talking to during face-to-face conversation. Higher interpersonal synchrony is linked to greater empathy and more effortless interactions. This paper presents a first method and a corresponding ...
research-article
Cognitive load assessment from facial temperature using smart eyewear
- Fangqing Zhengren
  Keio Media Design, Japan
  ,
- George Chernyshov
  Keio Media Design, Japan
  ,
- Dingding Zheng
  Keio Media Design, Japan
  ,
- Kai Kunze
  Keio Media Design, Japan
September 2019pp 657-660 https://doi.org/10.1145/3341162.3348391

In this paper we present an approach to detection and estimation of the cognitive load[8, 9] by measuring temperature changes of the forehead and the nose bridge using smart eyewear. The presented system consists of a pair of glasses with four ...
research-article
Electrodermal activity sensing using smart eyewear
- Dingding Zheng
  Keio Media Design, Japan
  ,
- George Chernyshov
  Keio Media Design, Japan
  ,
- Kai Kunze
  Keio Media Design, Japan
September 2019pp 653-656 https://doi.org/10.1145/3341162.3348390

In this paper we present a system prototype capable of assessing electrodermal activity (EDA), also referred to as galvanic skin response (GSR) in smart eyewear form-factor. EDA has a long history in psychological research and has been used for ground ...
abstract
Eyewear 2019: third workshop on eyewear computing - focus: social interactions
- Benjamin Tag
  Keio University
  ,
- Jamie A Ward
  Goldsmiths University of London
  ,
- Yuji Uema
  J!NS Inc.
  ,
- Kai Kunze
  Keio University
September 2019pp 616-618 https://doi.org/10.1145/3341162.3347761

Computing devices worn on the human body have a long history in academic and industrial research, most importantly in wearable computing, mobile eye tracking, and mobile mixed and augmented reality. As humans receive most of their sensory input via the ...
poster
Smart eyewear enabled interactive pet toy for users with limited mobility
- Yuyu Lee
  Keio University, Yokohama, Japan
  ,
- Michi Kanda
  Keio University, Yokohama, Japan
  ,
- Jiarui Zu
  Keio University, Yokohama, Japan
  ,
- Fangqing Zhengren
  Keio University, Yokohama, Japan
  ,
- George Chernyshov
  Keio University, Yokohama, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
September 2019pp 113-116 https://doi.org/10.1145/3341162.3343821

Smart eyewear that detects eye movements and head motions have been applied to studies on detecting oneâĂŹs mental state [5], engagement level in social interactions, and measuring concentration [4]. However, applications for these smart eyewear that ...
demonstration
http://eyewear.pro: an open platform to record and analyze large scale data sets from smart eyewear
- George Chernyshov
  Keio University
  ,
- Kai Kunze
  Keio University
  ,
- Benjamin Tag
  Keio University
  ,
- Jamie A Ward
  Goldsmiths University of London, London, UK
  ,
- Yuji Uema
  J!NS Inc.
September 2019pp 264-265 https://doi.org/10.1145/3341162.3343790

In this demo, we present the smart eyewear toolchain consisting of smart glasses prototypes and a software platform for cognitive and social interaction assessments in the wild, with several application cases and a demonstration of activity recognition ...
demonstration
Dyslexic and private reader: an eye-tracking platform for reading interactions with applications to increase empathy and privacy
- Kirill Ragozin
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
September 2019pp 296-297 https://doi.org/10.1145/3341162.3343788

We present a demonstration based on a MobileHCI 2019 paper to use eye gaze to selectively render or obscure text. Obscuring is used to "simulate" a specific kind of dyslexia. Selectively render text is to give users a more private reading experience in ...
poster
ShareHaptics: a modular haptic feedback system using shape memory alloy for mixed reality shared space applications
- Takuro Nakao
  Keio University, Kanagawa, Japan
  ,
- Stevanus Kevin Santana
  Keio University, Kanagawa, Japan
  ,
- Megumi Isogai
  NTT Media Intelligence Lab, Tokyo, Japan
  ,
- Shinya Shimizu
  NTT Media Intelligence Lab, Tokyo, Japan
  ,
- Hideaki Kimata
  NTT Media Intelligence Lab, Tokyo, Japan
  ,
- Kai Kunze
  Keio University, Kanagawa, Japan
  ,
- Yun Suen Pai
  Keio University, Kanagawa, Japan
July 2019pp 1-2 https://doi.org/10.1145/3306214.3338597

We present ShareHaptics, a novel modular system to provide tactile and pressure feedback in mixed reality applications using a novel actuator: shape memory alloy (SMA). We apply it to fingers, wrist and foot ankle. Although it can be used for haptic ...
research-article
Superhuman sports --- a testing ground for augmenting our senses
- Kai Kunze
  Keio University, Yokohama, Japan and Osaka Prefecture University, Osaka and Passau University
  ,
- Stephan Lukosch
  Delft University of Technology, Netherlands
July 2019pp 38-43 https://doi.org/10.1145/3331069

This article reviews recent developments in superhuman sports with regard to extending the human body and augmenting the playing field, and gives an outlook on future research directions.
research-article
Continuous Alertness Assessments: Using EOG Glasses to Unobtrusively Monitor Fatigue Levels In-The-Wild
- Benjamin Tag
  Keio University, Yokohama, Japan
  ,
- Andrew W. Vargo
  The Kyoto College of Graduate Studies for Informatics, Kyoto, Japan
  ,
- Aman Gupta
  Keio University, Yokohama, Japan
  ,
- George Chernyshov
  Keio University, Yokohama, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Tilman Dingler
  University of Melbourne, Melbourne, Victoria, Australia
May 2019pp 1-12 https://doi.org/10.1145/3290605.3300694

As the day progresses, cognitive functions are subject to fluctuations. While the circadian process results in diurnal peaks and drops, the homeostatic process manifests itself in a steady decline of alertness across the day. Awareness of these changes ...
research-article
Sentiment Pen: Recognizing Emotional Context Based on Handwriting Features
- Jiawen Han
  Keio Media Design, Yokohama, Japan
  ,
- George Chernyshov
  Keio Media Design, Yokohama, Japan
  ,
- Dingding Zheng
  Keio Media Design, Yokohama, Japan
  ,
- Peizhong Gao
  University of Tokyo, Tokyo, Japan
  ,
- Takuji Narumi
  University of Tokyo, Tokyo, Japan
  ,
- Katrin Wolf
  HAW Hamburg, Hamburg, Germany
  ,
- Kai Kunze
  Keio Media Design, Yokohama, Japan
March 2019pp 1-8 https://doi.org/10.1145/3311823.3311868

In this paper, we discuss the assessment of the emotional state of the user from digitized handwriting for implicit human-computer interaction. The proposed concept exemplifies how a digital system could recognize the emotional context of the ...
short-paper
Haptic Collar: Vibrotactile Feedback around the Neck for Guidance Applications
- Stefanie Schaack
  Keio University, Yokohama, Japan
  ,
- George Chernyshov
  Keio University, Yokohama, Japan
  ,
- Kirill Ragozin
  Keio University, Yokohama, Japan
  ,
- Benjamin Tag
  Keio University, Yokohama, Japan
  ,
- Roshan Peiris
  Keio University, Yokohama, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
March 2019pp 1-4 https://doi.org/10.1145/3311823.3311840

In this paper, we present a Haptic Collar prototype, a neck worn band with vibrotactile actuators for eyes-free haptic navigation. We evaluate the system for guidance applications on over 11 users, analyzing 4 different tactile patterns regarding ...
abstract
Virtual gaze: exploring use of gaze as rich interaction method with virtual agent in interactive virtual reality content
- Stevanus Kevin
  Keio University Graduate School of Media Design, Yokohama, Kanagawa
  ,
- Yun Suen Pai
  Keio University Graduate School of Media Design, Yokohama, Kanagawa
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Kanagawa
November 2018pp 1-2 https://doi.org/10.1145/3281505.3281587

Nonverbal cues, especially eye gaze, plays an important role in our daily communication, not just as an indicator of interest, but also as a method to convey information to another party. In this work, we propose a simulation of human eye gaze in ...
abstract
VRTe do: the way of the virtual hand
- Kevin Wennrich
  University of Stuttgart, Stuttgart, Germany
  ,
- Benjamin Tag
  Keio University Graduate School of Media Design, Yokohama, Kanagawa
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Kanagawa
November 2018pp 1-2 https://doi.org/10.1145/3281505.3281578

We are presenting a Virtual Reality training system for Karate kata based on motion capture and Virtual Reality technologies. The system is built as a game, in which the player needs to learn and repeat different kata to progress and reach the next ...
abstract
Hand motion prediction for just-in-time thermo-haptic feedback
- George Chernyshov
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Kirill Ragozin
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Cedric Caremel
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
November 2018pp 1-2 https://doi.org/10.1145/3281505.3281573

This paper presents two innovative design solutions for thermal feedback displays in virtual environments. First solution is aiming to eliminate or decrease the time delay between the user action and onset of the thermal feedback using Machine Learning ...
demonstration
AURA: Urban Personal Projection to Initiate the Communication
- Miyo Okada
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Laura Lugaresi
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Dingding Zheng
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Roshan Peiris
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Katrin Wolf
  Hamburg University of Applied Sciences, Hamburg, Germany
  ,
- Cristian Norlin
  Ericsson Research, Stockholm, Sweden
  ,
- Mikael Anneroth
  Ericsson Research, Stockholm, Sweden
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Masa Inakage
  Keio University Graduate School of Media Design, Yokohama, Japan
November 2018pp 397-399 https://doi.org/10.1145/3279778.3281758

We present a concept of AURA, an urban personal projection to initiate the communication. In this work, we focus on how to break the ice with strangers through technology in urban public space. The Aura, as an enliven spiritual pet, floats around user's ...
demonstration
Artificial Motion Guidance: an Intuitive Device based on Pneumatic Gel Muscle (PGM)
- Takashi Goto
  Keio University, Yokohama, Japan
  ,
- Swagata Das
  Hiroshima University, Hiroshima, Japan
  ,
- Yuichi Kurita
  Hiroshima University, Hiroshima, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
October 2018pp 182-184 https://doi.org/10.1145/3266037.3271644

We present a wearable soft exoskeleton sleeve based on PGM. The sleeve consists of 4 PGMs is controlled by a computing system and can actuate 4 different movements (hand extension, flexion, pronation and supination). Depending on how strong the ...
research-article
MetaArms: Body Remapping Using Feet-Controlled Artificial Arms
- MHD Yamen Saraiji
  Keio University, Yokohama, Japan
  ,
- Tomoya Sasaki
  The University of Tokyo, Tokyo, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Kouta Minamizawa
  Keio University, Yokohama, Japan
  ,
- Masahiko Inami
  The University of Tokyo, Tokyo, Japan
October 2018pp 65-74 https://doi.org/10.1145/3242587.3242665

We introduce MetaArms, wearable anthropomorphic robotic arms and hands with six degrees of freedom operated by the user's legs and feet. Our overall research goal is to re-imagine what our bodies can do with the aid of wearable robotics using a body-...
abstract
EyeWear 2018: Second Workshop on EyeWear Computing
- Benjamin Tag
  Keio University, Yokohama, Japan
  ,
- Christian Holz
  Microsoft Research, Redmond, US
  ,
- Paul Lukowicz
  DFKI, Kaiserslautern, Germany
  ,
- Olivier Augereau
  Osaka Prefecture University, Osaka, Japan
  ,
- Yuji Uema
  J!NS Inc., Tokyo, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
October 2018pp 964-967 https://doi.org/10.1145/3267305.3274140

Virtual/augmented reality headsets, smart sensing glasses and similar "Smart Eyewear" have recently emerged as commercial products and can provide an interesting research platform for a range of research fields, including human-computer interaction, ...
poster
Urban Wanderer: Towards Reconnecting with Our Physical Surroundings
- Xiaohui Lin
  Keio Media Design, Keio University, Yokohama, Japan
  ,
- Cristian Norlin
  Ericsson Research, Consumer Industry Lab, Stockholm, Sweden
  ,
- Masa Inakage
  Keio Media Design, Keio University, Yokohama, Japan
  ,
- Rebeccah Pailes-Friedman
  Pratt Institute, Brooklyn, New York
  ,
- Mikael Anneroth
  Ericsson Research, Consumer Industry Lab, Stockholm, Sweden
  ,
- Kai Kunze
  Keio Media Design, Keio University, Yokohama, Japan
October 2018pp 142-145 https://doi.org/10.1145/3267305.3267657

This paper describes our effort to reconnect people to their surroundings in an urban setting, making them aware of the immediate environment. We present an initial exploration, as well as a first prototype to support urban wandering. Our first insights ...
poster
Piece: Towards Personalized Music Video Annotations Based on the User's Physiological Data
- Ryan Mannschreck
  Keio Media Design, Keio University, Yokohama, Japan
  ,
- Kai Kunze
  Keio Media Design, Keio University, Yokohama, Japan
October 2018pp 150-153 https://doi.org/10.1145/3267305.3267656

Our overall goal of our is to provide a personalized method to categorize and find media content of interest based for individual users, especially focusing on implicit feedback (facial expressions, posture and other reactions). This paper presents an ...
demonstration
UbiTrain: Leveraging the Physical and Virtual Environment for Ubiquitous Sports Training
- Yun Suen Pai
  Keio University Graduate School of Media Design, Kohoku, Yokohama, Japan
  ,
- Megumi Isogai
  NTT Media Intelligence, Laboratories, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Kohoku, Yokohama, Japan
  ,
- Takuro Nakao
  Keio University Graduate School of Media Design, Kohoku, Yokohama, Japan
  ,
- Hideaki Kimata
  NTT Media Intelligence, Laboratories, Japan
October 2018pp 202-206 https://doi.org/10.1145/3267305.3267646

Training for any kind of sports not only requires dedication, but also the correct way of obtaining the necessary information. To maximize training, we delve into the understanding of bridging between spectating and practice by bridging the virtual and ...
poster
Mapping Natural Facial Expressions Using Unsupervised Learning and Optical Sensors on Smart Eyewear
- Katsutoshi Masai
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Yuta Sugiura
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Maki Sugimoto
  Keio University, Yokohama, Kanagawa, Japan
October 2018pp 158-161 https://doi.org/10.1145/3267305.3267562

Our communication highly depends on nonverbal clues, especially on facial expressions. This paper presents the mapping of spontaneous facial expressions in daily conversation using the optical sensors on smart eyewear and unsupervised learning method(...
poster
Flair: Towards a Therapeutic Serious Game for Social Anxiety Disorder
- Ana Y. Romera Sanchez
  Keio Media Design, Keio University, Yokohama, Japan
  ,
- Kai Kunze
  Keio Media Design, Keio University, Yokohama, Japan
October 2018pp 239-242 https://doi.org/10.1145/3267305.3267558

In this paper we present Flair, an interactive fiction game that is intended to serve as a psycho-educational material for the therapeutic treatment of Social Anxiety Disorder (SAD). Along with the game design approach, explanation of the inclusion of ...
research-article
Shape memory alloy wire actuators for soft, wearable haptic devices
- George Chernyshov
  Keio University Graduate, Yokohama, Japan
  ,
- Benjamin Tag
  Keio University Graduate, Yokohama, Japan
  ,
- Cedric Caremel
  Keio University Graduate, Yokohama, Japan
  ,
- Feier Cao
  Keio University Graduate, Yokohama, Japan
  ,
- Gemma Liu
  Keio University Graduate, Yokohama, Japan
  ,
- Kai Kunze
  Keio University Graduate, Yokohama, Japan
October 2018pp 112-119 https://doi.org/10.1145/3267242.3267257

This paper presents a new approach to implement wearable haptic devices using Shape Memory Alloy (SMA) wires. The proposed concept allows building silent, soft, flexible and lightweight wearable devices, capable of producing the sense of pressure on the ...
research-article
Pinchmove: improved accuracy of user mobility for near-field navigation in virtual environments
- Yun Suen Pai
  Keio University Graduate, Yokohama, Japan
  ,
- Zikun Chen
  Keio University Graduate, Yokohama, Japan
  ,
- Liwei Chan
  National Chiao Tung University, Hsinchu, Taiwan
  ,
- Megumi Isogai
  NTT Media Intelligence Laboratories, Tokyo, Japan
  ,
- Hideaki Kimata
  NTT Media Intelligence Laboratories, Tokyo, Japan
  ,
- Kai Kunze
  Keio University Graduate, Yokohama, Japan
September 2018pp 1-11 https://doi.org/10.1145/3229434.3229470

Navigation and mobility mechanics for virtual environments aim to be realistic or fun, but rarely prioritize the accuracy of movement. We propose PinchMove, a highly accurate navigation mechanic utilizing pinch gestures and manipulation of the viewport ...
poster
Make-a-face: a hands-free, non-intrusive device for tongue/mouth/cheek input using EMG
- Takuro Nakao
  Keio University Graduate School of Media Design
  ,
- Yun Suen Pai
  Keio University Graduate School of Media Design
  ,
- Megumi Isogai
  NTT Media Intelligence Laboratories, Japan
  ,
- Hideaki Kimata
  NTT Media Intelligence Laboratories, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design
August 2018pp 1-2 https://doi.org/10.1145/3230744.3230784

Current devices aim to be more hands-free by providing users with the means to interact with them using other forms of input, such as voice which can be intrusive. We propose Make-a-Face; a wearable device that allows the user to use tongue, mouth, or ...
research-article
Dubhap: a sensory substitution based superhuman sport
- George Chernyshov
  Keio Media Design
  ,
- Kirill Ragozin
  Keio Media Design
  ,
- Jiajun Chen
  Keio Media Design
  ,
- Kai Kunze
  Keio Media Design
July 2018pp 1-6 https://doi.org/10.1145/3210299.3210303

Presenting DubHap. A new Superhuman Sport based on the augmentation of human senses. The core idea of the game is to have players perform the activities in a virtual environment that can be sensed, perceived and interacted with only when the player's ...
research-article
Bubble jumper: enhancing the traditional japanese sport sumo with physical augmentation
- Ryoichi Ando
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Akihiro Ando
  Hashilus Co., Ltd., Tokyo, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design, Yokohama, Japan
July 2018pp 1-6 https://doi.org/10.1145/3210299.3210301

This paper introduces Bubble Jumper, a super human sport enhancing your jump and enlarge your bodies circumference (grith) simulating an augmented sumo wrestler. We focus on the experience of superhuman strength in the legs and giving you the feeling of ...
abstract
Anyorbit: orbital navigation in virtual environments with eye-tracking
- Benjamin I. Outram
  Keio University Graduate School of Media Design
  ,
- Yun Suen Pai
  Keio University Graduate School of Media Design
  ,
- Tanner Person
  Keio University Graduate School of Media Design
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design
  ,
- Kai Kunze
  Keio University Graduate School of Media Design
June 2018pp 1-5 https://doi.org/10.1145/3204493.3209579

Gaze-based interactions promise to be fast, intuitive and effective in controlling virtual and augmented environments. Yet, there is still a lack of usable 3D navigation and observation techniques. In this work: 1) We introduce a highly advantageous ...
abstract
Anyorbit: orbital navigation in virtual environments with eye-tracking
- Benjamin I. Outram
  Keio University Graduate School of Media Design
  ,
- Yun Suen Pai
  Keio University Graduate School of Media Design
  ,
- Tanner Person
  Keio University Graduate School of Media Design
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design
  ,
- Kai Kunze
  Keio University Graduate School of Media Design
June 2018pp 1-5 https://doi.org/10.1145/3204493.3204555

Gaze-based interactions promise to be fast, intuitive and effective in controlling virtual and augmented environments. Yet, there is still a lack of usable 3D navigation and observation techniques. In this work: 1) We introduce a highly advantageous ...
abstract
VR Reading UIs: Assessing Text Parameters for Reading in VR
- Tilman Dingler
  University of Melbourne, Melbourne, Australia
  ,
- Kai Kunze
  Keio University, Yokohama City, Japan
  ,
- Benjamin Outram
  Keio University, Yokohama, Japan
April 2018pp 1-6 https://doi.org/10.1145/3170427.3188695

Virtual Reality (VR) devices have increasingly sparked both commercial and academic interest. While applications range from immersive games to real-world simulations, little attention has been given to the display of text in virtual environments. Since ...
poster
Muscle-Wire Glove: Pressure-Based Haptic Interface
- Cedric Caremel
  Keio University, Tokyo, Japan
  ,
- Gemma Liu
  Keio Media Design, Tokyo, Japan
  ,
- George Chernyshov
  Keio Media Design, Tokyo, Japan
  ,
- Kai Kunze
  Keio Media Design, Tokyo, Japan
March 2018pp 1-2 https://doi.org/10.1145/3180308.3180361

This work follows a novel approach to information presentation through haptics using muscle-wire. The muscle-wire is extremely lightweight, silent and does not require complex circuitry. Its property to shrink in length when an electric current is ...
demonstration
Unconstrained Neck: Omnidirectional Observation from an Extra Robotic Neck
- Lichao Shen
  Keio University, Graduate School of Media Design, Yokohama, Japan
  ,
- Mhd Yamen Saraji
  Keio University, Graduate School of Media Design, Yokohama, Japan
  ,
- Kai Kunze
  Keio University, Graduate School of Media Design, Yokohama, Japan
  ,
- Kouta Minamizawa
  Keio University, Graduate School of Media Design, Yokohama, Japan
February 2018pp 1-2 https://doi.org/10.1145/3174910.3174955

Humans are born with physiological limitations in terms of the sensory and motor abilities. Due to the narrow range of motion of the neck and the small visual field of the eyes, the human visual sense is limited in terms of the spatial range. We address ...
demonstration
Automated Data Gathering and Training Tool for Personalized "Itchy Nose"
- Juyoung Lee
  Korea Advanced Institute of Science Technology, Daejeon, Republic of Korea
  ,
- Hui-Shyong Yeo
  University of St Andrews, Scotland, United Kingdom
  ,
- Thad Starner
  Georgia Institute of Technology, Atlanta, Georgia, United States
  ,
- Aaron Quigley
  University of St Andrews, Scotland, United Kingdom
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Woontack Woo
  Korea Advanced Institute of Science Technology, Daejeon, Republic of Korea
February 2018pp 1-3 https://doi.org/10.1145/3174910.3174953

In "Itchy Nose" we proposed a sensing technique for detecting finger movements on the nose for supporting subtle and discreet interaction. It uses the electrooculography sensors embedded in the frame of a pair of eyeglasses for data gathering and uses ...
poster
Towards Enhancing Emotional Responses to Media using Auto-Calibrating Electric Muscle Stimulation (EMS)
- Takashi Goto
  Keio University Graduate School of Media Design
  ,
- Benjamin Tag
  Keio University Graduate School of Media Design
  ,
- Kai Kunze
  Keio University Graduate School of Media Design
  ,
- Tilman Dingler
  Osaka Prefecture University
February 2018pp 1-2 https://doi.org/10.1145/3174910.3174939

We evaluate the use of Electric Muscle Stimulation (EMS) as a method of amplifying emotional responses to multimedia content. This paper presents an auto-calibration method to stimulate two facial expressions using EMS. We focus on two expressions: ...
research-article
Wordometer Systems for Everyday Life
- Olivier Augereau
  Osaka Prefecture University, Graduate School of Engineering
  ,
- Charles Lima Sanches
  Osaka Prefecture University, Graduate School of Engineering
  ,
- Koichi Kise
  Osaka Prefecture University, Graduate School of Engineering
  ,
- Kai Kunze
  Keio University, Graduate School of Media Design
January 2018pp 1-21 https://doi.org/10.1145/3161601

We present in this paper a detailed comparison of different algorithms and devices to determine the number of words read in everyday life. We call our system the “Wordometer”. We used three kinds of eye tracking systems in our experiment: mobile video-...
research-article
Evaluation of Facial Expression Recognition by a Smart Eyewear for Facial Direction Changes, Repeatability, and Positional Drift
- Katsutoshi Masai
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Yuta Sugiura
  Keio University, Japan
  ,
- Masa Ogata
  National Institute of Advanced Industrial Science Technology, Japan
  ,
- Masahiko Inami
  The University of Tokyo, Japan
  ,
- Maki Sugimoto
  Keio University, Japan
December 2017pp 1-23 https://doi.org/10.1145/3012941

This article presents a novel smart eyewear that recognizes the wearer’s facial expressions in daily scenarios. Our device uses embedded photo-reflective sensors and machine learning to recognize the wearer’s facial expressions. Our approach focuses on ...
research-article
Armswing: using arm swings for accessible and immersive navigation in AR/VR spaces
- Yun Suen Pai
  Keio University
  ,
- Kai Kunze
  Keio University
November 2017pp 189-198 https://doi.org/10.1145/3152832.3152864

Navigating in a natural way in augmented reality (AR) and virtual reality (VR) spaces is a large challenge. To this end, we present ArmSwingVR, a locomotion solution for AR/VR spaces that preserves immersion, while being low profile compared to current ...
extended-abstract
EMS icons: conveying information by analogy to enhance communication through electrical muscle stimulation
- Tilman Dingler
  Osaka Prefecture University, Osaka, Japan
  ,
- Takashi Goto
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Benjamin Tag
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
September 2017pp 732-739 https://doi.org/10.1145/3123024.3129275

Electrical Muscle Stimulation (EMS) has recently received an increased amount of attention from the HCI community. It has been used to remote control users for navigation and instrument playing, but also as a method to convey haptic feedback in VR, for ...
extended-abstract
Quantified reading and learning for sharing experiences
- Koichi Kise
  Osaka Prefecture University
  ,
- Olivier Augereau
  Osaka Prefecture University
  ,
- Yuzuko Utsumi
  Osaka Prefecture University
  ,
- Masakazu Iwamura
  Osaka Prefecture University
  ,
- Kai Kunze
  Keio University
  ,
- Shoya Ishimaru
  German Research Center for Artificial Intelligence (DFKI)
  ,
- Andreas Dengel
  German Research Center for Artificial Intelligence (DFKI)
September 2017pp 724-731 https://doi.org/10.1145/3123024.3129274

This paper presents two topics. The first is an overview of our recently started project called "experiential supplement", which is to transfer human experiences by recording and processing them to be acceptable by others. The second is sensing ...
extended-abstract
Towards reading trackers in the wild: detecting reading activities by EOG glasses and deep neural networks
- Shoya Ishimaru
  German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
  ,
- Kensuke Hoshika
  Osaka Prefecture University, Sakai, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Sakai, Japan
  ,
- Andreas Dengel
  German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
September 2017pp 704-711 https://doi.org/10.1145/3123024.3129271

Reading in real life occurs in a variety of settings. One may read while commuting to work, waiting in a queue or lying on the sofa relaxing. However, most of current activity recognition work focuses on reading in fully controlled experiments. This ...
extended-abstract
Towards interactive mindfulness training using breathing based feedback
- Andrea M. Pisa
  Royal College of Art and Imperial College London, London, UK
  ,
- George Chernyshov
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Andriana F. Nassou
  Royal College of Art and Imperial College London, London, UK
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
September 2017pp 688-692 https://doi.org/10.1145/3123024.3129268

Although regular meditation practice is linked to numerous mental health and cognitive benefits, it is often difficult for beginners to maintain focus during practice and persevere with the activity over time. To tackle this issue, we externalised the ...
research-article
WAHM - 4th workshop on ubiquitous technologies to augment the human mind: sharing experiences
- Sarah Clinch
  The University of Manchester, United Kingdom
  ,
- Tilman Dingler
  University of Stuttgart, Germany
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Passant ElAgroudy
  University of Stuttgart, Germany
  ,
- Tsutomu Terada
  Kobe University, Japan
September 2017pp 662-665 https://doi.org/10.1145/3123024.3124459

A recurring science fiction theme is the downloading of abilities from another human to one's own mind. Emerging technologies beyond simple audio/video recordings such as: 360° videos, tactile recorders and odor recorders are promising tools to enable ...
demonstration
atmoSphere: mindfulness over haptic-audio cross modal correspondence
- Benjamin Tag
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Takuya Goto
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Ryan Mannschreck
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Haruna Fushimi
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
September 2017pp 289-292 https://doi.org/10.1145/3123024.3123190

We explore cross-modal correspondence between haptic and audio output for meditation support. To this end, we implement atmoSphere, a haptic ball to prototype several haptic/audio designs. AtmoSphere consists of a sphere shaped device which provides ...
research-article
Wearable aura: an interactive projection on personal space to enhance communication
- Dingding Zheng
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Laura Lugaresi
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- George Chernyshov
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Benjamin Tag
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Masa Inakage
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
September 2017pp 141-144 https://doi.org/10.1145/3123024.3123161

This study focuses on how technology can encourage and ease awkwardness-free communications between people in real-world scenarios. We propose a device, The Wearable Aura, able to project a personalized animation onto one's Personal Distance zone. This ...
research-article
Nene: an interactive pet device
- Pafan Julsaksrisakul
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- George Chernyshov
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Masashi Nakatani
  Keio University, Japan
  ,
- Benjamin Tag
  Keio University Graduate School of Media Design, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
September 2017pp 89-92 https://doi.org/10.1145/3123024.3123156

In the past decades, it has become widely accepted that pets have a positive effect on humans, which leaded to multiple studies on the effects of Human-Animal Interaction (HAI)[4][3]. However, there are many occasions where pet owners have to leave ...
research-article
face2faceVR: using AR to assist VR in ubiquitous environment usage
- Yun Suen Pai
  Keio University Graduate, Yokohama, Japan
  ,
- Megumi Isogai
  NTT Media Intelligence Laboratories, Japan
  ,
- Daisuke Ochi
  NTT Media Intelligence Laboratories, Japan
  ,
- Hideaki Kimata
  NTT Media Intelligence Laboratories, Japan
  ,
- Kai Kunze
  Keio University Graduate, Yokohama, Japan
September 2017pp 173-176 https://doi.org/10.1145/3123024.3123155

As virtual reality (VR) usage becomes more popular, one of the issues, among others, which still prevents VR from being used in a more ubiquitous manner is spatial awareness, unlike augmented reality (AR). Generally, there are two forms of such an ...
research-article
Facial temperature sensing on smart eyewear for affective computing
- Benjamin Tag
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- George Chernyshov
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
September 2017pp 209-212 https://doi.org/10.1145/3123024.3123084

We present a system for tracking positive cognitive and emotional states for affective computing, which uses contactless temperature sensors on eye glasses to monitor changes in facial temperature. First user tests show promising results for identifying ...
research-article
Itchy nose: discreet gesture interaction using EOG sensors in smart eyewear
- Juyoung Lee
  KAIST, Daejeon, Republic of Korea
  ,
- Hui-Shyong Yeo
  University of St Andrews, Scotland, United Kingdom
  ,
- Murtaza Dhuliawala
  Georgia Institute of Technology
  ,
- Jedidiah Akano
  Georgia Institute of Technology
  ,
- Junichi Shimizu
  Keio University, Yokohama, Japan
  ,
- Thad Starner
  Georgia Institute of Technology
  ,
- Aaron Quigley
  University of St Andrews, Scotland, United Kingdom
  ,
- Woontack Woo
  KAIST, Daejeon, Republic of Korea
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
September 2017pp 94-97 https://doi.org/10.1145/3123021.3123060

We propose a sensing technique for detecting finger movements on the nose, using EOG sensors embedded in the frame of a pair of eyeglasses. Eyeglasses wearers can use their fingers to exert different types of movement on the nose, such as flicking, ...
poster
CleaVR: collaborative layout evaluation and assessment in virtual reality
- Yun Suen Pai
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Benjamin I. Outram
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Benjamin Tag
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Megumi Isogai
  NTT Media Intelligence Laboratories, Japan
  ,
- Daisuke Ochi
  NTT Media Intelligence Laboratories, Japan
  ,
- Hideaki Kimata
  NTT Media Intelligence Laboratories, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
July 2017pp 1-2 https://doi.org/10.1145/3102163.3102186

Layout planning is a process often used in architectural interior design, for factory production plans, and so on. We present CleaVR, a system that provides the user with an immersive virtual reality system that accurately visualizes the layout plan in ...
poster
GazeSphere: navigating 360-degree-video environments in VR using head rotation and eye gaze
- Yun Suen Pai
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Benjamin I. Outram
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Benjamin Tag
  Keio University Graduate School of Media Design, Yokohama, Japan
  ,
- Megumi Isogai
  NTT Media Intelligence Laboratories, Japan
  ,
- Daisuke Ochi
  NTT Media Intelligence Laboratories, Japan
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Japan
July 2017pp 1-2 https://doi.org/10.1145/3102163.3102183

Viewing 360-degree-images and videos through head-mounted displays (HMDs) currently lacks a compelling interface to transition between them. We propose GazeSphere; a navigation system that provides a seamless transition between 360-degree-video ...
abstract
atmoSphere: designing cross-modal music experiences using spatial audio with haptic feedback
- Haruna Fushimi
  Keio University Graduate school of Media Design, Yokohama, Kanagawa
  ,
- Daiya Kato
  Keio University Graduate School of Media Design, Yokohama, Kanagawa
  ,
- Youichi Kamiyama
  Keio University Graduate School of Media Design, Yokohama, Kanagawa
  ,
- Kazuya Yanagihara
  Keio University Graduate School of Media Design, Yokohama, Kanagawa
  ,
- Kouta Minamizawa
  Keio University Graduate School of Media Design, Yokohama, Kanagawa
  ,
- Kai Kunze
  Keio University Graduate School of Media Design, Yokohama, Kanagawa
July 2017pp 1-2 https://doi.org/10.1145/3084822.3084845

We use cross-Modal correspondence -the interaction between two or more sensory modalities- to create an engaging user experience. We present atmoSphere, a system that provides users immersive music experiences using spatial audio and haptic feedback. We ...
abstract
Facial Thermography for Attention Tracking on Smart Eyewear: An Initial Study
- Benjamin Tag
  Keio University, Yokohama City, Kanagawa, Japan
  ,
- Ryan Mannschreck
  Keio University, Yokohama City, Kanagawa, Japan
  ,
- Kazunori Sugiura
  Keio University, Yokohama City, Kanagawa, Japan
  ,
- George Chernyshov
  Keio University, Yokohama City, Kanagawa, Japan
  ,
- Naohisa Ohta
  Keio University, Yokohama City, Japan
  ,
- Kai Kunze
  Keio University, Yokohama City, Kanagawa, Japan
May 2017pp 2959-2966 https://doi.org/10.1145/3027063.3053243

We are describing the first step towards the development of an unobtrusive open eyewear system for attention tracking in daily life situations. We are logging thermographic data from infrared imaging and electrooculographic readings from off-the-shelf ...
abstract
IN360: A 360-Degree-Video Platform to Change Students Preconceived Notions on Their Career
- Fathima Assilmia
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Yun Suen Pai
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Keiko Okawa
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Kai Kunze
  Keio University, Yokohama City, Kanagawa, Japan
May 2017pp 2359-2365 https://doi.org/10.1145/3027063.3053211

To motivate primary school students in Indonesia to learn more, career inspiration sessions are usually held by communities of professionals. However, these activities face limitations such as time, distance and physical infrastructure. We propose IN360,...
abstract
Workshop on Amplification and Augmentation of Human Perception
- Albrecht Schmidt
  University of Stuttgart, Stuttgart, Germany
  ,
- Stefan Schneegass
  University of Stuttgart, Stuttgart, Germany
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Jun Rekimoto
  University of Tokyo, Bunkyo-ku, Tokyo, Japan
  ,
- Woontack Woo
  Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
May 2017pp 668-673 https://doi.org/10.1145/3027063.3027088

Technical capabilities increase steadily while human evolution is slow. Technical sensors improve while human senses remain largely the same. Many tasks are becoming much easier when our perception is augmented with additional information. In this ...
wip
Eyewear to Make Me Smile: Can Electric Muscle Stimulation increase Happiness?
- Lai Yen-Chin
  Keio University, Yokohama, Kanagawa, Japan
  ,
- YuanLing Feng
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Junich Shimizu
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Takuro Nakao
  Keio University, Yokohama, Kanagawa, Japan
March 2017pp 579-582 https://doi.org/10.1145/3024969.3025097

This paper suggests a demonstration to make users smile using electr ical muscle stimulation (EMS). We present our first insights in how to use an unobtr usive EMS setup to stimulate smiles and showed first findings from our entr y in this year's ...
research-article
Ambient Rhythm: Melodic Sonification of Status Information for IoT-enabled Devices
- George Chernyshov
  Keio Media Design, Japan
  ,
- Jiajun Chen
  Keio Media Design, Japan
  ,
- Yenchin Lai
  Keio Media Design, Japan
  ,
- Vontin Noriyasu
  Fujitsu Design, Japan
  ,
- Kai Kunze
  Keio Media Design, Japan
November 2016pp 1-6 https://doi.org/10.1145/2991561.2991564

In this paper we explore how to embed status information of IoT-enabled devices in the acoustic atmosphere using melodic ambient sounds while limiting obtrusiveness for the user. The user can use arbitrary sound samples to represent the devices he wants ...
short-paper
Smooth eye movement interaction using EOG glasses
- Murtaza Dhuliawala
  Georgia Institute of Technology, USA
  ,
- Juyoung Lee
  KAIST, South Korea
  ,
- Junichi Shimizu
  Keio University, Japan
  ,
- Andreas Bulling
  Max Planck Institute for Informatics, Germany
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Thad Starner
  Georgia Institute of Technology, USA
  ,
- Woontack Woo
  KAIST, South Korea
October 2016pp 307-311 https://doi.org/10.1145/2993148.2993181

Orbits combines a visual display and an eye motion sensor to allow a user to select between options by tracking a cursor with the eyes as the cursor travels in a circular path around each option. Using an off-the-shelf Jins MEME pair of eyeglasses, we ...
poster
Transparent Reality: Using Eye Gaze Focus Depth as Interaction Modality
- Yun Suen Pai
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Benjamin Outram
  Keio University, Yokohama, Japan
  ,
- Noriyasu Vontin
  Fujitsu Design Ltd., Kawasaki, Japan
  ,
- Kai Kunze
  Keio University, Yokohama City, Kanagawa, Japan
October 2016pp 171-172 https://doi.org/10.1145/2984751.2984754

We present a novel, eye gaze based interaction technique, using focus depth as an input modality for virtual reality (VR) applications. We also show custom hardware prototype implementation. Comparing the focus depth based interaction to a scroll wheel ...
abstract
AnyOrbit: Fluid 6DOF Spatial Navigation of Virtual Environments using Orbital Motion
- Benjamin I. Outram
  Keio University, Yokohama, Japan
  ,
- Yun Suen Pai
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Kevin Fan
  Keio University, Yokohama, Japan
  ,
- Kouta Minamizawa
  Keio University, Yokohama City, Kanagawa, Japan
  ,
- Kai Kunze
  Keio University, Yokohama City, Kanagawa, Japan
October 2016pp 199-199 https://doi.org/10.1145/2983310.2989195

Emerging media technologies such as 3D film and head-mounted displays (HMDs) call for new types of spatial interaction. Here we describe and evaluate AnyOrbit: a novel orbital navigation technique that enables flexible and intuitive 3D spatial ...
short-paper
Wearable ambient sound display: embedding information in personal music
- George Chernyshov
  Keio Media Design, Japan
  ,
- Benjamin Tag
  Keio Media Design, Japan
  ,
- Jiajun Chen
  Keio Media Design, Japan
  ,
- Vontin Noriyasu
  Fujitsu Design, Japan
  ,
- Paul Lukowicz
  DFKI, Germany
  ,
- Kai Kunze
  Keio Media Design, Japan
September 2016pp 58-59 https://doi.org/10.1145/2971763.2971789

In this paper we explore how to embed information into users' music playlists while limiting the obtrusiveness to the user. We focus on continuous over time information rather than discrete information (e.g. "monitoring traffic flow" versus "new email ...
extended-abstract
EyeWear 2016: first workshop on eyeWear computing
- Andreas Bulling
  Max Planck for Informatics, Saarbrücken, Germany
  ,
- Ozan Cakmakci
  Google Inc.
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- James M. Rehg
  Georgia Institute of Technology
September 2016pp 1746-1750 https://doi.org/10.1145/2968219.2979153

Smart glasses, head-worn eye trackers, egocentric vision devices, and similar "smart eyewear" have recently emerged as interesting research platforms for a range of research fields, including human-computer interaction, ubiquitous computing, computer ...
poster
Personalized record of the city wander with a wearable device: a pilot study
- Feng Liang
  Keio University, Yokohama, Japan
  ,
- Masashi Nakatani
  Graduate School of Media Design Keio University Yokohama, Japan
  ,
- Kai Kunze
  Graduate School of Media Design Keio University Yokohama, Japan
  ,
- Kouta Minamizawa
  Graduate School of Media Design Keio University Yokohama, Japan
September 2016pp 141-144 https://doi.org/10.1145/2968219.2971462

In this paper, we proposed personalized guided walking holidays in the city with wearable devices, which aim to provide a personalized service based on one's interest [Figure 1]. We firstly hypothesize that one's heart rate rises when he/she sees ...
poster
Run with me: designing storytelling tools for runners
- Albara Alohali
  Keio Media Design
  ,
- Kai Kunze
  Keio Media Design
  ,
- Robert Earle
  University of Southern Denmark
September 2016pp 5-8 https://doi.org/10.1145/2968219.2971452

In this paper we explore storytelling tools for runners. We believe sharing third person 360-degree live-streams and stories while running can be a motivational factor to get people more active. To this end, we conducted a couple of initial user tests, ...
poster
Eye blink as an input modality for a responsive adaptable video system
- Benjamin Tag
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Junichi Shimizu
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Chi Zhang
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Naohisa Ohta
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Kazunori Sugiura
  Keio University, Yokohama, Kanagawa, Japan
September 2016pp 205-208 https://doi.org/10.1145/2968219.2971449

We propose a unique system that allows real-time adaption of video settings to a viewer's physical state. A custom made program toggles between videos according to the average eye blink frequency of each viewer. The physical data is harnessed with J!NS ...
demonstration
The wordometer 2.0: estimating the number of words you read in real life using commercial EOG glasses
- Shoya Ishimaru
  German Research Center for Artificial Intelligence, Kaiserslautern, Germany
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Koichi Kise
  Osaka Preecture University, Sakai, Japan
  ,
- Andreas Dengel
  German Research Center for Artificial Intelligence, Kaiserslautern, Germany
September 2016pp 293-296 https://doi.org/10.1145/2968219.2971398

On the basis of the motivation to increase daily reading volumes, this paper introduces an implementation of "Wordometer 2.0," which counts the number of read words in a day. While word count estimation using eye tracking glasses or medical EOG (...
demonstration
Smart glasses with a peripheral vision display
- Takuro Nakuo
  Keio Media Design
  ,
- Kai Kunze
  Keio Media Design
September 2016pp 341-344 https://doi.org/10.1145/2968219.2971393

We present a demonstration of an initial peripheral vision glasses prototype. We can display patterns in the peripheral vision of the user. A simple use case is to show notifications. Up to 8 different notification types can be distinguished. We also ...
demonstration
Solar system: smooth pursuit interactions using EOG glasses
- Junichi Shimizu
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Juyoung Lee
  KAIST, Daejeon, Korea
  ,
- Murtaza Dhuliawala
  Georgia Institute of Technology Atlanta
  ,
- Andreas Bulling
  Max Planck Institute for Informatics, Saarbrücken, Germany
  ,
- Thad Starner
  Georgia Institute of Technology
  ,
- Woontack Woo
  KAIST, Daejeon, Korea
  ,
- Kai Kunze
  Keio University, Yokohama, Kanagawa, Japan
September 2016pp 369-372 https://doi.org/10.1145/2968219.2971376

Solar System implements smooth pursuit eye movement interactions on commercial smart glasses using electrooculography. The system requires no calibration and little to no training. We present a prototype implementation, describe initial user tests and ...
research-article
WAHM 2016: 3rd workshop on ubiquitous technologies for augmenting the human mind
- Tilman Dingler
  University of Stuttgart, Stuttgart, Germany
  ,
- Kai Kunze
  Keio University, Tokyo, Japan
  ,
- Evangelos Niforatos
  Università della Svizzera italiana, Lugano, Switzerland
  ,
- Cathal Gurrin
  Dublin City University, Dublin, Ireland
  ,
- Ioannis Giannopolos
  ETH Zurich, Zurich, Switzerland
  ,
- Andreas Dengel
  German Research Center for Artificial Intelligence, Kaiserslautern, Germany
  ,
- Koichi Kise
  Osaka Prefecture University, Osaka, Japan
September 2016pp 1010-1013 https://doi.org/10.1145/2968219.2968570

In recent years there has been a growing interest in augmenting human cognition (attention, engagement, memory, learning, etc.) through ubiquitous technologies. With the ongoing research and development of near-constant capture devices, unlimited ...
extended-abstract
Estimation of english skill with a mobile eye tracker
- Olivier Augereau
  Osaka Prefecture University, Gakuen-cho, Naka, Sakai, Osaka, JAPAN
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Hiroki Fujiyoshi
  Osaka Prefecture University, Gakuen-cho, Naka, Sakai, Osaka, JAPAN
  ,
- Koichi Kise
  Osaka Prefecture University, Gakuen-cho, Naka, Sakai, Osaka, JAPAN
September 2016pp 1777-1781 https://doi.org/10.1145/2968219.2968275

Learning a foreign language such as English is an important task for many people. The process of learning takes time and it is important to have a simple way to evaluate the progress of the skill. We propose a method to evaluate the reader's English ...
extended-abstract
Smart glasses with peripheral vision display
- Takuro Nakuo
  Keio Media Design
  ,
- Kai Kunze
  Keio Media Design
September 2016pp 1769-1772 https://doi.org/10.1145/2968219.2968273

This paper describes our initial prototypes for peripheral vision glasses. This device enables implicit and explicit interactions utilizing peripheral vision. A simple use case is to show notifications. Up to 8 different notification types can be ...
extended-abstract
Reading interventions: tracking reading state and designing interventions
- Shoya Ishimaru
  Osaka Prefecture University, Sakai, Osaka, Japan
  ,
- Tilman Dingler
  University of Stuttgart
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Sakai, Osaka, Japan
  ,
- Andreas Dengel
  DFKI, Kaiserslautern, Germany
September 2016pp 1759-1764 https://doi.org/10.1145/2968219.2968271

The quantified-self movement has brought us a multitude of tracking devices mostly focused on physical activities. But healthy user habits go beyond the physical realm, such as cognitive activities, learning and reading. For installing healthy reading ...
poster
GazeSim: simulating foveated rendering using depth in eye gaze for VR
- Yun Suen Pai
  KEIO University, Yokohama, Japan
  ,
- Benjamin Tag
  KEIO University, Yokohama, Japan
  ,
- Benjamin Outram
  KEIO University, Yokohama, Japan
  ,
- Noriyasu Vontin
  Fujitsu Design Ltd., Kawasaki, Japan
  ,
- Kazunori Sugiura
  KEIO University, Yokohama, Japan
  ,
- Kai Kunze
  KEIO University, Yokohama, Japan
July 2016pp 1-2 https://doi.org/10.1145/2945078.2945153

We present a novel technique of implementing customized hardware that uses eye gaze focus depth as an input modality for virtual reality applications. By utilizing eye tracking technology, our system can detect the point in depth the viewer focusses on, ...
abstract
In the Eye of the Beholder: The Impact of Frame Rate on Human Eye Blink
- Benjamin Tag
  Keio University, Yokohama City, Kanagawa, Japan
  ,
- Junichi Shimizu
  Keio University, Yokohama City, Kanagawa, Japan
  ,
- Chi Zhang
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Kai Kunze
  Keio University, Yokohama City, Kanagawa, Japan
  ,
- Naohisa Ohta
  Keio University, Yokohama City, Japan
  ,
- Kazunori Sugiura
  Keio University, Yokohama City, Japan
May 2016pp 2321-2327 https://doi.org/10.1145/2851581.2892449

We introduce a study investigating the impact of high frame rate videos on viewer's eye blink frequency. A series of videos with varying combinations of motion complexities and frame rates were shown to participants, while their eye blinks were counted ...
abstract
Empathy Glasses
- Katsutoshi Masai
  Keio University, Yokohama, Japan
  ,
- Kai Kunze
  Keio University, Yokohama City, Kanagawa, Japan
  ,
- Maki sugimoto
  Keio University, Yokohama, Japan
  ,
- Mark Billinghurst
  University of South Australia, Adelaide, Australia
May 2016pp 1257-1263 https://doi.org/10.1145/2851581.2892370

In this paper, we describe Empathy Glasses, a head worn prototype designed to create an empathic connection between remote collaborators. The main novelty of our system is that it is the first to combine the following technologies together: (1) wearable ...
abstract
Embodied Reading: A Multisensory Experience.
- Susana Sanchez
  Keio University, Yokohama, Kanagawa, Japan
  ,
- Tilman Dingler
  University of Stuttgart, Stuttgart, Germany
  ,
- Heng Gu
  Keio University, Tokyo, Japan
  ,
- Kai Kunze
  Keio University, Yokohama City, Kanagawa, Japan
May 2016pp 1459-1466 https://doi.org/10.1145/2851581.2892353

Reading fiction is a silent activity, where readers come to know imaginary worlds and characters from the book's pages. However, we perceive the natural world with more than our eyes, and literature should be no different. Thus, an embodied reading ...
forum
Eyewear computers for human-computer interaction
- Andreas Bulling
  Max Planck Institute for Informatics
  ,
- Kai Kunze
  Keio University
April 2016pp 70-73 https://doi.org/10.1145/2912886

Envisioning, designing, and implementing the user interface require a comprehensive understanding of interaction technologies. In this forum we scout trends and discuss new technologies with the potential to influence interaction design. --- Albrecht ...
short-paper
Smart glasses with a peripheral vision display
- Takuro Nakao
  Keio University, Hiyoshi, Kouhoku, Yokohama, Kanagawa, Japan
  ,
- Masashi Nakatani
  Keio University, Hiyoshi, Kouhoku, Yokohama, Kanagawa, Japan
  ,
- Liwei Chan
  Keio University, Hiyoshi, Kouhoku, Yokohama, Kanagawa, Japan
  ,
- Kai Kunze
  Keio University, Hiyoshi, Kouhoku, Yokohama, Kanagawa, Japan
March 2016pp 1-3 https://doi.org/10.1145/2927929.2927938

This paper describes a design for smart glasses with a peripheral vision display. We show that users are able to perceive information from our device. We explore different animation patterns. The recognition rates for over 8 patterns are over 80 %. We ...
research-article
Facial Expression Recognition in Daily Life by Embedded Photo Reflective Sensors on Smart Eyewear
- Katsutoshi Masai
  Keio University, Yokohama, Japan
  ,
- Yuta Sugiura
  National Institute of Advanced Industrial Science and Technology (AIST), Koto, Tokyo, Japan
  ,
- Masa Ogata
  Keio University, Yokohama City, Japan
  ,
- Kai Kunze
  Keio University, Yokohama City, Kanagawa, Japan
  ,
- Masahiko Inami
  The University of Tokyo, Bunkyo, Tokyo, Japan
  ,
- Maki Sugimoto
  Keio University, Tokyo, Japan
March 2016pp 317-326 https://doi.org/10.1145/2856767.2856770

This paper presents a novel smart eyewear that uses embedded photo reflective sensors and machine learning to recognize a wearer's facial expressions in daily life. We leverage the skin deformation when wearers change their facial expressions. With ...
forum
Demo hour
- Hayeon Jeong
  KAIST
  ,
- Daniel Saakes
  KAIST
  ,
- Uichin Lee
  KAIST
  ,
- Augusto Esteves
  Lancaster University
  ,
- Eduardo Velloso
  Lancaster University
  ,
- Andreas Bulling
  Max Planck Institute for Informatics Hans Gellersen, Lancaster University
  ,
- Katsutoshi Masai
  Keio University
  ,
- Yuta Sugiura
  National Institute of Advanced Industrial Science and Technology (AIST)
  ,
- Masa Ogata
  National Institute of Advanced Industrial Science and Technology (AIST)
  ,
- Kai Kunze
  Keio University
  ,
- Masahiko Inami
  Keio Media Design
  ,
- Maki Sugimoto
  Keio University
  ,
- Anura Rathnayake
  Nottingham Trent University
  ,
- Tilak Dias
  Nottingham Trent University
December 2016pp 8-11 https://doi.org/10.1145/2854149

Demos at UBICOMP 2015 provided researchers with an opportunity to present their latest cutting-edge research, but also early implementations, prototypes, work-in-progress systems, and commercial products. At UBICOMP, demos offer a chance for authors to ...
short-paper
Collective eyewear
- Kai Kunze
  Keio University, Yokohama, Japan
September 2015pp 889-890 https://doi.org/10.1145/2800835.2809506

This paper outlines the prospects of collective eye wear, aggregating sensor signals from large deployments of smart eye glasses. Collective eye wear can be used as large application platform to enable crowd sensing. Interesting applications area are ...
research-article
2nd workshop on ubiquitous technologies to augment the human mind: towards the knowledge log
- Kai Kunze
  KMD, Keio University
  ,
- Tilman Dingler
  VIS, University of Stuttgart
  ,
- Niels Henze
  VIS, University of Stuttgart
  ,
- Koichi Kise
  Osaka Prefecture University
  ,
- Yoichi Sato
  University of Tokyo
September 2015pp 1213-1216 https://doi.org/10.1145/2800835.2808718

Lifelogging technologies, the use of sensing technologies to analyze and record one's lives, is on the rise. Products from industry and research in academia currently focus on using the collected data to support health and fitness. Given these trends, ...
research-article
Multimodal literacy: storytelling across senses
- Suana Sanchez
  Keio University, Japan
  ,
- Heng Gu
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Masahiko Inami
  Keio University, Japan
September 2015pp 1257-1260 https://doi.org/10.1145/2800835.2807940

This paper describes a novel framework for literature that presents the reader with a multimodal experience (visual, haptic and auditory). We present an initial prototype, extending an iPad with a surface vibration transducer for haptic feedback to ...
short-paper
Enhanced tradition: combining tech and traditional clothing
- Vilhelmina Sokol
  Keio University, Japan
  ,
- Yuta Sugiura
  National Institute of Advanced Industrial Science and Technology
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Masahiko Inami
  Keio University, Japan
September 2015pp 591-594 https://doi.org/10.1145/2800835.2801668

We present the concept of the "Enhanced Tradition", combining electronics with traditional Japanese clothes; our initial prototype integrates a smart phone display in an obi (traditional sash). We overcome the common problem of where to put the phone ...
demonstration
MEME: eye wear computing to explore human behavior
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Katsuma Tanaka
  Osaka Prefecture University, Sakai, Osaka, Japan
  ,
- Shoya Ishimaru
  Osaka Prefecture University, Sakai, Osaka, Japan
  ,
- Yuji Uema
  Keio University, Yokohama, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Sakai, Osaka, Japan
  ,
- Masahiko Inami
  Keio University, Yokohama, Japan
September 2015pp 361-363 https://doi.org/10.1145/2800835.2800900

In this demonstration, we focus on eye wear to assist people, sensing their physical, social and mental activities. Detecting and quantifying our behavior can raise awareness towards unhealthy practices. We use J!NS MEME prototypes, smart glasses with ...
demonstration
AffectiveWear: towards recognizing affect in real life
- Katsutoshi Masai
  Keio University, Yokohama, Japan
  ,
- Yuta Sugiura
  National Institute of Advanced Industrial Science and Technology
  ,
- Katsuhiro Suzuki
  Keio University, Yokohama, Japan
  ,
- Sho Shimamura
  Keio University, Yokohama, Japan
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Masa Ogata
  Keio University, Yokohama, Japan
  ,
- Masahiko Inami
  Keio University, Yokohama, Japan
  ,
- Maki Sugimoto
  Keio University, Yokohama, Japan
September 2015pp 357-360 https://doi.org/10.1145/2800835.2800898

We present a novel wearable facial recognition system "AffectiveWear". This device can recognize 7 facial expressions (neutral, disgust, angry, smile, laugh, sad, and surprise). It looks like a normal eyewear; you can wear anytime, anywhere. We made 2 ...
demonstration
An augmented e-reader for multimodal literacy
- Heng Gu
  Keio University, Japan
  ,
- Susana Sanchez
  Keio University, Japan
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Masahiko Inami
  Keio University, Japan
September 2015pp 353-356 https://doi.org/10.1145/2800835.2800897

We present an initial prototype to extend a reading tablet for haptic feedback -with a surface vibration transducer. This, in order to transform literature into a multimodal reading experience. In this augmented literature, the text provides its reader ...
poster
Towards performance feedback through tactile displays to improve learning archery
- Heng Gu
  Keio University
  ,
- Kai Kunze
  Keio University
  ,
- Masashi Takatani
  Keio University
  ,
- Kouta Minamizawa
  Keio University
September 2015pp 141-144 https://doi.org/10.1145/2800835.2800893

In this paper, we explore a specific case of sensory augmentation through substitution techniques. We present an early tactile display prototype designed for novice archers to provide real time feedback on their performance. We evalute the protoype over ...
poster
Silhouette interactions: using the hand shadow as interaction modality
- Eria Chita
  Keio University, Japan
  ,
- Yuta Sugiura
  National Institute of Advanced Industrial Science and Technology
  ,
- Sunao Hashimoto
  Meiji University, Japan
  ,
- Kai Kunze
  Keio University, Japan
  ,
- Masahiko Inami
  Keio University, Japan
  ,
- Masa Ogata
  Keio University, Japan
September 2015pp 69-72 https://doi.org/10.1145/2800835.2800870

We present the concept of Silhouette Interactions, using the shadow of our hand as an extension of our body to interact with our physical environment. We apply Silhouette Interactions to the application case of home appliance control, show 2 user ...
research-article
Quantifying reading habits: counting how many words you read
- Kai Kunze
  Keio Media Design, Yokohama, Japan
  ,
- Katsutoshi Masai
  Keio Media Design, Yokohama, Japan
  ,
- Masahiko Inami
  Keio Media Design, Yokohama, Japan
  ,
- Ömer Sacakli
  DFKI, Kaiserslautern, Germany
  ,
- Marcus Liwicki
  DFKI, Kaiserslautern, Germany
  ,
- Andreas Dengel
  DFKI, Kaiserslautern, Germany
  ,
- Shoya Ishimaru
  Osaka Prefecture University, Sakai, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Sakai, Japan
September 2015pp 87-96 https://doi.org/10.1145/2750858.2804278

Reading is a very common learning activity, a lot of people perform it everyday even while standing in the subway or waiting in the doctors office. However, we know little about our everyday reading habits, quantifying them enables us to get more ...
poster
AffectiveWear: toward recognizing facial expression
- Katsutoshi Masai
  Keio University
  ,
- Yuta Sugiura
  National Institute of Advanced Industrial Science and Technology (AIST)
  ,
- Masa Ogata
  Keio University
  ,
- Katsuhiro Suzuki
  Keio University
  ,
- Fumihiko Nakamura
  Keio University
  ,
- Sho Shimamura
  Keio University
  ,
- Kai Kunze
  Keio University
  ,
- Masahiko Inami
  Keio University
  ,
- Maki Sugimoto
  Keio University
July 2015pp 1-1 https://doi.org/10.1145/2787626.2792632

Facial expression is a powerful way for us to exchange information nonverbally. They can give us insights into how people feel and think. There are a number of works related to facial expression detection in computer vision. However, most works focus on ...
abstract
AffectiveWear: toward recognizing facial expression
- Katsutoshi Masai
  Keio University
  ,
- Yuta Sugiura
  National Institute of Advanced Industrial Science and Technology (AIST)
  ,
- Masa Ogata
  Keio University
  ,
- Katsuhiro Suzuki
  Keio University
  ,
- Fumihiko Nakamura
  Keio University
  ,
- Sho Shimamura
  Keio University
  ,
- Kai Kunze
  Keio University
  ,
- Masahiko Inami
  Keio University
  ,
- Maki Sugimoto
  Keio University
July 2015pp 1-1 https://doi.org/10.1145/2782782.2792495

Facial expression is a powerful way for us to exchange information nonverbally. They can give us insights into how people feel and think. There are a number of works related to facial expression detection in computer vision. However, most works focus on ...
abstract
MEME: smart glasses to promote healthy habits for knowledge workers
- Kai Kunze
  Keio University
  ,
- Kazutaka Inoue
  J!NS Co. LTD.
  ,
- Katsutoshi Masai
  Keio University
  ,
- Yuji Uema
  J!NS Co. LTD.
  ,
- Sean Shao-An Tsai
  Keio University
  ,
- Shoya Ishimaru
  Osaka Prefecture University, Sakai, Japan
  ,
- Katsuma Tanaka
  Osaka Prefecture University, Sakai, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Sakai, Japan
  ,
- Masahiko Inami
  Keio University
July 2015pp 1-1 https://doi.org/10.1145/2782782.2792491

As people use computing devices more and more -not only desktops and laptops but also smart phones and tablets- related health risks also increase. Two of the most common and severe issues related to computer work are (1) the computer vision syndrome (...
wip
Towards Extraction of Subjective Reading Incomprehension: Analysis of Eye Gaze Features
- Ayano Okoso
  Graduate School of Engineering, Osaka, Japan
  ,
- Takumi Toyama
  German Research Center for Artificial Intelligence (DFKI) GmbH, Kaiserslautern, Germany
  ,
- Kai Kunze
  Osaka Prefecture University, Osaka, Japan
  ,
- Joachim Folz
  GmbH, Kaiserslautern, Germany
  ,
- Marcus Liwicki
  DFKI, Kaiserslautern, Germany
  ,
- Koichi Kise
  Osaka Prefecture University, Osaka, Japan
April 2015pp 1325-1330 https://doi.org/10.1145/2702613.2732896

One way to optimize learning processes is to clearly inform the learner about problematic areas. Recent work on gazebased CHI showed that a reader's language skill can be inferred by gaze analysis. However, only few approaches have been proposed to ...
extended-abstract
Smart Eyewear for Interaction and Activity Recognition
- Shoya Ishimaru
  Osaka Prefecture University, Osaka, Japan
  ,
- Kai Kunze
  Keio University, Yokohama City, Japan
  ,
- Katsuma Tanaka
  Osaka Prefecture University, Osaka, Japan
  ,
- Yuji Uema
  Keio University, Yokohama City, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Osaka, Japan
  ,
- Masahiko Inami
  Keio University, Yokohama City, Japan
April 2015pp 307-310 https://doi.org/10.1145/2702613.2725449

vice class with a lot of possibilities for user interac- tion design and unobtrusive activity tracking. In this paper we show applications using an early prototype of J!NS MEME, smart glasses with integrated electrodes to detect eye movements (...
short-paper
How much do you read?: counting the number of words a user reads using electrooculography
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Masai Katsutoshi
  Keio University, Yokohama, Japan
  ,
- Yuji Uema
  Keio University, Yokohama, Japan
  ,
- Masahiko Inami
  Keio University, Yokohama, Japan
March 2015pp 125-128 https://doi.org/10.1145/2735711.2735832

We read to acquire knowledge. Reading is a common activity performed in transit and while sitting, for example during commuting to work or at home on the couch. Although reading is associated with high vocabulary skills and even with increased critical ...
research-article
The augmented narrative: toward estimating reader engagement
- Kai Kunze
  Keio University, Japan
  ,
- Susana Sanchez
  Keio University, Japan
  ,
- Tilman Dingler
  Stuttgart University, Germany
  ,
- Olivier Augereau
  Osaka Prefecture University, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Japan
  ,
- Masahiko Inami
  Keio University, Japan
  ,
- Terada Tsutomu
  Kobe University, Japan
March 2015pp 163-164 https://doi.org/10.1145/2735711.2735814

We present the concept of bio-feedback driven computing to design a responsive narrative, which acts according to the readers experience. We explore on how to detect engagement and give our evaluation on the usefulness of different sensor modalities. We ...
research-article
Assessment of stimuli for supporting speed reading on electronic devices
- Tilman Dingler
  VIS, University of Stuttgart, Stuttgart, Germany
  ,
- Alireza Sahami Shirazi
  VIS, University of Stuttgart, Stuttgart, Germany
  ,
- Kai Kunze
  Keio University, Yokohama, Japan
  ,
- Albrecht Schmidt
  VIS, University of Stuttgart, Stuttgart, Germany
March 2015pp 117-124 https://doi.org/10.1145/2735711.2735796

Technology has introduced multimedia to tailor information more broadly to our various senses, but by no means has the ability to consume information through reading lost its importance. To cope with the ever-growing amount of textual information to ...
research-article
Position paper: brain teasers - toward wearable computing that engages our mind
- Shoya Ishimaru
  Osaka Prefecture University Sakai, Osaka, Japan
  ,
- Kai Kunze
  Osaka Prefecture University Sakai, Osaka, Japan
  ,
- Koichi Kise
  Osaka Prefecture University Sakai, Osaka, Japan
  ,
- Masahiko Inami
  Keio University, Yokohama, Japan
September 2014pp 1405-1408 https://doi.org/10.1145/2638728.2641722

The emerging field of cognitive activity recognition -- real life tracking of mental states -- can give us new possibilities to enhance our minds.

In this paper, we outline the use of wearable computing to engage the user's mind. We argue that the more ...
research-article
WAHM 2014: workshop on ubiquitous technologies for augmenting the human mind
- Tilman Dingler
  VIS, University of Stuttgart
  ,
- Kai Kunze
  Osaka Prefecture University
  ,
- Nigel Davies
  Lancaster University
  ,
- Albrecht Schmidt
  VIS, University of Stuttgart
  ,
- Marc Langheinrich
  University of Lugano
  ,
- Niels Henze
  VIS, University of Stuttgart
September 2014pp 1339-1345 https://doi.org/10.1145/2638728.2641713

Ubiquitous sensing will soon allow us to record any moment of our lives. These moments can be restored and used to create radically new ways of aiding human memory. The goal with memory aids is: recalling what matters. This implies retrieving relevant ...
research-article
Shiny: an activity logging platform for Google Glass
- Jens Weppner
  DFKI Kaiserslautern, Germany
  ,
- Andreas Poxrucker
  DFKI Kaiserslautern, Germany
  ,
- Paul Lukowicz
  DFKI Kaiserslautern, Germany
  ,
- Shoya Ishimaru
  Osaka Prefecture University, Sakai, Japan
  ,
- Kai Kunze
  Osaka Prefecture University, Sakai, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Sakai, Japan
September 2014pp 283-286 https://doi.org/10.1145/2638728.2638798

We describe an activity logging platform for Google Glass based on our previous work. We introduce new multi-modal methods for quick non-disturbing interactions for activity logging control and real time ground truth labeling, consisting of swipe ...
research-article
Smarter eyewear: using commercial EOG glasses for activity recognition
- Shoya Ishimaru
  Osaka Prefecture University, Sakai, Osaka, Japan
  ,
- Kai Kunze
  Osaka Prefecture University, Sakai, Osaka, Japan
  ,
- Yuji Uema
  Keio University, Yokohama, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Sakai, Osaka, Japan
  ,
- Masahiko Inami
  Keio University, Yokohama, Japan
  ,
- Katsuma Tanaka
  Osaka Prefecture University, Sakai, Osaka, Japan
September 2014pp 239-242 https://doi.org/10.1145/2638728.2638795

Smart eyewear computing is a relatively new subcategory in ubiquitous computing research, which has enormous potential. In this paper we present a first evaluation of soon commercially available Electrooculography (EOG) glasses (J!NS MEME) for the use ...
research-article
Implicit gaze based annotations to support second language learning
- Ayano Okoso
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
  ,
- Kai Kunze
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
September 2014pp 143-146 https://doi.org/10.1145/2638728.2638783

This paper explores if implicit gaze based annotations can support reading comprehension tasks of second language learners. We show how to use eye tracking to add implicit annotations to the text the user reads and we start by annotating physical ...
research-article
Memory specs: an annotation system on Google Glass using document image retrieval
- Katsuma Tanaka
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
  ,
- Kai Kunze
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
  ,
- Motoi Iwata
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
September 2014pp 267-270 https://doi.org/10.1145/2638728.2638775

We present a system working on a wearable computer that can annotate and retrieve annotations for signs, posters, public displays etc. The only limitation of the system: the annotated objects need to contain at least 3-5 lines of text with fixed layout. ...
research-article
Wearable computing for older adults: initial insights into head-mounted display usage
- Kai Kunze
  Osaka Prefecture University, Sakai, Japan
  ,
- Niels Henze
  University of Stuttgart, Stuttgart, Germany
  ,
- Koichi Kise
  Osaka Prefecture University, Sakai, Japan
September 2014pp 83-86 https://doi.org/10.1145/2638728.2638747

With recent interest in industry, wearable computers with head-mounted displays are about to become mainstream. As it is typical for novel technologies, development is directed towards early adopters. This typically excludes special target groups such ...
research-article
What's on your mind?: mental task awareness using single electrode brain computer interfaces
- Alireza Sahami Shirazi
  VIS, University of Stuttgart, Stuttgart, Germany
  ,
- Mariam Hassib
  VIS, University of Stuttgart, Stuttgart, Germany
  ,
- Niels Henze
  VIS, University of Stuttgart, Stuttgart, Germany
  ,
- Albrecht Schmidt
  VIS, University of Stuttgart, Stuttgart, Germany
  ,
- Kai Kunze
  Osaka Prefecture University, Osaka, Japan
March 2014pp 1-4 https://doi.org/10.1145/2582051.2582096

Recognizing and summarizing persons' activities have proven to be effective for increasing self-awareness and enable to improve habits. Reading improves one's language skills and periodic relaxing improves one's health. Recognizing these activities and ...
research-article
Haven't we met before?: a realistic memory assistance system to remind you of the person in front of you
- Masakazu Iwamura
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
  ,
- Kai Kunze
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
  ,
- Yuya Kato
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
  ,
- Yuzuko Utsumi
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Naka, Sakai, Osaka, Japan
March 2014pp 1-4 https://doi.org/10.1145/2582051.2582083

This paper presents a perceived real-time system for memory augmentation. We propose a realistic approach to realize a memory assistance system, focusing on retrieving the person in front of you. The proposed system is capable of fully automatic ...
research-article
In the blink of an eye: combining head motion and eye blink frequency for activity recognition with Google Glass
- Shoya Ishimaru
  Osaka Prefecture University, Osaka, Japan
  ,
- Kai Kunze
  Osaka Prefecture University, Osaka, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Osaka, Japan
  ,
- Jens Weppner
  DFKI and University of Kaiserslautern, Kaiserslautern, Germany
  ,
- Andreas Dengel
  DFKI and University of Kaiserslautern, Kaiserslautern, Germany
  ,
- Paul Lukowicz
  DFKI and University of Kaiserslautern, Kaiserslautern, Germany
  ,
- Andreas Bulling
  Max Planck Institute, Saarbruecken, Germany
March 2014pp 1-4 https://doi.org/10.1145/2582051.2582066

We demonstrate how information about eye blink frequency and head motion patterns derived from Google Glass sensors can be used to distinguish different types of high level activities. While it is well known that eye blink frequency is correlated with ...
research-article
On the tip of my tongue: a non-invasive pressure-based tongue interface
- Jingyuan Cheng
  DFKI, Kaiserslautern, Germany
  ,
- Ayano Okoso
  Osaka Prefecture University, Japan
  ,
- Kai Kunze
  Osaka Prefecture University, Japan
  ,
- Niels Henze
  Stuttgart University, Germany
  ,
- Albrecht Schmidt
  Stuttgart University, Germany
  ,
- Paul Lukowicz
  DFKI, Kaiserslautern, Germany
  ,
- Koichi Kise
  Osaka Prefecture University, Japan
March 2014pp 1-4 https://doi.org/10.1145/2582051.2582063

Mobile and wearable devices became pervasive in daily life. The dominant input techniques for mobile and wearable technology are touch and speech. Both approaches are not appropriate in all settings. Therefore, we propose a novel interface that is ...
research-article
Tracking how we read: activity recognition for cognitive tasks
- Kai Kunze
  Osaka Prefecture University, Japan
December 2013pp 28-32 https://doi.org/10.1145/2538691

Using activity recognition for cognitive tasks can provide new insights about reading and learning habits.
poster
My reading life: towards utilizing eyetracking on unmodified tablets and phones
- Kai Kunze
  Osaka Prefecture University, Sakai, Japan
  ,
- Shoya Ishimaru
  Osaka Prefecture University, Sakai, Japan
  ,
- Yuzuko Utsumi
  Osaka Prefecture University, Sakai, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Sakai, Japan
September 2013pp 283-286 https://doi.org/10.1145/2494091.2494179

As reading is an integral part of our knowledge lives, we should know more about our reading activities. This paper introduces a reading application for smart phone and tablets that aims at giving user more quantified information about their reading ...
poster
Annotate me: supporting active reading using real-time document image retrieval on mobile devices
- Kai Kunze
  Osaka Prefecture University, Sakai, Japan
  ,
- Katsuma Tanaka
  Osaka Prefecture University, Sakai, Japan
  ,
- Masakazu Iwamura
  Osaka Prefecture University, Sakai, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Sakai, Japan
September 2013pp 231-234 https://doi.org/10.1145/2494091.2494165

We present a novel system to support active reading. Utilizing a mobile device the user can add digital annotations to physical documents like papers and posters. We present first prototype implementations of the mobile phone interface with and without ...
poster
Activity recognition and nutrition monitoring in every day situations with a textile capacitive neckband
- Jingyuan Cheng
  German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
  ,
- Bo Zhou
  German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
  ,
- Kai Kunze
  Osaka Prefecture University, Osaka, Japan
  ,
- Carl Christian Rheinländer
  TU Kaiserslautern, Kaiserslautern, Germany
  ,
- Sebastian Wille
  TU Kaiserslautern, Kaiserslautern, Germany
  ,
- Norbert Wehn
  Microelectronic Systems Design Research Group, TU Kaiserslautern, Germany
  ,
- Jens Weppner
  German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
  ,
- Paul Lukowicz
  German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
September 2013pp 155-158 https://doi.org/10.1145/2494091.2494143

We build on previous work [5] that demonstrated, in simple isolated experiments, how head and neck related events (e.g. swallowing, head motion) can be detected using an unobtrusive, textile capacitive sensor integrated in a collar like neckband. We have ...
research-article
I know what you are reading: recognition of document types using mobile eye tracking
- Kai Kunze
  Osaka Prefecture University, Sakai, Japan
  ,
- Yuzuko Utsumi
  Osaka Prefecture University, Sakai, Japan
  ,
- Yuki Shiga
  Osaka Prefecture University, Sakai, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Sakai, Japan
  ,
- Andreas Bulling
  Max Planck Institute for Informatics, Saarbrücken, Germany
September 2013pp 113-116 https://doi.org/10.1145/2493988.2494354

Reading is a ubiquitous activity that many people even perform in transit, such as while on the bus or while walking. Tracking reading enables us to gain more insights about expertise level and potential knowledge of users -- towards a reading log ...
research-article
Upright or sideways?: analysis of smartphone postures in the wild
- Alireza Sahami Shirazi
  University of Stuttgart, Stuttgart, Germany
  ,
- Niels Henze
  University of Stuttgart, Stuttgart, Germany
  ,
- Tilman Dingler
  University of Stuttgart, Stuttgart, Germany
  ,
- Kai Kunze
  Osaka Prefecture University, Osaka, Japan
  ,
- Albrecht Schmidt
  University of Stuttgart, Stuttgart, Germany
August 2013pp 362-371 https://doi.org/10.1145/2493190.2493230

In this paper, we investigate how smartphone applications, in particular web browsers, are used on mobile phones. Using a publicly available widget for smart phones, we recorded app usage and the phones' acceleration and orientation from 1,330 devices. ...
research-article
Real-life activity recognition: recognizing reading activities
- Kai Kunze
  Osaka Prefecture University, Sakai, Japan
August 2013pp 3-3 https://doi.org/10.1145/2516911.2516912

How can we extract high level information about human actions and complex real world situations from heterogeneous ensembles of simple, often unreliable sensors embedded in commodity devices?

We focus on how to use body-worn devices for activity ...
poster
Towards inferring language expertise using eye tracking
- Kai Kunze
  Osaka Prefecture University, Osaka, Japan
  ,
- Hitoshi Kawaichi
  Osaka Prefecture University, Osaka, Japan
  ,
- Kazuyo Yoshimura
  Osaka Prefecture University, Osaka, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Osaka, Japan
April 2013pp 217-222 https://doi.org/10.1145/2468356.2468396

We present initial work towards recognizing reading activities. This paper describes our efforts detect the English skill level of a user and infer which words are difficult for them to understand. We present an initial study of 5 students and show our ...
research-article
Who are you?: A wearable face recognition system to support human memory
- Yuzuko Utsumi
  Osaka Prefecture University, Gakuencho, Naka, Sakai Osaka, Japan
  ,
- Yuya Kato
  Osaka Prefecture University, Gakuencho, Naka, Sakai Osaka, Japan
  ,
- Kai Kunze
  Osaka Prefecture University, Gakuencho, Naka, Sakai Osaka, Japan
  ,
- Masakazu Iwamura
  Osaka Prefecture University, Gakuencho, Naka, Sakai Osaka, Japan
  ,
- Koichi Kise
  Osaka Prefecture University, Gakuencho, Naka, Sakai Osaka, Japan
March 2013pp 150-153 https://doi.org/10.1145/2459236.2459262

Have you ever experienced that you cannot remember the name of a person you meet again? To circumvent such an awkward situation, it would be great if you had had a system that tells you the name of the person in secret. In this paper, we propose a ...
demonstration
Integrated tool chain for recording and handling large, multimodal context recognition data sets
- David Bannach
  University of Passau, Passau, Germany
  ,
- Kai Kunze
  University of Passau, Passau, Germany
  ,
- Jens Weppner
  University of Passau, Passau, Germany
  ,
- Paul Lukowicz
  University of Passau, Passau, Germany
September 2010pp 357-358 https://doi.org/10.1145/1864431.1864434

The demo will present a tool chain for recording, monitoring, labeling, and manipulation of complex multimodal data sets for activity recognition. The tool chain is comprehensive (going from logging, through labeling, monitoring to post processing and ...
research-article
Dealing with sensor displacement in motion-based onbody activity recognition systems
- Kai Kunze
  University Passau, Passau, Germany
  ,
- Paul Lukowicz
  University Passau, Passau, Germany
September 2008pp 20-29 https://doi.org/10.1145/1409635.1409639

We present a set of heuristics that significantly increase the robustness of motion sensor-based activity recognition with respect to sensor displacement. In this paper placement refers to the position within a single body part (e.g, lower arm). We show ...