SelemcaThe Services of Electro-mechanical Care Agencies (SELEMCA) lab was a research facility in Amsterdam dedicated to exploring novel assistive technologies for groups such as elderly persons and people suffering from (mental) health disorders. More specifically, our mandate included the development of systems built around human interactions with robots, computer-based agents, and virtual worlds. We refer to these systems as Caredroids, devices or software that will provide a variety of medical services.
As traditional channels for secondary health care become scarcer due to aging populations and smaller family sizes, supplementing or replacing existing support networks with technology such as Caredroids will become increasingly critical. The increasing demand for care services cannot be solved by productivity improvements alone.
A new approach is the use of creative technological solutions to supplement and replace existing care-services. These solutions include agents, robots, ambient and virtual worlds; mechanotronic robots that we call Caredroids - Product-Service Systems (PSSs) that create a better fit between carer and patient. In SELEMCA, a PSS is a value proposition consisting of a marketable set of robots and avatars that provide services such as brokerage, coaching, tutoring, conversation, and companionship as related to healthcare. They were designed and combined to optimally fulfill healthcare needs from the perspectives of the patient, caretaker, care professional, and care managers. Clients may not attach particular value to the electro-mechanics or virtual environments themselves but rather to the functionality that robots and their digital counterparts offer. SELEMCA focused on care brokerage, exercise coaching, Q&A on wellbeing, companionship, and health education.
What questions were answered?
Teams from 3 universities and industry partners were working together to address the questions:
How do users of Caredroid experience these novel product-service combinations – both in terms of having humanoid company and as interactive healthcare tools?
How to improve the relationship between Caredroids and humans in terms of creativity and aesthetics?
How to establish trust in the application of Caredroids in the medical domain?
What have the teams achieved?
The team has established a transdisciplinary design theory of human-android interaction by investigating the human affective system and emotion regulation. This lead to the development of generic knowledge instruments and design guidelines to create care services that are emotionally intelligent and human-oriented.
Timeframe and communication:
SELEMCA started in 2011 and finished in 2015. The project generated innovative scientific knowledge in the forms of new learning technology facilitating brainstorming and problemsolving. Scientific output was distributed in journal publications and conference proceedings. Throughout the project, we have communicated information and results via this website.
Who was involved?
Scientific partners: Vrije Universiteit Amsterdam, Delft University of Technology, University of Twente, Inholland;
Creative and Industry partners: Osira, GermansMedia, IC3D Media, Roessingh Enschede, Aernout Mik, Waag Society, Lost Boys, Mentrum/Arkin, Appsterdam, Hanson Robotics.
Dr. Dr. Johan F. Hoorn, CAMeRA@VU
SPUSZLE - the spastic puzzleWith Spuszle a handicap such as a spasm will not be a restriction, but is a game element! Spuszle can change any image into a digital puzzle, projected onto a computer screen. While every player add pieces to the puzzle, the next player with for instance a spasm can play an entirely different role by messing the game up.
Alice does the MANSAAlice is a care-robot, meant to guide lonely elderly or elderly who are dealing with dementia. They do not only provide company, but can also be used for practice help, such as physical therapy, the shows emotions and can even make moral decisions. Alice is in a wheel chair and needs help herself. While you help Alice, she is doing her job. She speaks to people, make sure you will not get lost and elderly no longer need a walker. Alice breaks the stigma of the illness and prevents a feeling of being patronised.
DARwIn physiotherapistDARwIn-OP is a Dynamic Anthropomorphic Robot with Intelligence - Open Platform, which means that everybody can help program the AI of this android with the cat-like head and reflexes. DARwIn does quite some advanced sensoring (head follows objects quickly and accurately), it can carry a high payload, and has dynamic motion ability with high-performance networked actuators, a really good gait algorithm, vision, and inverse kinematics. If it trips over, it can put itself back on its feet again as if it were a breakdancer.
Biking Apart TogetherDuring the participating in the EU funded project Metaverse1 CAMeRA helped to provide a standardised global framework that enables the interoperability between virtual worlds (e.g. Second Life, Google Earth) and the real world (e.g. sensors, vision and rendering, social welfare systems). For the SELEMCA project we would like to use this knowledge and develop new products for the elderly people. (e.g. biking apart together).
Caren CarebrokerTalking with people from different care institutions about the development and the use of new technologies within the health care domain (e.g., caredroids and virtual agents). During these conversations the SELEMCA realised it is difficult for the care institute’s clients to oversee the complexity of all the rules and regulations in the health care domain. The idea arose to develop the CareDroidBroker app ZorgQ (equipped with the software of the Silicon Coppélia model and a ‘smart’ database system), which guides people through this process and helps them to make the ‘right’ decisions.
Chimp Chess ChampAn off-the-shelf chimpanzee toy robot is installed with in-house developed artificial intelligence for affect generation and emotion regulation (Silicon Coppélia model). The robot can have a short interaction with the participant, playing the tic-tac-toe game. We equipped the toy chimp with several sensors so users can touch and pet it to show affection. These inputs will be used to control the affective behaviour of the chimp towards the user. The chimpanzee will be able to trade rational choices to win the game for affective choices to let the human opponent win if that person is nice to him (e.g., patting on the back). Additional to serving as a test bed for the empirical evaluation of emotion models, the chimpanzee also can be used as a virtual companion to improve the well-being of people, for instance, during long-term care trajectories.
Talking CT HeadThe Talking CT Head is an integration of ps-medtech desktop virtual reality, IC3D Media game technology, and the Luminis PulseOn e-learning system. SELEMCA agent technology will be applied in the next phase.
Ps-medtech is the company that developed the VR hardware and made the 3D CT scans navigable. Medical Technology Inholland provided the expert knowledge on, for example, radiology. Their students and teachers are the end-users of this system. IC3D Media is a company dedicated to the development of game engines and avatar technology. They designed the mouth layer over the CT scan head. They moreover developed the audio so that the head can talk about itself. Luminis/PulseOn is a company that delivered the e-learning platform for personalised learning.