Journal of Information Organization Matej Cigale, Mitja Lustrek, Matjaz Gams, Torsten Kramer, Meike Engelhardt, Peter Zentel 8 4 2018 http://www.dline.info/jio/fulltext/v8n4/jiov8n4_4.pdf People with Profound Intellectual and Multiple Disabilities (PIMD) stand for a broad and very heterogeneous spectrum of people that are characterised by some common aspects like a severe intellectual disability usually in combination with a lack of conventional and symbolic communication abilities, coupled with the need for high levels of support due to comorbidities or other possible disabilities (i.e., motor or sensorial impairments). Supporting these individuals is extremely challenging, as their communication signals are atypical and idiosyncratic. Therefore, a plethora of these behaviours are not or not easily readable for the caregivers. Without background information on a specific person with PIMD, it is hard for a caregiver, even a trained professional, to interpret the desires and mental state of the person they are interacting with, which leads to a stressful interaction for both. With advances in computer vision (CV), speech recognition technology (SRT) and artificial intelligence (AI), we are making the first steps in codifying these behaviours and attempting to mechanically extract the meaning of the communication. The INSENSION project aims to use these advancements to catalogue the actions of persons with PIMD and the environment and thus provide feedback to caregivers and enable individuals to control their surroundings. A similar system could be used to analyse the behaviour of healthy individuals so that the generalised and personalised expressions of body language could be codified and compared across cultures and individuals.