AI-Twin · AI-Twins of Human Experience: Towards Personal Generative AI-Systems for Amplifying Human Cognition

We aim to establish a scientific foundation for AI-twins of human experience - personalized multi-modal generative AI systems that capture and encode an individual’s real-world experiences and tacit knowledge. Through continuous data capture from wearable devices, we will explore and develop AI-twins as advanced personal systems for storing and processing human experiences. We believe AI-twins can augment human cognitive and social abilities and enhance human executive functions such as memory creation and retrieval, metacognition, planning and prioritizing, decision making, and creativity. AI-twins will enable personal simulations of future scenarios grounded in one's own experience. By effective cognitive augmentation, AI-twins will allow a symbiotic human-AI relationship built on real and individual experiences. Using ubiquitous sensing, we hope to continuously add new and authentic real-world information (e.g. texts, conversations, images, gaze, location) to ensure the sustainability of the generative AI model, reducing the risk of model degradation or collapse. We will adopt an experimental approach, prototyping functional systems that facilitate in-situ capture, processing, storage, and access. We will empirically explore applications in skill acquisition, human memory aids, self-reflection, and social networking to assess the potential impact qualitatively and quantitatively. In addressing technical and ethical challenges, we will look at the implications of design decisions on user privacy and the system's utility. This project has the potential to transform personal data utilization, enabling cognitive augmentation and social connectivity through AI. We will also explore the broader impact of AI-twins beyond personal use, envisioning societal knowledge sharing through the fusion of these models. Ultimately, this research aims to pioneer human-AI symbiosis, leading to a form of personalized symbiotic intelligence grounded in authentic human experiences.