Keynote by Dr. Boateng and Dr. Mensah on a Voice-Based Clinical AI Assistant, 28 June 2024
Friday, 28 June 2024, 4.15 pm CET | HYBRID: Zoom & ETH Zurich: WEV F 109-111
About Dr. George Jojo Boateng and Dr. (Med) Paulina Boadiwaa Mensah
Dr. George Jojo Boateng
Dr. George Jojo. Boateng is a Computer Scientist, Educator, and Social Entrepreneur recognized as one of the 2023 Forbes 30 Under 30 Europe, and 2021 MIT Technology Review’s 35 Innovators Under 35. He is a Postdoctoral Researcher, Core Director of Wearable AI for Rheumatoid Arthritis Management (WARAM), and Lecturer at ETH Zurich, Switzerland. His research spans ubiquitous computing (mobile and wearable), applied machine learning, mobile health, and education, and has resulted in 35+ peer-reviewed publications in international conferences and journals. He is also the CEO and Cofounder of Kwame AI Inc., an AI startup that empowers learners and knowledge workers (e.g., educators, researchers, lawyers) with their personal knowledge assistants to improve their outcomes and productivity significantly. He previously worked as a Visiting Researcher at the University of Cambridge, U.K., and as an Applied Scientist at Amazon (Alexa AI). He has a BA in Computer Science and an MS in Computer Engineering from Dartmouth College, U.S., and a PhD in Applied Machine Learning from ETH Zurich, Switzerland.
Dr. (Med) Paulina Boadiwaa Mensah
Dr. (Med) Paulina Boadiwaa Mensah is a medical doctor (General Practitioner), data scientist, and an AI in Healthcare practitioner. She is currently working as a Technologist in Research and Data Science with the SnooCODERED team where she spearheads the integration of AI into clinical decision-support tools for emergency medicine and public health. She has background experience in computer programming, community health research, health data analysis, tech education, and science journalism. She previously served as the AI in Global Health Coordinator Support with the Global Health and Infectious Diseases Research Group, at the Kumasi Centre for Collaborative Research into Tropical Medicine, and with The Global Health Network, Ghana, as a Data Science Community of Practice Coordinator. She also publishes articles on global health with Liaison Press or on technology with Hashnode. Her goal is to leverage AI to improve healthcare delivery globally, with a special focus on sub-Saharan Africa.
About the Lecture
In this hands-on lecture, we will teach the fundamentals of Retrieval Augmented Generation (RAG), and then build a RAG system in the context of health — a clinical decision support tool — using diabetes mellitus as a case study. We will leverage state-of-the-art generative AI models, one that is open source and relatively small, Llama-3 8B and one that is commercial and large, GPT-4o. We will build a demo app that acts as a voice-based conversational clinical AI assistant. Our system would accept text or voice input of a query, use a speech-to-text model, generate an answer using the RAG system, and produce both text and voice outputs using a text-to-speech model. We will also discuss the opportunities and potential challenges of deploying such a tool in clinical care to improve health outcomes. A tool like this could be useful for clinicians to enable them to find answers and insights quickly from dense medical guidelines along with supporting references based on those documents.
![Jojo&Paulina](https://www.c4dhi.org/wp-content/uploads/2024/05/JojoPaulina.jpeg)
We are pleased to invite you to join this guest lecture, which is part of our CDHI Lecture Series Digital Health Forum. Registration is not required. Please be aware that we will be recording this guest lecture and will be making it available in our teaching library. If you have any questions, please contact Victoria Brügger (victoria.bruegger@unisg.ch) prior to the start of the guest lecture.
Prof. Dr. Tobias Kowatsch, Associate Professor for Digital Health Interventions, Institute for Implementation Science in Health Care, University of Zurich; Director, School of Medicine, University of St.Gallen (HSG); Scientific Director, Centre for Digital Health Interventions (CDHI), ETH Zurich & HSG; Principal Investigator, Future Health Technologies programme, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore-ETH Centre, Singapore
Prof. Dr. Elgar Fleisch, Professor of Information Management, ETH Zürich; Professor of Technology Management, University of St.Gallen; Advisory Board Member, CDHI, ETH Zürich & University of St.Gallen; Principal Investigator, Future Health Technologies programme, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore-ETH Centre, Singapore
Prof. Dr. Florian von Wangenheim, Professor of Technology Marketing, ETH Zurich & Advisory Board Member, CDHI; Principal Investigator, Future Health Technologies programme, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore-ETH Centre, Singapore