Leveraging LLMs for Medical Assessment: The OpenCampus Drupal Framework with ECA Integration
Speaker: Michael Schmidts
This presentation details how the OpenCampus Framework, built upon Drupal, enables medical schools to integrate Large Language Models (LLMs) into their assessment design and management. A core principle is maintaining institutional control over data and ensuring adherence to compliance standards. We utilize Drupal’s Event-Condition-Action (ECA) module, which supports BPMN-style process modeling, to automate various assessment tasks, including item writing and question banking.
The system supports a blueprint-driven question authoring process, aligning items with intended learning outcomes and curriculum structure, an approach that previously incorporated “classical AI” for formal item improvement (e.g., vignette checks, answer homogeneity, avoiding negatives/absolutes) and a structured review process. The new LLM integration, facilitated by an API within the ECA module, allows for prompt-based creation of MCQs, OSCE stations, and MMI scenarios. This offers institutions the flexibility to utilize their chosen LLM (local or cloud-based), significantly streamlining the authoring process and drawing on evidence that LLMs can produce high-quality assessment items comparable to human authors.
Surg. Robotics
Speaker: Anthony G Gallagher
Tony will be discussing the shift in Digital Healthcare for the assessment and training of surgeons and physicians particularly in image guided medicine. He will share key messages from his authored book “Fundamentals of Surgical Simulation; Principles and Practices” which was published in 2011. Tony will discuss his international experience of simulation-based training for robot assisted surgery and minimally invasive surgery, endovascular interventions, pacemaker implantation and validation of medical devices for training and assessment.
AI and UX in Digital Health Research
Speaker: Raymond Bond
This talk will summarise selected research studies related to the use of AI in healthcare as well as user experience (UX) research which is key to ensuring that our digital health future is data-informed and human centred.
