HealthcareGenerative AIOn-Premise

Cliniques universitaires Saint-Luc deploys an on-premises Qwen3-235B assistant inside its Epic EHR

Cliniques universitaires Saint-Luc· BelgiumQwen3-235B · vLLM · LiteLLM +5

A Brussels university hospital hosts a GDPR-compliant LLM assistant on-site on a server with 8 NVIDIA H200 GPUs, using Qwen3-235B, vLLM, LiteLLM, Open WebUI and retrieval over EHR documents and literature. After a one-month pilot with 28 physicians, it was deployed hospital-wide and adopted by 1,028 users who generated 14,910 conversations over five months.

Overview

A Brussels university hospital hosts a GDPR-compliant LLM assistant on-site on a server with 8 NVIDIA H200 GPUs, using Qwen3-235B, vLLM, LiteLLM, Open WebUI and retrieval over EHR documents and literature. After a one-month pilot with 28 physicians, it was deployed hospital-wide and adopted by 1,028 users who generated 14,910 conversations over five months.

This entry has 17 published fields tied to exact passages in an immutable source capture.

Inspect the highlighted source

The challenge

Electronic Health Records have improved access to patient information but substantially increased clinicians' documentation workload, and physicians must also process a large volume of information when preparing a consultation.

The solution

The hospital implemented a secure, GDPR-compliant, on-premises LLM assistant integrated into its Epic EHR. It uses Qwen3-235B (FP8) served with vLLM, with LiteLLM managing access control and request distribution, and retrieval augmented generation over structured patient data, internal and regional clinical documents, internal literature and medical literature. The interface is built on Open WebUI and embedded in Epic via the SMART on FHIR protocol, and every answer lists the sources consulted. The system runs on an on-site server with 8 NVIDIA H200 GPUs.

Generative AIConversational AI

Reported business value

After a one-month pilot with 28 physicians across nine specialties, 64% of whom used the assistant daily, the system was deployed hospital-wide and adopted by 1,028 users who generated 14,910 conversations over five months, with more than half of clinicians using it at least weekly. Usage concentrated on information access and documentation support. The authors state they deliberately did not measure clinical outcomes or time savings.

Sources

Open any source and check the claim yourself — that is the point of the register.

This record was researched and written with AI assistance, and its claims were checked against the sources above. (EU AI Act art. 50 transparency notice.)

Related entries

Other healthcare entries in the register.

All entries
HealthcareSpeech & Audio AIPublic Cloud

Less paperwork, more time for people: Azure OpenAI at Landsberg Hospital

Klinikum Landsberg am Lech, a German acute-care hospital, deployed an AI language solution built on Azure OpenAI with partner Pexon Consulting that transcribes doctor-patient consultations in real time via tablet, recognizes medical terms, structures the content, and transfers it directly into the hospital information system.

96/100HighPrimary source
Klinikum Landsberg am Lech· GermanyAzure OpenAI
HealthcareGenerative AIPublic Cloud

Novo Nordisk builds AI drug discovery platform on Azure with Microsoft Research

Novo Nordisk partnered with Microsoft Research to build an AI platform on Azure AI and data stacks spanning regulatory affairs, early research, drug discovery and trial design, using Azure OpenAI Service, Azure Cosmos DB and Azure Kubernetes Service, with Power BI and Power Apps for collaboration. The platform includes a copilot for researchers, shared reasoning-chain templates, and governance/auditing of how data and models are used. The teams published early results on predictive AI models for cardiovascular disease risk detection, including an algorithm that Novo Nordisk says predicts patients' cardiovascular risk better than the best clinical standards, drawing on more than 100 years of insulin research data.

96/100HighPrimary source
Novo Nordisk· DenmarkAzure OpenAI Service · Azure Cosmos DB · Azure Kubernetes Service +2
HealthcareGenerative AIPublic Cloud

BAYADA Builds a Unified, AI-Ready Platform for Compassionate Care

BAYADA Home Health Care is consolidating three separate legacy data platforms (multiple practice management systems, an on-prem ODS, and Snowflake) and 65+ enterprise data sources into a single Databricks Lakehouse under its Data Modernization program, using medallion tiers, Lakeflow Jobs, Asset Bundles, and Unity Catalog governance. As part of the migration, BAYADA uses an LLM-powered code converter and Databricks Assistant to automate SQL and stored-procedure translation, and applies a machine learning-based data mastering accelerator to create golden Client, Payor, Candidate, and Referrer records. BAYADA reports roughly 30% better workload performance and cost efficiency versus its prior Snowflake environment, and is laying a governed foundation for AI agents supporting payroll validation, compliance monitoring, and operational insights, separately from its roadmap for AI-assisted chart review and risk prediction.

96/100HighPrimary source
BAYADA Home Health CareDatabricks SQL · Lakeflow Jobs · Unity Catalog +1
HealthcareSpeech & Audio AIUnknown

Heidi Health fine-tunes NVIDIA Parakeet/Nemotron ASR, cutting clinical transcription latency 75% and costs 64%

Heidi Health, which processes 2.4 million clinical consultations weekly across 110 languages, fine-tuned the open NVIDIA Parakeet V2 speech recognition model on 1,500 hours of curated clinical audio using the NVIDIA NeMo framework and 8x H100 GPUs, replacing its closed-source vendor ASR. The in-house Nemotron-based ASR stack cut end-to-end transcription latency from about 3.0 seconds to 0.7 seconds (75%+ improvement), reduced word error rate from 13% to 9.4%, and cut operating costs by 64% by eliminating per-minute API pricing, while giving Heidi full ownership of model weights for data sovereignty.

92/100HighPrimary source
Heidi HealthNVIDIA Parakeet V2 · NVIDIA NeMo · NVIDIA Nemotron ASR +1

Was this helpful?

Your feedback helps us improve our use case database