HealthcareGenerative AI
University Hospital Bonn deploys an isolated on-premise open-weights LLM for radiology, piloted with 22 radiologists
University Hospital Bonn built an isolation-first, self-hosted LLM service on a single on-premise server with eight NVIDIA A100 80 GB GPUs, serving DeepSeek-R1 via vLLM behind Open WebUI, with network segmentation and egress filtering so unanonymized patient data can be processed. In a one-week pilot in July 2025, 22 radiologists used ten prompt templates; stability was rated high and source-anchored tasks such as translation and report correction rated best, while open-ended conclusion generation produced the most critical errors. Median time-to-first-token was 3.13 seconds. The authors state the system is the basis for an official service for a hospital with over 10,000 employees.
UHUniversity Hospital Bonn· GermanyDeepSeek-R1 · vLLM · Open WebUI