vLLM

4 use cases using this technology

4published use cases

4industries

3countries on record

Generative AI

top AI capability

Evidence mix: High 4 · Medium 0 · Low 0 — bands are computed from each record's evidence signals.

Industry

Country

4 use cases

HealthcareGenerative AI

University Hospital Bonn deploys an isolated on-premise open-weights LLM for radiology, piloted with 22 radiologists

University Hospital Bonn built an isolation-first, self-hosted LLM service on a single on-premise server with eight NVIDIA A100 80 GB GPUs, serving DeepSeek-R1 via vLLM behind Open WebUI, with network segmentation and egress filtering so unanonymized patient data can be processed. In a one-week pilot in July 2025, 22 radiologists used ten prompt templates; stability was rated high and source-anchored tasks such as translation and report correction rated best, while open-ended conclusion generation produced the most critical errors. Median time-to-first-token was 3.13 seconds. The authors state the system is the basis for an official service for a hospital with over 10,000 employees.

University Hospital Bonn· GermanyDeepSeek-R1 · vLLM · Open WebUI

Government & Public SectorGenerative AI

Lugo Provincial Council runs 17 AI tools on open-source and open-weight models on its own servers (MencIA)

The Provincial Council of Lugo, Spain, operates an AI Laboratory in production with 17 tools (8 applications and 9 assistants) running open-source and open-weight models on its own servers, using Ollama, vLLM, LangChain and Open WebUI, with RAG only on Council documents. The 2026-2030 MencIA strategy aims to extend this to the province's 66 small municipalities. Internal measurements cited in the source: daily email management in the Presidency Office fell from about 60 minutes to 5, and analysis of grant calls from about 30 minutes to 2.

Diputación Provincial de Lugo· SpainOllama · vLLM · LangChain +1

Media & EntertainmentSpeech & Audio AIAI Model Development & MLOpsLarge Language ModelsPredictive Analytics

RTLZWEI Hones Competitive Edge with Red Hat OpenShift AI

RTLZWEI, a German broadcaster and digital media company, modernized its on-premise core system BOBY by deploying Red Hat OpenShift Platform Plus and Red Hat OpenShift AI, with guidance from Red Hat Consulting and Red Hat Training. A proof of concept integrated NVIDIA H100 GPUs with Red Hat OpenShift AI, using Whisper on vLLM to speed up video transcription for subtitles, dubbing and accessibility. By fine-tuning the transcription model with its own data, RTLZWEI reduced the word error rate by 33%. The platform also hosts LLMs for data science experiments, forecasting and fine-tuning, running on-premise to meet data sovereignty and cybersecurity requirements.

RTLZWEI· GermanyRed Hat OpenShift Platform Plus · Red Hat OpenShift AI · Red Hat Enterprise Linux +5

LogisticsLarge Language Models

Delhivery achieves 160 ms latency for high-precision geocoding using Amazon EKS

Delhivery, a logistics provider in India, implemented a fine-tuned open-source Llama 3.2 1B large language model on Amazon EKS to support high-volume geocoding of pickup and drop-off addresses. The system processes up to 8,000 requests per minute at 160 milliseconds latency using NVIDIA A10G GPU-backed G5 Xlarge instances and the vLLM framework. Delhivery cut model-serving costs by approximately 80 percent and accelerated prototyping cycles from two days to under six hours, working with the AWS Prototyping and Cloud Engineering (PACE) team.

Delhivery· IndiaLlama 3.2 1B · Amazon Elastic Kubernetes Service · Amazon EC2 G5 Instances +3