German Federal Employment Agency deploys cloud-based AI with Privatemode
German Federal Employment Agency (Bundesagentur für Arbeit) · Germany
The German Federal Employment Agency (Bundesagentur für Arbeit, BA), with over 110,000 employees and one of the largest public authorities in Germany, needed an internal knowledge management AI chatbot but a local AI deployment would have been very time-consuming. It tested Privatemode, the confidential AI service from Edgeless Systems, which encrypts data during storage, transmission and processing. Using the Privatemode API, the BA set up a chatbot that answers questions from internal databases of its Cloud Center of Excellence, accessing the open-source Llama 3.3 70B model and scaling without owning GPU infrastructure, while keeping user data such as AI prompts protected against access by cloud, model, or service providers.
Overview
The German Federal Employment Agency (Bundesagentur für Arbeit, BA), with over 110,000 employees and one of the largest public authorities in Germany, needed an internal knowledge management AI chatbot but a local AI deployment would have been very time-consuming. It tested Privatemode, the confidential AI service from Edgeless Systems, which encrypts data during storage, transmission and processing. Using the Privatemode API, the BA set up a chatbot that answers questions from internal databases of its Cloud Center of Excellence, accessing the open-source Llama 3.3 70B model and scaling without owning GPU infrastructure, while keeping user data such as AI prompts protected against access by cloud, model, or service providers.
The challenge
The BA operates one of the largest IT landscapes in Germany, with over 100 IT systems and around 15,000 applications for unemployment or child benefits submitted daily. At the same time, the BA faces a significant shortage of skilled workers, as around 38% of its workforce will retire within the next decade. An AI service for internal knowledge management needed to be implemented and tested quickly, but a local AI deployment would have been very time-consuming, so a secure cloud-based LLM solution was to be used, while ensuring sensitive personally identifiable information is processed securely and in compliance with data protection regulations.
The solution
As part of its AI and multi-cloud strategy, the BA evaluated the use of confidential computing and tested Privatemode, the confidential AI service from Edgeless Systems, for its desired knowledge management solution. Privatemode ensures data is encrypted not only during storage and transmission but also during processing. Using the Privatemode API, the BA set up a chatbot capable of answering questions using information from internal databases of its Cloud Center of Excellence, accessing the open-source Llama 3.3 70B model and scaling without needing its own GPU infrastructure, while keeping user data such as AI prompts protected against access by cloud, model, or service providers.
Reported business value
With Privatemode AI, the BA very quickly set up a secure, scalable AI chatbot capable of answering questions using information from internal databases of its Cloud Center of Excellence, scaling without the need for its own GPU infrastructure while ensuring maximum data protection.
Sources
Open any source and check the claim yourself — that is the point of the register.
Other government & public sector entries in the register.
Estonia rolls out Bürokratt, an AI-guided virtual assistant network for public services
Bürokratt is a network of chatbots deployed on Estonian public sector institutions' websites, letting people obtain information from institutions and use public and information services via virtual assistants. It is a state-created, AI-based digital assistant that helps institutions deliver modern, efficient, around-the-clock customer service using large language models.
Austrian Academy of Sciences unlocks Ancient Greek with Mistral
The Austrian Academy of Sciences (OeAW), together with its Austrian Archaeological Institute, partnered with Mistral and services partner Reply to build Apollo, described as the first advanced large language model for Ancient Greek. Apollo is trained on a specialized corpus of 600 million words of historical Greek text plus tens of thousands of published inscriptions and papyri, helping researchers reconstruct damaged texts and identify thematic connections across collections. The OeAW reports Apollo turns work that once took years into hours, addressing over one million unread Greek papyri worldwide, with future phases planned for semantic search and handwritten inscription decipherment.
MITRE's Federal AI Sandbox accelerates government AI research with NVIDIA DGX SuperPOD
Nonprofit MITRE built the Federal AI Sandbox, powered by NVIDIA DGX SuperPOD, to give federal sponsors an affordable, centralized space to test and deploy AI and machine learning across domains such as weather forecasting, cybersecurity, and public benefits administration. The DGX SuperPOD delivers a 300-fold performance increase over MITRE's previous AI computing capabilities and supports thousands of researchers; MITRE is using it with NVIDIA Omniverse and NVIDIA Earth-2 to develop 1-kilometer precision weather forecasts with NOAA and the National Weather Service, plus a foundational model for cybersecurity threat analysis across 190 nations.
Israel's Meteorological Service Predicts the Weather Using NVIDIA Earth-2
The Israel Meteorological Service integrated an AI weather model called F3, powered by NVIDIA Earth-2 and NVIDIA PhysicsNeMo (including the CorrDiff neural network), into its forecasting system to achieve hyperlocal 2.5-kilometer resolution precipitation forecasts. F3 achieved 90 percent lower computational costs compared to running a classic non-AI numerical weather prediction model on a CPU cluster, delivering forecasts in minutes rather than hours, and saved 20-30 percent of the Tel Aviv-Yafo Municipality's preparedness budget for things like urban flood safety. CorrDiff was trained to emulate IMS's regional high-resolution ICON model using low-resolution ECMWF IFS input, enabling four high-resolution forecasts per day. Partners including the Israeli Police, the National Fire and Rescue Authority, the Ministry of Transportation and the National Road Company have adopted the forecasts, and IMS used F3 to issue a high-resolution flood map during a January storm that dropped 150 millimeters of rain in six hours.
Was this helpful?
Your feedback helps us improve our use case database