Government & Public SectorConversational AILarge Language Models
German Federal Employment Agency deploys cloud-based AI with Privatemode
German Federal Employment Agency (Bundesagentur für Arbeit)
The German Federal Employment Agency (Bundesagentur für Arbeit, BA), with over 110,000 employees and one of the largest public authorities in Germany, needed an internal knowledge management AI chatbot but a local AI deployment would have been very time-consuming. It tested Privatemode, the confidential AI service from Edgeless Systems, which encrypts data during storage, transmission and processing. Using the Privatemode API, the BA set up a chatbot that answers questions from internal databases of its Cloud Center of Excellence, accessing the open-source Llama 3.3 70B model and scaling without owning GPU infrastructure, while keeping user data such as AI prompts protected against access by cloud, model, or service providers.