Llama-3.3-70B-Instruct

Stadt Bern proof of concept: open-source RAG chatbot on Llama-3.3-70B answers staff questions on legal documents

The Institute Public Sector Transformation at Bern University of Applied Sciences built a proof-of-concept chatbot for the City of Bern's resident services. It uses retrieval-augmented generation over a knowledge base of 296 documents with Streamlit, Haystack, Snowflake Arctic Embed 2.0, a reranker and Llama-3.3-70B-Instruct. It shows sources, supports follow-up questions, and all data can be processed on the city's own servers. Evaluated qualitatively by a lawyer and with automated metrics.