Source proof for ESGpedia powers sustainable finance with data intelligence on Databricks

Powering sustainable finance with data intelligence | Databricks Skip to main content Login Why Databricks Discover For App Develop…

…ces, each requiring extensive precleaning, processing and relationship mapping. With about 300 different pipelines running and increasing, the task of bringing new datasets on board was becoming increasingly complex and time-consuming. Jin Ser, Director of Engineering at ESGpedia, explained the situation: “Fragmen…

…ve AI workflow that uses custom data and documents to provide context for LLMs. The company used the Agent Bricks Custom Agents to develop a RAG solution specifically tailored to improve the efficiency and effectiveness of their internal teams. “We are looking to provide highly customized and tailored sustainability data a…

…’s operations and platform enhancements in terms of advancing quality insights. The company achieved a remarkable 4x cost savings in data pipeline management, significantly reducing operational expenses while improving efficiency. The migration to Databricks, which involved transitioning about 300 pipelines,…

…able finance with data intelligence 4x cost savings in data pipeline management ESGpedia is a leading environmental, social and governance (ESG) data and technology platform, supporting companies across the Asia-Pacific region in their ESG journey toward net zero goals and ESG compliance. ESGpedia partnered with Databricks to create a unified lakehouse architecture,…

…able business practices across the Asia-Pacific region. Share this post Details Industry : Financial Services , Technology and Software Use Case : Artificial Intelligence Cloud : AWS Product : Agent Bricks , Delta L…

…ces, each requiring extensive precleaning, processing and relationship mapping. With about 300 different pipelines running and increasing, the task of bringing new datasets on board was becoming increasingly complex and time-consuming. Jin Ser, Director of Engineering at ESGpedia, explained the situation: “Fragmen…

…suming. Jin Ser, Director of Engineering at ESGpedia, explained the situation: “Fragmented data across multiple different platforms hampered our efficiency and ability to provide timely, personalized insights. Our internal teams struggled to quickly access the necessary information, leadi…

…cks ESGpedia leveraged several components of the Databricks Data + AI Platform. Central to this implementation was a lakehouse architecture that enabled the combination of data storage and management to facilitate easier access and analysis. “Databricks served as the foundational step for us,” Ser said. “It’s not just a…

…ing data capabilities, enabling continuous data ingestion from various sources. Unity Catalog played a critical role in data management and governance, supporting compliance requirements with stringent access controls and detailed data lineage. This unified approach to governance accelerated data and AI initiatives, simpli…

…ve AI workflow that uses custom data and documents to provide context for LLMs. The company used the Agent Bricks Custom Agents to develop a RAG solution specifically tailored to improve the efficiency and effectiveness of their internal teams. “We are looking to provide highly customized and tailored sustainability data a…

…’s operations and platform enhancements in terms of advancing quality insights. The company achieved a remarkable 4x cost savings in data pipeline management, significantly reducing operational expenses while improving efficiency. The migration to Databricks, which involved transitioning about 300 pipelines,…

…gement, significantly reducing operational expenses while improving efficiency. The migration to Databricks, which involved transitioning about 300 pipelines, was completed in just six months. This rapid transformation speaks to both the dedication of ESGpedia’s team and…

…ith the aim of resolving challenges posed by the fragmented ESG data landscape. This move slashed costs and enabled the use of large language models (LLMs) with retrieval augmented generation (RAG) techniques. Leveraging the Databricks Data + AI Platform, ESGpedia now swiftly processes co…

…rvices , Technology and Software Use Case : Artificial Intelligence Cloud : AWS Product : Agent Bricks , Delta Lake Ready to get started? Try Databricks for free Learn more about our product Talk…

…Financial Services , Technology and Software Use Case : Artificial Intelligence Cloud : AWS Product : Agent Bricks , Delta Lake Ready to get started? Try Databricks for fr…

…Financial Services , Technology and Software Use Case : Artificial Intelligence Cloud : AWS Product : Agent Bricks , Delta Lake Ready to get started? Try Databricks for fr…

…s / ESGpedia CUSTOMER STORY Powering sustainable finance with data intelligence 4x cost savings in data pipeline management ESGpedia is a leading environmental, social and governance (ESG) data and techn…

…for our customers based on their industry, country and sector,” Ser explained. “A RAG framework can be running on Databricks, and that’s actually what we use. In terms of prompt engineering, we currently are using few-shot prompting to help with the classification of our datasets.” Transforming ESG insights and achieving operational excellence The implementat…