BNP Paribas Deploys Internal ‘LLM as a Service’ Platform

To facilitate the development and deployment of generative AI use cases in its businesses and functions, BNP Paribas has designed and deployed an internal LLM as a Service platform. Operated by the Group’s IT teams, this technology, allows each entity to access a selection of language models (LLM) tailored to its needs via a standardized and secure interface. These models can be directly integrated into tools or processes. According to a story in Markets Media news, the platform is based on a shared infrastructure hosted in the Group’s data centers, equipped with specialized computing capabilities (GPU). It provides access to a selection of open-source models, models from Mistral AI, a partner of the Group, and soon models trained on internal datasets, according to specific needs.