Aleph Alpha has introduced Kolibri, a new AI model combining German and English language processing using a mixture-of-experts architecture. According to The Decoder, this model features 78 billion parameters, with around 3 billion active parameters engaged per token, reflecting a sophisticated approach to efficient language modeling.
The training of Kolibri utilized 768 B200 GPUs across Germany and Finland, incorporating over 21 percent German-language data. Notably, Aleph Alpha has made the model's weights available under the Apache 2.0 license, promoting open access and further research collaboration.
For Japanese investors and market participants, the release of Kolibri highlights ongoing innovation in European AI development, which could influence global tech competition and investment trends in AI-driven industries.