Nebius monthly digest, September 2024
Nebius monthly digest, September 2024
In September, we announced the opening of our French region, launched the world’s first open-source K8s operator for Slurm as well as Nebius AI Studio, a product for GenAI builders — and there’s more.
We’re launching a new region: France
The Paris data center presence is a colocation deployment based at Equinix’s PA10 campus in the Saint-Denis, the northern suburb of the French capital.
Thanks to the sustainability initiatives in place at the site, waste heat generated by Nebius’ servers will be used to warm the urban farm on the facility’s roof. This aligns perfectly with our own DC in Finland, where the excess heat keeps nearby houses warm. You can learn more and see the photos here.
Introducing Soperator, the world’s first open-source K8s operator for Slurm
Read about premises and architecture
From the article on our blog, you’ll find out how the community tackled the task of marrying Slurm with K8s before and the details of the architecture of our solution.
Try it and contribute on GitHub
Check out the main repo with the source code and Helm charts for deployment. If you need something we haven’t implemented yet, don’t hesitate to contribute.
Announcing Nebius AI Studio: Achieve fast, flexible inference today
Nebius AI Studio is our new product designed to simplify the process of creating applications and using foundational models. The first release within Studio, Inference Service, provides endpoints for today’s most popular AI models. Log in here or learn more in our blog post.
Upcoming events and recent competition
Event season is in full swing
We’re supporting numerous hackathons across the United States and Europe while actively participating in tech conferences with talks and booths. There are also webinars coming — see which events match with your plans and needs.
Chatbot Arena Human Preference Predictions: tech review
One of the experts from our LLM R&D team, Alexander Golubev, recently took part in the Kaggle competition hosted by the Large Model Systems Organization (LMSYS). Here are his impressions.
See also
We recently reduced the prices of NVIDIA H100, invited everyone interested to reserve H200, launched a public preview of Managed Service for MLflow and released a new talk about deploying generative AI models in production.
In July, we introduced our LLM R&D team and shared more of the team’s experience. We also launched a GPU auction and published diverse materials, including guest post about the London Institute’s research based on our infra.
Our June’s highlights included offering up to 8 GPUs via self-service, decoding GPU pricing and adding L40S to our portfolio. We also detailed our Terraform provider, discussed LLM dataprep, announced DVC.ai partnership and introduced feature requests.