Contact us

Request access for Managed MLflow

Request access

Contact our team to get access

Make your bid

Request access for Managed Spark

Request access to Inference Service by Nebius AI Studio

Subscribe

Contact us for H200

Talk to an expert in biotech

Contact us for Blackwell GPU cluster

Blog

A&nbsp;detailed analysis of&nbsp;the incident on&nbsp;May 5th, 2025&nbsp;that led to&nbsp;an&nbsp;outage of&nbsp;the S3 service in&nbsp;the eu-north1 region.

Incident post-mortem analysis: outage of the S3 service in the eu-north1 region

Incident post-mortem analysis: outage of&nbsp;the S3 service in&nbsp;the eu-north1 region

In&nbsp;the past weeks, we&nbsp;have made several significant observability-related improvements to&nbsp;the Nebius AI&nbsp;Cloud. Among them: advanced monitoring metrics in&nbsp;our web console and API, out-of-the-box Grafana dashboards, as&nbsp;well as&nbsp;monitoring and logging features, allowing customers to&nbsp;upload their custom metrics and logs to&nbsp;our cloud.

Improving AI cluster observability: New metrics, Grafana dashboards and advanced logging

Improving AI&nbsp;cluster observability: New metrics, Grafana dashboards and advanced logging

Our AI&nbsp;R&amp;D team presents SWE-rebench, a&nbsp;new benchmark for evaluating agentic LLMs on&nbsp;a&nbsp;continuously updated and decontaminated set of&nbsp;real-world software engineering tasks mined from real GitHub repositories. Our goal with this benchmark is&nbsp;to&nbsp;make evaluation of&nbsp;software engineering LLMs more transparent, reproducible and focused on&nbsp;core model capabilities.

SWE-rebench: A continuously updated benchmark for SWE LLMs

SWE-rebench: A&nbsp;continuously updated benchmark for&nbsp;SWE&nbsp;LLMs

Explore how to&nbsp;get Qwen3 running on&nbsp;Nebius AI&nbsp;Cloud with SkyPilot and SGLang. This setup enables you to&nbsp;deploy both the massive 235B MoE model and the efficient 32B variant seamlessly, leveraging high throughput, cost-effective scaling and robust multilingual support.

Serving Qwen3 models on Nebius AI Cloud by using SkyPilot and SGLang

Serving Qwen3 models on&nbsp;Nebius AI&nbsp;Cloud by&nbsp;using SkyPilot and SGLang

Let&rsquo;s walk through how to&nbsp;get Llama 4&nbsp;running on&nbsp;Nebius AI&nbsp;Cloud (recently integrated with SkyPilot) by&nbsp;using SGLang as&nbsp;the serving framework. This combo provides high throughput, efficient memory usage and none of&nbsp;the typical deployment headaches.

Serving Llama 4 models on Nebius AI Cloud with SkyPilot and SGLang

Serving Llama 4&nbsp;models on&nbsp;Nebius AI&nbsp;Cloud with SkyPilot and SGLang

This month, we&nbsp;revealed some of&nbsp;the partnerships and collaborations we&rsquo;ve been engaged in, such as&nbsp;with Meta and&nbsp;DDN. We&nbsp;also showcased work done by&nbsp;our customers like vLLM and Brave, as&nbsp;well as&nbsp;participants of&nbsp;our Research credits program&nbsp;&mdash; including Stanford, USC and others.

Nebius monthly digest: April 2025

Nebius monthly digest: April 2025

As&nbsp;LLM-powered agents become more complex, integrating them with tools, APIs, and private data sources remains a&nbsp;major challenge. Model Context Protocol (MCP) offers a&nbsp;clean, open standard for connecting language models to&nbsp;real-world systems through a&nbsp;modular, plug-and-play interface. In&nbsp;this article, we&nbsp;explore how MCP works.

Understanding the Model Context Protocol: Architecture

Understanding the Model Context Protocol: Architecture

In&nbsp;this short research blog post, we&nbsp;discuss how RL-finetuned reasoning language models can be&nbsp;used as&nbsp;a&nbsp;better alternative to&nbsp;regression-based critics when performing parallel trajectory search in&nbsp;test time, and how to&nbsp;train such models to&nbsp;prioritize precision over recall.

Reasoning critics enable better parallel search for software engineering agents

Reasoning critics enable better parallel search for software engineering agents

Large language models (LLMs) rely on&nbsp;fast data processing and distributed computing, making the efficiency of&nbsp;data processing tools a&nbsp;critical factor. Apache Spark streamlines text data preparation, enables parallel processing of&nbsp;massive datasets and simplifies the development of&nbsp;scalable ML&nbsp;workflows. This article explores Spark&rsquo;s architecture, its advantages for data preparation and solutions to&nbsp;common limitations when working with LLM-scale models.

What is Apache Spark and how can it help with LLMs?

What is&nbsp;Apache Spark and how can it&nbsp;help with LLMs?

Moving large datasets between S3 buckets is&nbsp;often slow, unreliable and frustrating&nbsp;&mdash; especially across accounts or&nbsp;clouds. In&nbsp;this post, we&nbsp;share a&nbsp;fast, fully open-source workaround using SkyPilot, s5cmd and Nebius AI&nbsp;Cloud.

Bulk Object Storage data migration with SkyPilot

Bulk Object Storage data migration with SkyPilot

Audit Logs is&nbsp;a&nbsp;new feature, now available in&nbsp;preview in&nbsp;Nebius AI&nbsp;Cloud. With Audit Logs, our customers can improve their accountability, security and ensure compliance with regulatory requirements.

Meet Audit Logs in Nebius&nbsp;AI Cloud

Meet Audit Logs in&nbsp;Nebius&nbsp;AI&nbsp;Cloud

Pre-trained models let you skip the hassle of&nbsp;training new models by&nbsp;providing already hosted models you can fine-tune to&nbsp;build use-case-specific models. This article explores how this works, some use cases, upsides and downsides (plus countermeasures) of&nbsp;using pre-trained models.

Understanding pre-trained AI models and their applications

Understanding pre-trained AI&nbsp;models and their applications

Fine-tuning pre-trained AI&nbsp;models is&nbsp;a&nbsp;challenging task in&nbsp;itself. What strategy should you use and what resources do&nbsp;you require? This article presents a&nbsp;comprehensive overview of&nbsp;the AI&nbsp;model fine-tuning process.

AI model fine-tuning: What it is and why it matters

AI&nbsp;model fine-tuning: What it&nbsp;is&nbsp;and why it&nbsp;matters

We&rsquo;ve had a&nbsp;very productive first quarter of&nbsp;2025&nbsp;at&nbsp;Nebius AI&nbsp;Studio, shipping major features, adding powerful new models and significantly expanding our infrastructure. This comprehensive roundup covers everything we&rsquo;ve launched and where you can find us&nbsp;next.

Nebius AI Studio Q1 2025 roundup: Fine-tuning, new models and major expansions

Nebius AI&nbsp;Studio Q1&nbsp;2025&nbsp;roundup: Fine-tuning, new models and major expansions

If&nbsp;you work with personal data and need to&nbsp;store it&nbsp;in&nbsp;the cloud, you have to&nbsp;choose a&nbsp;cloud provider that offers appropriate storage. If&nbsp;you&rsquo;re wondering whether our cloud can store and process personal user data, the answer is&nbsp;yes. Our platform ensures the secure storage of&nbsp;personal data, in&nbsp;full compliance with applicable regulations. But what does that mean in&nbsp;practice? Let&rsquo;s break it&nbsp;down.

Storing personal data in Nebius AI Cloud: Security, GDPR and AI readiness

Storing personal data in&nbsp;Nebius&nbsp;AI&nbsp;Cloud: Security, GDPR and AI&nbsp;readiness

The increasing adoption of&nbsp;AI&nbsp;cloud solutions highlights the need for efficient, vendor-independent orchestration tools. dstack provides an&nbsp;open-source, AI-focused orchestration platform that emphasizes flexibility and ease of&nbsp;use for AI&nbsp;development. We&nbsp;are announcing an&nbsp;integration with dstack to&nbsp;enhance the developer experience for professional ML&nbsp;teams. You can now choose Nebius in&nbsp;dstack and start managing dev environments, executing training jobs and deploying models on&nbsp;our AI&nbsp;infrastructure.

Announcing the integration between Nebius and dstack

Announcing the integration between Nebius and dstack

Nebius AI&nbsp;Cloud is&nbsp;collaborating with NVIDIA Inception, a&nbsp;leading program for AI&nbsp;startups with over 22,000 members, to&nbsp;accelerate AI&nbsp;startup innovation. Nebius&rsquo; AI&nbsp;Lift program&nbsp;&mdash; announced at&nbsp;NVIDIA GTC 2025&nbsp;&mdash; offers eligible NVIDIA Inception members up&nbsp;to&nbsp;$150,000 in&nbsp;cloud credits, access to&nbsp;AI&nbsp;technical expertise and support and a&nbsp;range of&nbsp;other exclusive benefits.

Supercharging startups: Nebius accelerates AI-native innovation with NVIDIA

Supercharging startups: Nebius&nbsp;accelerates AI-native innovation with NVIDIA

The end of&nbsp;the quarter is&nbsp;a&nbsp;great time to&nbsp;reflect and share a&nbsp;kind of&nbsp;changelog with you, highlighting what&rsquo;s improved in&nbsp;Nebius AI&nbsp;Cloud over the past three months. This quarter, we&nbsp;launched new regions, released new services for MLOps and enhanced our existing product lineup to&nbsp;minimize your infrastructure concerns even further.

Q1 2025: Nebius AI Cloud updates

Q1 2025: Nebius&nbsp;AI&nbsp;Cloud updates

We&nbsp;wrapped up&nbsp;our first series of&nbsp;technical meetups with stops in&nbsp;Paris, London and San Francisco&nbsp;&mdash; each time providing a&nbsp;deep dive into our cloud. Here, you can watch all the talks from the first event in&nbsp;the series.

Watch the talks: Videos from Nebius AI Cloud Unveiled meetup

Watch the talks: Videos from Nebius AI&nbsp;Cloud Unveiled meetup

NVIDIA GTC was the highlight of&nbsp;last month for&nbsp;us. Our extensive participation included being a&nbsp;platinum sponsor, a&nbsp;strong presence with the booth, two tech talks, interviews with our leaders, partners and customers, and much more.

Nebius monthly digest: March 2025 and NVIDIA GTC

Nebius monthly digest: March 2025&nbsp;and NVIDIA&nbsp;GTC

We&rsquo;re excited to&nbsp;announce our integration with SkyPilot, an&nbsp;open-source framework that simplifies running AI&nbsp;and batch workloads across cloud platforms. This collaboration enables direct access to&nbsp;Nebius AI&nbsp;Cloud resources via SkyPilot.

Nebius AI Cloud is now integrated with SkyPilot

Nebius AI&nbsp;Cloud is&nbsp;now integrated with SkyPilot

Managed Service for MLflow becomes generally available&nbsp;&mdash; which means it&nbsp;gains more stability, a&nbsp;newer version of&nbsp;the platform, service level agreements and a&nbsp;service fee.

Meet Managed Service for MLflow in general availability

Meet Managed Service for MLflow in&nbsp;general availability

Today, we&rsquo;re excited to&nbsp;announce that JupyterLab is&nbsp;now available in&nbsp;our Standalone Applications service, running on&nbsp;NVIDIA GPUs on&nbsp;our cloud platform. This fully managed offering eliminates infrastructure complexities, allowing you to&nbsp;focus entirely on&nbsp;your AI&nbsp;and machine learning (ML) projects.

JupyterLab®: The first app in our new service for AI development

JupyterLab&reg;: The first app&nbsp;in&nbsp;our new service for&nbsp;AI&nbsp;development

In&nbsp;this blog post, we&rsquo;ll demonstrate how to&nbsp;fine-tune an&nbsp;LLM using Nebius AI&nbsp;Studio with a&nbsp;function-calling task as&nbsp;our running example. The goal isn&rsquo;t to&nbsp;achieve state-of-the-art results but to&nbsp;walk you through the steps and showcase why fine-tuning matters.

Beyond prompting: Fine-tuning LLMs with Nebius AI Studio

Beyond prompting: Fine-tuning LLMs with Nebius AI&nbsp;Studio

Speeding up&nbsp;computational tasks is&nbsp;critical to&nbsp;push the boundaries of&nbsp;science and ensure scalability and efficiency. Check out how NVIDIA Hopper GPUs available on&nbsp;Nebius AI&nbsp;Cloud performed against CPU workflows to&nbsp;accelerate homology research, deep learning-enabled protein embeddings and ML&nbsp;clustering.

GPU vs CPU: what is the best bioinformatics accelerator?

GPU vs&nbsp;CPU: what is&nbsp;the best bioinformatics accelerator?

On&nbsp;March 13, 2025, a&nbsp;release of&nbsp;one of&nbsp;the control plane components of&nbsp;the VPC service in&nbsp;the eu-west1 region caused massive networking issues for clients' pods of&nbsp;Managed Services for Kubernetes.

Incident post-mortem analysis: networking issues for Managed Services for Kubernetes on March 13, 2025

Incident post-mortem analysis: networking issues for Managed Services for Kubernetes on&nbsp;March 13, 2025

We&nbsp;are excited to&nbsp;unveil our latest collaboration: Nebius AI&nbsp;Cloud, the ultimate cloud for AI&nbsp;innovators, and Outerbounds, an&nbsp;AI/ML platform powered by&nbsp;the popular open-source framework Metaflow, are now integrated as&nbsp;part of&nbsp;a&nbsp;broader technology partnership.

Nebius and Outerbounds form strategic technology partnership through integration

Nebius and Outerbounds form strategic technology partnership through integration

In&nbsp;February, we&nbsp;at&nbsp;Nebius were busy preparing several new data center regions and working on&nbsp;our large-scale participation in&nbsp;NVIDIA GTC. We&nbsp;also rolled out some improvements to&nbsp;the platform and contributions to&nbsp;open source&nbsp;&mdash; as&nbsp;well as&nbsp;new initiatives to&nbsp;support AI&nbsp;research: a&nbsp;brand new biotech award and a&nbsp;research credits program.

Nebius monthly digest, February 2025

Nebius monthly digest, February&nbsp;2025

Today marks a&nbsp;significant step forward for AI&nbsp;developers and businesses: fine-tuning is&nbsp;<a href="https://nebius.com/services/studio-fine-tuning?utm_medium=blog&amp;utm_source=blog&amp;utm_campaign=ai-studio-fine-tuning">now available</a> in&nbsp;Nebius AI&nbsp;Studio. This launch transforms how you can customize leading open-source models, making them work precisely for your specific needs.

Make AI work for you: fine-tuning launches on Nebius AI Studio

Make AI&nbsp;work for you: fine-tuning launches on&nbsp;Nebius AI&nbsp;Studio

We&rsquo;re thrilled to&nbsp;announce a&nbsp;major upgrade to&nbsp;our US-based compute capacity. To&nbsp;bring it&nbsp;to&nbsp;life, we&rsquo;ve joined forces with DataOne, an&nbsp;AI&nbsp;hosting infrastructure company, to&nbsp;ensure that the first phase of&nbsp;the New Jersey facility goes live this summer. We&rsquo;re also launching a&nbsp;colocation facility in&nbsp;Iceland with Verne, a&nbsp;provider of&nbsp;sustainably powered data centers across the Nordics, and expect it&nbsp;to&nbsp;go&nbsp;live this month.

We’re introducing the 300 MW New Jersey region and expanding to Iceland

We&rsquo;re introducing the 300&nbsp;MW&nbsp;New Jersey region and&nbsp;expanding to&nbsp;Iceland

<a href="/services/managed-postgresql">Managed Service for PostgreSQL</a> is&nbsp;now generally available to&nbsp;all Nebius users. We&rsquo;ve been improving the service&rsquo;s functionality and stability for the last few months, to&nbsp;empower AI&nbsp;practitioners with a&nbsp;reliable and convenient tool for storing structured data in&nbsp;the cloud.

Introducing general availability of Managed Service for PostgreSQL 

Introducing general availability of&nbsp;Managed Service for PostgreSQL

Generative AI&nbsp;and LLMs require immense computational power, making compute clusters essential for efficient scaling. Training and fine-tuning these models exceed the capacity of&nbsp;a&nbsp;single compute node, and parallel computing enables businesses to&nbsp;handle GenAI workloads at&nbsp;scale. In&nbsp;this article, we&nbsp;explore what compute clusters are and how to&nbsp;choose the right one for your needs.

What are AI compute clusters and how to choose yours?

What are AI&nbsp;compute clusters and how to&nbsp;choose yours?

Modern AI&nbsp;systems require substantial computational power to&nbsp;train and infer complex models. Cloud GPUs provide scalable infrastructure with high parallelism, offering access to&nbsp;virtualized GPUs through APIs and cloud platforms. The article delves into the technical aspects of&nbsp;cloud GPUs including virtualization, elastic scaling and management of&nbsp;high-performance workloads.

What is cloud infrastructure and why&nbsp;is it essential for&nbsp;AI development

What is&nbsp;cloud infrastructure and why&nbsp;is&nbsp;it&nbsp;essential for&nbsp;AI&nbsp;development

Images with pre-installed drivers in&nbsp;our Managed Service for Kubernetes enhance NVIDIA GPU cluster scalability and reduce compute node start-up time by&nbsp;2-3x.
Preparing a&nbsp;GPU cluster requires some effort and careful attention from your engineering team. It&nbsp;can become a&nbsp;significant challenge in&nbsp;terms of&nbsp;deploying and configuring a&nbsp;compute environment. Today, we&rsquo;re happy to&nbsp;announce a&nbsp;small yet meaningful enhancement that makes the cluster preparation process much easier and faster.

Pre-installed drivers are now available for Kubernetes nodes

Pre-installed drivers are now available for&nbsp;Kubernetes nodes

Today, we&rsquo;re <a href="https://github.com/nebius/kvax">open-sourcing Kvax</a>, our Flash Attention implementation based on&nbsp;JAX. Designed for efficient training with long sequences, Kvax supports context parallelism and optimized computation of&nbsp;document masks. It&nbsp;outperforms many other Flash Attention implementations in&nbsp;long-context training with dense packing, achieving state-of-the-art performance.

Kvax: Fast and easy-to-use Flash Attention implementation for JAX

Kvax: Fast and easy-to-use Flash Attention implementation for JAX

A&nbsp;wave of&nbsp;advancements, including the generation of&nbsp;massive amounts of&nbsp;data, is&nbsp;transforming how researchers and companies reshape science. Access to&nbsp;compute and workflow management systems is&nbsp;essential to&nbsp;benefit from the new wave of&nbsp;tools. In&nbsp;this blog post, we&rsquo;ll explore how to&nbsp;leverage <a href="https://seqera.io/platform/">Seqera Platform</a> and Slurm on&nbsp;Nebius AI&nbsp;Cloud to&nbsp;deploy scalable <a href="https://www.nextflow.io/">Nextflow</a> workflows.

Running Nextflow workflows with Seqera Platform and Slurm on Nebius AI Cloud

Running Nextflow workflows with Seqera Platform and Slurm on&nbsp;Nebius AI&nbsp;Cloud

Repetitive employee queries can overwhelm HR&nbsp;departments and reduce time for strategic tasks. At&nbsp;Nebius, we&nbsp;implemented an&nbsp;AI&nbsp;Assistant powered by&nbsp;Nebius AI&nbsp;Studio that automates over 150&nbsp;monthly queries. In&nbsp;this article, we&nbsp;explore how NLP and RAG help Studio drive such processes efficiency.

How we streamlined HR operations with an AI assistant (and why you should too)

How we&nbsp;streamlined HR&nbsp;operations with an&nbsp;AI&nbsp;assistant (and why you should too)

Explore what tokens are, how they enable AI&nbsp;models to&nbsp;understand and process language, represent text in&nbsp;AI&nbsp;systems and why tokenization is&nbsp;critical for LLMs. This post will also allow you to&nbsp;understand different tokenization techniques, how they affect processing efficiency and how modern NLP models like transformers use them to&nbsp;deliver accurate and context-aware responses.

What is a token in AI? Understanding how AI processes language with tokenization

What is&nbsp;a&nbsp;token in&nbsp;AI? Understanding how AI&nbsp;processes language with tokenization

We&nbsp;have been hard at&nbsp;work this past month, expanding the scope of&nbsp;our materials, which support customer progress on&nbsp;the platform. Our blog has been hopping too, showcasing the latest releases from Nebius AI&nbsp;Studio and the resilient infrastructure potential Nebius AI&nbsp;Cloud, accelerated by&nbsp;NVIDIA, brings for different AI&nbsp;use cases. We&nbsp;wish you a&nbsp;productive Q1, as&nbsp;we&nbsp;empower your AI&nbsp;journey on&nbsp;our platform.

Nebius monthly digest, January 2025

Nebius monthly digest, January&nbsp;2025

A&nbsp;detailed analysis of&nbsp;the incident that led to&nbsp;service outages. The incident impacted Compute API, Virtual&nbsp;Private&nbsp;Cloud and Managed Kubernetes.

Incident post-mortem analysis: Major connectivity loss on January 27, 2025

Incident post-mortem analysis: Major connectivity loss on&nbsp;January 27, 2025

Striving to&nbsp;simplify the user experience, we&nbsp;<a href="https://console.eu.nebius.com/">increased</a> the amount of&nbsp;compute resources immediately available for every user that signs up&nbsp;to&nbsp;our cloud. <a href="https://console.eu.nebius.com/">You can now</a> access 8 <a href="https://www.nvidia.com/en-us/data-center/h200/">NVIDIA H200 GPUs</a>, 16 <a href="https://www.nvidia.com/en-us/data-center/h100/">NVIDIA H100 GPUs</a> and 2 <a href="https://www.nvidia.com/en-us/data-center/l40s/">NVIDIA L40S GPUs</a> via our console and start using them immediately.

Nebius extends immediate access to NVIDIA Hopper GPUs

Nebius extends immediate access to&nbsp;NVIDIA Hopper GPUs

With this complete prompt guide, you will learn practical tips for creating exceptional images with Flux on&nbsp;Nebius AI&nbsp;Studio. I&nbsp;will share clear, actionable insights from experience to&nbsp;help bring your AI&nbsp;art game to&nbsp;the next level. With Nebius AI&nbsp;Studio&rsquo;s prices starting at&nbsp;$0.0013 per image, you can experiment with crystal-clear visuals up&nbsp;to&nbsp;2000&times;2000 pixels without breaking the bank.

Creating images with Flux: Your prompt guide

Creating images with Flux: Your prompt guide

If&nbsp;you think New Year celebrations started on&nbsp;January 1, it&nbsp;depends on&nbsp;how you look at&nbsp;it&nbsp;&mdash; because in&nbsp;the AI&nbsp;world, the real fireworks went off in&nbsp;December with the release of&nbsp;<a href="https://studio.nebius.ai/playground?models=deepseek-ai%2FDeepSeek-V3">DeepSeek V3</a>. Now, <a href="https://studio.nebius.ai/playground?models=deepseek-ai%2FDeepSeek-R1">DeepSeek R1</a> is&nbsp;lighting up&nbsp;the sky with open-source brilliance that&rsquo;s making even the most entrenched Silicon Valley giants feel the heat.

DeepSeek R1 and V3: Chinese AI New Year started early

DeepSeek R1 and V3: Chinese AI&nbsp;New Year started early

Today, we&nbsp;are happy to&nbsp;announce that our SDKs for Go&nbsp;and Python are now generally available to&nbsp;all users. This major update in&nbsp;programmatic interfaces brings more flexibility for MLOps teams and AI&nbsp;developers.

Meet SDKs for Go and Python

Meet SDKs for Go&nbsp;and&nbsp;Python

From concept art to&nbsp;product visuals, text-to-image AI&nbsp;is&nbsp;revolutionizing creative workflows, reducing hours of&nbsp;design work to&nbsp;mere minutes. Today, we&rsquo;re excited to&nbsp;launch Nebius AI&nbsp;Studio&rsquo;s text-to-image service, delivering premium, production-ready image generation at&nbsp;a&nbsp;fraction of&nbsp;typical costs.

Transforming ideas into images: Introducing text-to-image generation on Nebius AI Studio

Transforming ideas into images: Introducing text-to-image generation on&nbsp;Nebius AI&nbsp;Studio

When adapting a&nbsp;large language model to&nbsp;your domain or&nbsp;specialized application, you want efficiency and a&nbsp;certain degree of&nbsp;simplicity. The setup of&nbsp;Managed K8s plus SkyPilot we&rsquo;re going to&nbsp;run through today provides exactly that, albeit not as&nbsp;the only option. Meta Llama-3.1-8B is&nbsp;just an&nbsp;example here&nbsp;&mdash; you can apply a&nbsp;similar method to&nbsp;many other LLMs.

Using SkyPilot and Kubernetes for multi-node fine-tuning of Llama 3.1

Using SkyPilot and Kubernetes for multi-node fine-tuning of&nbsp;Llama 3.1

While many focus on&nbsp;the modeling aspects during LLM fine-tuning, efficiently managing compute and experiment tracking is&nbsp;equally crucial. This guide demonstrates how to&nbsp;effectively leverage SkyPilot and MLflow, two powerful open-source tools, to&nbsp;orchestrate LLM fine-tuning jobs.

Orchestrating LLM fine-tuning on K8s with SkyPilot and MLflow

Orchestrating LLM fine-tuning on&nbsp;K8s with SkyPilot and MLflow

A&nbsp;detailed analysis of&nbsp;the incident that impacted Compute Cloud virtual machines and Managed Kubernetes clusters, including the root cause, mitigation steps, and improvements to&nbsp;prevent future occurrences.

Incident post-mortem analysis: Partial unavailability on November 26, 2024

Incident post-mortem analysis: Partial unavailability on&nbsp;November 26, 2024

While the holiday season is&nbsp;perhaps not all about numbers&nbsp;&mdash; and more about not thinking about them for a&nbsp;while&nbsp;&mdash; they still pop up&nbsp;here and there. Whether it&rsquo;s the GPU capacity you&rsquo;re planning for next year or&nbsp;how many billions of&nbsp;parameters you&rsquo;ll use in&nbsp;your next model, numbers are driving us&nbsp;into 2025. Here are some figures we&nbsp;are reflecting on&nbsp;these days&nbsp;&mdash; while keeping a&nbsp;sense of&nbsp;fun about them.

A landmark year: highlights of Nebius’ journey in 2024

A&nbsp;landmark year: highlights of&nbsp;Nebius&rsquo; journey in&nbsp;2024

In&nbsp;this follow-up to&nbsp;our previous research blog post, we&nbsp;focus on&nbsp;the data collection process used to&nbsp;train our action generator and critic models. We&rsquo;re also releasing two datasets on&nbsp;Hugging Face: <a href="https://huggingface.co/datasets/nebius/SWE-bench-extra">nebius/SWE-bench-extra</a>, containing 6,411 Issue-Pull Request pairs, and <a href="https://huggingface.co/datasets/nebius/swe-agent-trajectories">nebius/SWE-agent-trajectories</a>, featuring 80,036 software engineering agent trajectories, where an&nbsp;agent attempts to&nbsp;solve these issues.

Scaling data collection for training software engineering agents

Scaling data collection for&nbsp;training software engineering agents

After completing a&nbsp;full rewrite of&nbsp;our cloud from the ground up&nbsp;in&nbsp;October, we&nbsp;began improving the foundation that we&nbsp;brought to&nbsp;the market. The features and tools we&nbsp;have introduced since then span our entire range of&nbsp;cloud services, from Compute Cloud with NVIDIA accelerated computing in&nbsp;a&nbsp;new region, to&nbsp;managed MLOps solutions.

Q4: Nebius cloud updates

Q4: Nebius cloud updates

Prompt engineering has advanced considerably in&nbsp;the last three years. This article overviews the process and includes several beginner and advanced strategies to&nbsp;help AI&nbsp;teams get the most out of&nbsp;their LLM models.

What is prompt engineering?

What is&nbsp;prompt engineering?

As&nbsp;the holiday season approaches and we&nbsp;all juggle year-end projects, we&rsquo;re excited to&nbsp;bring you a&nbsp;gift of&nbsp;expanded capabilities on&nbsp;Nebius AI&nbsp;Studio. These updates&nbsp;&mdash; including advanced vision models, a&nbsp;broader range of&nbsp;language models, powerful embeddings and LoRA hosting&nbsp;&mdash; are designed to&nbsp;help you jumpstart the new year with stronger, more versatile AI&nbsp;tools.

Nebius AI Studio expands with vision models, new language models, embeddings and LoRA

Nebius AI&nbsp;Studio expands with vision models, new language models, embeddings and LoRA

Metrics provide a&nbsp;mathematical basis to&nbsp;assess AI&nbsp;model quality. Organizations use a&nbsp;range of&nbsp;metrics to&nbsp;measure every aspect of&nbsp;the AI&nbsp;model&nbsp;&mdash; from output, to&nbsp;speed, user experience and even ethics. This article covers 30+ metrics you can use to&nbsp;track AI&nbsp;progress.

AI model performance metrics: in-depth guide

AI&nbsp;model performance metrics: in-depth guide

This blog explores the process of&nbsp;AI&nbsp;model hosting, where trained models are deployed and made accessible via APIs for users and applications. It&nbsp;covers the complexities of&nbsp;running AI&nbsp;workloads in&nbsp;distributed environments, the different technology layers involved and key factors like performance, cost and security when choosing the best hosting option.

AI model hosting options

AI&nbsp;model hosting options

We&nbsp;are now <a href="#blackwell-form">accepting pre-orders</a> for <a href="https://www.nvidia.com/en-us/data-center/gb200-nvl72/">NVIDIA GB200 NVL72</a> and NVIDIA HGX B200 clusters to&nbsp;be&nbsp;deployed in&nbsp;our data centers in&nbsp;the United States and Finland from early 2025. Based on&nbsp;<a href="https://www.nvidia.com/en-us/data-center/technologies/blackwell-architecture/">NVIDIA Blackwell</a>, the architecture to&nbsp;power a&nbsp;new industrial revolution of&nbsp;generative AI, these new clusters deliver a&nbsp;massive leap forward over existing solutions.

Nebius opens pre-orders for NVIDIA Blackwell GPU-powered clusters

Nebius opens pre-orders for NVIDIA Blackwell GPU-powered clusters

This month&rsquo;s digest is&nbsp;our most packed so&nbsp;far. We&rsquo;re opening pre-orders for NVIDIA Blackwell GPU-powered clusters, expanding to&nbsp;a&nbsp;new US&nbsp;data center in&nbsp;Q1 2025&nbsp;and opening offices there. Both of&nbsp;our R&amp;D teams, AI&nbsp;and hardware, shared their latest developments, and more.

Nebius monthly digest, November 2024

Nebius monthly digest, November&nbsp;2024

In&nbsp;this hands-on tutorial, you&rsquo;ll learn how to&nbsp;create a&nbsp;powerful code generation and review application that you can customize to&nbsp;your exact needs. We&rsquo;ll use Nebius AI&nbsp;Studio and open-source models, making it&nbsp;both cost-effective and extensible.

Creating your own AI-powered code generator and reviewer

Creating your own AI-powered code generator and reviewer

Explore the importance of&nbsp;context windows in&nbsp;AI&nbsp;and LLMs. Learn how context window size affects model performance, tokenization and natural language processing.

What is a context window in AI? Understanding its importance in LLMs

What is&nbsp;a&nbsp;context window in&nbsp;AI? Understanding its importance in&nbsp;LLMs

In&nbsp;this guide, we&rsquo;ll build an&nbsp;AI-powered financial planner using the Meta Llama 3.1 70B model via Nebius AI&nbsp;Studio and a&nbsp;full-stack Next.js&nbsp;app. This solution works seamlessly whether you&rsquo;re using the Pages Router or&nbsp;the App Router, as&nbsp;much of&nbsp;the customization relies on&nbsp;setting up&nbsp;a&nbsp;custom Next.js server.

Building an AI-powered finance planner with full-stack Next.js and Nebius AI Studio

Building an&nbsp;AI-powered finance planner with full-stack Next.js and Nebius AI&nbsp;Studio

Among the many database options available, PostgreSQL stands out as&nbsp;a&nbsp;tool of&nbsp;choice for ML&nbsp;engineers. This article explores why and how you can use PostgreSQL to&nbsp;increase efficiency and speed in&nbsp;ML&nbsp;development.

PostgreSQL in the context of ML

PostgreSQL in&nbsp;the context of&nbsp;ML

Deep learning models and LLMs work well in&nbsp;development but often slow down on&nbsp;prod due to&nbsp;scale and unpredictability of&nbsp;input. This article explores more than ten different approaches you can use to&nbsp;optimize your model inference.

 Inference optimization techniques and solutions

Inference optimization techniques and solutions

Scheduled to&nbsp;go&nbsp;live in&nbsp;Q1 2025, the Kansas City availability zone will house thousands of&nbsp;state-of-the-art NVIDIA GPUs, primarily H200 Tensor Core GPUs in&nbsp;the initial phase, with the energy-efficient NVIDIA Blackwell platform expected to&nbsp;arrive in&nbsp;2025.

Blog

SWE-rebench: A continuously updated benchmark for SWE LLMs

Incident post-mortem analysis: outage of the S3 service in the eu-north1 region

Improving AI cluster observability: New metrics, Grafana dashboards and advanced logging

Serving Qwen3 models on Nebius AI Cloud by using SkyPilot and SGLang

Products

Resources

Solutions

Prices

Programs

Company

Legal