Blog

We are excited to announce the release of PyTorch® 2.3 (release note)! PyTorch 2.3 offers…

1.0 Summary We show that by implementing column-major scheduling to improve data locality, we can…

In this blog, we demonstrate the scalability of FSDP with a pre-training exemplar, a 7B…

This post is the fourth part of a multi-series blog focused on how to accelerate…

Overview PyTorch is a Python-based framework for developing deep learning models. It is one of…

TL;DR Leveraging a first principles approach, we showcase a step by step process undertaken to…

We demonstrate how to finetune a 7B parameter model on a typical consumer GPU (NVIDIA…

Multi-model endpoints (MMEs) are a powerful feature of Amazon SageMaker designed to simplify the deployment and operation…

This post is the third part of a multi-series blog focused on how to accelerate…

This is part 2 of the Understanding GPU Memory blog series. Our first post Understanding GPU…

1. Introduction PyTorch 2.0 (abbreviated as PT2) can significantly improve the training and inference performance of…

Introduction PyTorch 2.0 (PT2) offers a compiled execution mode which rewrites Python bytecode to extract sequences…

During your time with PyTorch on GPUs, you may be familiar with this common error…

Lightning Talk 1: Seismic Data to Subsurface Models with OpenFWI Speaker: Benjamin Consolvo, AI Software…

This post is the second part of a multi-series blog focused on how to accelerate…

We are excited to see the release of PyTorch 2.1. In this blog, we discuss…

This post is the first part of a multi-series blog focused on how to accelerate…

In this blog, we discuss how to improve the inference latencies of the Llama 2…

In a landscape where AI innovation is accelerating at an unprecedented pace, Meta’s Llama family of open…

Supported in PyTorch 2.0 as a beta feature, oneDNN Graph leverages aggressive fusion patterns to…