Skip to content

Commit 6fe20ef

Browse files
fix v3 (#1740)
1 parent 4f35ce0 commit 6fe20ef

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

_posts/2024-09-25-pytorch-native-architecture-optimization.md

-1
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,6 @@ title: "PyTorch Native Architecture Optimization: torchao"
44
author: Team PyTorch
55
---
66

7-
87
We’re happy to officially launch torchao, a PyTorch native library that makes models faster and smaller by leveraging low bit dtypes, quantization and sparsity. [torchao](https://github.com/pytorch/ao) is an accessible toolkit of techniques written (mostly) in easy to read PyTorch code spanning both inference and training. This blog will help you pick which techniques matter for your workloads.
98

109
We benchmarked our techniques on popular GenAI models like LLama 3 and Diffusion models and saw minimal drops in accuracy. Unless otherwise noted the baselines are bf16 run on A100 80GB GPU.

0 commit comments

Comments
 (0)