Update README.md

This commit is contained in:
费政聪
2024-07-16 05:19:54 -05:00
committed by GitHub
parent 9965a54a29
commit 611239d92a
+5 -1
View File
@@ -1,4 +1,8 @@
## Scaling Diffusion Transformers with Mixture of Experts
## Scaling Diffusion Transformers with Mixture of Experts <br><sub>Official PyTorch Implementation</sub>
This repo contains PyTorch model definitions, pre-trained weights and training/sampling code for our paper scaling diffusion Transformers to 16 billion parameters (DiT-MoE).
DiT-MoE as a sparse version of the diffusion Transformer, is scalable and competitive with dense networks while exhibiting highly optimized inference.
1. training / inference scripts