PyTorch
Open-source deep learning framework
Records 5
Newest first. Open one to see it with its source.
In the team's own measurements, 4 MLPerf Tiny models each ran in 21.5ms or less and under 90KiB of RAM on a single Cortex-M55 core of the Alif Ensemble E8 (the anomaly detection autoencoder in 5.2KiB). The team noted the
The point at which the single-controller model proposed by Google's Pathways in 2022 entered the core PyTorch lineage. TorchTitan becomes an actor inside Monarch, and torchforge is built on top of Monarch
Just as Triton abstracted CUDA by one level, Helion abstracts Triton by one more. The next layer in the lineage of kernel authoring
An attempt to replace the checkpoint-based recovery paradigm. Treats each step as a distributed transaction
A redesign of FSDP1. The precondition that made FP8 training, partial freezing and compiler optimization possible