Log in Get started

Back to Annotated Deep Learning Paper Implementations

Weight Standardization

docs/normalization/weight_standardization/readme.html

latest741 B

Original Source

home normalization weight_standardization

View code on Github

Weight Standardization

This is a PyTorch implementation of Weight Standardization from the paper Micro-Batch Training with Batch-Channel Normalization and Weight Standardization. We also have an annotated implementation of Batch-Channel Normalization.