The adaptation behavior of BatchNorm is no different than Norm-Free - View it on GitHub