Will NadamAccum work with batchnormalization?

Hello, 
I wonder if NadamAccum will approximately work with BatchNormalization?, if I understand the code the moving averages will be updated every minibatch, and the parameters will be updated after serveral minibatches. 

This is different than to update the moving averages of batchnorm only once every N minibatches, but the results should be similar. 

What do you think?