Using TensorFlow’s Batch Normalization Correctly

Update: This guide applies to TF1. For TF2, use tf.keras.layers.BatchNormalization layer. The TensorFlow library’s layers API contains a function for batch normalization: tf.layers.batch_normalization. It is supposedly as easy to use as all the other tf.layers functions, however, it has some pitfalls. […]