centered and normalized input data is still important.
Goal:
A model can deal best with data, that is centered and normalised (ref). This is true for the input, but also for between layers (each layer can be considered its own model taking input from the previous layer).