This research provides a natural definition of information gain for measurable spaces and connects it to dynamical entropy production in the context of thermodynamic formalism for symbolic dynamics.