Diffusion for Markov wave equations