If it were visual ads with no audio, I actually think this is a good idea. When you pause you're ready for an interruption of sorts: it jars the brain less.
I'd still want to be able to maximise the video still frame to see details sometimes. Just yesterday I watched a 3blue1brown with a brief freeze-frame of extra detail to read if you wanted (and I did!)