This is required to avoid glitches when seeking, as some formats (e.g.
MP3) may use data from previous frames.