Always use the same number of samples from each channel's ring
buffer.  This ensures that all channels are kept in sync.