Simulate a dynamic batching scheduler: requests arrive over time and are grouped into a forming batch.
