Does the CPU wait on the GPU?

Take a look at that explanation: