Having multiple workers gives a big speed boost to parts of a project which can be computed simultaneously, but often a single assembly ends up hanging up one worker for an extended period of time (tens of minutes in some complex cases).
If we were able to parallelize the process of computing an assembly we could see a dramatic speed increase by using the processor more fully.