[Router] Add phase 1 router queue groundwork#905

ardecode wants to merge 4 commits into

vllm-project:mainvllm-project/production-stack:mainfrom

ardecode:router-side-queue-phase1-infraardecode/production-stack:router-side-queue-phase1-infraCopy head branch name to clipboard