AI inference is shifting from single GPU clusters to Heterogeneous Disaggregated Inference. Prefill (compute-bound) and Decode (memory-bandwidth-bound) have completely opposite hardware needs. Instead of forcing H100s/B200s to do both (poorly), the industry is splitting the pipeline across specialized chips.