Broadcom recently unveiled a new inference-focused chip designed to meet OpenAI's needs, and the early results are promising.